Nearly two thirds of global web activity is thanks to bots, say study

Increasing levels of non-human activity reflects a rise in automated web services that collect data for us - as well as an influx of more sophisticated hackers

It’s perhaps no surprise that amongst the roughly two and a half billion internet users there are a few robots online as well, but a new study suggests that the bots may actually account for nearly two thirds of all web traffic.

Security analysts Incapsula observed more than 1.45 billion bot visits over a 90 day period across all of the world’s 249 countries, and used this network data to deduce that 61.5 per cent of online page views and hits are generated by bots.

This figure represents a 21 per cent rise in bot traffic compared to 2012, where 51 per cent of online activity was robot-created. Fortunately, the bulk of this growth (an increase of 20 per cent to 31 per cent) has come from visits by ‘good bots’, described by Incapsula as “certified agents of legitimate software, such as search engines”.

There has also been a drop in activity by spam bots, the automated programs that post links to scams or malware-infected links (there might even be a couple of these lurking in the comments below).

These bots only make up 0.5 per cent of internet traffic, a 75 per cent drop from 2012 which is largely thanks to new anti-spam measures spearheaded by Google.

However, 31 per cent of bots are still classed as ‘malicious’. Scraper bots (these comb the web for exploitable information, anything from emails to news content) make up 5 per cent of web traffic whilst general purpose hacking tools (the sort of bots that might be employed by a criminal to steal your credit card data) make up 4.5 per cent.

Worryingly though, the fastest rising category of malicious bots (up 8 per cent on 2012) were those designated “Other Impersonators” – a grab-bag of ill-intentioned bots that represent “a higher tier in the bot hierarchy”:

“These can be automated spy bots, human-like DDoS agents or a Trojan-activated barebones browser,” says Incapsula. “One way or another, these are also the tools of top-tier hackers who are proficient enough to create their own malware.”

In other words, bot traffic, both good and bad, is showing signs of increasing sophistication: helpful online services are sending out more workers to make the internet a smoother experience for the web-going masses, but hackers are accordingly upping their game as well.

Life and Style
ebookNow available in paperback
ebooks
ebookPart of The Independent’s new eBook series The Great Composers
Latest stories from i100
Have you tried new the Independent Digital Edition apps?
Independent Dating
and  

By clicking 'Search' you
are agreeing to our
Terms of Use.

ES Rentals

    iJobs Job Widget
    iJobs Gadgets & Tech

    Recruitment Genius: Software Developer - C# / ASP.NET / SQL

    £17000 - £30000 per annum: Recruitment Genius: Developer required to join a bu...

    Recruitment Genius: Software Consultant / 1st Line Support

    £15000 - £25000 per annum: Recruitment Genius: As your knowledge grows you wil...

    Ashdown Group: Systems Engineer - Linux - Central London

    £40000 - £48000 per annum + Benefits: Ashdown Group: Systems Engineer - Linux ...

    Recruitment Genius: Technical Support and Sales Engineer - UC / M2M / IoT

    £20000 - £30000 per annum: Recruitment Genius: This leading provider of Cloud ...

    Day In a Page

    'It was first time I had ever tasted chocolate. I kept a piece, and when Amsterdam was liberated, I gave it to the first Allied soldier I saw'

    Bread from heaven

    Dutch survivors thank RAF for World War II drop that saved millions
    Britain will be 'run for the wealthy and powerful' if Tories retain power - Labour

    How 'the Axe' helped Labour

    UK will be 'run for the wealthy and powerful' if Tories retain power
    Rare and exclusive video shows the horrific price paid by activists for challenging the rule of jihadist extremists in Syria

    The price to be paid for challenging the rule of extremists

    A revolution now 'consuming its own children'
    Welcome to the world of Megagames

    Welcome to the world of Megagames

    300 players take part in Watch the Skies! board game in London
    'Nymphomaniac' actress reveals what it was really like to star in one of the most explicit films ever

    Charlotte Gainsbourg on 'Nymphomaniac'

    Starring in one of the most explicit films ever
    Robert Fisk in Abu Dhabi: The Emirates' out-of-sight migrant workers helping to build the dream projects of its rulers

    Robert Fisk in Abu Dhabi

    The Emirates' out-of-sight migrant workers helping to build the dream projects of its rulers
    Vince Cable interview: Charging fees for employment tribunals was 'a very bad move'

    Vince Cable exclusive interview

    Charging fees for employment tribunals was 'a very bad move'
    Iwan Rheon interview: Game of Thrones star returns to his Welsh roots to record debut album

    Iwan Rheon is returning to his Welsh roots

    Rheon is best known for his role as the Bastard of Bolton. It's gruelling playing a sadistic torturer, he tells Craig McLean, but it hasn't stopped him recording an album of Welsh psychedelia
    Russell Brand's interview with Ed Miliband has got everyone talking about The Trews

    Everyone is talking about The Trews

    Russell Brand's 'true news' videos attract millions of viewers. But today's 'Milibrand' interview introduced his resolutely amateurish style to a whole new crowd
    Morne Hardenberg interview: Cameraman for BBC's upcoming show Shark on filming the ocean's most dangerous predator

    It's time for my close-up

    Meet the man who films great whites for a living
    Increasing numbers of homeless people in America keep their mobile phones on the streets

    Homeless people keep mobile phones

    A homeless person with a smartphone is a common sight in the US. And that's creating a network where the 'hobo' community can share information - and fight stigma - like never before
    'Queer saint' Peter Watson left his mark on British culture by bankrolling artworld giants

    'Queer saint' who bankrolled artworld giants

    British culture owes a huge debt to Peter Watson, says Michael Prodger
    Pushkin Prizes: Unusual exchange programme aims to bring countries together through culture

    Pushkin Prizes brings countries together

    Ten Scottish schoolchildren and their Russian peers attended a creative writing workshop in the Highlands this week
    14 best kids' hoodies

    14 best kids' hoodies

    Don't get caught out by that wind on the beach. Zip them up in a lightweight top to see them through summer to autumn
    Robert Fisk in Abu Dhabi: The acceptable face of the Emirates

    The acceptable face of the Emirates

    Has Abu Dhabi found a way to blend petrodollars with principles, asks Robert Fisk