Nearly two thirds of global web activity is thanks to bots, say study

Increasing levels of non-human activity reflects a rise in automated web services that collect data for us - as well as an influx of more sophisticated hackers

It’s perhaps no surprise that amongst the roughly two and a half billion internet users there are a few robots online as well, but a new study suggests that the bots may actually account for nearly two thirds of all web traffic.

Security analysts Incapsula observed more than 1.45 billion bot visits over a 90 day period across all of the world’s 249 countries, and used this network data to deduce that 61.5 per cent of online page views and hits are generated by bots.

This figure represents a 21 per cent rise in bot traffic compared to 2012, where 51 per cent of online activity was robot-created. Fortunately, the bulk of this growth (an increase of 20 per cent to 31 per cent) has come from visits by ‘good bots’, described by Incapsula as “certified agents of legitimate software, such as search engines”.

There has also been a drop in activity by spam bots, the automated programs that post links to scams or malware-infected links (there might even be a couple of these lurking in the comments below).

These bots only make up 0.5 per cent of internet traffic, a 75 per cent drop from 2012 which is largely thanks to new anti-spam measures spearheaded by Google.

However, 31 per cent of bots are still classed as ‘malicious’. Scraper bots (these comb the web for exploitable information, anything from emails to news content) make up 5 per cent of web traffic whilst general purpose hacking tools (the sort of bots that might be employed by a criminal to steal your credit card data) make up 4.5 per cent.

Worryingly though, the fastest rising category of malicious bots (up 8 per cent on 2012) were those designated “Other Impersonators” – a grab-bag of ill-intentioned bots that represent “a higher tier in the bot hierarchy”:

“These can be automated spy bots, human-like DDoS agents or a Trojan-activated barebones browser,” says Incapsula. “One way or another, these are also the tools of top-tier hackers who are proficient enough to create their own malware.”

In other words, bot traffic, both good and bad, is showing signs of increasing sophistication: helpful online services are sending out more workers to make the internet a smoother experience for the web-going masses, but hackers are accordingly upping their game as well.

Sport
Alexis Sanchez has completed a £35m move to Arsenal, the club have confirmed
sportGunners complete £35m signing of Barcelona forward
Voices
Poor teachers should be fearful of not getting pay rises or losing their job if they fail to perform, Steve Fairclough, headteacher of Abbotsholme School, suggested
voicesChris Sloggett explains why it has become an impossible career path
Sport
world cup 2014
Sport
Popes current and former won't be watching the football together
PROMOTED VIDEO
Life and Style
ebookA wonderful selection of salads, starters and mains featuring venison, grouse and other game
Arts and Entertainment
Celebrated children’s author Allan Ahlberg, best known for Each Peach Pear Plum
books
News
Wayne’s estate faces a claim for alleged copyright breaches
newsJohn Wayne's heirs duke it out with university over use of the late film star's nickname
Life and Style
It beggars belief: the homeless and hungry are weary, tortured, ghosts of people – with bodies contorted by imperceptible pain
lifeRough sleepers exist in every city. Hear the stories of those whose luck has run out
News
peopleIndian actress known as the 'Grand Old Lady of Bollywood' was 102
Arts and Entertainment
In a minor key: Keira Knightley in the lightweight 'Begin Again'
film
News
business
News
Mick Jagger performing at Glastonbury
people
Arts and Entertainment
Currently there is nothing to prevent all-male or all-female couples from competing against mixed sex partners at any of the country’s ballroom dancing events
Potential ban on same-sex partners in ballroom dancing competitions amounts to 'illegal discrimination'
Sport
Germany's Andre Greipel crosses the finish line to win the sixth stage of the Tour de France cycling race over 194 kilometers (120.5 miles) with start in Arras and finish in Reims, France
tour de franceGerman champion achieves sixth Tour stage win in Reims
Extras
indybest
Life and Style
beautyBelgian fan lands L'Oreal campaign after being spotted at World Cup
News
people
Independent
Travel Shop
the manor
Up to 70% off luxury travel
on city breaks Find out more
santorini
Up to 70% off luxury travel
on chic beach resorts Find out more
sardina foodie
Up to 70% off luxury travel
on country retreats Find out more
Have you tried new the Independent Digital Edition apps?
Independent Dating
and  

By clicking 'Search' you
are agreeing to our
Terms of Use.

ES Rentals

    iJobs Job Widget
    iJobs Gadgets & Tech

    Senior IOS Developer

    £40000 - £45000 per annum + competitive: Progressive Recruitment: My client is...

    SAP SD OTC Consultant | 12Months

    competitive: Progressive Recruitment: SAP SD OTC Consultant | 12 Months | 500/...

    Business Systems Analyst - London - £40,000 plus benefits

    £35000 - £40000 per annum + substantial benefits: Ashdown Group: Business Syst...

    Business Continuity Manager

    £300 - £301 per day + competitive: Progressive Recruitment: The successful can...

    Day In a Page

    A History of the First World War in 100 Moments: Peace without magnanimity - the summit in a railway siding that ended the fighting

    A History of the First World War in 100 Moments

    Peace without magnanimity - the summit in a railway siding that ended the fighting
    Scottish independence: How the Commonwealth Games could swing the vote

    Scottish independence: How the Commonwealth Games could swing the vote

    In the final part of our series, Chris Green arrives in Glasgow - a host city struggling to keep the politics out of its celebration of sport
    Out in the cold: A writer spends a night on the streets and hears the stories of the homeless

    A writer spends a night on the streets

    Rough sleepers - the homeless, the destitute and the drunk - exist in every city. Will Nicoll meets those whose luck has run out
    Striking new stations, high-speed links and (whisper it) better services - the UK's railways are entering a new golden age

    UK's railways are entering a new golden age

    New stations are opening across the country and our railways appear to be entering an era not seen in Britain since the early 1950s
    Conchita Wurst becomes a 'bride' on the Paris catwalk - and proves there is life after Eurovision

    Conchita becomes a 'bride' on Paris catwalk

    Alexander Fury salutes the Eurovision Song Contest winner's latest triumph
    Pétanque World Championship in Marseilles hit by

    Pétanque 'world cup' hit by death threats

    This year's most acrimonious sporting event took place in France, not Brazil. How did pétanque get so passionate?
    10 best women's sunglasses

    In the shade: 10 best women's sunglasses

    From luxury bespoke eyewear to fun festival sunnies, we round up the shades to be seen in this summer
    Germany vs Argentina World Cup 2014: Lionel Messi? Javier Mascherano is key for Argentina...

    World Cup final: Messi? Mascherano is key for Argentina...

    No 10 is always centre of attention but Barça team-mate is just as crucial to finalists’ hopes
    Siobhan-Marie O’Connor: Swimmer knows she needs Glasgow joy on road to Rio

    Siobhan-Marie O’Connor: Swimmer needs Glasgow joy on road to Rio

    18-year-old says this month’s Commonwealth Games are a key staging post in her career before time slips away
    The true Gaza back-story that the Israelis aren’t telling this week

    The true Gaza back-story that the Israelis aren’t telling this week

    A future Palestine state will have no borders and be an enclave within Israel, surrounded on all sides by Israeli-held territory, says Robert Fisk
    A History of the First World War in 100 Moments: The German people demand an end to the fighting

    A History of the First World War in 100 Moments

    The German people demand an end to the fighting
    New play by Oscar Wilde's grandson reveals what the Irish wit said at his trials

    New play reveals what Oscar Wilde said at trials

    For a century, what Wilde actually said at his trials was a mystery. But the recent discovery of shorthand notes changed that. Now his grandson Merlin Holland has turned them into a play
    Can scientists save the world's sea life from

    Can scientists save our sea life?

    By the end of the century, the only living things left in our oceans could be plankton and jellyfish. Alex Renton meets the scientists who are trying to turn the tide
    Richard III, Trafalgar Studios, review: Martin Freeman gives highly intelligent performance

    Richard III review

    Martin Freeman’s psychotic monarch is big on mockery but wanting in malice
    Hollywood targets Asian audiences as US films enjoy record-breaking run at Chinese box office

    Hollywood targets Asian audiences

    The world's second biggest movie market is fast becoming the Hollywood studios' most crucial