Nearly two thirds of global web activity is thanks to bots, say study

Increasing levels of non-human activity reflects a rise in automated web services that collect data for us - as well as an influx of more sophisticated hackers

It’s perhaps no surprise that amongst the roughly two and a half billion internet users there are a few robots online as well, but a new study suggests that the bots may actually account for nearly two thirds of all web traffic.

Security analysts Incapsula observed more than 1.45 billion bot visits over a 90 day period across all of the world’s 249 countries, and used this network data to deduce that 61.5 per cent of online page views and hits are generated by bots.

This figure represents a 21 per cent rise in bot traffic compared to 2012, where 51 per cent of online activity was robot-created. Fortunately, the bulk of this growth (an increase of 20 per cent to 31 per cent) has come from visits by ‘good bots’, described by Incapsula as “certified agents of legitimate software, such as search engines”.

There has also been a drop in activity by spam bots, the automated programs that post links to scams or malware-infected links (there might even be a couple of these lurking in the comments below).

These bots only make up 0.5 per cent of internet traffic, a 75 per cent drop from 2012 which is largely thanks to new anti-spam measures spearheaded by Google.

However, 31 per cent of bots are still classed as ‘malicious’. Scraper bots (these comb the web for exploitable information, anything from emails to news content) make up 5 per cent of web traffic whilst general purpose hacking tools (the sort of bots that might be employed by a criminal to steal your credit card data) make up 4.5 per cent.

Worryingly though, the fastest rising category of malicious bots (up 8 per cent on 2012) were those designated “Other Impersonators” – a grab-bag of ill-intentioned bots that represent “a higher tier in the bot hierarchy”:

“These can be automated spy bots, human-like DDoS agents or a Trojan-activated barebones browser,” says Incapsula. “One way or another, these are also the tools of top-tier hackers who are proficient enough to create their own malware.”

In other words, bot traffic, both good and bad, is showing signs of increasing sophistication: helpful online services are sending out more workers to make the internet a smoother experience for the web-going masses, but hackers are accordingly upping their game as well.

Life and Style
ebookNow available in paperback
Latest stories from i100
Have you tried new the Independent Digital Edition apps?
Independent Dating
and  

By clicking 'Search' you
are agreeing to our
Terms of Use.

ES Rentals

    iJobs Job Widget
    iJobs Gadgets & Tech

    SThree: Trainee Recruitment Consultant

    £18000 - £23000 per annum + Uncapped Commission: SThree: As a Trainee Recruitm...

    SThree: Trainee Recruitment Consultant

    £18000 - £23000 per annum + Uncapped Commission: SThree: As a Trainee Recruitm...

    SThree: Trainee Recruitment Consultant

    £13676.46 - £15864.28 per annum + Uncapped Commission: SThree: As a Trainee Re...

    SThree: Trainee Recruitment Consultant

    £18000 - £23000 per annum + Uncapped Commission: SThree: As a Trainee Recruitm...

    Day In a Page

    Raif Badawi: Wife pleads for fresh EU help as Saudi blogger's health worsens

    Please save my husband

    As the health of blogger Raif Badawi worsens in prison, his wife urges EU governments to put pressure on the Saudi Arabian royal family to allow her husband to join his family in Canada
    Birthplace of Arab Spring in turmoil as angry Tunisians stage massive sit-in over lack of development

    They shall not be moved: jobless protesters bring Tunisia to a halt

    A former North African boom town is wasting away while its unemployed citizens stick steadfastly to their sit-in
    David Hasselhoff's new show 'Hoff the Record': What's it like working with a superstar?

    Hanging with the Hoff

    Working with David Hasselhoff on his new TV series was an education for Ella Smith
    Can Dubai's Design District 'hipster village' attract the right type of goatee-wearing individualist?

    Hipsters of Arabia

    Can Dubai’s ‘creative village’ attract the right type of goatee-wearing individualist?
    The cult of Roger Federer: What is it that inspires such obsessive devotion?

    The cult of Roger Federer

    What is it that inspires such obsessive devotion?
    Kuala Lumpur's street food: Not a 'scene', more a way of life

    Malaysian munchies

    With new flights, the amazing street food of Kuala Lumpur just got more accessible
    10 best festival beauty

    Mud guards: 10 best festival beauty

    Whether you're off to the Isle of Wight, Glastonbury or a local music event, we've found the products to help you
    Unai Emery’s passion for winning and eye for a bargain keep Seville centre stage in Europe

    A Different League

    Unai Emery’s passion for winning and eye for a bargain keep Seville centre stage in Europe, says Pete Jenson
    Amir Khan and James DeGale’s remarkable Olympic performances were just the start of an extraordinary journey - Steve Bunce

    Steve Bunce on Boxing

    Amir Khan and James DeGale’s remarkable Olympic performances were just the start of an extraordinary journey
    Abuse - and the hell that came afterwards

    Abuse - and the hell that follows

    James Rhodes on the extraordinary legal battle to publish his memoir
    Why we need a 'tranquility map' of England, according to campaigners

    It's oh so quiet!

    The case for a 'tranquility map' of England
    'Timeless fashion': It may be a paradox, but the industry loves it

    'Timeless fashion'

    It may be a paradox, but the industry loves it
    If the West needs a bridge to the 'moderates' inside Isis, maybe we could have done with Osama bin Laden staying alive after all

    Could have done with Osama bin Laden staying alive?

    Robert Fisk on the Fountainheads of World Evil in 2011 - and 2015
    New exhibition celebrates the evolution of swimwear

    Evolution of swimwear

    From bathing dresses in the twenties to modern bikinis
    Sun, sex and an anthropological study: One British academic's summer of hell in Magaluf

    Sun, sex and an anthropological study

    One academic’s summer of hell in Magaluf