Nearly two thirds of global web activity is thanks to bots, say study

Increasing levels of non-human activity reflects a rise in automated web services that collect data for us - as well as an influx of more sophisticated hackers

It’s perhaps no surprise that amongst the roughly two and a half billion internet users there are a few robots online as well, but a new study suggests that the bots may actually account for nearly two thirds of all web traffic.

Security analysts Incapsula observed more than 1.45 billion bot visits over a 90 day period across all of the world’s 249 countries, and used this network data to deduce that 61.5 per cent of online page views and hits are generated by bots.

This figure represents a 21 per cent rise in bot traffic compared to 2012, where 51 per cent of online activity was robot-created. Fortunately, the bulk of this growth (an increase of 20 per cent to 31 per cent) has come from visits by ‘good bots’, described by Incapsula as “certified agents of legitimate software, such as search engines”.

There has also been a drop in activity by spam bots, the automated programs that post links to scams or malware-infected links (there might even be a couple of these lurking in the comments below).

These bots only make up 0.5 per cent of internet traffic, a 75 per cent drop from 2012 which is largely thanks to new anti-spam measures spearheaded by Google.

However, 31 per cent of bots are still classed as ‘malicious’. Scraper bots (these comb the web for exploitable information, anything from emails to news content) make up 5 per cent of web traffic whilst general purpose hacking tools (the sort of bots that might be employed by a criminal to steal your credit card data) make up 4.5 per cent.

Worryingly though, the fastest rising category of malicious bots (up 8 per cent on 2012) were those designated “Other Impersonators” – a grab-bag of ill-intentioned bots that represent “a higher tier in the bot hierarchy”:

“These can be automated spy bots, human-like DDoS agents or a Trojan-activated barebones browser,” says Incapsula. “One way or another, these are also the tools of top-tier hackers who are proficient enough to create their own malware.”

In other words, bot traffic, both good and bad, is showing signs of increasing sophistication: helpful online services are sending out more workers to make the internet a smoother experience for the web-going masses, but hackers are accordingly upping their game as well.

PROMOTED VIDEO
Life and Style
ebookNow available in paperback
Life and Style
ebooksA superb mix of recipes serving up the freshest of local produce in a delicious range of styles
Latest stories from i100
Have you tried new the Independent Digital Edition apps?
Independent Dating
and  

By clicking 'Search' you
are agreeing to our
Terms of Use.

ES Rentals

    iJobs Job Widget
    iJobs Gadgets & Tech

    Langley James : Desktop Support Analyst; 1st Line; Moorgate up to £23k

    £20000 - £23000 per annum: Langley James : Desktop Support Analyst; 1st Line; ...

    Recruitment Genius: Project Manager

    £35000 - £40000 per annum: Recruitment Genius: An exciting and rewarding role ...

    Selby Jennings: C++ Developer – Hedge Fund – Hong Kong

    $1250000 - $1750000 per annum, Benefits: Competitive Bonus: Selby Jennings: C+...

    Recruitment Genius: Senior Project Manager

    £45000 - £65000 per annum: Recruitment Genius: This is a fantastic opportunity...

    Day In a Page

    In a world of Saudi bullying, right-wing Israeli ministers and the twilight of Obama, Iran is looking like a possible policeman of the Gulf

    Iran is shifting from pariah to possible future policeman of the Gulf

    Robert Fisk on our crisis with Iran
    The young are the new poor: A third of young people pushed into poverty

    The young are the new poor

    Sharp increase in the number of under-25s living in poverty
    Greens on the march: ‘We could be on the edge of something very big’

    Greens on the march

    ‘We could be on the edge of something very big’
    Revealed: the case against Bill Cosby - through the stories of his accusers

    Revealed: the case against Bill Cosby

    Through the stories of his accusers
    Why are words like 'mongol' and 'mongoloid' still bandied about as insults?

    The Meaning of Mongol

    Why are the words 'mongol' and 'mongoloid' still bandied about as insults?
    Mau Mau uprising: Kenyans still waiting for justice join class action over Britain's role in the emergency

    Kenyans still waiting for justice over Mau Mau uprising

    Thousands join class action over Britain's role in the emergency
    Isis in Iraq: The trauma of the last six months has overwhelmed the remaining Christians in the country

    The last Christians in Iraq

    After 2,000 years, a community will try anything – including pretending to convert to Islam – to avoid losing everything, says Patrick Cockburn
    Black Friday: Helpful discounts for Christmas shoppers, or cynical marketing by desperate retailers?

    Helpful discounts for Christmas shoppers, or cynical marketing by desperate retailers?

    Britain braced for Black Friday
    Bill Cosby's persona goes from America's dad to date-rape drugs

    From America's dad to date-rape drugs

    Stories of Bill Cosby's alleged sexual assaults may have circulated widely in Hollywood, but they came as a shock to fans, says Rupert Cornwell
    Clare Balding: 'Women's sport is kicking off at last'

    Clare Balding: 'Women's sport is kicking off at last'

    As fans flock to see England women's Wembley debut against Germany, the TV presenter on an exciting 'sea change'
    Oh come, all ye multi-faithful: The Christmas jumper is in fashion, but should you wear your religion on your sleeve?

    Oh come, all ye multi-faithful

    The Christmas jumper is in fashion, but should you wear your religion on your sleeve?
    Dr Charles Heatley: The GP off to do battle in the war against Ebola

    The GP off to do battle in the war against Ebola

    Dr Charles Heatley on joining the NHS volunteers' team bound for Sierra Leone
    Flogging vlogging: First video bloggers conquered YouTube. Now they want us to buy their books

    Flogging vlogging

    First video bloggers conquered YouTube. Now they want us to buy their books
    Saturday Night Live vs The Daily Show: US channels wage comedy star wars

    Saturday Night Live vs The Daily Show

    US channels wage comedy star wars
    When is a wine made in Piedmont not a Piemonte wine? When EU rules make Italian vineyards invisible

    When is a wine made in Piedmont not a Piemonte wine?

    When EU rules make Italian vineyards invisible