Rhodri Marsden: They may have passed the test, but the robots aren't taking over yet


The news was announced with such fanfare and excitement that you'd have forgiven us for bracing ourselves for psychological subjugation at the hands of an army of sentient robots. "Turing test passed for the first time", screamed the headlines, before going on to explain that a Russian-produced chatbot had managed to convince a panel of humans attending an event at the Royal Society that it, too, was human.

"We're here!" I roared, sarcastically, at my coffee-stained laptop. "We have arrived in the future! Kindly take up the slack of my floundering social life, dear computer, and engage me on topics both broad and deep!" The laptop responded by flashing a cursor and marginally increasing the speed of its fan. Business as usual.

The idea of the Turing test being passed holds great popular appeal. It was first proposed, fairly casually, by Alan Turing in 1950, while considering the question of whether computers could imitate human beings during typewritten exchanges. Less to do with artificial intelligence (AI) and more to do with human gullibility, it has nevertheless inspired countless competitions and research projects over the years, all of them imposing arbitrary ideas of what constitutes "success", and then excitedly crowing when said criteria appears to have been fulfilled.

Saturday's event at the Royal Society required 30 per cent of the judges to be hoodwinked over a conversation lasting five minutes – both figures extrapolated fairly tenuously from Turing's writings in the absence of any firm criteria set down by the man himself.

Consequently, the idea of any Turing test pass signalling a tipping point in AI seems to be faintly absurd; indeed, as Mike Masnick wrote on technology site Techdirt this week, many in the AI world "look on the Turing test as a needless distraction". You could argue that there have been far more significant dupes in the history of human-computer communication than the judging panel at the Royal Society: perhaps the many Russian men who, in 2007, were being fooled by a chatbot called Cyberlover into handing over credit card details and other personal information, albeit on the promise of saucy fun; perhaps the 59.3 per cent of participants at a 2011 event in Guwahati, India, who rated a bot called Cleverbot as human (humans themselves, rather intriguingly, were only rated as human by 63.3 per cent of them); or even those of us who use online help facilities provided by companies such as Lloyds or Citroën, that are powered by chatbots and are sometimes more helpful than the call centre staff that they replace.

These are all akin to Turing test passes, they all signal some kind of progression in the power of computing, but to pretend that a eureka moment exists when we're all supposed to throw our hats in the air feels somewhat bogus.

Over the past couple of days, that test at the Royal Society, organised by academics at the University of Reading, has been dissected online; many are contemptuous of the fact that the human being the chatbot was supposed to imitate was a 13-year-old boy whose first language wasn't English, but Ukrainian. "Come back to us when you've modelled it on an English-speaking adult", their comments seem to say, and no doubt the programmers will, once again claiming victory, and the news will be retweeted breathlessly while the real business of technological advancement carries on, quietly, with little fanfare and whizzing champagne corks noticeably absent.


Life and Style
ebookNow available in paperback
ebookA delicious collection of 50 meaty main courses
Latest stories from i100
Have you tried new the Independent Digital Edition apps?
Independent Dating

By clicking 'Search' you
are agreeing to our
Terms of Use.

ES Rentals

    iJobs Job Widget
    iJobs Gadgets & Tech

    Recruitment Genius: Technical Support Analyst

    £20000 - £23000 per annum: Recruitment Genius: This Managed IT Services Provid...

    Recruitment Genius: 1st / 2nd Line IT Support Engineer

    £20000 - £28000 per annum: Recruitment Genius: This specialist high tech compa...

    Recruitment Genius: Web Designer / Developer

    £12000 - £16000 per annum: Recruitment Genius: New Full-time, Part-time and Fr...

    Recruitment Genius: Creative Web and UI Designer

    £30000 - £35000 per annum: Recruitment Genius: An experienced creative web and...

    Day In a Page

    On your feet! Spending at least two hours a day standing reduces the risk of heart attacks, cancer and diabetes, according to new research

    On your feet!

    Spending half the day standing 'reduces risk of heart attacks and cancer'
    Liverpool close in on Milner signing

    Liverpool close in on Milner signing

    Reds baulk at Christian Benteke £32.5m release clause
    With scores of surgeries closing, what hope is there for the David Cameron's promise of 5,000 more GPs and a 24/7 NHS?

    The big NHS question

    Why are there so few new GPs when so many want to study medicine?
    Big knickers are back: Thongs ain't what they used to be

    Thongs ain't what they used to be

    Big knickers are back
    Thurston Moore interview

    Thurston Moore interview

    On living in London, Sonic Youth and musical memoirs
    In full bloom

    In full bloom

    Floral print womenswear
    From leading man to Elephant Man, Bradley Cooper is terrific

    From leading man to Elephant Man

    Bradley Cooper is terrific
    In this the person to restore our trust in the banks?

    In this the person to restore our trust in the banks?

    Dame Colette Bowe - interview
    When do the creative juices dry up?

    When do the creative juices dry up?

    David Lodge thinks he knows
    The 'Cher moment' happening across fashion just now

    Fashion's Cher moment

    Ageing beauty will always be more classy than all that booty
    Thousands of teenage girls enduring debilitating illnesses after routine school cancer vaccination

    Health fears over school cancer jab

    Shock new Freedom of Information figures show how thousands of girls have suffered serious symptoms after routine HPV injection
    Fifa President Sepp Blatter warns his opponents: 'I forgive everyone, but I don't forget'

    'I forgive everyone, but I don't forget'

    Fifa president Sepp Blatter issues defiant warning to opponents
    Extreme summer temperatures will soon cause deaths of up to 1,700 more Britons a year, says government report

    Weather warning

    Extreme summer temperatures will soon cause deaths of up to 1,700 more Britons a year, says government report
    LSD: Speaking to volunteer users of the drug as trials get underway to see if it cures depression and addiction

    High hopes for LSD

    Meet the volunteer users helping to see if it cures depression and addiction
    German soldier who died fighting for UK in Battle of Waterloo should be removed from museum display and given dignified funeral, say historians

    Saving Private Brandt

    A Belgian museum's display of the skeleton of a soldier killed at Waterloo prompts calls for him to be given a dignified funeral