Rhodri Marsden: They may have passed the test, but the robots aren't taking over yet

 

The news was announced with such fanfare and excitement that you'd have forgiven us for bracing ourselves for psychological subjugation at the hands of an army of sentient robots. "Turing test passed for the first time", screamed the headlines, before going on to explain that a Russian-produced chatbot had managed to convince a panel of humans attending an event at the Royal Society that it, too, was human.

"We're here!" I roared, sarcastically, at my coffee-stained laptop. "We have arrived in the future! Kindly take up the slack of my floundering social life, dear computer, and engage me on topics both broad and deep!" The laptop responded by flashing a cursor and marginally increasing the speed of its fan. Business as usual.

The idea of the Turing test being passed holds great popular appeal. It was first proposed, fairly casually, by Alan Turing in 1950, while considering the question of whether computers could imitate human beings during typewritten exchanges. Less to do with artificial intelligence (AI) and more to do with human gullibility, it has nevertheless inspired countless competitions and research projects over the years, all of them imposing arbitrary ideas of what constitutes "success", and then excitedly crowing when said criteria appears to have been fulfilled.

Saturday's event at the Royal Society required 30 per cent of the judges to be hoodwinked over a conversation lasting five minutes – both figures extrapolated fairly tenuously from Turing's writings in the absence of any firm criteria set down by the man himself.

Consequently, the idea of any Turing test pass signalling a tipping point in AI seems to be faintly absurd; indeed, as Mike Masnick wrote on technology site Techdirt this week, many in the AI world "look on the Turing test as a needless distraction". You could argue that there have been far more significant dupes in the history of human-computer communication than the judging panel at the Royal Society: perhaps the many Russian men who, in 2007, were being fooled by a chatbot called Cyberlover into handing over credit card details and other personal information, albeit on the promise of saucy fun; perhaps the 59.3 per cent of participants at a 2011 event in Guwahati, India, who rated a bot called Cleverbot as human (humans themselves, rather intriguingly, were only rated as human by 63.3 per cent of them); or even those of us who use online help facilities provided by companies such as Lloyds or Citroën, that are powered by chatbots and are sometimes more helpful than the call centre staff that they replace.

These are all akin to Turing test passes, they all signal some kind of progression in the power of computing, but to pretend that a eureka moment exists when we're all supposed to throw our hats in the air feels somewhat bogus.

Over the past couple of days, that test at the Royal Society, organised by academics at the University of Reading, has been dissected online; many are contemptuous of the fact that the human being the chatbot was supposed to imitate was a 13-year-old boy whose first language wasn't English, but Ukrainian. "Come back to us when you've modelled it on an English-speaking adult", their comments seem to say, and no doubt the programmers will, once again claiming victory, and the news will be retweeted breathlessly while the real business of technological advancement carries on, quietly, with little fanfare and whizzing champagne corks noticeably absent.

Twitter.com/rhodri

PROMOTED VIDEO
Life and Style
ebookNow available in paperback
ebooks
ebookPart of The Independent’s new eBook series The Great Composers
Latest stories from i100
Have you tried new the Independent Digital Edition apps?
Independent Dating
and  

By clicking 'Search' you
are agreeing to our
Terms of Use.

ES Rentals

    iJobs Job Widget
    iJobs Gadgets & Tech

    Ashdown Group: Moodle Developer (PHP ,Linux, Apache, MySQL, Moodle)

    £35000 - £45000 per annum: Ashdown Group: Moodle Developer (PHP ,Linux, Apache...

    Recruitment Genius: Web Developer

    £17000 - £30000 per annum: Recruitment Genius: This is a fantastic opportunity...

    Recruitment Genius: Junior .NET Web Developer - Winform / MVC

    £21000 - £26000 per annum: Recruitment Genius: This Award-winning pharma softw...

    Recruitment Genius: Senior Java Developer

    £30000 - £45000 per annum: Recruitment Genius: A Senior Java Developer is requ...

    Day In a Page

    Isis in Iraq: Yazidi girls killing themselves to escape rape and imprisonment by militants

    'Jilan killed herself in the bathroom. She cut her wrists and hanged herself'

    Yazidi girls killing themselves to escape rape and imprisonment
    Ed Balls interview: 'If I think about the deficit when I'm playing the piano, it all goes wrong'

    Ed Balls interview

    'If I think about the deficit when I'm playing the piano, it all goes wrong'
    He's behind you, dude!

    US stars in UK panto

    From David Hasselhoff to Jerry Hall
    Grace Dent's Christmas Quiz: What are you – a festive curmudgeon or top of the tree?

    Grace Dent's Christmas Quiz

    What are you – a festive curmudgeon or top of the tree?
    Nasa planning to build cloud cities in airships above Venus

    Nasa planning to build cloud cities in airships above Venus

    Planet’s surface is inhospitable to humans but 30 miles above it is almost perfect
    Surrounded by high-rise flats is a little house filled with Lebanon’s history - clocks, rifles, frogmen’s uniforms and colonial helmets

    Clocks, rifles, swords, frogmen’s uniforms

    Surrounded by high-rise flats is a little house filled with Lebanon’s history
    Return to Gaza: Four months on, the wounds left by Israel's bombardment have not yet healed

    Four months after the bombardment, Gaza’s wounds are yet to heal

    Kim Sengupta is reunited with a man whose plight mirrors the suffering of the Palestinian people
    Gastric surgery: Is it really the answer to the UK's obesity epidemic?

    Is gastric surgery really the answer to the UK's obesity epidemic?

    Critics argue that it’s crazy to operate on healthy people just to stop them eating
    Homeless Veterans appeal: Christmas charity auction Part 2 - now LIVE

    Homeless Veterans appeal: Christmas charity auction

    Bid on original art, or trips of a lifetime to Africa or the 'Corrie' set, and help Homeless Veterans
    Pantomime rings the changes to welcome autistic theatre-goers

    Autism-friendly theatre

    Pantomime leads the pack in quest to welcome all
    The week Hollywood got scared and had to grow up a bit

    The week Hollywood got scared and had to grow up a bit

    Sony suffered a chorus of disapproval after it withdrew 'The Interview', but it's not too late for it to take a stand, says Joan Smith
    From Widow Twankey to Mother Goose, how do the men who play panto dames get themselves ready for the performance of a lifetime?

    Panto dames: before and after

    From Widow Twankey to Mother Goose, how do the men who play panto dames get themselves ready for the performance of a lifetime?
    Thirties murder mystery novel is surprise runaway Christmas hit

    Thirties murder mystery novel is surprise runaway Christmas hit

    Booksellers say readers are turning away from dark modern thrillers and back to the golden age of crime writing
    Anne-Marie Huby: 'Charities deserve the best,' says founder of JustGiving

    Anne-Marie Huby: 'Charities deserve the best'

    Ten million of us have used the JustGiving website to donate to good causes. Its co-founder says that being dynamic is as important as being kind
    The botanist who hunts for giant trees at Kew Gardens

    The man who hunts giants

    A Kew Gardens botanist has found 25 new large tree species - and he's sure there are more out there