Reading university holds artificial intelligence test

Computers argued, cracked jokes and parried trick questions on Sunday as part of an annual test of artificial intelligence carried out at the University of Reading.

Typing away at split-screen terminals, a dozen volunteers carried out two conversations at once: one with a chat programme, the other with a human. After five minutes, they were asked to say which was which. Some were not sure who - or what - they were talking to.



"There was one time when I was speaking to the two, and there was an element of humour in both conversations. That's the one that stumped me more than others," said Ian Andrews, one of the judges in Reading, just west of London.



Transcripts of the conversations showed some savvy judges ruthlessly trying to trip programmes up with questions about the day's weather, the global financial turmoil and the colour of their eyes.



"Blue, of course!" answered Eugene Goostman, a "chatbot" designed by Pennsylvania-based programmer Vladimir Vesselov.

Eugene was one of five programmes competing to pass themselves off as flesh and blood. A sixth programme, Alice, dropped out when it could not be set up in time.



Fred Roberts' Elbot scooped the day's top award: the Loebner Artificial Intelligence Prize's bronze medal, for duping three out of 12 judges assigned to evaluate it.



"I wish I was as good at conversation as Elbot," the Hamburg, Germany-based consultant joked after receiving the prize.



The contest draws on the ideas of British mathematician Alan Turing, who came up with a subjective but simple rule for determining whether machines were capable of thought.



Writing in 1950, Turing argued that conversation was proof of intelligence. If a computer talked like a human, then for all practical purposes it thought like a human too.



But judging a computer's eloquence was tricky: Humans might be prejudiced against a machine. So Turing devised the test in which a human judge would swap messages simultaneously with a computer and another human, without being told which was which.



If the judge had trouble telling his correspondents apart, Turing said, then the computer met the human standard of intelligence.



Each programme took a slightly different tack on Sunday.



Eugene often made pointed references to his native Odessa and "Aunt Sonya in America".



Cleverbot, designed by Rollo Carpenter, used humour to try to fool the judges.



Roberts said Elbot worked by catching some of the judges off-guard with provocative answers or impishly hinting that it was, in fact, a machine.



"Hi. How's it going?" one judge began.



"I feel terrible today," Elbot replied.

"This morning I made a mistake and poured milk over my breakfast instead of oil, and it rusted before I could eat it."



Roberts also said Elbot tried to dominate the conversation to keep it from wandering into areas it was not properly programmed to handle.



Although Turing died in 1954 without laying down precise rules for the competition, American scientist and philanthropist Hugh Loebner has been overseeing an annual series of tests based on Turing's principles since 1991.



The bronze prize handed out by Loebner goes to the piece of software that best mimics human conversation in text form.



No programme has won the gold or silver prizes. The silver would go to a machine that could pass a longer version of the Turing Test and fool at least half the judges.



The gold would go to a machine that could process audio and visual information rather than just text.



Cybernetics Professor Kevin Warwick, one of this year's contest organisers, said passing the test would be something akin to the moment IBM supercomputer Deep Blue beat Russian chess master Garry Kasparov in 1997.

Despite - or maybe because of - his win, Roberts said he did not buy Turing's argument.



"I don't think it's anything like thought," he said of Elbot's conversational prowess.



"If you know a magic trick, you know how it's done, it's not magic anymore. Sorry to be so pessimistic."









Life and Style
ebookNow available in paperback
ebooks
ebookPart of The Independent’s new eBook series The Great Composers
Latest stories from i100
Have you tried new the Independent Digital Edition apps?
Independent Dating
and  

By clicking 'Search' you
are agreeing to our
Terms of Use.

ES Rentals

    iJobs Job Widget
    iJobs Gadgets & Tech

    Ashdown Group: Application Developer - C#.Net, ASP.Net - Cambridgeshire

    Negotiable: Ashdown Group: Software Application Developer (C# & ASP.Net, SQL S...

    Ashdown Group: Front-End Developer / Front-End Designer - City of London

    £27000 - £33000 per annum + Excellent benefits: Ashdown Group: Front-End Devel...

    Recruitment Genius: 1st Line Customer Support Technician

    £15000 - £19000 per annum: Recruitment Genius: This Waterlooville based softwa...

    Ashdown Group: C# Developer - (C#, VB.Net, SQL, Git, TDD)

    Negotiable: Ashdown Group: Developer (C#, VB & ASP.Net, SQL Server, TSQL) - Pe...

    Day In a Page

    War with Isis: Iraq's government fights to win back Tikrit from militants - but then what?

    Baghdad fights to win back Tikrit from Isis – but then what?

    Patrick Cockburn reports from Kirkuk on a conflict which sectarianism has made intractable
    Living with Alzheimer's: What is it really like to be diagnosed with early-onset dementia?

    What is it like to live with Alzheimer's?

    Depicting early-onset Alzheimer's, the film 'Still Alice' had a profound effect on Joy Watson, who lives with the illness. She tells Kate Hilpern how she's coped with the diagnosis
    The Internet of Things: Meet the British salesman who gave real-world items a virtual life

    Setting in motion the Internet of Things

    British salesman Kevin Ashton gave real-world items a virtual life
    Election 2015: Latest polling reveals Tories and Labour on course to win the same number of seats - with the SNP holding the balance of power

    Election 2015: A dead heat between Mr Bean and Dick Dastardly!

    Lord Ashcroft reveals latest polling – and which character voters associate with each leader
    Audiences queue up for 'true stories told live' as cult competition The Moth goes global

    Cult competition The Moth goes global

    The non-profit 'slam storytelling' competition was founded in 1997 by the novelist George Dawes Green and has seen Malcolm Gladwell, Salman Rushdie and Molly Ringwald all take their turn at the mic
    Pakistani women come out fighting: A hard-hitting play focuses on female Muslim boxers

    Pakistani women come out fighting

    Hard-hitting new play 'No Guts, No Heart, No Glory' focuses on female Muslim boxers
    Leonora Carrington transcended her stolid background to become an avant garde star

    Surreal deal: Leonora Carrington

    The artist transcended her stolid background to become an avant garde star
    LGBT History Month: Pupils discuss topics from Sappho to same-sex marriage

    Education: LGBT History Month

    Pupils have been discussing topics from Sappho to same-sex marriage
    11 best gel eyeliners

    Go bold this season: 11 best gel eyeliners

    Use an ink pot eyeliner to go bold on the eyes with this season's feline flicked winged liner
    Cricket World Cup 2015: Tournament runs riot to make the event more hit than miss...

    Cricket World Cup runs riot to make the event more hit than miss...

    The tournament has reached its halfway mark and scores of 300 and amazing catches abound. One thing never changes, though – everyone loves beating England
    Katarina Johnson-Thompson: Heptathlete ready to jump at first major title

    Katarina Johnson-Thompson: Ready to jump at first major title

    After her 2014 was ruined by injury, 21-year-old Briton is leading pentathlete going into this week’s European Indoors. Now she intends to turn form into gold
    Syrian conflict is the world's first 'climate change war', say scientists, but it won't be the last one

    Climate change key in Syrian conflict

    And it will trigger more war in future
    How I outwitted the Gestapo

    How I outwitted the Gestapo

    My life as a Jew in wartime Berlin
    The nation's favourite animal revealed

    The nation's favourite animal revealed

    Women like cuddly creatures whilst men like creepy-crawlies
    Is this the way to get young people to vote?

    Getting young people to vote

    From #VOTESELFISH to Bite the Ballot