Reading university holds artificial intelligence test

Computers argued, cracked jokes and parried trick questions on Sunday as part of an annual test of artificial intelligence carried out at the University of Reading.

Typing away at split-screen terminals, a dozen volunteers carried out two conversations at once: one with a chat programme, the other with a human. After five minutes, they were asked to say which was which. Some were not sure who - or what - they were talking to.



"There was one time when I was speaking to the two, and there was an element of humour in both conversations. That's the one that stumped me more than others," said Ian Andrews, one of the judges in Reading, just west of London.



Transcripts of the conversations showed some savvy judges ruthlessly trying to trip programmes up with questions about the day's weather, the global financial turmoil and the colour of their eyes.



"Blue, of course!" answered Eugene Goostman, a "chatbot" designed by Pennsylvania-based programmer Vladimir Vesselov.

Eugene was one of five programmes competing to pass themselves off as flesh and blood. A sixth programme, Alice, dropped out when it could not be set up in time.



Fred Roberts' Elbot scooped the day's top award: the Loebner Artificial Intelligence Prize's bronze medal, for duping three out of 12 judges assigned to evaluate it.



"I wish I was as good at conversation as Elbot," the Hamburg, Germany-based consultant joked after receiving the prize.



The contest draws on the ideas of British mathematician Alan Turing, who came up with a subjective but simple rule for determining whether machines were capable of thought.



Writing in 1950, Turing argued that conversation was proof of intelligence. If a computer talked like a human, then for all practical purposes it thought like a human too.



But judging a computer's eloquence was tricky: Humans might be prejudiced against a machine. So Turing devised the test in which a human judge would swap messages simultaneously with a computer and another human, without being told which was which.



If the judge had trouble telling his correspondents apart, Turing said, then the computer met the human standard of intelligence.



Each programme took a slightly different tack on Sunday.



Eugene often made pointed references to his native Odessa and "Aunt Sonya in America".



Cleverbot, designed by Rollo Carpenter, used humour to try to fool the judges.



Roberts said Elbot worked by catching some of the judges off-guard with provocative answers or impishly hinting that it was, in fact, a machine.



"Hi. How's it going?" one judge began.



"I feel terrible today," Elbot replied.

"This morning I made a mistake and poured milk over my breakfast instead of oil, and it rusted before I could eat it."



Roberts also said Elbot tried to dominate the conversation to keep it from wandering into areas it was not properly programmed to handle.



Although Turing died in 1954 without laying down precise rules for the competition, American scientist and philanthropist Hugh Loebner has been overseeing an annual series of tests based on Turing's principles since 1991.



The bronze prize handed out by Loebner goes to the piece of software that best mimics human conversation in text form.



No programme has won the gold or silver prizes. The silver would go to a machine that could pass a longer version of the Turing Test and fool at least half the judges.



The gold would go to a machine that could process audio and visual information rather than just text.



Cybernetics Professor Kevin Warwick, one of this year's contest organisers, said passing the test would be something akin to the moment IBM supercomputer Deep Blue beat Russian chess master Garry Kasparov in 1997.

Despite - or maybe because of - his win, Roberts said he did not buy Turing's argument.



"I don't think it's anything like thought," he said of Elbot's conversational prowess.



"If you know a magic trick, you know how it's done, it's not magic anymore. Sorry to be so pessimistic."









Life and Style
ebookNow available in paperback
ebooks
ebookPart of The Independent’s new eBook series The Great Composers
Latest stories from i100
Have you tried new the Independent Digital Edition apps?
Independent Dating
and  

By clicking 'Search' you
are agreeing to our
Terms of Use.

ES Rentals

    iJobs Job Widget
    iJobs Gadgets & Tech

    Recruitment Genius: Client IT Account Manager

    £25000 - £30000 per annum: Recruitment Genius: A Client IT Account Manager is ...

    Recruitment Genius: Windows Server Engineer - Compute Engineer

    £30000 - £35000 per annum: Recruitment Genius: The Compute Engineer role also ...

    SThree: Trainee Recruitment Consultant

    £13676.46 - £15864.28 per annum + Uncapped Commission: SThree: As a Trainee Re...

    Recruitment Genius: 3rd Line IT Support / Senior Engineer / Support Analyst

    £24000 - £32000 per annum: Recruitment Genius: An exciting opportunity has ari...

    Day In a Page

    No postcode? No vote

    Floating voters

    How living on a houseboat meant I didn't officially 'exist'
    Louis Theroux's affable Englishman routine begins to wear thin

    By Reason of Insanity

    Louis Theroux's affable Englishman routine begins to wear thin
    Power dressing is back – but no shoulderpads!

    Power dressing is back

    But banish all thoughts of Eighties shoulderpads
    Spanish stone-age cave paintings 'under threat' after being re-opened to the public

    Spanish stone-age cave paintings in Altamira 'under threat'

    Caves were re-opened to the public
    'I was the bookies’ favourite to be first to leave the Cabinet'

    Vince Cable interview

    'I was the bookies’ favourite to be first to leave the Cabinet'
    Election 2015: How many of the Government's coalition agreement promises have been kept?

    Promises, promises

    But how many coalition agreement pledges have been kept?
    The Gaza fisherman who built his own reef - and was shot dead there by an Israeli gunboat

    The death of a Gaza fisherman

    He built his own reef, and was fatally shot there by an Israeli gunboat
    Saudi Arabia's airstrikes in Yemen are fuelling the Gulf's fire

    Saudi airstrikes are fuelling the Gulf's fire

    Arab intervention in Yemen risks entrenching Sunni-Shia divide and handing a victory to Isis, says Patrick Cockburn
    Zayn Malik's departure from One Direction shows the perils of fame in the age of social media

    The only direction Zayn could go

    We wince at the anguish of One Direction's fans, but Malik's departure shows the perils of fame in the age of social media
    Young Magician of the Year 2015: Meet the schoolgirl from Newcastle who has her heart set on being the competition's first female winner

    Spells like teen spirit

    A 16-year-old from Newcastle has set her heart on being the first female to win Young Magician of the Year. Jonathan Owen meets her
    Jonathan Anderson: If fashion is a cycle, this young man knows just how to ride it

    If fashion is a cycle, this young man knows just how to ride it

    British designer Jonathan Anderson is putting his stamp on venerable house Loewe
    Number plates scheme could provide a licence to offend in the land of the free

    Licence to offend in the land of the free

    Cash-strapped states have hit on a way of making money out of drivers that may be in collision with the First Amendment, says Rupert Cornwell
    From farm to fork: Meet the Cornish fishermen, vegetable-growers and butchers causing a stir in London's top restaurants

    From farm to fork in Cornwall

    One man is bringing together Cornwall's most accomplished growers, fishermen and butchers with London's best chefs to put the finest, freshest produce on the plates of some of the country’s best restaurants
    Robert Parker interview: The world's top wine critic on tasting 10,000 bottles a year, absurd drinking notes and New World wannabes

    Robert Parker interview

    The world's top wine critic on tasting 10,000 bottles a year, absurd drinking notes and New World wannabes
    Don't believe the stereotype - or should you?

    Don't believe the stereotype - or should you?

    We exaggerate regional traits and turn them into jokes - and those on the receiving end are in on it too, says DJ Taylor