Reading university holds artificial intelligence test

Computers argued, cracked jokes and parried trick questions on Sunday as part of an annual test of artificial intelligence carried out at the University of Reading.

Typing away at split-screen terminals, a dozen volunteers carried out two conversations at once: one with a chat programme, the other with a human. After five minutes, they were asked to say which was which. Some were not sure who - or what - they were talking to.



"There was one time when I was speaking to the two, and there was an element of humour in both conversations. That's the one that stumped me more than others," said Ian Andrews, one of the judges in Reading, just west of London.



Transcripts of the conversations showed some savvy judges ruthlessly trying to trip programmes up with questions about the day's weather, the global financial turmoil and the colour of their eyes.



"Blue, of course!" answered Eugene Goostman, a "chatbot" designed by Pennsylvania-based programmer Vladimir Vesselov.

Eugene was one of five programmes competing to pass themselves off as flesh and blood. A sixth programme, Alice, dropped out when it could not be set up in time.



Fred Roberts' Elbot scooped the day's top award: the Loebner Artificial Intelligence Prize's bronze medal, for duping three out of 12 judges assigned to evaluate it.



"I wish I was as good at conversation as Elbot," the Hamburg, Germany-based consultant joked after receiving the prize.



The contest draws on the ideas of British mathematician Alan Turing, who came up with a subjective but simple rule for determining whether machines were capable of thought.



Writing in 1950, Turing argued that conversation was proof of intelligence. If a computer talked like a human, then for all practical purposes it thought like a human too.



But judging a computer's eloquence was tricky: Humans might be prejudiced against a machine. So Turing devised the test in which a human judge would swap messages simultaneously with a computer and another human, without being told which was which.



If the judge had trouble telling his correspondents apart, Turing said, then the computer met the human standard of intelligence.



Each programme took a slightly different tack on Sunday.



Eugene often made pointed references to his native Odessa and "Aunt Sonya in America".



Cleverbot, designed by Rollo Carpenter, used humour to try to fool the judges.



Roberts said Elbot worked by catching some of the judges off-guard with provocative answers or impishly hinting that it was, in fact, a machine.



"Hi. How's it going?" one judge began.



"I feel terrible today," Elbot replied.

"This morning I made a mistake and poured milk over my breakfast instead of oil, and it rusted before I could eat it."



Roberts also said Elbot tried to dominate the conversation to keep it from wandering into areas it was not properly programmed to handle.



Although Turing died in 1954 without laying down precise rules for the competition, American scientist and philanthropist Hugh Loebner has been overseeing an annual series of tests based on Turing's principles since 1991.



The bronze prize handed out by Loebner goes to the piece of software that best mimics human conversation in text form.



No programme has won the gold or silver prizes. The silver would go to a machine that could pass a longer version of the Turing Test and fool at least half the judges.



The gold would go to a machine that could process audio and visual information rather than just text.



Cybernetics Professor Kevin Warwick, one of this year's contest organisers, said passing the test would be something akin to the moment IBM supercomputer Deep Blue beat Russian chess master Garry Kasparov in 1997.

Despite - or maybe because of - his win, Roberts said he did not buy Turing's argument.



"I don't think it's anything like thought," he said of Elbot's conversational prowess.



"If you know a magic trick, you know how it's done, it's not magic anymore. Sorry to be so pessimistic."









Life and Style
ebookNow available in paperback
Latest stories from i100
Have you tried new the Independent Digital Edition apps?
Independent Dating
and  

By clicking 'Search' you
are agreeing to our
Terms of Use.

ES Rentals

    iJobs Job Widget
    iJobs Gadgets & Tech

    SThree: Trainee Recruitment Consultant

    £18000 - £23000 per annum + Uncapped Commission: SThree: As a Trainee Recruitm...

    SThree: Trainee Recruitment Consultant

    £18000 - £23000 per annum + Uncapped Commission: SThree: As a Trainee Recruitm...

    SThree: Trainee Recruitment Consultant

    £13676.46 - £15864.28 per annum + Uncapped Commission: SThree: As a Trainee Re...

    SThree: Trainee Recruitment Consultant

    £18000 - £23000 per annum + Uncapped Commission: SThree: As a Trainee Recruitm...

    Day In a Page

    Raif Badawi: Wife pleads for fresh EU help as Saudi blogger's health worsens

    Please save my husband

    As the health of blogger Raif Badawi worsens in prison, his wife urges EU governments to put pressure on the Saudi Arabian royal family to allow her husband to join his family in Canada
    Birthplace of Arab Spring in turmoil as angry Tunisians stage massive sit-in over lack of development

    They shall not be moved: jobless protesters bring Tunisia to a halt

    A former North African boom town is wasting away while its unemployed citizens stick steadfastly to their sit-in
    David Hasselhoff's new show 'Hoff the Record': What's it like working with a superstar?

    Hanging with the Hoff

    Working with David Hasselhoff on his new TV series was an education for Ella Smith
    Can Dubai's Design District 'hipster village' attract the right type of goatee-wearing individualist?

    Hipsters of Arabia

    Can Dubai’s ‘creative village’ attract the right type of goatee-wearing individualist?
    The cult of Roger Federer: What is it that inspires such obsessive devotion?

    The cult of Roger Federer

    What is it that inspires such obsessive devotion?
    Kuala Lumpur's street food: Not a 'scene', more a way of life

    Malaysian munchies

    With new flights, the amazing street food of Kuala Lumpur just got more accessible
    10 best festival beauty

    Mud guards: 10 best festival beauty

    Whether you're off to the Isle of Wight, Glastonbury or a local music event, we've found the products to help you
    Unai Emery’s passion for winning and eye for a bargain keep Seville centre stage in Europe

    A Different League

    Unai Emery’s passion for winning and eye for a bargain keep Seville centre stage in Europe, says Pete Jenson
    Amir Khan and James DeGale’s remarkable Olympic performances were just the start of an extraordinary journey - Steve Bunce

    Steve Bunce on Boxing

    Amir Khan and James DeGale’s remarkable Olympic performances were just the start of an extraordinary journey
    Abuse - and the hell that came afterwards

    Abuse - and the hell that follows

    James Rhodes on the extraordinary legal battle to publish his memoir
    Why we need a 'tranquility map' of England, according to campaigners

    It's oh so quiet!

    The case for a 'tranquility map' of England
    'Timeless fashion': It may be a paradox, but the industry loves it

    'Timeless fashion'

    It may be a paradox, but the industry loves it
    If the West needs a bridge to the 'moderates' inside Isis, maybe we could have done with Osama bin Laden staying alive after all

    Could have done with Osama bin Laden staying alive?

    Robert Fisk on the Fountainheads of World Evil in 2011 - and 2015
    New exhibition celebrates the evolution of swimwear

    Evolution of swimwear

    From bathing dresses in the twenties to modern bikinis
    Sun, sex and an anthropological study: One British academic's summer of hell in Magaluf

    Sun, sex and an anthropological study

    One academic’s summer of hell in Magaluf