Robots must learn to value humans or 'they could kill us out of kindness'

A leading futurist claims super-intelligent robots could decide destroying the human race is the kindest thing to do

Robots should be taught to appreciate human value to ensure they do not one day “kill us out of kindness”, a leading futurist has warned.

Nell Watson told The Conference in Malmo, Sweden, that robots will soon reach the stage where they have the same level of cognition as a bumblebee, creatures which are both socially aware and can navigate their way around their environment.

This advancement in artificial intelligence will be the first example of machines exhibiting ‘system one’ thinking used by humans to develop assumptions about the world around them.

Robots currently use 'system two' intelligence systems which rely on rules, according to Wired.

Ms Watson said the emergence of system one robots will create “huge change” in society globally. House-holds will have domestic-help robots and self-driving cars, while professions such as stockbroking, law and medical analysis will be undertaken by robots, not humans.

 

However, Ms Watson expressed concerns over super-intelligent robots. "I can't help but look at these trends and imagine how then shall we live?” she said. “When we start to see super-intelligent artificial intelligences are they going to be friendly or unfriendly?"

It would not be enough to teach robots benevolence, as they may decide destroying the human race is the kindest thing they could do.

"The most important work of our lifetime is to ensure that machines are capable of understanding human value," said Ms Watson. "It is those values that will ensure machines don't end up killing us out of kindness."

A nearly completed RoboThespian robot inside the Engineered Arts workshop is tested A nearly completed RoboThespian robot inside the Engineered Arts workshop is tested Her words of caution come after Stephen Hawking warned that while the rapid progress in artificial-intelligence (AI) research could be best thing that happened to humanity, it could also be the worst.

Writing in The Independent, he said that while it's tempting to dismiss the notion of highly intelligent machines as science fiction, "this would be a mistake, and potentially our worst mistake in history".

The development of robots also sparked concerns earlier this year when Human Rights Watch warned 'killer robots' could “jeopardise basic human rights” as the United Nations held its first ever multinational convention on lethal autonomous weapons systems.

So-called killer robots are autonomous machines able to identify and kill targets without human input. Fully autonomous weapons have not yet been developed but technological advances are bringing them closer to fruition.

Arts and Entertainment
Lou Reed distorted the truth about his upbringing, and since his death in 2013, biographers and memoirists have added to the myths
musicThe truth about Lou Reed's upbringing beyond the biographers' and memoirists' myths
News
people
News
Ed Miliband received a warm welcome in Chester
election 2015
Life and Style
Apple CEO Tim Cook announces the Apple Watch during an Apple special even
fashionIs the Apple Watch for you? Well, it depends if you want it for the fitness tech, or for the style
Life and Style
ebookNow available in paperback
ebooks
ebookPart of The Independent’s new eBook series The Great Composers
Latest stories from i100
Have you tried new the Independent Digital Edition apps?
Independent Dating
and  

By clicking 'Search' you
are agreeing to our
Terms of Use.

ES Rentals

    iJobs Job Widget
    iJobs Gadgets & Tech

    Recruitment Genius: Project Implementation Executive

    £18000 - £23000 per annum: Recruitment Genius: They work with major vehicle ma...

    Recruitment Genius: Digital Account Executive - Midlands

    £18000 - £26000 per annum: Recruitment Genius: They work with major vehicle ma...

    Ashdown Group: Front-End UI Application Developer

    £30000 - £40000 per annum + Benefits: Ashdown Group: Front-End UI Application ...

    Recruitment Genius: Digital Account Executive

    £18000 - £26000 per annum: Recruitment Genius: They work with major vehicle ma...

    Day In a Page

    Armenian genocide: To continue to deny the truth of this mass human cruelty is close to a criminal lie

    Armenian genocide and the 'good Turks'

    To continue to deny the truth of this mass human cruelty is close to a criminal lie
    Lou Reed: The truth about the singer's upbringing beyond the biographers' and memoirists' myths

    'Lou needed care, but what he got was ECT'

    The truth about the singer's upbringing beyond
    Migrant boat disaster: This human tragedy has been brewing for four years and EU states can't say they were not warned

    This human tragedy has been brewing for years

    EU states can't say they were not warned
    Women's sportswear: From tackling a marathon to a jog in the park, the right kit can help

    Women's sportswear

    From tackling a marathon to a jog in the park, the right kit can help
    Hillary Clinton's outfits will be as important as her policies in her presidential bid

    Clinton's clothes

    Like it or not, her outfits will be as important as her policies
    NHS struggling to monitor the safety and efficacy of its services outsourced to private providers

    Who's monitoring the outsourced NHS services?

    A report finds that private firms are not being properly assessed for their quality of care
    Zac Goldsmith: 'I'll trigger a by-election over Heathrow'

    Zac Goldsmith: 'I'll trigger a by-election over Heathrow'

    The Tory MP said he did not want to stand again unless his party's manifesto ruled out a third runway. But he's doing so. Watch this space
    How do Greek voters feel about Syriza's backtracking on its anti-austerity pledge?

    How do Greeks feel about Syriza?

    Five voters from different backgrounds tell us what they expect from Syriza's charismatic leader Alexis Tsipras
    From Iraq to Libya and Syria: The wars that come back to haunt us

    The wars that come back to haunt us

    David Cameron should not escape blame for his role in conflicts that are still raging, argues Patrick Cockburn
    Sam Baker and Lauren Laverne: Too busy to surf? Head to The Pool

    Too busy to surf? Head to The Pool

    A new website is trying to declutter the internet to help busy women. Holly Williams meets the founders
    Heston Blumenthal to cook up a spice odyssey for British astronaut manning the International Space Station

    UK's Major Tum to blast off on a spice odyssey

    Nothing but the best for British astronaut as chef Heston Blumenthal cooks up his rations
    John Harrison's 'longitude' clock sets new record - 300 years on

    ‘Longitude’ clock sets new record - 300 years on

    Greenwich horologists celebrate as it keeps to within a second of real time over a 100-day test
    Fears in the US of being outgunned in the vital propaganda wars by Russia, China - and even Isis - have prompted a rethink on overseas broadcasters

    Let the propaganda wars begin - again

    'Accurate, objective, comprehensive': that was Voice of America's creed, but now its masters want it to promote US policy, reports Rupert Cornwell
    Why Japan's incredible long-distance runners will never win the London Marathon

    Japan's incredible long-distance runners

    Every year, Japanese long-distance runners post some of the world's fastest times – yet, come next weekend, not a single elite competitor from the country will be at the London Marathon
    Why does Tom Drury remain the greatest writer you've never heard of?

    Tom Drury: The quiet American

    His debut was considered one of the finest novels of the past 50 years, and he is every bit the equal of his contemporaries, Jonathan Franzen, Dave Eggers and David Foster Wallace