Robots must learn to value humans or 'they could kill us out of kindness'

A leading futurist claims super-intelligent robots could decide destroying the human race is the kindest thing to do

Robots should be taught to appreciate human value to ensure they do not one day “kill us out of kindness”, a leading futurist has warned.

Nell Watson told The Conference in Malmo, Sweden, that robots will soon reach the stage where they have the same level of cognition as a bumblebee, creatures which are both socially aware and can navigate their way around their environment.

This advancement in artificial intelligence will be the first example of machines exhibiting ‘system one’ thinking used by humans to develop assumptions about the world around them.

Robots currently use 'system two' intelligence systems which rely on rules, according to Wired.

Ms Watson said the emergence of system one robots will create “huge change” in society globally. House-holds will have domestic-help robots and self-driving cars, while professions such as stockbroking, law and medical analysis will be undertaken by robots, not humans.

 

However, Ms Watson expressed concerns over super-intelligent robots. "I can't help but look at these trends and imagine how then shall we live?” she said. “When we start to see super-intelligent artificial intelligences are they going to be friendly or unfriendly?"

It would not be enough to teach robots benevolence, as they may decide destroying the human race is the kindest thing they could do.

"The most important work of our lifetime is to ensure that machines are capable of understanding human value," said Ms Watson. "It is those values that will ensure machines don't end up killing us out of kindness."

A nearly completed RoboThespian robot inside the Engineered Arts workshop is tested A nearly completed RoboThespian robot inside the Engineered Arts workshop is tested Her words of caution come after Stephen Hawking warned that while the rapid progress in artificial-intelligence (AI) research could be best thing that happened to humanity, it could also be the worst.

Writing in The Independent, he said that while it's tempting to dismiss the notion of highly intelligent machines as science fiction, "this would be a mistake, and potentially our worst mistake in history".

The development of robots also sparked concerns earlier this year when Human Rights Watch warned 'killer robots' could “jeopardise basic human rights” as the United Nations held its first ever multinational convention on lethal autonomous weapons systems.

So-called killer robots are autonomous machines able to identify and kill targets without human input. Fully autonomous weapons have not yet been developed but technological advances are bringing them closer to fruition.

Life and Style
ebookNow available in paperback
ebooks
ebookA delicious collection of 50 meaty main courses
Latest stories from i100
Have you tried new the Independent Digital Edition apps?
SPONSORED FEATURES
Independent Dating
and  

By clicking 'Search' you
are agreeing to our
Terms of Use.

ES Rentals

    iJobs Job Widget
    iJobs Gadgets & Tech

    Recruitment Genius: Junior / Mid Software Developer

    £21000 - £28000 per annum: Recruitment Genius: This is an exciting opportunity...

    Recruitment Genius: Linux Systems Administrator

    £26000 - £35000 per annum: Recruitment Genius: A Systems Administrator is requ...

    Ampersand Consulting LLP: Sitecore Developer / Software Developer - Sitecore,.NET,C#, SQL

    £70000 - £90000 per annum: Ampersand Consulting LLP: Sitecore Developer / Soft...

    Ashdown Group: Reporting & Analytics Supervisor - Buckinghamshire - £36,000

    £34000 - £36000 per annum + benefits: Ashdown Group: Analytics & Reporting Tea...

    Day In a Page

    Mullah Omar, creator of the Taliban, is dead... for the fourth time

    Mullah Omar, creator of the Taliban, is dead... again

    I was once told that intelligence services declare their enemies dead to provoke them into popping up their heads and revealing their location, says Robert Fisk
    Margaret Attwood on climate change: 'Time is running out for our fragile, Goldilocks planet'

    Margaret Attwood on climate change

    The author looks back on what she wrote about oil in 2009, and reflects on how the conversation has changed in a mere six years
    New Dr Seuss manuscript discovered: What Pet Should I Get? goes on sale this week

    New Dr Seuss manuscript discovered

    What Pet Should I Get? goes on sale this week
    Oculus Rift and the lonely cartoon hedgehog who could become the first ever virtual reality movie star

    The cartoon hedgehog leading the way into a whole new reality

    Virtual reality is the 'next chapter' of entertainment. Tim Walker gives it a try
    Ants have unique ability to switch between individual and collective action, says study

    Secrets of ants' teamwork revealed

    The insects have an almost unique ability to switch between individual and collective action
    Donovan interview: The singer is releasing a greatest hits album to mark his 50th year in folk

    Donovan marks his 50th year in folk

    The singer tells Nick Duerden about receiving death threats, why the world is 'mentally ill', and how he can write a song about anything, from ecology to crumpets
    Let's Race simulator: Ultra-realistic technology recreates thrill of the Formula One circuit

    Simulator recreates thrill of F1 circuit

    Rory Buckeridge gets behind the wheel and explains how it works
    Twitter accused of 'Facebookisation' over plans to overhaul reverse-chronological timeline

    Twitter accused of 'Facebookisation'

    Facebook exasperates its users by deciding which posts they can and can’t see. So why has Twitter announced plans to do the same?
    Jane Birkin asks Hermès to rename bag - but what else could the fashion house call it?

    Jane Birkin asks Hermès to rename bag

    The star was shocked by a Peta investigation into the exotic skins trade
    10 best waterproof mascaras

    Whatever the weather: 10 best waterproof mascaras

    We found lash-enhancing beauties that won’t budge no matter what you throw at them
    Diego Costa biography: Chelsea striker's route to the top - from those who shared his journey

    Diego Costa: I go to war. You come with me...

    Chelsea's rampaging striker had to fight his way from a poor city in Brazil to life at the top of the Premier League. A new book speaks to those who shared his journey
    Ashes 2015: England show the mettle to strike back hard in third Test

    England show the mettle to strike back hard in third Test

    The biggest problem facing them in Birmingham was the recovery of the zeitgeist that drained so quickly under the weight of Australian runs at Lord's, says Kevin Garside
    Women's Open 2015: Charley Hull - 'I know I'm a good golfer but I'm also just a person'

    Charley Hull: 'I know I'm a good golfer but I'm also just a person'

    British teen keeps her feet on ground ahead of Women's Open
    Turkey's conflict with Kurdish guerrillas in Iraq can benefit Isis in Syria

    Turkey's conflict with Kurdish guerrillas in Iraq can benefit Isis in Syria

    Turkish President Erdogan could benefit politically from the targeting of the PKK, says Patrick Cockburn
    Yvette Cooper: Our choice is years of Tory rule under Jeremy Corbyn or a return to a Labour government

    Our choice is years of Tory rule under Corbyn or a return to a Labour government

    Yvette Cooper urged Labour members to 'get serious' about the next general election rather than become 'a protest movement'