Robots must learn to value humans or 'they could kill us out of kindness'

A leading futurist claims super-intelligent robots could decide destroying the human race is the kindest thing to do

Robots should be taught to appreciate human value to ensure they do not one day “kill us out of kindness”, a leading futurist has warned.

Nell Watson told The Conference in Malmo, Sweden, that robots will soon reach the stage where they have the same level of cognition as a bumblebee, creatures which are both socially aware and can navigate their way around their environment.

This advancement in artificial intelligence will be the first example of machines exhibiting ‘system one’ thinking used by humans to develop assumptions about the world around them.

Robots currently use 'system two' intelligence systems which rely on rules, according to Wired.

Ms Watson said the emergence of system one robots will create “huge change” in society globally. House-holds will have domestic-help robots and self-driving cars, while professions such as stockbroking, law and medical analysis will be undertaken by robots, not humans.

 

However, Ms Watson expressed concerns over super-intelligent robots. "I can't help but look at these trends and imagine how then shall we live?” she said. “When we start to see super-intelligent artificial intelligences are they going to be friendly or unfriendly?"

It would not be enough to teach robots benevolence, as they may decide destroying the human race is the kindest thing they could do.

"The most important work of our lifetime is to ensure that machines are capable of understanding human value," said Ms Watson. "It is those values that will ensure machines don't end up killing us out of kindness."

A nearly completed RoboThespian robot inside the Engineered Arts workshop is tested A nearly completed RoboThespian robot inside the Engineered Arts workshop is tested Her words of caution come after Stephen Hawking warned that while the rapid progress in artificial-intelligence (AI) research could be best thing that happened to humanity, it could also be the worst.

Writing in The Independent, he said that while it's tempting to dismiss the notion of highly intelligent machines as science fiction, "this would be a mistake, and potentially our worst mistake in history".

The development of robots also sparked concerns earlier this year when Human Rights Watch warned 'killer robots' could “jeopardise basic human rights” as the United Nations held its first ever multinational convention on lethal autonomous weapons systems.

So-called killer robots are autonomous machines able to identify and kill targets without human input. Fully autonomous weapons have not yet been developed but technological advances are bringing them closer to fruition.

News
The surrealist comedian at the Q Awards in 2010
people
Life and Style
Six of the 76 Goats' cheese samples contained a significant amount of sheep's cheese
food + drink
News
Russell Brand arriving for the book launch in East London
peopleRussell Brand cancels his book launch debate due to concerns about the make-up of the panel
Arts and Entertainment
Contestants during this summer's Celebrity Big Brother grand finale
tvBroadcaster attempts to change its image following sale to US
PROMOTED VIDEO
Life and Style
ebooksA superb mix of recipes serving up the freshest of local produce in a delicious range of styles
Life and Style
ebooksFrom the lifespan of a slug to the distance to the Sun: answers to 500 questions from readers
Arts and Entertainment
Sarah Dales attempts to sell British Breeze in the luxury scent task
tvReview: 'Apprentice' candidates on the verge of tears as they were ejected from the boardroom
News
New look: Zellweger at Elle's Women in Hollywood awards on Monday

Actress sees off speculation about her face in an amazing way

News

Florida mother launched a petition to ban the sale of the dolls

Arts and Entertainment
film

Marvel has released first teaser trailer week early after it leaked online

Extras
indybest
Life and Style
CHARGE BOOSTER: Aeroplane mode doesn't sound very exciting, but it can be a (phone) hacker's friend. Turning on the option while charging your mobile will increase the speed at which your phone battery charges
techNew book reveals how to rid your inbox of spam, protect your passwords and amplify your iPhone
Sport
Christiano Ronaldo enjoys his opening goal
champions leagueLiverpool 0 Real Madrid 3: Ronaldo and Benzema run Reds ragged to avenge thrashing from their last visit to Anfield
Arts and Entertainment
Awesome foursome: Sam Smith shows off his awards
music22-year-old confirms he is 2014’s breakout British music success
Arts and Entertainment
Sir Nicholas Serota has been a feature in the Power 100 top ten since its 2002 launch
art
News
Call me Superman: one of many unusual names chosen by Chinese students
newsChinese state TV offers advice for citizens picking a Western moniker
News
Wilko Johnson is currently on his farewell tour
people
News
Let’s pretend: KidZania in Tokyo
educationKidZania lets children try their hands at being a firefighter, doctor or factory worker for the day
News
i100
Voices
'Irritatingly Disneyfied': fashion vlogger Zoella
voicesVicky Chandler: Zoella shows us that feminism can come in all forms
Life and Style
health
Latest stories from i100
Have you tried new the Independent Digital Edition apps?
Independent Dating
and  

By clicking 'Search' you
are agreeing to our
Terms of Use.

ES Rentals

    iJobs Job Widget
    iJobs Gadgets & Tech

    Front end web developer - URGENT CONTRACT

    £250 - £300 Per Day: Clearwater People Solutions Ltd: **URGENT CONTRACT** Our...

    SQL Developer - Cardiff - £40,000

    £30000 - £40000 per annum + benefits and bonus: Ashdown Group: SQL Developer -...

    SQL Developer - Cardiff - £40,000

    £30000 - £40000 per annum + benefits and bonus: Ashdown Group: SQL Developer ...

    .NET Developer - .NET & SharePoint - Coventry

    £35000 - £50000 per annum + Benefits + bonus: Ampersand Consulting LLP: .NET a...

    Day In a Page

    How could three tourists have been battered within an inch of their lives by a burglar in a plush London hotel?

    A crime that reveals London's dark heart

    How could three tourists have been battered within an inch of their lives by a burglar in a plush London hotel?
    Meet 'Porridge' and 'Vampire': Chinese state TV is offering advice for citizens picking a Western moniker

    Lost in translation: Western monikers

    Chinese state TV is offering advice for citizens picking a Western moniker. Simon Usborne, who met a 'Porridge' and a 'Vampire' while in China, can see the problem
    Handy hacks that make life easier: New book reveals how to rid your inbox of spam, protect your passwords and amplify your iPhone

    Handy hacks that make life easier

    New book reveals how to rid your email inbox of spam, protect your passwords and amplify your iPhone with a loo-roll
    KidZania lets children try their hands at being a firefighter, doctor or factory worker for the day

    KidZania: It's a small world

    The new 'educational entertainment experience' in London's Shepherd's Bush will allow children to try out the jobs that are usually undertaken by adults, including firefighter, doctor or factory worker
    Renée Zellweger's real crime has been to age in an industry that prizes women's youth over humanity

    'Renée Zellweger's real crime was to age'

    The actress's altered appearance raised eyebrows at Elle's Women in Hollywood awards on Monday
    From Cinderella to The Jungle Book, Disney plans live-action remakes of animated classics

    Disney plans live-action remakes of animated classics

    From Cinderella to The Jungle Book, Patrick Grafton-Green wonders if they can ever recapture the old magic
    Thousands of teenagers to visit battlefields of the First World War in new Government scheme

    Pupils to visit First World War battlefields

    A new Government scheme aims to bring the the horrors of the conflict to life over the next five years
    The 10 best smartphone accessories

    Make the most of your mobile: 10 best smartphone accessories

    Try these add-ons for everything from secret charging to making sure you never lose your keys again
    Mario Balotelli substituted at half-time against Real Madrid: Was this shirt swapping the real reason?

    Liverpool v Real Madrid

    Mario Balotelli substituted at half-time. Was shirt swapping the real reason?
    West Indies tour of India: Hurricane set to sweep Windies into the shadows

    Hurricane set to sweep Windies into the shadows

    Decision to pull out of India tour leaves the WICB fighting for its existence with an off-field storm building
    Indiana serial killer? Man arrested for murdering teenage prostitute confesses to six other murders - and police fear there could be many more

    A new American serial killer?

    Police fear man arrested for murder of teen prostitute could be responsible for killing spree dating back 20 years
    Sweetie, the fake 10-year-old girl designed to catch online predators, claims her first scalp

    Sting to trap paedophiles may not carry weight in UK courts

    Computer image of ‘Sweetie’ represented entrapment, experts say
    Fukushima nuclear crisis: Evacuees still stuck in cramped emergency housing three years on - and may never return home

    Return to Fukushima – a land they will never call home again

    Evacuees still stuck in cramped emergency housing three years on from nuclear disaster
    Wildlife Photographer of the Year: Intimate image of resting lions claims top prize

    Wildlife Photographer of the Year

    Intimate image of resting lions claims top prize
    Online petitions: Sign here to change the world

    Want to change the world? Just sign here

    The proliferation of online petitions allows us to register our protests at the touch of a button. But do they change anything?