Robots must learn to value humans or 'they could kill us out of kindness'
A leading futurist claims super-intelligent robots could decide destroying the human race is the kindest thing to do
Heather Saul is a digital reporter for The Independent, currently working on the People desk. She has written news and features across a number of topics, paying particular attention to the activities of Isis and events in Iraq, Syria, Iran and Saudi Arabia.
Saturday 23 August 2014
Robots should be taught to appreciate human value to ensure they do not one day “kill us out of kindness”, a leading futurist has warned.
Nell Watson told The Conference in Malmo, Sweden, that robots will soon reach the stage where they have the same level of cognition as a bumblebee, creatures which are both socially aware and can navigate their way around their environment.
This advancement in artificial intelligence will be the first example of machines exhibiting ‘system one’ thinking used by humans to develop assumptions about the world around them.
Robots currently use 'system two' intelligence systems which rely on rules, according to Wired.
Ms Watson said the emergence of system one robots will create “huge change” in society globally. House-holds will have domestic-help robots and self-driving cars, while professions such as stockbroking, law and medical analysis will be undertaken by robots, not humans.
However, Ms Watson expressed concerns over super-intelligent robots. "I can't help but look at these trends and imagine how then shall we live?” she said. “When we start to see super-intelligent artificial intelligences are they going to be friendly or unfriendly?"
It would not be enough to teach robots benevolence, as they may decide destroying the human race is the kindest thing they could do.
"The most important work of our lifetime is to ensure that machines are capable of understanding human value," said Ms Watson. "It is those values that will ensure machines don't end up killing us out of kindness."
A nearly completed RoboThespian robot inside the Engineered Arts workshop is tested Her words of caution come after Stephen Hawking warned that while the rapid progress in artificial-intelligence (AI) research could be best thing that happened to humanity, it could also be the worst.
Writing in The Independent, he said that while it's tempting to dismiss the notion of highly intelligent machines as science fiction, "this would be a mistake, and potentially our worst mistake in history".
The development of robots also sparked concerns earlier this year when Human Rights Watch warned 'killer robots' could “jeopardise basic human rights” as the United Nations held its first ever multinational convention on lethal autonomous weapons systems.
So-called killer robots are autonomous machines able to identify and kill targets without human input. Fully autonomous weapons have not yet been developed but technological advances are bringing them closer to fruition.
Life & Style blogs
The difference between a psychopath and a sociopath
From criminal to catwalk: Convict Jeremy Meeks wins modelling contract in the most unusual fashion scouting – behind bars
Prostate cancer could actually be five different diseases, say scientists
NHS treatments such as vasectomies and hip operations to be rationed because of cost-cutting
What do the emojis on Snapchat mean?
Yvette Cooper: Our choice is years of Tory rule under Jeremy Corbyn – or a return to a Labour government
Labour leadership contender Jeremy Corbyn says 'we can learn a great deal from Karl Marx'
I am the Jeremy Corbyn supporter that many will tell you doesn't exist
Public anger after French sunbather beaten up by gang for wearing a bikini in Reims park
Labour leadership: New poll shows party is now even 'less electable' than under Ed Miliband
Labour leadership contest: I would never quit the party, says Liz Kendall
- 1 Australia to impose 24-hour curfew on all cats to protect endangered species
- 2 Model's video shoot on the beach interrupted by sudden landing of a group of illegal migrants
- 3 The difference between a psychopath and a sociopath
- 4 MH370: Boeing 777 wing that could match missing plane found on the French island of Reunion
- 5 'Killer robots' with AI must be banned, urge Stephen Hawking, Noam Chomsky and thousands of others in open letter
iJobs Gadgets & Tech
£21000 - £28000 per annum: Recruitment Genius: This is an exciting opportunity...
£26000 - £35000 per annum: Recruitment Genius: A Systems Administrator is requ...
£70000 - £90000 per annum: Ampersand Consulting LLP: Sitecore Developer / Soft...
£34000 - £36000 per annum + benefits: Ashdown Group: Analytics & Reporting Tea...