Stephen Hawking: 'Transcendence looks at the implications of artificial intelligence - but are we taking AI seriously enough?'

Success in creating AI would be the biggest event in human history. Unfortunately, it might also be the last, unless we learn how to avoid the risks, says a group of leading scientists

With the Hollywood blockbuster Transcendence playing in cinemas, with Johnny Depp and Morgan Freeman showcasing clashing visions for the future of humanity, it's tempting to dismiss the notion of highly intelligent machines as mere science fiction. But this would be a mistake, and potentially our worst mistake in history.

Artificial-intelligence (AI) research is now progressing rapidly. Recent landmarks such as self-driving cars, a computer winning at Jeopardy! and the digital personal assistants Siri, Google Now and Cortana are merely symptoms of an IT arms race fuelled by unprecedented investments and building on an increasingly mature theoretical foundation. Such achievements will probably pale against what the coming decades will bring.

The potential benefits are huge; everything that civilisation has to offer is a product of human intelligence; we cannot predict what we might achieve when this intelligence is magnified by the tools that AI may provide, but the eradication of war, disease, and poverty would be high on anyone's list. Success in creating AI would be the biggest event in human history.

Unfortunately, it might also be the last, unless we learn how to avoid the risks. In the near term, world militaries are considering autonomous-weapon systems that can choose and eliminate targets; the UN and Human Rights Watch have advocated a treaty banning such weapons. In the medium term, as emphasised by Erik Brynjolfsson and Andrew McAfee in The Second Machine Age, AI may transform our economy to bring both great wealth and great dislocation.

Looking further ahead, there are no fundamental limits to what can be achieved: there is no physical law precluding particles from being organised in ways that perform even more advanced computations than the arrangements of particles in human brains. An explosive transition is possible, although it might play out differently from in the movie: as Irving Good realised in 1965, machines with superhuman intelligence could repeatedly improve their design even further, triggering what Vernor Vinge called a "singularity" and Johnny Depp's movie character calls "transcendence".

One can imagine such technology outsmarting financial markets, out-inventing human researchers, out-manipulating human leaders, and developing weapons we cannot even understand. Whereas the short-term impact of AI depends on who controls it, the long-term impact depends on whether it can be controlled at all.

Johnny Depp plays a scientist who is shot by Luddites in 'Transcendence' (Alcon) Johnny Depp plays a scientist who is shot by Luddites in 'Transcendence' (Alcon)

So, facing possible futures of incalculable benefits and risks, the experts are surely doing everything possible to ensure the best outcome, right? Wrong. If a superior alien civilisation sent us a message saying, "We'll arrive in a few decades," would we just reply, "OK, call us when you get here – we'll leave the lights on"? Probably not – but this is more or less what is happening with AI. Although we are facing potentially the best or worst thing to happen to humanity in history, little serious research is devoted to these issues outside non-profit institutes such as the Cambridge Centre for the Study of Existential Risk, the Future of Humanity Institute, the Machine Intelligence Research Institute, and the Future of Life Institute. All of us should ask ourselves what we can do now to improve the chances of reaping the benefits and avoiding the risks.

Stephen Hawking is the director of research at the Department of Applied Mathematics and Theoretical Physics at Cambridge and a 2012 Fundamental Physics Prize laureate for his work on quantum gravity. Stuart Russell is a computer-science professor at the University of California, Berkeley and a co-author of 'Artificial Intelligence: A Modern Approach'. Max Tegmark is a physics professor at the Massachusetts Institute of Technology (MIT) and the author of 'Our Mathematical Universe'. Frank Wilczek is a physics professor at the MIT and a 2004 Nobel laureate for his work on the strong nuclear force.

News
people
Sport
FootballGerman sparks three goals in four minutes at favourite No 10 role
News
Rumer was diagnosed with bipolarity, attention deficit hyperactivity disorder and post-traumatic stress disorder: 'I was convinced it was a misdiagnosis'
peopleHer debut album caused her post-traumatic stress - how will she cope as she releases her third record?
Sport
A long jumper competes in the 80-to-84-year-old age division at the 2007 World Masters Championships
athletics
PROMOTED VIDEO
Sport
Radamel Falcao was forced to withdraw from the World Cup after undergoing surgery
premier leagueExclusive: Reds have agreement with Monaco
Arts and Entertainment
'New Tricks' star Dennis Waterman is departing from the show after he completes filming on two more episodes
tvHe is only remaining member of original cast
Life and Style
Walking tall: unlike some, Donatella Versace showed a strong and vibrant collection
fashionAlexander Fury on the staid Italian clothing industry
Arts and Entertainment
Gregory Porter learnt about his father’s voice at his funeral
music
News
ebooksAn unforgettable anthology of contemporary reportage
Arts and Entertainment
tvHighs and lows of the cast's careers since 2004
Life and Style
Children at the Leytonstone branch of the Homeless Children's Aid and Adoption Society tuck into their harvest festival gifts, in October 1936
food + drinkThe harvest festival is back, but forget cans of tuna and packets of instant mash
Sport
Lewis Hamilton will start the Singapore Grand Prix from pole, with Nico Rosberg second and Daniel Ricciardo third
F1... for floodlit Singapore Grand Prix
New Articles
i100
Life and Style
Couples have been having sex less in 2014, according to a new survey
life
Latest stories from i100
Have you tried new the Independent Digital Edition apps?
Independent Dating
and  

By clicking 'Search' you
are agreeing to our
Terms of Use.

iJobs Job Widget
iJobs General

Volunteer Trustee opportunities now available at The Society for Experimental Biology

Unpaid Voluntary Position : Reach Volunteering: Volunteer your expertise as Tr...

Early Years Educator

£68 - £73 per day + Competitive rates of pay based on experience: Randstad Edu...

Nursery Nurse

£69 - £73 per day + Competitive London rates of pay: Randstad Education Group:...

Primary KS1 NQTs required in Lambeth

£117 - £157 per day + Competitive London rates: Randstad Education Group: * Pr...

Day In a Page

Scottish referendum: The Yes vote was the love that dared speak its name, but it was not to be

Despite the result, this is the end of the status quo

Boyd Tonkin on the fall-out from the Scottish referendum
Manolo Blahnik: The high priest of heels talks flats, Englishness, and why he loves Mary Beard

Manolo Blahnik: Flats, Englishness, and Mary Beard

The shoe designer who has been dubbed 'the patron saint of the stiletto'
The Beatles biographer reveals exclusive original manuscripts of some of the best pop songs ever written

Scrambled eggs and LSD

Behind The Beatles' lyrics - thanks to Hunter Davis's original manuscript copies
'Normcore' fashion: Blending in is the new standing out in latest catwalk non-trend

'Normcore': Blending in is the new standing out

Just when fashion was in grave danger of running out of trends, it only went and invented the non-trend. Rebecca Gonsalves investigates
Dance’s new leading ladies fight back: How female vocalists are now writing their own hits

New leading ladies of dance fight back

How female vocalists are now writing their own hits
Mystery of the Ground Zero wedding photo

A shot in the dark

Mystery of the wedding photo from Ground Zero
His life, the universe and everything

His life, the universe and everything

New biography sheds light on comic genius of Douglas Adams
Save us from small screen superheroes

Save us from small screen superheroes

Shows like Agents of S.H.I.E.L.D are little more than marketing tools
Reach for the skies

Reach for the skies

From pools to football pitches, rooftop living is looking up
These are the 12 best hotel spas in the UK

12 best hotel spas in the UK

Some hotels go all out on facilities; others stand out for the sheer quality of treatments
These Iranian-controlled Shia militias used to specialise in killing American soldiers. Now they are fighting Isis, backed up by US airstrikes

Widespread fear of Isis is producing strange bedfellows

Iranian-controlled Shia militias that used to kill American soldiers are now fighting Isis, helped by US airstrikes
Topshop goes part Athena poster, part last spring Prada

Topshop goes part Athena poster, part last spring Prada

Shoppers don't come to Topshop for the unique
How to make a Lego masterpiece

How to make a Lego masterpiece

Toy breaks out of the nursery and heads for the gallery
Meet the ‘Endies’ – city dwellers who are too poor to have fun

Meet the ‘Endies’ – city dwellers who are too poor to have fun

Urbanites are cursed with an acronym pointing to Employed but No Disposable Income or Savings
Paisley’s decision to make peace with IRA enemies might remind the Arabs of Sadat

Ian Paisley’s decision to make peace with his IRA enemies

His Save Ulster from Sodomy campaign would surely have been supported by many a Sunni imam