Stephen Hawking: 'Transcendence looks at the implications of artificial intelligence - but are we taking AI seriously enough?'

Success in creating AI would be the biggest event in human history. Unfortunately, it might also be the last, unless we learn how to avoid the risks, says a group of leading scientists

With the Hollywood blockbuster Transcendence playing in cinemas, with Johnny Depp and Morgan Freeman showcasing clashing visions for the future of humanity, it's tempting to dismiss the notion of highly intelligent machines as mere science fiction. But this would be a mistake, and potentially our worst mistake in history.

Artificial-intelligence (AI) research is now progressing rapidly. Recent landmarks such as self-driving cars, a computer winning at Jeopardy! and the digital personal assistants Siri, Google Now and Cortana are merely symptoms of an IT arms race fuelled by unprecedented investments and building on an increasingly mature theoretical foundation. Such achievements will probably pale against what the coming decades will bring.

The potential benefits are huge; everything that civilisation has to offer is a product of human intelligence; we cannot predict what we might achieve when this intelligence is magnified by the tools that AI may provide, but the eradication of war, disease, and poverty would be high on anyone's list. Success in creating AI would be the biggest event in human history.

Unfortunately, it might also be the last, unless we learn how to avoid the risks. In the near term, world militaries are considering autonomous-weapon systems that can choose and eliminate targets; the UN and Human Rights Watch have advocated a treaty banning such weapons. In the medium term, as emphasised by Erik Brynjolfsson and Andrew McAfee in The Second Machine Age, AI may transform our economy to bring both great wealth and great dislocation.

Looking further ahead, there are no fundamental limits to what can be achieved: there is no physical law precluding particles from being organised in ways that perform even more advanced computations than the arrangements of particles in human brains. An explosive transition is possible, although it might play out differently from in the movie: as Irving Good realised in 1965, machines with superhuman intelligence could repeatedly improve their design even further, triggering what Vernor Vinge called a "singularity" and Johnny Depp's movie character calls "transcendence".

One can imagine such technology outsmarting financial markets, out-inventing human researchers, out-manipulating human leaders, and developing weapons we cannot even understand. Whereas the short-term impact of AI depends on who controls it, the long-term impact depends on whether it can be controlled at all.

Johnny Depp plays a scientist who is shot by Luddites in 'Transcendence' (Alcon) Johnny Depp plays a scientist who is shot by Luddites in 'Transcendence' (Alcon)

So, facing possible futures of incalculable benefits and risks, the experts are surely doing everything possible to ensure the best outcome, right? Wrong. If a superior alien civilisation sent us a message saying, "We'll arrive in a few decades," would we just reply, "OK, call us when you get here – we'll leave the lights on"? Probably not – but this is more or less what is happening with AI. Although we are facing potentially the best or worst thing to happen to humanity in history, little serious research is devoted to these issues outside non-profit institutes such as the Cambridge Centre for the Study of Existential Risk, the Future of Humanity Institute, the Machine Intelligence Research Institute, and the Future of Life Institute. All of us should ask ourselves what we can do now to improve the chances of reaping the benefits and avoiding the risks.

Stephen Hawking is the director of research at the Department of Applied Mathematics and Theoretical Physics at Cambridge and a 2012 Fundamental Physics Prize laureate for his work on quantum gravity. Stuart Russell is a computer-science professor at the University of California, Berkeley and a co-author of 'Artificial Intelligence: A Modern Approach'. Max Tegmark is a physics professor at the Massachusetts Institute of Technology (MIT) and the author of 'Our Mathematical Universe'. Frank Wilczek is a physics professor at the MIT and a 2004 Nobel laureate for his work on the strong nuclear force.

News
scienceExcitement from alien hunters at 'evidence' of extraterrestrial life
Life and Style
Customers can get their caffeine fix on the move
food + drink
News
newsRyan Crighton goes in search of the capo dei capi
Extras
indybest

PROMOTED VIDEO
Arts and Entertainment
Actors front row from left, Jared Leto, Jennifer Lawrence, Meryl Streep, Ellen DeGeneres, Bradley Cooper, Peter Nyongío Jr., and, second row, from left, Channing Tatum, Julia Roberts, Kevin Spacey, Brad Pitt, Lupita Nyongío and Angelina Jolie as they pose for a
film
Sport
sport
Life and Style
techCould new invention save millions in healthcare bills?
Sport
David Moyes gets soaked
sport Moyes becomes latest manager to take part in the ALS challenge
Voices
A meteor streaks across the sky during the Perseid Meteor Shower at a wind farm near Bogdanci, south of Skopje, Macedonia, in the early hours of 13 August
voicesHagel and Dempsey were pure Hollywood. They only needed Tom Cruise, says Robert Fisk
News
peopleEnglishman managed quintessential Hollywood restaurant Chasen's
Life and Style
food + drinkHarrods launches gourmet food qualification for staff
Arts and Entertainment
Michael Flatley prepares to bid farewell to the West End stage
danceMichael Flatley hits West End for last time alongside Team GB World champion Alice Upcott
News
ebooksAn evocation of the conflict through the eyes of those who lived through it
Life and Style
Horst P Horst mid-fashion shoot in New York, 1949
fashionFar-reaching retrospective to celebrate Horst P Horst's six decades of creativity
News
Members and supporters of the lesbian, gay, bisexual, transgender (LGBT) community walk with a rainbow flag during a rally in July
i100
Life and Style
Black Ivory Coffee is made using beans plucked from elephants' waste after ingested by the animals
food + drinkFirm says it has created the "rarest" coffee in the world
Life and Style
news

As Voltaire once said, “Ice cream is exquisite. What a pity it isn’t illegal”

Life and Style
food + drinkThese simple recipes will have you refreshed within minutes
Independent
Travel Shop
the manor
Up to 70% off luxury travel
on city breaks Find out more
santorini
Up to 70% off luxury travel
on chic beach resorts Find out more
sardina foodie
Up to 70% off luxury travel
on country retreats Find out more
Have you tried new the Independent Digital Edition apps?
Independent Dating
and  

By clicking 'Search' you
are agreeing to our
Terms of Use.

iJobs Job Widget
iJobs General

C#.NET VB6 Developer (Software Developer, Software Engineer)

Negotiable: Harrington Starr: C#.NET VB6 Developer (Software Developer, Softwa...

Service Desk Analyst- Desktop Support, Helpdesk, ITIL

£20000 - £27000 per annum: Harrington Starr: Service Desk Analyst- (Desktop Su...

Service Desk Analyst - (Active Directory, Support, London)

£25000 - £35000 per annum: Harrington Starr: Service Desk Analyst - (Active Di...

Junior Quant Analyst - C++, Boost, Data Mining

£30000 - £50000 per annum: Harrington Starr: Junior Quant Analyst - C++, Boost...

Day In a Page

All this talk of an ‘apocalyptic’ threat is simply childish

Robert Fisk: All this talk of an ‘apocalyptic’ threat is simply childish

Chuck Hagel and Martin Dempsey were pure Hollywood. They only needed Tom Cruise
Mafia Dons: is the Camorra in control of the Granite City?

Mafia Dons: is the Camorra in control of the Granite City?

So claims an EU report which points to the Italian Mob’s alleged grip on everything from public works to property
Emmys look set to overhaul the Oscars as Hollywood’s prize draw

Emmys look set to overhaul the Oscars as Hollywood’s prize draw

Once the poor relation, the awards show now has the top stars and boasts the best drama
What happens to African migrants once they land in Italy during the summer?

What happens to migrants once they land in Italy?

Memphis Barker follows their trail through southern Europe
French connection: After 1,300 years, there’s a bridge to Mont Saint-Michel

French connection: After 1,300 years, there’s a bridge to Mont Saint-Michel

The ugly causeway is being dismantled, an elegant connection erected in its place. So everyone’s happy, right?
Frank Mugisha: Uganda's most outspoken gay rights activist on changing people's attitudes, coming out, and the threat of being attacked

Frank Mugisha: 'Coming out was a gradual process '

Uganda's most outspoken gay rights activist on changing people's attitudes, coming out, and the threat of being attacked
Radio 1 to hire 'YouTube-famous' vloggers to broadcast online

Radio 1’s new top ten

The ‘vloggers’ signed up to find twentysomething audience
David Abraham: Big ideas for the small screen

David Abraham: Big ideas for the small screen

A blistering attack on US influence on British television has lifted the savvy head of Channel 4 out of the shadows
Florence Knight's perfect picnic: Make the most of summer's last Bank Holiday weekend

Florence Knight's perfect picnic

Polpetto's head chef shares her favourite recipes from Iced Earl Grey tea to baked peaches, mascarpone & brown sugar meringues...
Horst P Horst: The fashion photography genius who inspired Madonna comes to the V&A

Horst P Horst comes to the V&A

The London's museum has delved into its archives to stage a far-reaching retrospective celebrating the photographer's six decades of creativity
Mark Hix recipes: Try our chef's summery soups for a real seasonal refresher

Mark Hix's summery soups

Soup isn’t just about comforting broths and steaming hot bowls...
Tim Sherwood column: 'It started as a three-horse race but turned into the Grand National'

Tim Sherwood column

I would have taken the Crystal Palace job if I’d been offered it soon after my interview... but the whole process dragged on so I had to pull out
Eden Hazard: Young, gifted... not yet perfect

Eden Hazard: Young, gifted... not yet perfect

Eden Hazard admits he is still below the level of Ronaldo and Messi but, after a breakthrough season, is ready to thrill Chelsea’s fans
Tim Howard: I’m an old dog. I don’t get too excited

Tim Howard: I’m an old dog. I don’t get too excited

The Everton and US goalkeeper was such a star at the World Cup that the President phoned to congratulate him... not that he knows what the fuss is all about
Match of the Day at 50: Show reminds us that even the most revered BBC institution may have a finite lifespan – thanks to the opposition

Tom Peck on Match of the Day at 50

The show reminds us that even the most revered BBC institution may have a finite lifespan – thanks to the opposition