Can artificial intelligence become addicted?

When provided with a pleasure lever would an AI player become a ‘super-junkie’, forgetting its main purpose altogether? Thomas Moynihan and Anders Sandberg report

Sunday 24 October 2021 00:35
Comments
<p>Wireheading is when a being is so bent on maximising its reward that it sets aside other concerns</p>

Wireheading is when a being is so bent on maximising its reward that it sets aside other concerns

In 1953, a Harvard psychologist thought he discovered pleasure – accidentally – within the cranium of a rat. With an electrode inserted into a specific area of its brain, the rat was allowed to pulse the implant by pulling a lever. It kept returning for more: insatiably, incessantly, lever-pulling. In fact, the rat didn’t seem to want to do anything else. Seemingly, the reward centre of the brain had been located.

More than 60 years later, in 2016, a pair of artificial intelligence (AI) researchers were training an AI to play video games. The goal of one game – Coastrunner – was to complete a racetrack. But the AI player was rewarded for picking up collectable items along the track. When the program was run, they witnessed something strange. The AI found a way to skid in an unending circle, picking up an unlimited cycle of collectables. It did this, incessantly, instead of completing the course.

What links these seemingly unconnected events is something strangely akin to addiction in humans. Some AI researchers call the phenomenon “wireheading”.

Join our new commenting forum

Join thought-provoking conversations, follow other Independent readers and see their replies

Comments

Thank you for registering

Please refresh the page or navigate to another page on the site to be automatically logged in