On your wavelength

Don't thump your PC when it crashes, just frown at it. In the future, says HESTER LACEY, your computer will tune into your mood

Most people's interaction with their computer is pretty one-way. It crashes; they shout. The computer remains stoically unmoved by irritation, anger or out-and-out rage, even if it actually gets thumped pretty hard. But that could be set to change.

Researchers are working on the computer of the future: one that will recognise how its human operator is feeling, and react appropriately. Rosalind Picard is associate professor of media, arts and sciences at Media Lab, part of the Massachusetts Institute of Technology, and the team she works with are pioneers in the field of "affective" computing.

Prof Picard - whose array of space age gadgets rival her namesake's, Captain Jean-Luc on Star Trek - is working on computers that can recognise their operators' voice patterns, facial expressions and other physical manifestations of anger, frustration or happiness. "If the computer can see if what it has done annoys you or makes you happy, it can change what it does," she explains. "For example, if there was a particular feature that always popped up on your screen and your reaction was `Grrr, this feature is driving me crazy', the computer could then either offer to turn it off for you or show you how to turn it off yourself."

This self-customising would save a lot of aggravation for the user. But the difficulty is that the subtlety and range of human expression are not easy for a mere machine to decipher. Remember the bit in Star Wars where Luke, Leia, Han and Chewie are stuck in the Death Star's garbage compactor, which is slowly crushing them? C3PO is frantically trying to de-activate the mechanism, all the while hearing a cacophony of yells from inside the compactor. The despairing droid curses his slowness, thinking his friends are being squished to death, when in fact they are shouting with joy. This, says Professor Picard, is a clear case of life mirroring art.

While computers are very good at telling the difference between excited and calm, they are not very good at the difference between excited-happy and excited-angry-or-upset. "They confuse a shriek of joy and a shriek of terror," she explains.

As for facial expressions, the hardest part for the poor machine is finding the person's face and following it about. "The camera is fixed to the computer and it just isn't that fast at grabbing images," says Prof Picard. "With current technology, if you hold still and don't change the lighting, a computer can recognise the difference between a smile and a frown." It might well think you are smiling when in fact you are scratching your nose, or frowning when you are fiddling with your ear, but if you really want to confuse it, try having lunch at your desk, or chatting to a colleague. The smile/frown recognition is based on the computer spotting various bits of your face moving up or down and the movements involved in chomping a tuna wrap or gossiping animatedly will throw it completely.

As well as voices and faces, there are other possibilities. "We're building a lot of crazy gizmos to see which people will prefer," says Professor Picard. "We interviewed a number of people using frustrating software and some preferred an on-screen dialogue box, while others wanted a mouse they could pound on, or something they could squeeze, hit or throw to let the computer know when they were irritated." As well as relieving the operator's feelings, this technology could also be used to let software designers know about glitches in their programs. "The computer probably isn't smart enough to fix itself," says Professor Picard. "But it can gather information to pass on to the programmer."

It's also possible that computers will be able to work out how their humans are feeling using sensors that check levels of arousal by measuring physical symptoms like skin conductivity or muscle tension. IBM is working on a mouse that incorporates sensors that measure heart rate, temperature, skin conductivity and clicking pressure. Media Lab is currently testing a portable CD player, which can sense skin conductivity - a good indicator of agitation levels. "You can choose your own music, or the player can select randomly - or it can pick things in accordance with your mood parameters," explains Professor Picard. "You can instruct it to go for rousing mode and it will play peppy music until it senses that you are aroused to a certain level, or if you want it could pick music to calm you down."

While computers could use similar technology to gauge their operators' stress levels, she does not advocate them ever using jolly tunes to try to soothe these frazzled users. "We have to think carefully. We don't want the computer to manipulate the mood. If your computer just played happy music it would drive you nuts," she rightly observes. "I don't mind the computer making suggestions. The idea is to think of what you would expect an intelligent friend or co-worker to do and see if you can get the computer to do it."

A sympathetic pat on the shoulder and a hot cup of tea with a chocolate biscuit are, sadly, out of the question, however empathetic your electronic companion might be. And it's unlikely that a computer that cares will be installed on a desk near you in the very near future. All these projects are still at the research stages. "Some things will be there in the next few years, others will take decades," says Prof Picard. And, she says, there is no need to fear a computer with an agenda of its own. "HAL, the computer in 2001: A Space Odyssey, seemed to have emotions and express them, and that was kind of dangerous."

HAL, however, is nothing to be scared of - even the most sophisticated of computers can't think. "Computers can seem to have emotions, but they can communicate without understanding," says Prof Picard. "After all, the Mac has been smiling when you boot it up since 1984, without ever feeling happy! Even if a computer can recognise the external manifestations of your emotions, it can't see the thoughts behind them. Computers can't get into your mind."

`Affective Computing' by Professor Rosalind Picard, Massachusetts Institute of Technology Press, $29.

Have you tried new the Independent Digital Edition apps?
ebookA delicious collection of 50 meaty main courses
Life and Style
ebookNow available in paperback
Arts and Entertainment
Billie Piper as Brona in Penny Dreadful
tvReview: It’s business as usual in Victorian London. Let’s hope that changes as we get further into the new series spoiler alert
Life and Style
A nurse tends to a recovering patient on a general ward at The Queen Elizabeth Hospital in Birmingham
Arts and Entertainment
No Offence
tvReview: No Offence has characters who are larger than life and yet somehow completely true to life at the same time spoiler alert
Chuck Norris pictured in 1996
Arts and Entertainment
Sarah Lucas, I SCREAM DADDIO, Installation View, British Pavilion 2015
artWhy Sarah Lucas is the perfect choice to represent British art at the Venice Biennale
A voter placing a ballot paper in the box at a polling station
Arts and Entertainment
The Queen (Kristin Scott Thomas) in The Audience
theatreReview: Stephen Daldry's direction is crisp in perfectly-timed revival
  • Get to the point
Latest stories from i100
Have you tried new the Independent Digital Edition apps?
Independent Dating

By clicking 'Search' you
are agreeing to our
Terms of Use.

ES Rentals

    iJobs Job Widget
    iJobs General

    SThree: Trainee Recruitment Consultant - Dublin

    £13676.46 - £16411.61 per annum + OTE: SThree: SThree Trainee Recruitment Cons...

    Ashdown Group: Marketing or Business Graduate Opportunity - Norwich - £22,000

    £18000 - £22000 per annum + training: Ashdown Group: Business and Marketing Gr...

    SThree: Trainee Recruitment Consultant

    £20000 - £25000 per annum + Commission: SThree: Are you great at building rela...

    Ashdown Group: Database Analyst - Birmingham - £22,000 plus benefits

    £20000 - £22000 per annum + excellent benefits: Ashdown Group: Application Sup...

    Day In a Page

    General Election 2015: Ed Miliband's unlikely journey from hapless geek to heart-throb

    Miliband's unlikely journey from hapless geek to heart-throb

    He was meant to be Labour's biggest handicap - but has become almost an asset
    General Election 2015: A guide to the smaller parties, from the the National Health Action Party to the Church of the Militant Elvis Party

    On the margins

    From Militant Elvis to Women's Equality: a guide to the underdogs standing in the election
    Amr Darrag: Ex-Muslim Brotherhood minister in exile still believes Egypt's military regime can be replaced with 'moderate' Islamic rule

    'This is the battle of young Egypt for the future of our country'

    Ex-Muslim Brotherhood minister Amr Darrag still believes the opposition can rid Egypt of its military regime and replace it with 'moderate' Islamic rule, he tells Robert Fisk
    Why patients must rely less on doctors: Improving our own health is the 'blockbuster drug of the century'

    Why patients must rely less on doctors

    Improving our own health is the 'blockbuster drug of the century'
    Sarah Lucas is the perfect artist to represent Britain at the Venice Biennale

    Flesh in Venice

    Sarah Lucas has filled the British pavilion at the Venice Biennale with slinky cats and casts of her female friends' private parts. It makes you proud to be a woman, says Karen Wright
    11 best anti-ageing day creams

    11 best anti-ageing day creams

    Slow down the ageing process with one of these high-performance, hardworking anti-agers
    Juventus 2 Real Madrid 1: Five things we learnt, including Iker Casillas is past it and Carlos Tevez remains effective

    Juventus vs Real Madrid

    Five things we learnt from the Italian's Champions League first leg win over the Spanish giants
    Ashes 2015: Test series looks a lost cause for England... whoever takes over as ECB director of cricket

    Ashes series looks a lost cause for England...

    Whoever takes over as ECB director of cricket, says Stephen Brenkley
    Fishing for votes with Nigel Farage: The Ukip leader shows how he can work an audience as he casts his line to the disaffected of Grimsby

    Fishing is on Nigel Farage's mind

    Ukip leader casts a line to the disaffected
    Who is bombing whom in the Middle East? It's amazing they don't all hit each other

    Who is bombing whom in the Middle East?

    Robert Fisk untangles the countries and factions
    China's influence on fashion: At the top of the game both creatively and commercially

    China's influence on fashion

    At the top of the game both creatively and commercially
    Lord O’Donnell: Former cabinet secretary on the election and life away from the levers of power

    The man known as GOD has a reputation for getting the job done

    Lord O'Donnell's three principles of rule
    Rainbow shades: It's all bright on the night

    Rainbow shades

    It's all bright on the night
    'It was first time I had ever tasted chocolate. I kept a piece, and when Amsterdam was liberated, I gave it to the first Allied soldier I saw'

    Bread from heaven

    Dutch survivors thank RAF for World War II drop that saved millions
    Britain will be 'run for the wealthy and powerful' if Tories retain power - Labour

    How 'the Axe' helped Labour

    UK will be 'run for the wealthy and powerful' if Tories retain power