Voice commands or gesture recognition: how will we control the computers of the future?

The future of computing will be as much about input as it is about processing power, but with so many options on the market can anything supplant the touchscreen, keyboard and mouse?

Computers that augment our vision with new abilities and convincing virtual worlds are commonplace in science fiction, but can they survive on the high street? 

Winning a slice of the consumer tech market is dangerously unpredictable, pitting Kickstarter funded enthusiasts against corporate giants, and the bedroom boffins are winning.  As Microsoft, Nokia, and Hewlett Packard have learned, you can’t assume anything will be a success or rest on your laurels.

Wearable technology is a different kind of user experience from what we’re used to.  There’s no multi-functional touchscreen on smart eyewear, or a mouse and keyboard. That tactile interface between man and machine was instrumental in making home computers succeed by clicking, scrolling, typing and thumbing their way into our daily lives. 

The success of wearable devices rests on filling the functional gap left by the desktop paraphernalia we've come to rely on.  It needs the mouse of the future.  Here’s a quick tour of the main contenders for this small, but pivotal, sidekick role:

“Time of flight” controllers 

Pros: These devices, like the Xbox Kinect and Leap Motion, measure the “flight time” of your hand (or limbs) by firing out light beams and measuring how they bounce back, a bit like radar tracking a plane.  They’re popular because they deliver ‘6 degrees of freedom’ - i.e up/down, left/right, forwards/backwards, roll (turning head over heels), pitch (rolling over sideways) and yaw (spinning like a car skidding) making them versatile enough to match the functionality of a mouse or touchscreen with a wave of your finger. 

Cons: They need to be fixed to a wall or desk xbefore you can use them which is tricky if you’re out and about.

Verdict. A winner for indoor use but not if you’re walking down the street or on a crowded bus.

Current time of flight controllers include the Kinect controller for the Xbox - seen here controlling a neon snake at E3 in 2010.

Voice control

Pros: After sixty years of development, voice recognition has become a default feature of most new computing devices, including (apparently) Google Glass. It eliminates the need for using your hands, which means it replaces the need for mice and keyboards. 

Cons: It’s not a front runner because regional accents and slang still confuse voice systems.  They’re also too slow for playing games and interacting with complex drop-down menus and surfing websites.

Verdict: Limited.  Useless if they’re not programmed for your accent.

Voice control has become fairly common thanks to Apple's Siri (above) and Google's Google Now.

Muscle Control (myoelectrics)

Pros: These devices usually take the form of armbands - like the MYO from Thalmic Labs - measuring the electrical signals our muscles produce.  As you move your arm, the device translates your muscles’ electrical signals into mouse movement.  In theory they do everything a Time of Flight system can, plus they’re truly mobile. 

Cons: Unfortunately, human physical biology wasn’t designed to control computers, as a result, you have to be very precise in the way you move your arm and hand to make them work accurately, which is harder than it sounds.

Verdict: Impressive but difficult to get used to.

The MYO from Thalmic Labs (above) recognises specific gestures to perform actions. In the image above the user is telling his computer to 'play Pantera'.

Smart gloves

Pros: Derived from motion capture technology that has been around since the 1980s, smart gloves are reliable and very accurate, effectively taking commonplace smartphone tech (like accelerometers) and stitching them into gloves to control computer systems. 

Cons: They’re used by rocket scientists and brain surgeons as well as Hollywood studios, but not really suitable for everyday wear and tear.

Verdict: Too specialist to risk losing them or getting them wet, which happens a lot to gloves.

Sci-fi imagined smart gloves as tools to be super productive in a flashy way, but in hospitals surgeons put the technology to far more practical uses.

Electroencephalography (EEG) devices 

Pros: These devices, like the Emotiv headset, monitor your brainwaves and use them to control your computer.  You quite literally think (and even feel) a certain way and your computer responds to the electrical activity this causes in your brain. 

Cons: They’ve had limited successes for people with impaired motion, so in theory everyone could use one, but you have to wear a headset… which is a problem if you’re already wearing another headset.

Verdict: Cool, but impractical.  Harder to use than myoelectrics.

Commercial EEG controllers aren't quite as clunky as this, but without this sort of equipment it's difficult to record finely-differentiated readings.

None of the above?

VR expert Nick Ludlam, Chief Technical Officer at Berg London, is working on control systems for VR games using smartphones.  His view is we’re so used to manipulating these multi-purpose handsets, they are the obvious solution.  Smartphones give us 6 degrees of freedom and can be used as joysticks, pointers, keyboards, game controllers and so on.  Plus (almost) everyone has one.  This explains why Google is already working on Android phone/Google Glass combos to address the same control issues. 

So will we judge wearable technology is on its own merits, or on how useful it makes our phones?  The answer to that question might make the difference between entering a new age of computing… or passing fad for wearing funky goggles.

Thanks to interactive technology experts Alan Rankin and Jonathan Tustain of www.Inition.co.uk for their help compiling this list.

News
The Banksy image in Folkestone before it was vandalised
people
Life and Style
tech

Sales of the tablet are set to fall again, say analysts

Sport
football West Brom vs Man Utd match report: Blind grabs point, but away form a problem for Van Gaal
Arts and Entertainment
Gotham is coming to UK shores this autumn
tvGotham, episode 2, review
PROMOTED VIDEO
Life and Style
ebooksA superb mix of recipes serving up the freshest of local produce in a delicious range of styles
Life and Style
ebooksFrom the lifespan of a slug to the distance to the Sun: answers to 500 questions from readers
News
i100
Arts and Entertainment
Bloom Time: Mira Sorvino
tvMira Sorvino on leaving movie roles for 'The Intruders'
News
Brian Harvey turned up at Downing Street today demanding to speak to the Prime Minister
news

Met Police confirm there was a 'minor disturbance' and that no-one was arrested

Arts and Entertainment
George Lucas poses with a group of Star Wars-inspired Disney characters at Disney's Hollywood Studios in 2010
films

George Lucas criticises the major Hollywood film studios

Voices
Chris Grayling, Justice Secretary: 'There are pressures which we are facing but there is not a crisis'
voices

Does Chris Grayling realise what a vague concept he is dealing with?

Life and Style
A street vendor in Mexico City sells Dorilocos, which are topped with carrot, jimaca, cucumber, peanuts, pork rinds, spices and hot sauce
food + drink

Trend which requires crisps, a fork and a strong stomach is sweeping Mexico's streets

Life and Style
The charity Sands reports that 11 babies are stillborn everyday in the UK
lifeEleven babies are stillborn every day in the UK, yet no one speaks about this silent tragedy
News
Blackpool is expected to become one of the first places to introduce the Government’s controversial new Public Space Protection Orders (PSPOs)
news

Parties threaten resort's image as a family destination

Life and Style
Northern soul mecca the Wigan Casino
fashionGone are the punks, casuals, new romantics, ravers, skaters, crusties. Now all kids look the same
Life and Style
gaming

I Am Bread could actually be a challenging and nuanced title

News
Nigel Farage has backed DJ Mike Read's new Ukip song
i100
Latest stories from i100
Have you tried new the Independent Digital Edition apps?
Independent Dating
and  

By clicking 'Search' you
are agreeing to our
Terms of Use.

ES Rentals

    iJobs Job Widget
    iJobs Gadgets & Tech

    Software Developer

    £35000 - £45000 Per Annum Pensions Scheme After 6 Months: Clearwater People So...

    Systems Analyst / Business Analyst - Central London

    £35000 - £37000 per annum + Benefits: Ashdown Group: Systems Analyst / Busines...

    Senior Change Engineer (Network, Cisco, Juniper) £30k

    £30000 - £35000 per annum + Benefits: Ampersand Consulting LLP: Senior Change ...

    Senior Change Engineer (Windows, Linux, VMWare) - London £35k

    £30000 - £35000 per annum + Benefits: Ampersand Consulting LLP: Senior Change ...

    Day In a Page

    Oscar Pistorius sentencing: The athlete's wealth and notoriety have provoked a long overdue debate on South African prisons

    'They poured water on, then electrified me...'

    If Oscar Pistorius is sent to jail, his experience will not be that of other inmates
    James Wharton: The former Guard now fighting discrimination against gay soldiers

    The former Guard now fighting discrimination against gay soldiers

    Life after the Army has brought new battles for the LGBT activist James Wharton
    Ebola in the US: Panic over the virus threatens to infect President Obama's midterms

    Panic over Ebola threatens to infect the midterms

    Just one person has died, yet November's elections may be affected by what Republicans call 'Obama's Katrina', says Rupert Cornwell
    Premier League coaches join the RSC to swap the tricks of their trades

    Darling, you were fabulous! But offside...

    Premier League coaches are joining the RSC to learn acting skills, and in turn they will teach its actors to play football. Nick Clark finds out why
    How to dress with authority: Kirsty Wark and Camila Batmanghelidjh discuss the changing role of fashion in women's workwear

    How to dress with authority

    Kirsty Wark and Camila Batmanghelidjh discuss the changing role of fashion in women's workwear
    New book on Joy Division's Ian Curtis sheds new light on the life of the late singer

    New book on Ian Curtis sheds fresh light on the life of the late singer

    'Joy Division were making art... Ian was for real' says author Jon Savage
    Sean Harris: A rare interview with British acting's secret weapon

    Sean Harris: A rare interview with British acting's secret weapon

    The Bafta-winner talks Hollywood, being branded a psycho, and how Barbra Streisand is his true inspiration
    Tim Minchin, interview: The musician, comedian and world's favourite ginger is on scorching form

    Tim Minchin interview

    For a no-holds-barred comedian who is scathing about woolly thinking and oppressive religiosity, he is surprisingly gentle in person
    Boris Johnson's boozing won't win the puritan vote

    Boris's boozing won't win the puritan vote

    Many of us Brits still disapprove of conspicuous consumption – it's the way we were raised, says DJ Taylor
    Ash frontman Tim Wheeler reveals how he came to terms with his father's dementia

    Tim Wheeler: Alzheimer's, memories and my dad

    Wheeler's dad suffered from Alzheimer's for three years. When he died, there was only one way the Ash frontman knew how to respond: with a heartfelt solo album
    Hugh Bonneville & Peter James: 'Peter loves his classic cars; I've always pootled along fine with a Mini Metro. I think I lack his panache'

    How We Met: Hugh Bonneville & Peter James

    'Peter loves his classic cars; I've always pootled along fine with a Mini Metro. I think I lack his panache'
    Bill Granger recipes: Our chef's heavenly crab dishes don't need hours of preparation

    Bill Granger's heavenly crab recipes

    Scared off by the strain of shelling a crab? Let a fishmonger do the hard work so you can focus on getting the flavours right
    Radamel Falcao: How faith and love drive the Colombian to glory

    Radamel Falcao: How faith and love drive the Colombian to glory

    After a remarkable conversion from reckless defender to prolific striker, Monaco's ace says he wants to make his loan deal at Old Trafford permanent
    Terry Venables: Premier League managers must not be allowed to dictate who plays and who does not play for England

    Terry Venables column

    Premier League managers must not be allowed to dictate who plays and who does not play for England
    The Inside Word: Brendan Rodgers looks to the future while Roy Hodgson is ghost of seasons past

    Michael Calvin's Inside Word

    Brendan Rodgers looks to the future while Roy Hodgson is ghost of seasons past