Voice commands or gesture recognition: how will we control the computers of the future?

The future of computing will be as much about input as it is about processing power, but with so many options on the market can anything supplant the touchscreen, keyboard and mouse?

Computers that augment our vision with new abilities and convincing virtual worlds are commonplace in science fiction, but can they survive on the high street? 

Winning a slice of the consumer tech market is dangerously unpredictable, pitting Kickstarter funded enthusiasts against corporate giants, and the bedroom boffins are winning.  As Microsoft, Nokia, and Hewlett Packard have learned, you can’t assume anything will be a success or rest on your laurels.

Wearable technology is a different kind of user experience from what we’re used to.  There’s no multi-functional touchscreen on smart eyewear, or a mouse and keyboard. That tactile interface between man and machine was instrumental in making home computers succeed by clicking, scrolling, typing and thumbing their way into our daily lives. 

The success of wearable devices rests on filling the functional gap left by the desktop paraphernalia we've come to rely on.  It needs the mouse of the future.  Here’s a quick tour of the main contenders for this small, but pivotal, sidekick role:

“Time of flight” controllers 

Pros: These devices, like the Xbox Kinect and Leap Motion, measure the “flight time” of your hand (or limbs) by firing out light beams and measuring how they bounce back, a bit like radar tracking a plane.  They’re popular because they deliver ‘6 degrees of freedom’ - i.e up/down, left/right, forwards/backwards, roll (turning head over heels), pitch (rolling over sideways) and yaw (spinning like a car skidding) making them versatile enough to match the functionality of a mouse or touchscreen with a wave of your finger. 

Cons: They need to be fixed to a wall or desk xbefore you can use them which is tricky if you’re out and about.

Verdict. A winner for indoor use but not if you’re walking down the street or on a crowded bus.

Current time of flight controllers include the Kinect controller for the Xbox - seen here controlling a neon snake at E3 in 2010.

Voice control

Pros: After sixty years of development, voice recognition has become a default feature of most new computing devices, including (apparently) Google Glass. It eliminates the need for using your hands, which means it replaces the need for mice and keyboards. 

Cons: It’s not a front runner because regional accents and slang still confuse voice systems.  They’re also too slow for playing games and interacting with complex drop-down menus and surfing websites.

Verdict: Limited.  Useless if they’re not programmed for your accent.

Voice control has become fairly common thanks to Apple's Siri (above) and Google's Google Now.

Muscle Control (myoelectrics)

Pros: These devices usually take the form of armbands - like the MYO from Thalmic Labs - measuring the electrical signals our muscles produce.  As you move your arm, the device translates your muscles’ electrical signals into mouse movement.  In theory they do everything a Time of Flight system can, plus they’re truly mobile. 

Cons: Unfortunately, human physical biology wasn’t designed to control computers, as a result, you have to be very precise in the way you move your arm and hand to make them work accurately, which is harder than it sounds.

Verdict: Impressive but difficult to get used to.

The MYO from Thalmic Labs (above) recognises specific gestures to perform actions. In the image above the user is telling his computer to 'play Pantera'.

Smart gloves

Pros: Derived from motion capture technology that has been around since the 1980s, smart gloves are reliable and very accurate, effectively taking commonplace smartphone tech (like accelerometers) and stitching them into gloves to control computer systems. 

Cons: They’re used by rocket scientists and brain surgeons as well as Hollywood studios, but not really suitable for everyday wear and tear.

Verdict: Too specialist to risk losing them or getting them wet, which happens a lot to gloves.

Sci-fi imagined smart gloves as tools to be super productive in a flashy way, but in hospitals surgeons put the technology to far more practical uses.

Electroencephalography (EEG) devices 

Pros: These devices, like the Emotiv headset, monitor your brainwaves and use them to control your computer.  You quite literally think (and even feel) a certain way and your computer responds to the electrical activity this causes in your brain. 

Cons: They’ve had limited successes for people with impaired motion, so in theory everyone could use one, but you have to wear a headset… which is a problem if you’re already wearing another headset.

Verdict: Cool, but impractical.  Harder to use than myoelectrics.

Commercial EEG controllers aren't quite as clunky as this, but without this sort of equipment it's difficult to record finely-differentiated readings.

None of the above?

VR expert Nick Ludlam, Chief Technical Officer at Berg London, is working on control systems for VR games using smartphones.  His view is we’re so used to manipulating these multi-purpose handsets, they are the obvious solution.  Smartphones give us 6 degrees of freedom and can be used as joysticks, pointers, keyboards, game controllers and so on.  Plus (almost) everyone has one.  This explains why Google is already working on Android phone/Google Glass combos to address the same control issues. 

So will we judge wearable technology is on its own merits, or on how useful it makes our phones?  The answer to that question might make the difference between entering a new age of computing… or passing fad for wearing funky goggles.

Thanks to interactive technology experts Alan Rankin and Jonathan Tustain of www.Inition.co.uk for their help compiling this list.

Life and Style
ebookNow available in paperback
ebooks
ebookA delicious collection of 50 meaty main courses
Latest stories from i100
Have you tried new the Independent Digital Edition apps?
SPONSORED FEATURES
Independent Dating
and  

By clicking 'Search' you
are agreeing to our
Terms of Use.

ES Rentals

    iJobs Job Widget
    iJobs Gadgets & Tech

    Recruitment Genius: IT Sales Consultant

    £35000 - £40000 per annum: Recruitment Genius: This IT support company has a n...

    Recruitment Genius: Senior IT Project Manager

    £55000 - £70000 per annum: Recruitment Genius: This is a fantastic opportunity...

    Recruitment Genius: iOS Developer - Objective-C

    £38000 - £45000 per annum: Recruitment Genius: Design and build advanced appli...

    SThree: Trainee Recruitment Consultant

    £18000 - £23000 per annum + Uncapped Commission: SThree: As a Trainee Recruitm...

    Day In a Page

    Isis profits from destruction of antiquities by selling relics to dealers - and then blowing up the buildings they come from to conceal the evidence of looting

    How Isis profits from destruction of antiquities

    Robert Fisk on the terrorist group's manipulation of the market to increase the price of artefacts
    Labour leadership: Andy Burnham urges Jeremy Corbyn voters to think again in last-minute plea

    'If we lose touch we’ll end up with two decades of the Tories'

    In an exclusive interview, Andy Burnham urges Jeremy Corbyn voters to think again in last-minute plea
    Tunisia fears its Arab Spring could be reversed as the new regime becomes as intolerant of dissent as its predecessor

    The Arab Spring reversed

    Tunisian protesters fear that a new law will whitewash corrupt businessmen and officials, but they are finding that the new regime is becoming as intolerant of dissent as its predecessor
    King Arthur: Legendary figure was real and lived most of his life in Strathclyde, academic claims

    Academic claims King Arthur was real - and reveals where he lived

    Dr Andrew Breeze says the legendary figure did exist – but was a general, not a king
    Who is Oliver Bonas and how has he captured middle-class hearts?

    Who is Oliver Bonas?

    It's the first high-street store to pay its staff the living wage, and it saw out the recession in style
    Earth has 'lost more than half its trees' since humans first started cutting them down

    Axe-wielding Man fells half the world’s trees – leaving us just 422 each

    However, the number of trees may be eight times higher than previously thought
    60 years of Scalextric: Model cars are now stuffed with as much tech as real ones

    60 years of Scalextric

    Model cars are now stuffed with as much tech as real ones
    Theme parks continue to draw in thrill-seekers despite the risks - so why are we so addicted?

    Why are we addicted to theme parks?

    Now that Banksy has unveiled his own dystopian version, Christopher Beanland considers the ups and downs of our endless quest for amusement
    Tourism in Iran: The country will soon be opening up again after years of isolation

    Iran is opening up again to tourists

    After years of isolation, Iran is reopening its embassies abroad. Soon, there'll be the chance for the adventurous to holiday there
    10 best PS4 games

    10 best PS4 games

    Can’t wait for the new round of blockbusters due out this autumn? We played through last year’s offering
    Transfer window: Ten things we learnt

    Ten things we learnt from the transfer window

    Record-breaking spending shows FFP restraint no longer applies
    Migrant crisis: UN official Philippe Douste-Blazy reveals the harrowing sights he encountered among refugees arriving on Lampedusa

    ‘Can we really just turn away?’

    Dead bodies, men drowning, women miscarrying – a senior UN figure on the horrors he has witnessed among migrants arriving on Lampedusa, and urges politicians not to underestimate our caring nature
    Nine of Syria and Iraq's 10 world heritage sites are in danger as Isis ravages centuries of history

    Nine of Syria and Iraq's 10 world heritage sites are in danger...

    ... and not just because of Isis vandalism
    Girl on a Plane: An exclusive extract of the novelisation inspired by the 1970 Palestinian fighters hijack

    Girl on a Plane

    An exclusive extract of the novelisation inspired by the 1970 Palestinian fighters hijack
    Why Frederick Forsyth's spying days could spell disaster for today's journalists

    Why Frederick Forsyth's spying days could spell disaster for today's journalists

    The author of 'The Day of the Jackal' has revealed he spied for MI6 while a foreign correspondent