Why touch screens push our buttons

Thought flicking through data with your fingertips was the last word in hi-tech? Just wait until you see what's coming next in the digit revolution, says Simon Usborne

Archaeologists in some post-apocalyptic future sifting through the remains of the 21st century may spot a puzzling disappearance of the pieces of plastic that had hitherto defined the Computer Age. "Where," they might inquire, "did all the buttons go?" A period of head-scratching might lead them to identify the explosion of the touch screen.



Touch has transformed our mobiles in the past two years, but recent months have seen the spread of button-free screens into just about every corner of gadget land. Last month, Sony launched a touch edition of its eBook Reader, allowing users to turn pages with a swipe of the screen. In the same week, LG unveiled a Dick Tracy-inspired watchphone (with a touch screen, naturally) and the past few days have seen the announcement of everything from new touch screen media players to a touch-controlled printer.



But what may be the biggest milestone in the history of touch comes next month with the launch of Windows 7. The latest edition of Microsoft's ubiquitous operating system will be fully touch-enabled – you'll be able rotate photos by, well, rotating them, and scroll by stroking a finger across a screen. Not surprisingly, manufacturers are racing to launch laptops, desktop computers and tablets with compatible screens.



So if we are about to plunge into a new era of computer interaction, what does it mean? For sure we'll see a new wave of smug gadgeteers pinching and caressing their devices in front of not-always-impressed friends. But more significantly, the touch screen's keenest advocates say the interface spells the demise of the keyboard and mouse. Others believe the spread of touch has a deeper significance.



"This is a dramatic evolution in how we interact with technology," says Chris Harrison, who is part of the Human-Computer Interaction Institute at America's Carnegie Mellon University. "We have grown used to intermediate devices that martial our input into computers – they allow us to talk to them. Touch is moving us to direct manipulation. That's a big change."



But in technology as in nature, evolution doesn't happen in a year, or even a decade. Touch screen show-offs would be forgiven for thinking their new toys are cutting-edge. But the act of controlling computers by means of fingers and a screen is nothing new. Bill Buxton is a principal researcher at Microsoft and has been working with touch screens for more than 25 years.



"The first multitouch screen I saw was in 1985," Buxton says. "Guys were using mini-computers the size of two fridges to explore the ways people could interact with computers." It was at around the same time that Buxton developed his own touch screen – something that wouldn't look out of place on one of today's devices. "I was trying to make a digital drum that I could hit with one hand while changing the tone with the other hand," he says.



The first touch screens predate even Buxton's work. During the Sixties a team at the University of Illinois developed a computerised educational tool called Plato. The fourth version, launched in schools in 1972, incorporated a plasma touch screen that used infra-red sensors around its periphery to sense the position of a finger. Children could navigate educational software, touching the answers to questions.



There were also rare examples of consumer touch screens that pre-date the iPhone by almost 30 years. "I have a Casio watch that I bought in 1984," Buxton says. "It allows me to use my finger to operate a calculator. I was able to trace '1 + 1 =' on the screen and it would say '2'. That's how long this stuff has been available."



Buxton applies what he calls the "long nose theory" to the evolution of technology. He cites the mouse as a prime example. "It was invented in 1965, I first used one in 1971, but it wasn't until the launch of Windows 95, some 30 years after its invention, that the mouse became ubiquitous."



If 2009 is to the touch screen what 1995 was to the mouse – the tipping point that sends it mainstream – then the "nose" of its evolution has been even longer. Early examples cropped up most commonly in information kiosks, cash machines and bar tills. "We've been using touch screens for a decade or more without noticing it," Buxton says. "What's changed isn't the technology but who's using it, how it's designed and, of course, the fact that the technology is now smaller, faster and cheaper."



Cheaper but as Buxton says, principally the same. Capacitive screens such as those used in smartphones work like Buxton's digital drum. They combine the glass of the monitor with a transparent layer of conducting material that stores an electrical charge. The introduction of a finger takes some of that charge away. By measuring the reduction, circuits at each corner of the screen can identify exactly where the finger has touched.



Now used in devices as diverse as satnavs, ereaders and kitchen computers, touch screens have, in some ways, come full circle. Conceived to make interacting with technology intuitive before computer literacy existed, touch is now opening devices to new users who for whom computers still aren't second nature. "Take my three-year-old son," says Russell Beale, an expert in human-computer interaction at the University of Birmingham. "He can unlock my iPhone, take photos and show them back to me. He couldn't do that if it had buttons."



But while touch screens lead us to a new world of opportunity, they are not necessarily the keypad's death knell. "If you're blind, your touch screen has no value," Buxton says. "And we're all blind sometimes – like when we're driving. What's more, unlike buttons, touch screens offer no tactile feedback. If you're a 12-year-old school pupil who likes texting under your desk you're screwed with a touch screen because you can't touch type."

Buxton isn't the first person to spot this flaw, which is why Chris Harrison at Carnegie Mellon is already devising the touch screens of the future. His remarkable prototype combines the near-infinite flexibility now transforming gadgets with the tactile responsiveness of buttons. It features a layer of latex that works as a touch screen. Then, with the flick of a switch (or the swipe of a screen), air is pumped behind the latex, deforming it to create pop-up buttons.



In Harrison's mocked-up cash machine, a user can select options by touching the screen as normal. But when it's time to punch in the PIN, the screen deforms to offer a numerical keypad. Imagine the same technology in a touch screen phone or a desktop keyboard and suddenly blind texting or touch typing becomes possible. "This technology is economically feasible," says Harrison, who is in talks with three mobile phone manufacturers. "You could put it in cellphones today."

Harrison also has a solution for that other drawback of the touch screen – not being able to see past your fingers on smaller devices. That's where "scratch input" comes in. Harrison's prototype uses a digital stethoscope to pick up the sound of scratching on a table or wall. The device attached to the stethoscope, be it a phone, watch or a computer, is programmed to recognise the sounds of different scratch gestures. By tracing a spiral on his desk, Harrison can, for example, turn the volume down on his media player. Ultimately the microphone would be built into the device. Imagine a touch screen watchphone that can be controlled simply by scratching your arm.



Touch may finally have come of age but it seems its rise is far from complete. "We're still mired in the technology we've been trained to use," Harrison says. "Who knows what the devices of the future will be able to do?"



Historical handmarks: The touch screen's story



1972



The American Plato IV educational computer uses an infrared touch screen to allow schoolchildren to pick answers to questions.



1980



Casio launches its AT-550 watch. With the device in calculator mode, users can trace numbers on the touch-sensitive watch face.



1982



A Canadian team develops an optical touch interface that uses a camera to recognise shadows created by fingers on a glass screen.





1984



Bell Labs in New Jersey develops a multitouch screen that uses electronic sensors to allow the manipulation of graphical objects.





1992



IBM and Bell South unveil arguably the world's first smartphone. The Simon used a touch screen.





1998



Fingerworks makes multi-touch tablets, including a Qwerty keyboard.





2003



A French team develops the Lemur, a music controller with the first commerically-produced transparent multi-touch screen.





2006



Cambridge-based Plastic Logic launches its first touch e-reader. Its ultra-thin new model, out in the US next year, will rival the Kindle.





2007



Apple's iPhone sets the standard for multitouch smartphones with its pinch-to-zoom capability and ultra-smooth scrolling.





2009



As Microsoft unveils Windows 7, its touch-enabled operating system, maunfacturers race to launch compatible PCs and laptops.





To watch videos of Harrison's deformable touch screen and scratch inter-face, go to independent.co.uk/tech

PROMOTED VIDEO
Life and Style
ebooksA superb mix of recipes serving up the freshest of local produce in a delicious range of styles
Life and Style
ebooksFrom the lifespan of a slug to the distance to the Sun: answers to 500 questions from readers
News
Dawkins: 'There’s a very interesting reason why a prince could not turn into a frog – it's statistically too improbable'
newsThat's Richard Dawkins on babies with Down Syndrome
Sport
Malky Mackay salutes the Cardiff fans after the 3-1 defeat at Liverpool on Sunday
footballFormer Cardiff boss accused of sending homophobic, racist and messages
Sport
Rodgers showered praise on Balotelli last week, which led to speculation he could sign the AC Milan front man
transfers
Life and Style
life – it's not, says Rachel McKinnon
Arts and Entertainment
Eye of the beholder? 'Concrete lasagne' Preston bus station
architectureWhich monstrosities should be nominated for the Dead Prize?
News
Lizards, such as Iguanas (pictured), have a unique pattern of tissue growth
science
Arts and Entertainment
Arctic Monkeys headline this year's Reading and Leeds festivals, but there's a whole host of other bands to check out too
music(who aren't Arctic Monkeys)
Extras
indybest
News
Anna Nicole Smith died of an accidental overdose in 2007
people
Life and Style
food + drink
Arts and Entertainment
'The Great British Bake Off' showcases food at its most sumptuous
tvReview: Bread-making skills of the Bake Off hopefuls put to the test
Independent
Travel Shop
the manor
Up to 70% off luxury travel
on city breaks Find out more
santorini
Up to 70% off luxury travel
on chic beach resorts Find out more
sardina foodie
Up to 70% off luxury travel
on country retreats Find out more
Latest stories from i100
Have you tried new the Independent Digital Edition apps?
Independent Dating
and  

By clicking 'Search' you
are agreeing to our
Terms of Use.

ES Rentals

    iJobs Job Widget
    iJobs Gadgets & Tech

    Senior Network Integration/Test Engineer

    £250 - £300 per day: Orgtel: Senior Network Integration/Test Engineer Berkshir...

    Software Developer - Newcastle - £30,000 - £37,000 + benefits

    £30000 - £37000 per annum + attractive benefits: Ashdown Group: .NET Developer...

    Trainee Recruitment Consultant

    £20000 - £25000 per annum + OTE £40,000: SThree: SThree Group have been well e...

    Digital Project Manager/BA

    £300 Per Day: Clearwater People Solutions Ltd: An experienced Digital/Ecommerc...

    Day In a Page

    Middle East crisis: We know all too much about the cruelty of Isis – but all too little about who they are

    We know all too much about the cruelty of Isis – but all too little about who they are

    Now Obama has seen the next US reporter to be threatened with beheading, will he blink, asks Robert Fisk
    Neanderthals lived alongside humans for centuries, latest study shows

    Final resting place of our Neanderthal neighbours revealed

    Bones dated to 40,000 years ago show species may have died out in Belgium species co-existed
    Scottish independence: The new Scots who hold fate of the UK in their hands

    The new Scots who hold fate of the UK in their hands

    Scotland’s immigrants are as passionate about the future of their adopted nation as anyone else
    Britain's ugliest buildings: Which monstrosities should be nominated for the Dead Prize?

    Blight club: Britain's ugliest buildings

    Following the architect Cameron Sinclair's introduction of the Dead Prize, an award for ugly buildings, John Rentoul reflects on some of the biggest blots on the UK landscape
    eBay's enduring appeal: Online auction site is still the UK's most popular e-commerce retailer

    eBay's enduring appeal

    The online auction site is still the UK's most popular e-commerce site
    Culture Minister Ed Vaizey: ‘lack of ethnic minority and black faces on TV is weird’

    'Lack of ethnic minority and black faces on TV is weird'

    Culture Minister Ed Vaizey calls for immediate action to address the problem
    Artist Olafur Eliasson's latest large-scale works are inspired by the paintings of JMW Turner

    Magic circles: Artist Olafur Eliasson

    Eliasson's works will go alongside a new exhibition of JMW Turner at Tate Britain. He tells Jay Merrick why the paintings of his hero are ripe for reinvention
    Josephine Dickinson: 'A cochlear implant helped me to discover a new world of sound'

    Josephine Dickinson: 'How I discovered a new world of sound'

    After going deaf as a child, musician and poet Josephine Dickinson made do with a hearing aid for five decades. Then she had a cochlear implant - and everything changed
    Greggs Google fail: Was the bakery's response to its logo mishap a stroke of marketing genius?

    Greggs gives lesson in crisis management

    After a mishap with their logo, high street staple Greggs went viral this week. But, as Simon Usborne discovers, their social media response was anything but half baked
    Matthew McConaughey has been singing the praises of bumbags (shame he doesn't know how to wear one)

    Matthew McConaughey sings the praises of bumbags

    Shame he doesn't know how to wear one. Harriet Walker explains the dos and don'ts of fanny packs
    7 best quadcopters and drones

    Flying fun: 7 best quadcopters and drones

    From state of the art devices with stabilised cameras to mini gadgets that can soar around the home, we take some flying objects for a spin
    Joey Barton: ‘I’ve been guilty of getting a bit irate’

    Joey Barton: ‘I’ve been guilty of getting a bit irate’

    The midfielder returned to the Premier League after two years last weekend. The controversial character had much to discuss after his first game back
    Andy Murray: I quit while I’m ahead too often

    Andy Murray: I quit while I’m ahead too often

    British No 1 knows his consistency as well as his fitness needs working on as he prepares for the US Open after a ‘very, very up and down’ year
    Ferguson: In the heartlands of America, a descent into madness

    A descent into madness in America's heartlands

    David Usborne arrived in Ferguson, Missouri to be greeted by a scene more redolent of Gaza and Afghanistan
    BBC’s filming of raid at Sir Cliff’s home ‘may be result of corruption’

    BBC faces corruption allegation over its Sir Cliff police raid coverage

    Reporter’s relationship with police under scrutiny as DG is summoned by MPs to explain extensive live broadcast of swoop on singer’s home