Augmented reality: Even better than the real thing?

Imagine if everything you pointed your phone at – from people to pets, shops to mountains – had its own 'bubble' of information. It sounds like science fiction, but augmented reality is already here. Anna Leach reports

It's an average city street: buildings, buses, people with shopping bags. Suddenly information bubbles pop up in your field of vision. The woman over there is called Jane and right now she's listening to Florence and the Machine on her iPod; you don't know her but you have five mutual friends on Facebook. The building opposite was built in 1932, is 31m tall and down the road is the boarding school Russell Brand went to. In the alleyway 10m behind you, there was a mugging at 1.15am last Wednesday, two streets away TopShop is having a sale and their summer range is reduced by 20 per cent, there are 14 coffee shops in a one-mile radius, and the flowerbed to your left has won "the most imaginative civic planting" award four times in a row.

If Arnold Schwarzenegger's Terminator had walked through, say, Bishop's Stortford, this is the sort of information his computer-enhanced vision might have provided. But "Terminator vision" is no longer just in the realm of science fiction films. It's called augmented reality and it is on its way to a smartphone near you. Complete Terminator vision would require bionic contact lenses ... but from this month, anyone with an iPhone will be able to peer at the world through the phone's camera and will see layered on their phone screen extra information about the physical things in front of them. Phones with a phone that supports Google Android can already do this.

Virtual reality used to be technology's Holy Grail. It let you create new worlds where you can jack cars, date babes and win wars. In contrast, augmented reality – in which computer graphics are layered onto a real world image – was the boring sub-technology confined to sports footage replays and technical engineering. That's what shows you the path of a tennis ball after a player has hit it, or demonstrates to an engineer how to piece a complex machine together by modelling it in 3D.

But with augmented reality about to be opened up to the mobile phone-owning masses, it has become an exciting field for development. Developers are racing to find useful and interesting ways that computers can enhance our interaction with the real world. And that could be by superimposing reviews on restaurants, directions on streets and Facebook profiles on people. It could be trivial, it could be fascinating. Perhaps the most useful application hasn't been figured out yet.

The technology that has brought augmented reality to mobiles is called Layar. As the name suggests, it layers computer information on top of "reality" as seen through the phone's camera. Layar uses the phone's Global Positioning System (GPS) to work out where you are and what you are looking at. Different types of information appear on different layers: there's a sightseeing layer called Wikitude which contains tourist information about what's around you – the posts are linked to specific buildings and points of interest (the Tate Liverpool, the Belfast docks, Big Ben) and pop up, like virtual blue plaques, as you pass by them.

There's an estate agent layer which flags up properties for sale or rent: as you scan your camera down a street, available properties are highlighted. Of course, a board outside a house would tell you as much, but the layer, called Trulia, will also tell you how much the house is going for, give you pictures of the inside and a phone number that you can ring to arrange a viewing. You don't only see things in your viewfinder – properties two streets away will show up too. There's a layer which tells you where the nearest council facilities are and plots them on an image of the street.

More interesting than the location of your local dump is information about your friends. And that's what applications like Brightkite offer – by bringing social networks into augmented reality. Partnered with Layar, it offers an app which lets you see where your friends are on a real-time map. Like the magic map in Harry Potter, they appear as moving dots. Even more excitingly, you can create posts – pictures, messages, videos – and then anchor or "geo-tag" them to the places you made them. They stick in that virtual space like graffiti or post-it notes and you can view them later. You can see your friends' posts or other peoples'.

Say you're in Trafalgar Square – by looking at Nelson's Column with your phone's camera, pictures of friends posing with it from three months ago will swim up and fix on your phone's screen, and so will a tweet you wrote there last year. Depending on what information you want, you can also call up reviews of nearby restaurants or of current plays showing down the road.

Gradually, layer upon layer of this virtual content will build up. Some posts will be more interesting than others, but, like with the rest of the internet, we'll get used to searching and filtering for what interests us. Other applications of augmented reality lead us right back into Terminator territory: "There was a project," says Dr David England, computer science lecturer at Liverpool John Moore University, "where people wearing visors and backpacks re-enacted a virtual Pacman outside, so they ran down the road shooting the enemy they could see in their visors," he says, referring to the popular computer game.

"Human Pacman" took place in Singapore University, but similar though less-exciting experiments with augmented or mixed reality gaming have taken place around the world. "The main problem is visor quality," Dr England explains. "When mass-produced visors improve, you'll see a lot more of this kind of game."

It's called pervasive gaming and a group set up to explore it, IPerG (Integrated Project on Pervasive Gaming) describes it as "a radically new game form that extends gaming experiences out into the physical world". Which sounds dangerous. However, Dr England says the risks are similar to driving when using a mobile phone: "Of course there will have to be basic common sense." He adds that AR can be put to much more co-operative and educative uses: letting people leave virtual treasure trails, or plant imaginary gardens together using the Facebook app Farmville, for example. "You get more co-operative games in mixed reality, people in different places can come together and share tasks". He also mentions a mixed reality table that sketches science diagrams and can be used as a teaching tool. There's also a belt that can help its wearer avoid collisions in the dark by vibrating when it senses an approaching object.

Rob Hale – games designer and author of the Games Design Blog – thinks augmented reality gaming will be different from its virtual equivalent: "Getting hit by a car in reality hurts a lot more than it does in a videogame," he says. But he sees possibilities as well. In sport for example: "AR could allow us to bring the best bits of video games to real-life sports such as feedback on your performance and positions of your team mates ... If you were going for a run, you could bring up a display of your previous best times, heart rate and the locations of other joggers nearby."

Slipping out of the gym and standing back to consider the philosophical implications of augmented reality, Japanese net culture expert Toshinao Sasaki has a few things to say. He thinks that the boundaries between real and virtual, public and private will disintegrate further as augmented reality spreads. "While the internet sphere and the reality sphere had previously been completely separate as 'virtual and non-virtual', mobile phones have rapidly shrunk the distance between them ... Eventually, it seems possible that mobile phones might play the role of a kind of supplementary brain," he told The Technological Innovation and Social Development Blog. So perhaps augmented reality will make cyborgs of all of us, although we'll have our prosthetic brains in our pockets rather than welded to our skulls, Schwarznegger-style. Until the batteries run out at least. And for the sake of our sanity, being able to tune out is going to be every bit as important as tuning in. As Rob Hale wisely points out, "the most important thing about augmented reality will be the ability to turn it off."

Augmented reality: How it can be used

Surgery: can be simplified by inserting extra information like labels onto the surgeon's field of view.



Venue reviews: compare the price of beer in different pubs on the same street, and from just looking at a venue see menus, prices, reviews and real-time information about what's on now. Pre-recorded bursts of music from bands at gigs that are on later would start playing.



Person recognition: point your phone at a stranger and icons they've selected bob up around their heads – last fm, Facebook – with links to their profiles.



Computer control: with AR embedded into visors or contact lenses and motion-sensitive cameras, we'll be able to wave, flick or nod and control over a hundred simulated PC screens as projected into our eyes by computerised eyewear.



Curated walks: New York company Soundwalk "curate" walks that fuse treasure trails with interactive films and tourist info, feeding walkers with audio and visuals as you walk a variety of set paths. Soundwalk claims it feels like being in a film. It's running its first AR version in Paris this October.

Voices
A Siberian Tiger
voices
Arts and Entertainment
Peter Griffin holds forth in The Simpsons Family Guy crossover episode
arts + ents
News
Ross Burden pictured in 2002
people
Life and Style
Upright, everything’s all right (to a point): remaining on one’s feet has its health benefits – though in moderation
HealthIf sitting is bad for your health, what happens when you stay on your feet for a whole month?
PROMOTED VIDEO
Life and Style
ebookA wonderful selection of salads, starters and mains featuring venison, grouse and other game
News
President Obama, one of the more enthusiastic users of the fist bump
scienceBumping fists rather than shaking hands could reduce the spread of infectious diseases, it is claimed
Sport
Laura Trott with her gold
Commonwealth Games
Arts and Entertainment
Gal Gadot as Wonder Woman
arts + ents
News
Bryan had a bracelet given to him by his late father stolen during the raid
people
Arts and Entertainment
Chris Pratt stars in Guardians of the Galaxy
arts + ents
Arts and Entertainment
Pedro Pascal gives a weird look at the camera in the blooper reel
arts + entsPrince Oberyn nearly sets himself on fire with a flaming torch
News
Danny Nickerson, 6, has received 15,000 cards and presents from well-wishers around the world
newsDanny loves to see his name on paper, so his mother put out a request for cards - it went viral
Sport
France striker Loic Remy
sportThe QPR striker flew to Boston earlier in the week to complete deal
News
Orville and Keith Harris. He covered up his condition by getting people to read out scripts to him
People
Arts and Entertainment
Zoe Saldana stars in this summer's big hope Guardians of the Galaxy
filmHollywood's summer blockbusters are no longer money-spinners
Arts and Entertainment
O'Shaughnessy pictured at the Unicorn Theatre in London
tvFiona O'Shaughnessy explains where she ends and her strange and wonderful character begins
Life and Style
Workers in Seattle are paid 100 times as much as workers in Bangladesh
fashionSeattle company lets customers create their own clothes, then click 'buy' and wait for delivery
Independent
Travel Shop
the manor
Up to 70% off luxury travel
on city breaks Find out more
santorini
Up to 70% off luxury travel
on chic beach resorts Find out more
sardina foodie
Up to 70% off luxury travel
on country retreats Find out more
Latest stories from i100
Have you tried new the Independent Digital Edition apps?
Independent Dating
and  

By clicking 'Search' you
are agreeing to our
Terms of Use.

ES Rentals

    iJobs Job Widget
    iJobs Gadgets & Tech

    Senior Java Developer

    £45000 - £60000 per annum + competitive: Progressive Recruitment: Leading Sof...

    SAP Finance Systems Analyst

    competitive: Progressive Recruitment: This is an exciting opportunity for a PE...

    JavaScript Developer (Angular, AJAX, TDD, HTML5, ExtJS) London

    £45000 - £70000 per annum + Benefits + Bonus: Harrington Starr: JavaScript Dev...

    C# Graduate Developer (SQL Server, ASP.Net, .Net)

    £30000 - £40000 per annum + Benefits + Bonus: Harrington Starr: C# Graduate De...

    Day In a Page

    A new Russian revolution: Cracks start to appear in Putin’s Kremlin power bloc

    A new Russian revolution

    Cracks start to appear in Putin’s Kremlin power bloc
    Eugene de Kock: Apartheid’s sadistic killer that his country cannot forgive

    Apartheid’s sadistic killer that his country cannot forgive

    The debate rages in South Africa over whether Eugene de Kock should ever be released from jail
    Standing my ground: If sitting is bad for your health, what happens when you stay on your feet for a whole month?

    Standing my ground

    If sitting is bad for your health, what happens when you stay on your feet for a whole month?
    Commonwealth Games 2014: Dai Greene prays for chance to rebuild after injury agony

    Greene prays for chance to rebuild after injury agony

    Welsh hurdler was World, European and Commonwealth champion, but then the injuries crept in
    Israel-Gaza conflict: Secret report helps Israelis to hide facts

    Patrick Cockburn: Secret report helps Israel to hide facts

    The slickness of Israel's spokesmen is rooted in directions set down by pollster Frank Luntz
    The man who dared to go on holiday

    The man who dared to go on holiday

    New York's mayor has taken a vacation - in a nation that has still to enforce paid leave, it caused quite a stir, reports Rupert Cornwell
    Best comedians: How the professionals go about their funny business, from Sarah Millican to Marcus Brigstocke

    Best comedians: How the professionals go about their funny business

    For all those wanting to know how stand-ups keep standing, here are some of the best moments
    The Guest List 2014: Forget the Man Booker longlist, Literary Editor Katy Guest offers her alternative picks

    The Guest List 2014

    Forget the Man Booker longlist, Literary Editor Katy Guest offers her alternative picks
    Jokes on Hollywood: 'With comedy film audiences shrinking, it’s time to move on'

    Jokes on Hollywood

    With comedy film audiences shrinking, it’s time to move on
    It's the best of British art... but not all is on display

    It's the best of British art... but not all is on display

    Voted for by the British public, the artworks on Art Everywhere posters may be the only place where they can be seen
    Critic claims 'I was the inspiration for Blanche DuBois'

    Critic claims 'I was the inspiration for Blanche DuBois'

    Blanche Marvin reveals how Tennessee Williams used her name and an off-the-cuff remark to create an iconic character
    Sometimes it's hard to be a literary novelist

    Sometimes it's hard to be a literary novelist

    Websites offering your ebooks for nothing is only the latest disrespect the modern writer is subjected to, says DJ Taylor
    Edinburgh Fringe 2014: The comedy highlights, from Bridget Christie to Jack Dee

    Edinburgh Fringe 2014

    The comedy highlights, from Bridget Christie to Jack Dee
    Dame Jenny Abramsky: 'We have to rethink. If not, museums and parks will close'

    Dame Jenny Abramsky: 'We have to rethink. If not, museums and parks will close'

    The woman stepping down as chair of the Heritage Lottery Fund is worried