Augmented reality: Even better than the real thing?

Imagine if everything you pointed your phone at – from people to pets, shops to mountains – had its own 'bubble' of information. It sounds like science fiction, but augmented reality is already here. Anna Leach reports

It's an average city street: buildings, buses, people with shopping bags. Suddenly information bubbles pop up in your field of vision. The woman over there is called Jane and right now she's listening to Florence and the Machine on her iPod; you don't know her but you have five mutual friends on Facebook. The building opposite was built in 1932, is 31m tall and down the road is the boarding school Russell Brand went to. In the alleyway 10m behind you, there was a mugging at 1.15am last Wednesday, two streets away TopShop is having a sale and their summer range is reduced by 20 per cent, there are 14 coffee shops in a one-mile radius, and the flowerbed to your left has won "the most imaginative civic planting" award four times in a row.

If Arnold Schwarzenegger's Terminator had walked through, say, Bishop's Stortford, this is the sort of information his computer-enhanced vision might have provided. But "Terminator vision" is no longer just in the realm of science fiction films. It's called augmented reality and it is on its way to a smartphone near you. Complete Terminator vision would require bionic contact lenses ... but from this month, anyone with an iPhone will be able to peer at the world through the phone's camera and will see layered on their phone screen extra information about the physical things in front of them. Phones with a phone that supports Google Android can already do this.

Virtual reality used to be technology's Holy Grail. It let you create new worlds where you can jack cars, date babes and win wars. In contrast, augmented reality – in which computer graphics are layered onto a real world image – was the boring sub-technology confined to sports footage replays and technical engineering. That's what shows you the path of a tennis ball after a player has hit it, or demonstrates to an engineer how to piece a complex machine together by modelling it in 3D.

But with augmented reality about to be opened up to the mobile phone-owning masses, it has become an exciting field for development. Developers are racing to find useful and interesting ways that computers can enhance our interaction with the real world. And that could be by superimposing reviews on restaurants, directions on streets and Facebook profiles on people. It could be trivial, it could be fascinating. Perhaps the most useful application hasn't been figured out yet.

The technology that has brought augmented reality to mobiles is called Layar. As the name suggests, it layers computer information on top of "reality" as seen through the phone's camera. Layar uses the phone's Global Positioning System (GPS) to work out where you are and what you are looking at. Different types of information appear on different layers: there's a sightseeing layer called Wikitude which contains tourist information about what's around you – the posts are linked to specific buildings and points of interest (the Tate Liverpool, the Belfast docks, Big Ben) and pop up, like virtual blue plaques, as you pass by them.

There's an estate agent layer which flags up properties for sale or rent: as you scan your camera down a street, available properties are highlighted. Of course, a board outside a house would tell you as much, but the layer, called Trulia, will also tell you how much the house is going for, give you pictures of the inside and a phone number that you can ring to arrange a viewing. You don't only see things in your viewfinder – properties two streets away will show up too. There's a layer which tells you where the nearest council facilities are and plots them on an image of the street.

More interesting than the location of your local dump is information about your friends. And that's what applications like Brightkite offer – by bringing social networks into augmented reality. Partnered with Layar, it offers an app which lets you see where your friends are on a real-time map. Like the magic map in Harry Potter, they appear as moving dots. Even more excitingly, you can create posts – pictures, messages, videos – and then anchor or "geo-tag" them to the places you made them. They stick in that virtual space like graffiti or post-it notes and you can view them later. You can see your friends' posts or other peoples'.

Say you're in Trafalgar Square – by looking at Nelson's Column with your phone's camera, pictures of friends posing with it from three months ago will swim up and fix on your phone's screen, and so will a tweet you wrote there last year. Depending on what information you want, you can also call up reviews of nearby restaurants or of current plays showing down the road.

Gradually, layer upon layer of this virtual content will build up. Some posts will be more interesting than others, but, like with the rest of the internet, we'll get used to searching and filtering for what interests us. Other applications of augmented reality lead us right back into Terminator territory: "There was a project," says Dr David England, computer science lecturer at Liverpool John Moore University, "where people wearing visors and backpacks re-enacted a virtual Pacman outside, so they ran down the road shooting the enemy they could see in their visors," he says, referring to the popular computer game.

"Human Pacman" took place in Singapore University, but similar though less-exciting experiments with augmented or mixed reality gaming have taken place around the world. "The main problem is visor quality," Dr England explains. "When mass-produced visors improve, you'll see a lot more of this kind of game."

It's called pervasive gaming and a group set up to explore it, IPerG (Integrated Project on Pervasive Gaming) describes it as "a radically new game form that extends gaming experiences out into the physical world". Which sounds dangerous. However, Dr England says the risks are similar to driving when using a mobile phone: "Of course there will have to be basic common sense." He adds that AR can be put to much more co-operative and educative uses: letting people leave virtual treasure trails, or plant imaginary gardens together using the Facebook app Farmville, for example. "You get more co-operative games in mixed reality, people in different places can come together and share tasks". He also mentions a mixed reality table that sketches science diagrams and can be used as a teaching tool. There's also a belt that can help its wearer avoid collisions in the dark by vibrating when it senses an approaching object.

Rob Hale – games designer and author of the Games Design Blog – thinks augmented reality gaming will be different from its virtual equivalent: "Getting hit by a car in reality hurts a lot more than it does in a videogame," he says. But he sees possibilities as well. In sport for example: "AR could allow us to bring the best bits of video games to real-life sports such as feedback on your performance and positions of your team mates ... If you were going for a run, you could bring up a display of your previous best times, heart rate and the locations of other joggers nearby."

Slipping out of the gym and standing back to consider the philosophical implications of augmented reality, Japanese net culture expert Toshinao Sasaki has a few things to say. He thinks that the boundaries between real and virtual, public and private will disintegrate further as augmented reality spreads. "While the internet sphere and the reality sphere had previously been completely separate as 'virtual and non-virtual', mobile phones have rapidly shrunk the distance between them ... Eventually, it seems possible that mobile phones might play the role of a kind of supplementary brain," he told The Technological Innovation and Social Development Blog. So perhaps augmented reality will make cyborgs of all of us, although we'll have our prosthetic brains in our pockets rather than welded to our skulls, Schwarznegger-style. Until the batteries run out at least. And for the sake of our sanity, being able to tune out is going to be every bit as important as tuning in. As Rob Hale wisely points out, "the most important thing about augmented reality will be the ability to turn it off."

Augmented reality: How it can be used

Surgery: can be simplified by inserting extra information like labels onto the surgeon's field of view.



Venue reviews: compare the price of beer in different pubs on the same street, and from just looking at a venue see menus, prices, reviews and real-time information about what's on now. Pre-recorded bursts of music from bands at gigs that are on later would start playing.



Person recognition: point your phone at a stranger and icons they've selected bob up around their heads – last fm, Facebook – with links to their profiles.



Computer control: with AR embedded into visors or contact lenses and motion-sensitive cameras, we'll be able to wave, flick or nod and control over a hundred simulated PC screens as projected into our eyes by computerised eyewear.



Curated walks: New York company Soundwalk "curate" walks that fuse treasure trails with interactive films and tourist info, feeding walkers with audio and visuals as you walk a variety of set paths. Soundwalk claims it feels like being in a film. It's running its first AR version in Paris this October.

Sport
football This was Kane’s night, even if he played just a small part of it
Travel
travel Dreamland Margate, Britain’s oldest amusement park, is set to reopen
News
news
News
Founders James Brown and Tim Southwell with a mock-up of the first ever ‘Loaded’ magazine in 1994
media
Life and Style
ebookNow available in paperback
ebooks
ebookPart of The Independent’s new eBook series The Great Composers
News
Threlfall says: 'I am a guardian of the reality keys. I think I drive directors nuts'
people
Voices
voices The group has just unveiled a billion dollar plan to help nurse the British countryside back to health
News
The Westgate, a gay pub in the centre of Gloucester which played host to drag queens, has closed
news
Latest stories from i100
Have you tried new the Independent Digital Edition apps?
Independent Dating
and  

By clicking 'Search' you
are agreeing to our
Terms of Use.

ES Rentals

    iJobs Job Widget
    iJobs Gadgets & Tech

    Recruitment Genius: IT Infrastructure Engineer

    £30000 - £40000 per annum: Recruitment Genius: Our client is looking to find a...

    Recruitment Genius: IT Engineer

    £21000 - £23600 per annum: Recruitment Genius: An exciting opportunity to join...

    Ashdown Group: IT Support Analyst - Liverpool - up to £28,000

    £22000 - £28000 per annum: Ashdown Group: This is a large multi-site operation...

    Recruitment Genius: Salesforce Developer

    £50000 - £65000 per annum: Recruitment Genius: Due to continued business growt...

    Day In a Page

    The saffron censorship that governs India: Why national pride and religious sentiment trump freedom of expression

    The saffron censorship that governs India

    Zareer Masani reveals why national pride and religious sentiment trump freedom of expression
    Prince Charles' 'black spider' letters to be published 'within weeks'

    Prince Charles' 'black spider' letters to be published 'within weeks'

    Supreme Court rules Dominic Grieve's ministerial veto was invalid
    Distressed Zayn Malik fans are cutting themselves - how did fandom get so dark?

    How did fandom get so dark?

    Grief over Zayn Malik's exit from One Direction seemed amusing until stories of mass 'cutting' emerged. Experts tell Gillian Orr the distress is real, and the girls need support
    The galaxy collisions that shed light on unseen parallel Universe

    The cosmic collisions that have shed light on unseen parallel Universe

    Dark matter study gives scientists insight into mystery of space
    The Swedes are adding a gender-neutral pronoun to their dictionary

    Swedes introduce gender-neutral pronoun

    Why, asks Simon Usborne, must English still struggle awkwardly with the likes of 's/he' and 'they'?
    Disney's mega money-making formula: 'Human' remakes of cartoon classics are part of a lucrative, long-term creative plan

    Disney's mega money-making formula

    'Human' remakes of cartoon classics are part of a lucrative, long-term creative plan
    Lobster has gone mainstream with supermarket bargains for £10 or less - but is it any good?

    Lobster has gone mainstream

    Anthea Gerrie, raised on meaty specimens from the waters around Maine, reveals how to cook up an affordable feast
    Easter 2015: 14 best decorations

    14 best Easter decorations

    Get into the Easter spirit with our pick of accessories, ornaments and tableware
    Paul Scholes column: Gareth Bale would be a perfect fit at Manchester United and could turn them into serious title contenders next season

    Paul Scholes column

    Gareth Bale would be a perfect fit at Manchester United and could turn them into serious title contenders next season
    Inside the Kansas greenhouses where Monsanto is 'playing God' with the future of the planet

    The future of GM

    The greenhouses where Monsanto 'plays God' with the future of the planet
    Britain's mild winters could be numbered: why global warming is leaving UK chillier

    Britain's mild winters could be numbered

    Gulf Stream is slowing down faster than ever, scientists say
    Government gives £250,000 to Independent appeal

    Government gives £250,000 to Independent appeal

    Donation brings total raised by Homeless Veterans campaign to at least £1.25m
    Oh dear, the most borrowed book at Bank of England library doesn't inspire confidence

    The most borrowed book at Bank of England library? Oh dear

    The book's fifth edition is used for Edexcel exams
    Cowslips vs honeysuckle: The hunt for the UK’s favourite wildflower

    Cowslips vs honeysuckle

    It's the hunt for UK’s favourite wildflower
    Child abuse scandal: Did a botched blackmail attempt by South African intelligence help Cyril Smith escape justice?

    Did a botched blackmail attempt help Cyril Smith escape justice?

    A fresh twist reveals the Liberal MP was targeted by the notorious South African intelligence agency Boss