Photos of the future

Thought that going digital was the biggest breakthrough in photography? Think again. Scientists are working on away of taking pictures that could change the way we point and shoot forever. Mark Piesing investigates

Deep in the bowels of Stanford University in California, a monster is being brought to life, not – for once – by a mad scientist playing God, but by a computer scientist, Professor Marc Levoy, and his team. Made from the spare parts of the photographic industry bolted on to a powerful computer, the Frankencamera may be incredibly ugly, but it will be the world's first open-source camera.

By giving researchers, programmers and the curious who buy the almost-£600 Frankencamera control for the first time over all the functions of a camera, Professor Levoy hopes those users will develop, as with the iPhone, the innovative ideas and applications necessary for the next revolution in photography: computational photography. That is the coming revolution that few people have heard of.

"Computational photography will change how we do photography," says the Professor of Computer Science. "It should allow you to fix things that you can't currently – whether by combining pictures in a different way, or by fiddling with optics so that more is recorded than on a normal camera; basically to do what photoshop can do, but the moment you take the photograph."

And so the only angry mob the Frankencamera will meet will be the photo fans desperate to get their hands on it.

Although the origins of computational photography lie in the Nineties, the term was first used by futurologists like Professor Steve Mann of the University of Toronto in 2004. Its big idea is to turn the camera into a powerful computer, that doesn't just digitise an image, but performs extensive computations on the image data as well. After all, despite the arrival of the digital camera, the camera itself has remained at its heart largely unchanged for over 100 years; all digital technology did was basically to replace the film with a sensor. Even the quality of a digital photograph is still largely judged by its closeness to its chemical ancestor.

So a future computational photography camera wouldn't take photos but rather compute them. Not only that, but innovations such as a micro array of multiple lenses would allow much more complex data to be collected than ever possible before; for example, every image captured would include data on its depth. This would enable future cameras to do things that until now have been considered impossible.

At its most tame, it means not only capturing shots of a visual richness unimagined before, but even changing the focus of a shot after it had been taken. At its most extreme, it could mean 3D photographs, and photographs that could be converted into a drawing, a diagram or even a watercolour at the press of a button. According to Shree Nayar, Professor of Computer Science at Columbia University, this isn't just changing how we do photography, it is actually a "new visual medium". "It allows photographers to manipulate photos after the fact. And yes, there is a boundary here beyond which one gets into the realm of art."

This may sound like a big boast just years after the digital revolution changed – and is still changing – how we take photographs, but big high-street names like Nokia, Adobe, Kodak and Hewlett Packard are betting with their dollars that Levoy is right.

However, Levoy and his team aren't alone.

In Silicon Valley, a company called Refocus Imaging has joined the race to turn theory into commercial reality; this time by looking an idea that is so revolutionary that it is hard for people to get their heads around it.

Founded in 2007 by Dr Ren Ng, the company has spent three years transforming Ng's Stanford Phd work on refocus imaging, which won the Association for Computing Machinery award in 2007, into a viable camera that we can buy on the high street.

According to Refocus Imaging's Alex Fishman, the refocus camera will, by replacing the single sensor behind the lens with microsensors, solve a number of problems that digital cameras present photographers with. "Currently, you are forced to take focus decisions (or depth-of-field decisions) before you take the picture", he says. "What's more, you can't change your mind after taking the picture. It also takes time for the autofocus to work as there is an inherent delay before exposure happens – anything from several hundreds milliseconds to a second. The result of this is that you miss your shot."

Although "For the end user the camera looks the same", he adds, "from an experience point of view you won't have to wait to take a photograph, as it will take a photo immediately, with no shutter lag, and you won't have to worry about focusing your shot as you can do it afterwards – as many times as you want. In fact the same exposure can yield multiple pictures after wards – each focused at a different object."

Not only that, but it will be cheaper, he believes, as refocus cameras will make lens design much cheaper, lighter and smaller, as the digital processor will do the work that the optics had to do.

"Its smartness will be loaded on to cheap digital processes rather than expensive optics – in which there have been no major breakthroughs in decades."

What's more, it's a transformational leap that we may not have to wait long for. According to Professor Ramesh Raskar, it may be only two years before technology such as this appears on our high streets, as camera manufacturers and software companies are working hard to deliver it; and he should know.

As Associate Professor of Media Arts and Sciences at the Massachusetts Institute of Technology (MIT) and head of its camera culture research group, Raskar has been described as one of the most important individuals shaping the future of visual imaging today. He is also co-author of the book Computational Photography, due out this this year.

"The first wave of this revolution is already here", he says. "It is about trying to improve the performance of the existing cameras in the attempt to make the digital camera as good as a film camera." Features that broaden the dynamic range of a digital camera are examples of this. "The second wave should hit in the next couple of years, and it is about coded photos. Trying to make the camera into something else, like the refocus camera."

However, Raskar believes that this is not the end of the transformational process. "The third wave will take us beyond traditional photography, and companies like Microsoft are already developing software like PhotoSense and PhotoTourism to deliver 'sense photographs'", he adds.

'Sense' photographs are all about trying to take photographs that capture the sense of the real experience, not just what the camera and computer are capable of recording. "If you're on a rollercoaster, you can never get a good picture. If you're at a candle-lit dinner you can never take pictures that make the food look appetising."

Beyond that, who knows, but as computing power comes to matter more than optical power, one view is that what we know as "the camera" may disappear entirely, to be replaced by one piece of kit that meets all of our needs; whose screen is in fact also its lens. Or that the "future is bionic" – our eyes will be augmented to become the camera of the future.

Almost one billion mobile phones are sold globally every year with cameras of ever-increasing quality, and it is likely that computational photography may well first appear on a mobile. This is an outcome made more likely by research at MIT into how a small aperture on a mobile-phone camera can simulate that of a single-lens reflex (SLR) camera, and by Levoy's work with Nokia to deliver the Frankencamera's software package for the Nokia 9000 Internet Tablet.

However, before this revolution can occur the problem of resolution has to be solved. So far, prototype computational cameras have at times struggled to produce a picture that has the same high resolution as the camera they use, and this is a big turn-off for consumers and thus manufacturers; even if researchers are less worried.

In the end, the exact length of time it will take to get computational photography out of the lab and onto the high street will, according to the professor, depend on a "negotiation between the wish list of the customers, such as speed, and that of the producers, such as cost", as well as "the possibility of Walkman like moments of inspiration."

For Levoy at Stanford, the future of computational photography and the Frankencamera depends on the manufacturers. "The megapixel war is winding down. So the Asian camera manufacturers can't compete on pixels any more, only on extra features. We would like them to offer the features that the research community is working on all at once, not just when they want to compete."

Photo finish: The experts' wish list

* The "iPhone camera" – which allows you to download apps.

* Micro arrays and coded apertures.

* Refocusing the shot after it has been taken.

* Elimination of blur and time delay.

* Wireless cameras to allow the instant sharing of photographs and comparison with photographs of a particular shot that already exist.

* The ability to take a photograph on your computer, using a camera that you are linked to wirelessly.

* Three-dimensional photography – taking photographs in 3D, and changing D photos into 3D.

* Studio-quality lighting on a mobile phone.

Arts and Entertainment
Larry David and Rosie Perez in ‘Fish in the Dark’
theatreReview: Had Fish in the Dark been penned by a civilian it would have barely got a reading, let alone £10m advance sales
Arts and Entertainment
Victoria Wood, Kayvan Novak, Alexa Chung, Chris Moyles
tvReview: No soggy bottoms, but plenty of other baking disasters on The Great Comic Relief Bake Off
Arts and Entertainment
80s trailblazer: comedian Tracey Ullman
tv
Arts and Entertainment
Stephen Tompkinson is back as DCI Banks
tvReview: Episode one of the new series played it safe, but at least this drama has a winning formula
Arts and Entertainment
TV
Have you tried new the Independent Digital Edition apps?
Arts and Entertainment

ebooksNow available in paperback
Arts and Entertainment

ebooks
Arts and Entertainment
Attenborough with the primates
tv
Arts and Entertainment
Former Communards frontman Jimmy Somerville
music
Arts and Entertainment
Secrets of JK Rowling's Harry Potter workings have been revealed in a new bibliography
arts + ents
Arts and Entertainment
Fearne Cotton is leaving Radio 1 after a decade
radio The popular DJ is leaving for 'family and new adventures'
Arts and Entertainment
arts + ents
Arts and Entertainment
Public Service Broadcasting are going it alone
music
Arts and Entertainment
Eddie Redmayne as transgender artist Lili Elbe in The Danish Girl
filmFirst look at Oscar winner as transgender artist
Arts and Entertainment
Season three of 'House of Cards' will be returning later this month
TV reviewHouse of Cards returns to Netflix
Arts and Entertainment
Harrison Ford will play Rick Deckard once again for the Blade Runner sequel
film review
Arts and Entertainment
The modern Thunderbirds: L-R, Scott, Virgil, Alan, Gordon and John in front of their home, the exotic Tracy Island
TV
Arts and Entertainment
Natural beauty: Aidan Turner stars in the new series of Poldark
TV
Arts and Entertainment
Taylor Swift won Best International Solo Female (Getty)

Brits 2015
Arts and Entertainment
Shining star: Maika Monroe, with Jake Weary, in ‘It Follows’
film review
Arts and Entertainment

Brits 2015
Arts and Entertainment
Paloma Faith arrives at the Brit Awards (Getty)

Brits 2015
Arts and Entertainment
Anne Boleyn's beheading in BBC Two's Wolf Hall

TV review
Arts and Entertainment
Follow every rainbow: Julie Andrews in 'The Sound of Music'
film Elizabeth Von Trapp reveals why the musical is so timeless
Arts and Entertainment
Bytes, camera, action: Leehom Wang in ‘Blackhat’
film
Arts and Entertainment
The Libertines will headline this year's festival
music
Arts and Entertainment
Richard Dean Anderson in the original TV series, which ran for seven seasons from 1985-1992
tv
Latest stories from i100
Have you tried new the Independent Digital Edition apps?

ES Rentals

    Independent Dating
    and  

    By clicking 'Search' you
    are agreeing to our
    Terms of Use.

    Homeless Veterans campaign: Donations hit record-breaking £1m target after £300,000 gift from Lloyds Bank

    Homeless Veterans campaign

    Donations hit record-breaking £1m target after huge gift from Lloyds Bank
    Flight MH370 a year on: Lost without a trace – but the search goes on

    Lost without a trace

    But, a year on, the search continues for Flight MH370
    Germany's spymasters left red-faced after thieves break into brand new secret service HQ and steal taps

    Germany's spy HQ springs a leak

    Thieves break into new €1.5bn complex... to steal taps
    International Women's Day 2015: Celebrating the whirlwind wit of Simone de Beauvoir

    Whirlwind wit of Simone de Beauvoir

    Simone de Beauvoir's seminal feminist polemic, 'The Second Sex', has been published in short-form for International Women's Day
    Mark Zuckerberg’s hiring policy might suit him – but it wouldn’t work for me

    Mark Zuckerberg’s hiring policy might suit him – but it wouldn’t work for me

    Why would I want to employ someone I’d be happy to have as my boss, asks Simon Kelner
    Confessions of a planespotter: With three Britons under arrest in the UAE, the perils have never been more apparent

    Confessions of a planespotter

    With three Britons under arrest in the UAE, the perils have never been more apparent. Sam Masters explains the appeal
    Russia's gulag museum 'makes no mention' of Stalin's atrocities

    Russia's gulag museum

    Ministry of Culture-run site 'makes no mention' of Stalin's atrocities
    The big fresh food con: Alarming truth behind the chocolate muffin that won't decay

    The big fresh food con

    Joanna Blythman reveals the alarming truth behind the chocolate muffin that won't decay
    Virginia Ironside was my landlady: What is it like to live with an agony aunt on call 24/7?

    Virginia Ironside was my landlady

    Tim Willis reveals what it's like to live with an agony aunt on call 24/7
    Paris Fashion Week 2015: The wit and wisdom of Manish Arora's exercise in high camp

    Paris Fashion Week 2015

    The wit and wisdom of Manish Arora's exercise in high camp
    8 best workout DVDs

    8 best workout DVDs

    If your 'New Year new you' regime hasn’t lasted beyond February, why not try working out from home?
    Paul Scholes column: I don't believe Jonny Evans was spitting at Papiss Cissé. It was a reflex. But what the Newcastle striker did next was horrible

    Paul Scholes column

    I don't believe Evans was spitting at Cissé. It was a reflex. But what the Newcastle striker did next was horrible
    Miguel Layun interview: From the Azteca to Vicarage Road with a million followers

    From the Azteca to Vicarage Road with a million followers

    Miguel Layun is a star in Mexico where he was criticised for leaving to join Watford. But he says he sees the bigger picture
    Frank Warren column: Amir Khan ready to meet winner of Floyd Mayweather v Manny Pacquiao

    Khan ready to meet winner of Mayweather v Pacquiao

    The Bolton fighter is unlikely to take on Kell Brook with two superstar opponents on the horizon, says Frank Warren
    War with Isis: Iraq's government fights to win back Tikrit from militants - but then what?

    Baghdad fights to win back Tikrit from Isis – but then what?

    Patrick Cockburn reports from Kirkuk on a conflict which sectarianism has made intractable