The future according to Microsoft: the Magic Window revolutionizes video chat

David Phelan has an exclusive peek behind the scenes at
Microsoft’s research and development facilities – here’s his first report

It may sound like something out of Play School, but the Magic Window is amazing out-there technology. Imagine a wall-sized window with you on one side and a friend on the other. Scrawl on the window with a marker pen and your friend can see it from the other side.

That’s all the Magic Window does, except that it’s really a screen, so you and your friend can be on opposite sides of the world.

It sounds simple, but making it happen is fiendishly difficult. We have two eyes, so we see in stereo. Steve Bathiche, a fast-talking boffin whose Microsoft team is behind the Magic Window explained that the window had to see in stereo, too.

“If you look around the window and move your head, the view changes. So we track the viewer’s head so the view changes as you move. This is what’s called motion view parallax and is a powerful technique to give the user the illusion of looking through a window.”

But an illusion of depth only comes through mimicking our eyes – so you need two cameras working together – and without the glasses you need for 3D TVs. This means using a special lens called the Wedge in conjunction with a motion sensor that knows where your eyes are. And that motion sensor? Well, you may have come across one already. It’s the Kinect sensor that comes with the Xbox.

In fact, it was Microsoft who developed this when exploring 3D movement, and when the Xbox team needed a sensor, they found the company had already invented one.

The Kinect is an example of how research into one thing, like the Magic Window, can have powerful side-effects. So, for instance, when working on transparent screens, the company devised a great way to improve video calls. When you have a see-through screen, you can place a camera right in the middle directly behind it.

You’ll be familiar with video calling apps like FaceTime on the iPhone and iPad: ever have a lingering feeling that you weren’t quite connecting? Some of that’s down to the way you and your caller are looking at the face in the middle of the display, not the camera at the top edge.

With this technology you create a video call where you can look your caller straight in the eyes and lose that feeling that the person you’re talking to is looking somewhere else. The result is a much better experience. Maybe, if that technology reaches fruition, it’ll be enough to actually persuade us to make video calls. Maybe not.

Even so, the transparent screen also lets you interact in different ways, grabbing the air behind the screen to affect what’s on the display. In practice, this takes some getting used to, but it’s fun. And very Minority Report.

When Steve’s team worked on making the Magic Window work for more than one person, they found a way to create a split screen where two people can play a video game at the same time, but see completely different screens. This technology is already available for some TVs and means two people can watch different channels simultaneously on the same TV (though at least one needs to wear headphones and it could feel somewhat isolating).

Steve has many more problems to solve before the Window is ready for home use, and he wouldn’t put a time frame on it, but if and when it happens the results will be realistic… but with extra features.

One person will be able to write a word on the window but – unlike a glass window, the Microsoft one can translate the word so the person on the other side sees it in their language.

The Magic Window exemplifies how crucial research and development departments are and how important it is to stay with developing technologies even if there’s no immediate implementation in sight.

News
Ben Little, right, is a Labour supporter while Jonathan Rogers supports the Green Party
general election 2015
News
The 91st Hakone Ekiden Qualifier at Showa Kinen Park, Tokyo, 2014
news
Life and Style
Former helicopter pilot Major Tim Peake will become the first UK astronaut in space for over 20 years
food + drinkNothing but the best for British astronaut as chef Heston Blumenthal cooks up his rations
News
Kim Wilde began gardening in the 1990s when she moved to the countryside
peopleThe singer is leading an appeal for the charity Thrive, which uses the therapy of horticulture
Life and Style
ebookNow available in paperback
ebooks
ebookPart of The Independent’s new eBook series The Great Composers
Sport
Alexis Sanchez celebrates scoring a second for Arsenal against Reading
football
Life and Style
health
Voices
An easy-peel potato; Dave Hax has come up with an ingenious method in food preparation
voicesDave Hax's domestic tips are reminiscent of George Orwell's tea routine. The world might need revolution, but we like to sweat the small stuff, says DJ Taylor
News
i100
News
Japan's population is projected to fall dramatically in the next 50 years (Wikimedia)
news
Life and Style
Buyers of secondhand cars are searching out shades last seen in cop show ‘The Sweeney’
motoringFlares and flounce are back on catwalks but a revival in ’70s car paintjobs was a stack-heeled step too far – until now
Latest stories from i100
Have you tried new the Independent Digital Edition apps?
Independent Dating
and  

By clicking 'Search' you
are agreeing to our
Terms of Use.

ES Rentals

    iJobs Job Widget
    iJobs Gadgets & Tech

    Recruitment Genius: Project Implementation Executive

    £18000 - £23000 per annum: Recruitment Genius: They work with major vehicle ma...

    Recruitment Genius: Digital Account Executive - Midlands

    £18000 - £26000 per annum: Recruitment Genius: They work with major vehicle ma...

    Ashdown Group: Front-End UI Application Developer

    £30000 - £40000 per annum + Benefits: Ashdown Group: Front-End UI Application ...

    Recruitment Genius: Digital Account Executive

    £18000 - £26000 per annum: Recruitment Genius: They work with major vehicle ma...

    Day In a Page

    NHS struggling to monitor the safety and efficacy of its services outsourced to private providers

    Who's monitoring the outsourced NHS services?

    A report finds that private firms are not being properly assessed for their quality of care
    Zac Goldsmith: 'I'll trigger a by-election over Heathrow'

    Zac Goldsmith: 'I'll trigger a by-election over Heathrow'

    The Tory MP said he did not want to stand again unless his party's manifesto ruled out a third runway. But he's doing so. Watch this space
    How do Greek voters feel about Syriza's backtracking on its anti-austerity pledge?

    How do Greeks feel about Syriza?

    Five voters from different backgrounds tell us what they expect from Syriza's charismatic leader Alexis Tsipras
    From Iraq to Libya and Syria: The wars that come back to haunt us

    The wars that come back to haunt us

    David Cameron should not escape blame for his role in conflicts that are still raging, argues Patrick Cockburn
    Sam Baker and Lauren Laverne: Too busy to surf? Head to The Pool

    Too busy to surf? Head to The Pool

    A new website is trying to declutter the internet to help busy women. Holly Williams meets the founders
    Heston Blumenthal to cook up a spice odyssey for British astronaut manning the International Space Station

    UK's Major Tum to blast off on a spice odyssey

    Nothing but the best for British astronaut as chef Heston Blumenthal cooks up his rations
    John Harrison's 'longitude' clock sets new record - 300 years on

    ‘Longitude’ clock sets new record - 300 years on

    Greenwich horologists celebrate as it keeps to within a second of real time over a 100-day test
    Fears in the US of being outgunned in the vital propaganda wars by Russia, China - and even Isis - have prompted a rethink on overseas broadcasters

    Let the propaganda wars begin - again

    'Accurate, objective, comprehensive': that was Voice of America's creed, but now its masters want it to promote US policy, reports Rupert Cornwell
    Why Japan's incredible long-distance runners will never win the London Marathon

    Japan's incredible long-distance runners

    Every year, Japanese long-distance runners post some of the world's fastest times – yet, come next weekend, not a single elite competitor from the country will be at the London Marathon
    Why does Tom Drury remain the greatest writer you've never heard of?

    Tom Drury: The quiet American

    His debut was considered one of the finest novels of the past 50 years, and he is every bit the equal of his contemporaries, Jonathan Franzen, Dave Eggers and David Foster Wallace
    You should judge a person by how they peel a potato

    You should judge a person by how they peel a potato

    Dave Hax's domestic tips are reminiscent of George Orwell's tea routine. The world might need revolution, but we like to sweat the small stuff, says DJ Taylor
    Beige is back: The drab car colours of the 1970s are proving popular again

    Beige to the future

    Flares and flounce are back on catwalks but a revival in ’70s car paintjobs was a stack-heeled step too far – until now
    Bill Granger recipes: Our chef's dishes highlight the delicate essence of fresh cheeses

    Bill Granger cooks with fresh cheeses

    More delicate on the palate, milder, fresh cheeses can also be kinder to the waistline
    Aston Villa vs Liverpool: 'This FA Cup run has been wonderful,' says veteran Shay Given

    Shay Given: 'This FA Cup run has been wonderful'

    The Villa keeper has been overlooked for a long time and has unhappy memories of the national stadium – but he is savouring his chance to play at Wembley
    Timeless drama of Championship race in league of its own - Michael Calvin

    Michael Calvin's Last Word

    Timeless drama of Championship race in league of its own