The future according to Microsoft: the Magic Window revolutionizes video chat

David Phelan has an exclusive peek behind the scenes at
Microsoft’s research and development facilities – here’s his first report

It may sound like something out of Play School, but the Magic Window is amazing out-there technology. Imagine a wall-sized window with you on one side and a friend on the other. Scrawl on the window with a marker pen and your friend can see it from the other side.

That’s all the Magic Window does, except that it’s really a screen, so you and your friend can be on opposite sides of the world.

It sounds simple, but making it happen is fiendishly difficult. We have two eyes, so we see in stereo. Steve Bathiche, a fast-talking boffin whose Microsoft team is behind the Magic Window explained that the window had to see in stereo, too.

“If you look around the window and move your head, the view changes. So we track the viewer’s head so the view changes as you move. This is what’s called motion view parallax and is a powerful technique to give the user the illusion of looking through a window.”

But an illusion of depth only comes through mimicking our eyes – so you need two cameras working together – and without the glasses you need for 3D TVs. This means using a special lens called the Wedge in conjunction with a motion sensor that knows where your eyes are. And that motion sensor? Well, you may have come across one already. It’s the Kinect sensor that comes with the Xbox.

In fact, it was Microsoft who developed this when exploring 3D movement, and when the Xbox team needed a sensor, they found the company had already invented one.

The Kinect is an example of how research into one thing, like the Magic Window, can have powerful side-effects. So, for instance, when working on transparent screens, the company devised a great way to improve video calls. When you have a see-through screen, you can place a camera right in the middle directly behind it.

You’ll be familiar with video calling apps like FaceTime on the iPhone and iPad: ever have a lingering feeling that you weren’t quite connecting? Some of that’s down to the way you and your caller are looking at the face in the middle of the display, not the camera at the top edge.

With this technology you create a video call where you can look your caller straight in the eyes and lose that feeling that the person you’re talking to is looking somewhere else. The result is a much better experience. Maybe, if that technology reaches fruition, it’ll be enough to actually persuade us to make video calls. Maybe not.

Even so, the transparent screen also lets you interact in different ways, grabbing the air behind the screen to affect what’s on the display. In practice, this takes some getting used to, but it’s fun. And very Minority Report.

When Steve’s team worked on making the Magic Window work for more than one person, they found a way to create a split screen where two people can play a video game at the same time, but see completely different screens. This technology is already available for some TVs and means two people can watch different channels simultaneously on the same TV (though at least one needs to wear headphones and it could feel somewhat isolating).

Steve has many more problems to solve before the Window is ready for home use, and he wouldn’t put a time frame on it, but if and when it happens the results will be realistic… but with extra features.

One person will be able to write a word on the window but – unlike a glass window, the Microsoft one can translate the word so the person on the other side sees it in their language.

The Magic Window exemplifies how crucial research and development departments are and how important it is to stay with developing technologies even if there’s no immediate implementation in sight.

News
A Brazilian wandering spider
news

World's most lethal spider found under a bunch of bananas

News
people
Arts and Entertainment
Tim Wonnacott dancing the pasadoble
TVStrictly Come Dancing The Result
Sport
Mario Balotelli pictured in the win over QPR
footballInternet reacts to miss shocker for Liverpool striker
PROMOTED VIDEO
Life and Style
ebooksA superb mix of recipes serving up the freshest of local produce in a delicious range of styles
Life and Style
ebooksFrom the lifespan of a slug to the distance to the Sun: answers to 500 questions from readers
Arts and Entertainment
BBC's Antiques Roadshow uncovers a TIE fighter pilot helmet from the 1977 Star Wars film, valuing it at £50,000
TV

TV presenter Fiona Bruce seemed a bit startled by the find during the filming of Antiques Roadshow

News
people

Comedian says he 'never laughed as hard as I have writing with Rik'

Sport
Steven Caulker of QPR scores an own goal during the Barclays Premier League match between Queens Park Rangers and Liverpool
football
News
i100
Life and Style
tech
Latest stories from i100
Have you tried new the Independent Digital Edition apps?
Independent Dating
and  

By clicking 'Search' you
are agreeing to our
Terms of Use.

ES Rentals

    iJobs Job Widget
    iJobs Gadgets & Tech

    ***ASP.NET Developer - Cheshire - £35k - Permanent***

    £30000 - £35000 Per Annum Excellent benefits: Clearwater People Solutions Ltd:...

    ***Social Media Application Developer*** or Graduate - Permanent - Surrey - £25k-£40k

    £25000 - £40000 Per Annum Excellent benefits: Clearwater People Solutions Ltd:...

    IT Business Analyst - London - £35,000

    £35000 per annum + 25 days holiday, pension & further benefits: Ashdown Group:...

    Datacentre Consultant (Infrastructure Consultant, HyperV) £45k

    £45000 per annum: Ampersand Consulting LLP: Datacentre Consultant (Datacentre,...

    Day In a Page

    Oscar Pistorius sentencing: The athlete's wealth and notoriety have provoked a long overdue debate on South African prisons

    'They poured water on, then electrified me...'

    If Oscar Pistorius is sent to jail, his experience will not be that of other inmates
    James Wharton: The former Guard now fighting discrimination against gay soldiers

    The former Guard now fighting discrimination against gay soldiers

    Life after the Army has brought new battles for the LGBT activist James Wharton
    Ebola in the US: Panic over the virus threatens to infect President Obama's midterms

    Panic over Ebola threatens to infect the midterms

    Just one person has died, yet November's elections may be affected by what Republicans call 'Obama's Katrina', says Rupert Cornwell
    Premier League coaches join the RSC to swap the tricks of their trades

    Darling, you were fabulous! But offside...

    Premier League coaches are joining the RSC to learn acting skills, and in turn they will teach its actors to play football. Nick Clark finds out why
    How to dress with authority: Kirsty Wark and Camila Batmanghelidjh discuss the changing role of fashion in women's workwear

    How to dress with authority

    Kirsty Wark and Camila Batmanghelidjh discuss the changing role of fashion in women's workwear
    New book on Joy Division's Ian Curtis sheds new light on the life of the late singer

    New book on Ian Curtis sheds fresh light on the life of the late singer

    'Joy Division were making art... Ian was for real' says author Jon Savage
    Sean Harris: A rare interview with British acting's secret weapon

    Sean Harris: A rare interview with British acting's secret weapon

    The Bafta-winner talks Hollywood, being branded a psycho, and how Barbra Streisand is his true inspiration
    Tim Minchin, interview: The musician, comedian and world's favourite ginger is on scorching form

    Tim Minchin interview

    For a no-holds-barred comedian who is scathing about woolly thinking and oppressive religiosity, he is surprisingly gentle in person
    Boris Johnson's boozing won't win the puritan vote

    Boris's boozing won't win the puritan vote

    Many of us Brits still disapprove of conspicuous consumption – it's the way we were raised, says DJ Taylor
    Ash frontman Tim Wheeler reveals how he came to terms with his father's dementia

    Tim Wheeler: Alzheimer's, memories and my dad

    Wheeler's dad suffered from Alzheimer's for three years. When he died, there was only one way the Ash frontman knew how to respond: with a heartfelt solo album
    Hugh Bonneville & Peter James: 'Peter loves his classic cars; I've always pootled along fine with a Mini Metro. I think I lack his panache'

    How We Met: Hugh Bonneville & Peter James

    'Peter loves his classic cars; I've always pootled along fine with a Mini Metro. I think I lack his panache'
    Bill Granger recipes: Our chef's heavenly crab dishes don't need hours of preparation

    Bill Granger's heavenly crab recipes

    Scared off by the strain of shelling a crab? Let a fishmonger do the hard work so you can focus on getting the flavours right
    Radamel Falcao: How faith and love drive the Colombian to glory

    Radamel Falcao: How faith and love drive the Colombian to glory

    After a remarkable conversion from reckless defender to prolific striker, Monaco's ace says he wants to make his loan deal at Old Trafford permanent
    Terry Venables: Premier League managers must not be allowed to dictate who plays and who does not play for England

    Terry Venables column

    Premier League managers must not be allowed to dictate who plays and who does not play for England
    The Inside Word: Brendan Rodgers looks to the future while Roy Hodgson is ghost of seasons past

    Michael Calvin's Inside Word

    Brendan Rodgers looks to the future while Roy Hodgson is ghost of seasons past