The future according to Microsoft: the Magic Window revolutionizes video chat

David Phelan has an exclusive peek behind the scenes at
Microsoft’s research and development facilities – here’s his first report

It may sound like something out of Play School, but the Magic Window is amazing out-there technology. Imagine a wall-sized window with you on one side and a friend on the other. Scrawl on the window with a marker pen and your friend can see it from the other side.

That’s all the Magic Window does, except that it’s really a screen, so you and your friend can be on opposite sides of the world.

It sounds simple, but making it happen is fiendishly difficult. We have two eyes, so we see in stereo. Steve Bathiche, a fast-talking boffin whose Microsoft team is behind the Magic Window explained that the window had to see in stereo, too.

“If you look around the window and move your head, the view changes. So we track the viewer’s head so the view changes as you move. This is what’s called motion view parallax and is a powerful technique to give the user the illusion of looking through a window.”

But an illusion of depth only comes through mimicking our eyes – so you need two cameras working together – and without the glasses you need for 3D TVs. This means using a special lens called the Wedge in conjunction with a motion sensor that knows where your eyes are. And that motion sensor? Well, you may have come across one already. It’s the Kinect sensor that comes with the Xbox.

In fact, it was Microsoft who developed this when exploring 3D movement, and when the Xbox team needed a sensor, they found the company had already invented one.

The Kinect is an example of how research into one thing, like the Magic Window, can have powerful side-effects. So, for instance, when working on transparent screens, the company devised a great way to improve video calls. When you have a see-through screen, you can place a camera right in the middle directly behind it.

You’ll be familiar with video calling apps like FaceTime on the iPhone and iPad: ever have a lingering feeling that you weren’t quite connecting? Some of that’s down to the way you and your caller are looking at the face in the middle of the display, not the camera at the top edge.

With this technology you create a video call where you can look your caller straight in the eyes and lose that feeling that the person you’re talking to is looking somewhere else. The result is a much better experience. Maybe, if that technology reaches fruition, it’ll be enough to actually persuade us to make video calls. Maybe not.

Even so, the transparent screen also lets you interact in different ways, grabbing the air behind the screen to affect what’s on the display. In practice, this takes some getting used to, but it’s fun. And very Minority Report.

When Steve’s team worked on making the Magic Window work for more than one person, they found a way to create a split screen where two people can play a video game at the same time, but see completely different screens. This technology is already available for some TVs and means two people can watch different channels simultaneously on the same TV (though at least one needs to wear headphones and it could feel somewhat isolating).

Steve has many more problems to solve before the Window is ready for home use, and he wouldn’t put a time frame on it, but if and when it happens the results will be realistic… but with extra features.

One person will be able to write a word on the window but – unlike a glass window, the Microsoft one can translate the word so the person on the other side sees it in their language.

The Magic Window exemplifies how crucial research and development departments are and how important it is to stay with developing technologies even if there’s no immediate implementation in sight.

Alexis Sanchez has completed a £35m move to Arsenal, the club have confirmed
sportGunners complete £35m signing of Barcelona forward
Poor teachers should be fearful of not getting pay rises or losing their job if they fail to perform, Steve Fairclough, headteacher of Abbotsholme School, suggested
voicesChris Sloggett explains why it has become an impossible career path
world cup 2014
Ray Whelan was arrested earlier this week
Life and Style
ebookA wonderful selection of salads, starters and mains featuring venison, grouse and other game
Arts and Entertainment
In a minor key: Keira Knightley in the lightweight 'Begin Again'
Arts and Entertainment
Celebrated children’s author Allan Ahlberg, best known for Each Peach Pear Plum
peopleIndian actress known as the 'Grand Old Lady of Bollywood' was 102
Wayne’s estate faces a claim for alleged copyright breaches
newsJohn Wayne's heirs duke it out with university over use of the late film star's nickname
Life and Style
It beggars belief: the homeless and hungry are weary, tortured, ghosts of people – with bodies contorted by imperceptible pain
lifeRough sleepers exist in every city. Hear the stories of those whose luck has run out
Mick Jagger performing at Glastonbury
Life and Style
fashionJ Crew introduces triple zero size to meet the Asia market demand
Santi Cazorla, Mikel Arteta and Mathieu Flamini of Arsenal launch the new Puma Arsenal kits at the Puma Store on Carnaby Street
sportMassive deal worth £150m over the next five years
Arts and Entertainment
Welsh opera singer Katherine Jenkins
musicHolyrood MPs 'staggered' at lack of Scottish artists performing
Life and Style
beautyBelgian fan lands L'Oreal campaign after being spotted at World Cup
Arts and Entertainment
Currently there is nothing to prevent all-male or all-female couples from competing against mixed sex partners at any of the country’s ballroom dancing events
Potential ban on same-sex partners in ballroom dancing competitions amounts to 'illegal discrimination'
Travel Shop
the manor
Up to 70% off luxury travel
on city breaks Find out more
Up to 70% off luxury travel
on chic beach resorts Find out more
sardina foodie
Up to 70% off luxury travel
on country retreats Find out more
Have you tried new the Independent Digital Edition apps?
Independent Dating

By clicking 'Search' you
are agreeing to our
Terms of Use.

ES Rentals

    iJobs Job Widget
    iJobs Gadgets & Tech

    Senior IOS Developer

    £40000 - £45000 per annum + competitive: Progressive Recruitment: My client is...

    SAP SD OTC Consultant | 12Months

    competitive: Progressive Recruitment: SAP SD OTC Consultant | 12 Months | 500/...

    Business Systems Analyst - London - £40,000 plus benefits

    £35000 - £40000 per annum + substantial benefits: Ashdown Group: Business Syst...

    Business Continuity Manager

    £300 - £301 per day + competitive: Progressive Recruitment: The successful can...

    Day In a Page

    A History of the First World War in 100 Moments: Peace without magnanimity - the summit in a railway siding that ended the fighting

    A History of the First World War in 100 Moments

    Peace without magnanimity - the summit in a railway siding that ended the fighting
    Scottish independence: How the Commonwealth Games could swing the vote

    Scottish independence: How the Commonwealth Games could swing the vote

    In the final part of our series, Chris Green arrives in Glasgow - a host city struggling to keep the politics out of its celebration of sport
    Out in the cold: A writer spends a night on the streets and hears the stories of the homeless

    A writer spends a night on the streets

    Rough sleepers - the homeless, the destitute and the drunk - exist in every city. Will Nicoll meets those whose luck has run out
    Striking new stations, high-speed links and (whisper it) better services - the UK's railways are entering a new golden age

    UK's railways are entering a new golden age

    New stations are opening across the country and our railways appear to be entering an era not seen in Britain since the early 1950s
    Conchita Wurst becomes a 'bride' on the Paris catwalk - and proves there is life after Eurovision

    Conchita becomes a 'bride' on Paris catwalk

    Alexander Fury salutes the Eurovision Song Contest winner's latest triumph
    Pétanque World Championship in Marseilles hit by

    Pétanque 'world cup' hit by death threats

    This year's most acrimonious sporting event took place in France, not Brazil. How did pétanque get so passionate?
    Whelks are healthy, versatile and sustainable - so why did we stop eating them in the UK?

    Why did we stop eating whelks?

    Whelks were the Victorian equivalent of the donor kebab and our stocks are abundant. So why do we now export them all to the Far East?
    10 best women's sunglasses

    In the shade: 10 best women's sunglasses

    From luxury bespoke eyewear to fun festival sunnies, we round up the shades to be seen in this summer
    Germany vs Argentina World Cup 2014: Lionel Messi? Javier Mascherano is key for Argentina...

    World Cup final: Messi? Mascherano is key for Argentina...

    No 10 is always centre of attention but Barça team-mate is just as crucial to finalists’ hopes
    Siobhan-Marie O’Connor: Swimmer knows she needs Glasgow joy on road to Rio

    Siobhan-Marie O’Connor: Swimmer needs Glasgow joy on road to Rio

    18-year-old says this month’s Commonwealth Games are a key staging post in her career before time slips away
    The true Gaza back-story that the Israelis aren’t telling this week

    The true Gaza back-story that the Israelis aren’t telling this week

    A future Palestine state will have no borders and be an enclave within Israel, surrounded on all sides by Israeli-held territory, says Robert Fisk
    A History of the First World War in 100 Moments: The German people demand an end to the fighting

    A History of the First World War in 100 Moments

    The German people demand an end to the fighting
    New play by Oscar Wilde's grandson reveals what the Irish wit said at his trials

    New play reveals what Oscar Wilde said at trials

    For a century, what Wilde actually said at his trials was a mystery. But the recent discovery of shorthand notes changed that. Now his grandson Merlin Holland has turned them into a play
    Can scientists save the world's sea life from

    Can scientists save our sea life?

    By the end of the century, the only living things left in our oceans could be plankton and jellyfish. Alex Renton meets the scientists who are trying to turn the tide
    Richard III, Trafalgar Studios, review: Martin Freeman gives highly intelligent performance

    Richard III review

    Martin Freeman’s psychotic monarch is big on mockery but wanting in malice