The future according to Microsoft: the Magic Window revolutionizes video chat

David Phelan has an exclusive peek behind the scenes at
Microsoft’s research and development facilities – here’s his first report

It may sound like something out of Play School, but the Magic Window is amazing out-there technology. Imagine a wall-sized window with you on one side and a friend on the other. Scrawl on the window with a marker pen and your friend can see it from the other side.

That’s all the Magic Window does, except that it’s really a screen, so you and your friend can be on opposite sides of the world.

It sounds simple, but making it happen is fiendishly difficult. We have two eyes, so we see in stereo. Steve Bathiche, a fast-talking boffin whose Microsoft team is behind the Magic Window explained that the window had to see in stereo, too.

“If you look around the window and move your head, the view changes. So we track the viewer’s head so the view changes as you move. This is what’s called motion view parallax and is a powerful technique to give the user the illusion of looking through a window.”

But an illusion of depth only comes through mimicking our eyes – so you need two cameras working together – and without the glasses you need for 3D TVs. This means using a special lens called the Wedge in conjunction with a motion sensor that knows where your eyes are. And that motion sensor? Well, you may have come across one already. It’s the Kinect sensor that comes with the Xbox.

In fact, it was Microsoft who developed this when exploring 3D movement, and when the Xbox team needed a sensor, they found the company had already invented one.

The Kinect is an example of how research into one thing, like the Magic Window, can have powerful side-effects. So, for instance, when working on transparent screens, the company devised a great way to improve video calls. When you have a see-through screen, you can place a camera right in the middle directly behind it.

You’ll be familiar with video calling apps like FaceTime on the iPhone and iPad: ever have a lingering feeling that you weren’t quite connecting? Some of that’s down to the way you and your caller are looking at the face in the middle of the display, not the camera at the top edge.

With this technology you create a video call where you can look your caller straight in the eyes and lose that feeling that the person you’re talking to is looking somewhere else. The result is a much better experience. Maybe, if that technology reaches fruition, it’ll be enough to actually persuade us to make video calls. Maybe not.

Even so, the transparent screen also lets you interact in different ways, grabbing the air behind the screen to affect what’s on the display. In practice, this takes some getting used to, but it’s fun. And very Minority Report.

When Steve’s team worked on making the Magic Window work for more than one person, they found a way to create a split screen where two people can play a video game at the same time, but see completely different screens. This technology is already available for some TVs and means two people can watch different channels simultaneously on the same TV (though at least one needs to wear headphones and it could feel somewhat isolating).

Steve has many more problems to solve before the Window is ready for home use, and he wouldn’t put a time frame on it, but if and when it happens the results will be realistic… but with extra features.

One person will be able to write a word on the window but – unlike a glass window, the Microsoft one can translate the word so the person on the other side sees it in their language.

The Magic Window exemplifies how crucial research and development departments are and how important it is to stay with developing technologies even if there’s no immediate implementation in sight.

Sport
Seth Rollins cashes in his Money in the Bank contract to win the WWE World Heavyweight Championship
WWERollins win the WWE World Heavyweight title in one of the greatest WrestleMania's ever seen
Arts and Entertainment
Louis Theroux: By Reason of Insanity takes him behind the bars again
tvBy Reason of Insanity, TV review
Arts and Entertainment
Cassetteboy's latest video is called Emperor's New Clothes rap
videoThe political parody genius duo strike again with new video
Arts and Entertainment
tvPoldark, TV review
Life and Style
ebookNow available in paperback
ebooks
ebookPart of The Independent’s new eBook series The Great Composers
Latest stories from i100
Have you tried new the Independent Digital Edition apps?
Independent Dating
and  

By clicking 'Search' you
are agreeing to our
Terms of Use.

ES Rentals

    iJobs Job Widget
    iJobs Gadgets & Tech

    Recruitment Genius: Junior Web Designer - Client Liaison

    £6 per hour: Recruitment Genius: This is an exciting opportunity to join a gro...

    Recruitment Genius: Service Delivery Manager

    Negotiable: Recruitment Genius: A Service Delivery Manager is required to join...

    Recruitment Genius: IT Infrastructure Engineer

    £30000 - £40000 per annum: Recruitment Genius: Our client is looking to find a...

    Recruitment Genius: IT Engineer

    £21000 - £23600 per annum: Recruitment Genius: An exciting opportunity to join...

    Day In a Page

    No postcode? No vote

    Floating voters

    How living on a houseboat meant I didn't officially 'exist'
    Louis Theroux's affable Englishman routine begins to wear thin

    By Reason of Insanity

    Louis Theroux's affable Englishman routine begins to wear thin
    Power dressing is back – but no shoulderpads!

    Power dressing is back

    But banish all thoughts of Eighties shoulderpads
    Spanish stone-age cave paintings 'under threat' after being re-opened to the public

    Spanish stone-age cave paintings in Altamira 'under threat'

    Caves were re-opened to the public
    'I was the bookies’ favourite to be first to leave the Cabinet'

    Vince Cable interview

    'I was the bookies’ favourite to be first to leave the Cabinet'
    Election 2015: How many of the Government's coalition agreement promises have been kept?

    Promises, promises

    But how many coalition agreement pledges have been kept?
    The Gaza fisherman who built his own reef - and was shot dead there by an Israeli gunboat

    The death of a Gaza fisherman

    He built his own reef, and was fatally shot there by an Israeli gunboat
    Saudi Arabia's airstrikes in Yemen are fuelling the Gulf's fire

    Saudi airstrikes are fuelling the Gulf's fire

    Arab intervention in Yemen risks entrenching Sunni-Shia divide and handing a victory to Isis, says Patrick Cockburn
    Zayn Malik's departure from One Direction shows the perils of fame in the age of social media

    The only direction Zayn could go

    We wince at the anguish of One Direction's fans, but Malik's departure shows the perils of fame in the age of social media
    Young Magician of the Year 2015: Meet the schoolgirl from Newcastle who has her heart set on being the competition's first female winner

    Spells like teen spirit

    A 16-year-old from Newcastle has set her heart on being the first female to win Young Magician of the Year. Jonathan Owen meets her
    Jonathan Anderson: If fashion is a cycle, this young man knows just how to ride it

    If fashion is a cycle, this young man knows just how to ride it

    British designer Jonathan Anderson is putting his stamp on venerable house Loewe
    Number plates scheme could provide a licence to offend in the land of the free

    Licence to offend in the land of the free

    Cash-strapped states have hit on a way of making money out of drivers that may be in collision with the First Amendment, says Rupert Cornwell
    From farm to fork: Meet the Cornish fishermen, vegetable-growers and butchers causing a stir in London's top restaurants

    From farm to fork in Cornwall

    One man is bringing together Cornwall's most accomplished growers, fishermen and butchers with London's best chefs to put the finest, freshest produce on the plates of some of the country’s best restaurants
    Robert Parker interview: The world's top wine critic on tasting 10,000 bottles a year, absurd drinking notes and New World wannabes

    Robert Parker interview

    The world's top wine critic on tasting 10,000 bottles a year, absurd drinking notes and New World wannabes
    Don't believe the stereotype - or should you?

    Don't believe the stereotype - or should you?

    We exaggerate regional traits and turn them into jokes - and those on the receiving end are in on it too, says DJ Taylor