Music by numbers

A clever piece of technology - Sinfonia - can now do the job of an orchestra. Is this the beginning of the end for live performance? Angel Brown reports

At worst it's a "karaoke machine," at best it's "progress", according to fans of the musical
Les Misérables on a busy web forum about the new virtual orchestra being used at London's Queen's Theatre.

At worst it's a "karaoke machine," at best it's "progress", according to fans of the musical Les Misérables on a busy web forum about the new virtual orchestra being used at London's Queen's Theatre.

When the show moved last month to its new smaller home, it lost half its musicians due to limited space. To preserve the audio drama of the Palace show, the promoter Cameron Mackintosh chose to be the first in the UK to use a technology called Sinfonia to boost the relatively thinner sound. Though the fans may feel somewhat cheated by having some of the live essence of the show stolen by this unknown technology, Sinfonia is no karaoke machine; it is alarmingly good at simulating live orchestra musicians. And not surprisingly, those musicians are worried about their futures.

What may be surprising is that Sinfonia is designed and built by people who say that they "really know music and what is important to musicians", the American company RealTime Music Solutions. The process begins with much better quality samples than we are used to in synthesised sound. To that, add filtering software, allowing up to 50 different sound nuances, to better simulate the quality of a live instrument. The software can layer these instruments together to build a virtual model of the full score. (This kind of sound processing requires substantial computer power, as well as stacks of memory.) The instruments being played live are then muted from Sinfonia's real-time delivery. During showtime (and this is the cleverest part) the person playing the Sinfonia keeps time with the conductor's baton; but not simply by tapping a key.

"He or she plays a fully notated musical phrase, following a score as well as the conductor and stage action," explains Jeff Lazarus, the chief executive of RealTime. "Other performance features include ways to initiate arbitrary vamps [improvisations] and relocates [key changes], holds and cut-offs for big fermatas [extended notes], pick-up phrases [opening lyrics], and more." This allows the "sinfonist" to stay in sync with the actors on stage, despite common events such as late entrances, where the musical cue might need to be repeated, or varying lengths of pauses before the music comes back in.

This ability to play along with the conductor is the ground-breaking differentiator of this technology: without it, orchestras must often rely on playing along with universally loathed "click tracks" or pre-recorded snippets. The ability to add nuance to the high-quality samples is also key as, Lazarus states: "It is not uncommon to see three or four synthesisers in a musical theatre orchestra pit. The synthesisers are almost always being used to approximate a larger traditional orchestra - more strings, or all the strings, more reeds, and so on." RealTime's vision for Sinfonia was to combine all the electronics into one space in the pit. "Overall, this improves the sound - as well as creating more work for acoustic musicians. And it frees up chairs for a violin, an oboe and so on."

Except that those chairs were already occupied. Sinfonia is so good at its job that it is making the musicians' unions on both sides of the Atlantic increasingly nervous. Its arrival in the US last year caused strikes that closed Broadway theatres. In the UK, Mackintosh was spared that controversy because The Queen's Theatre pit is simply too small for the full orchestra of the Palace Theatre, from which it transferred. Nine musicians lost their jobs. (Arguably, though, they would have lost them anyway in the move.)

But the topic is still controversial. When asked for a comment, the theatre's press office replied the show had signed an agreement not to talk about Sinfonia.

Horace Trubridge, the Assistant General Secretary of the Musicians' Union, says they are still in talks with the Society of London Theatre about the regulation of this device. "So long as it fits the genre, then it's fine," he says. "If you're putting on a show about Kraftwerk you wouldn't expect to see a bunch of musicians in the pit. But if it's Oklahoma!, an audience would expect a traditional orchestra. We object to its indiscriminate use where musicians could otherwise reasonably expect to be employed."

Musicians themselves are ambivalent. Michelle Wright, a freelance violinist says: "This technology has to be better. It's really an insult if you're losing musicians to a string section played on a synthesiser." But on the other hand, she also finds the idea of it "belittling". "Musicians must be protected," she says, "as it demands such a high level of training and there are so few jobs as it is."

Lazarus insists that Sinfonia has never cost musicians jobs. "It has always been used to enable productions to sound better," he says, "always with the same number of musicians planned before Sinfonia entered the picture; frequently with a greater number." There's no doubt, though, that this technology has the power to change the contexts where we are used to hearing the big orchestra sound.

If the technology were readily available, its impact could be far reaching. Besides musicals, any musical performance that tours the UK, and even pantomime, might find it attractive. "There may also be a danger of ballet companies being tempted to use it," says Bill Kerr, the Orchestral Organiser of the Musicians' Union. It has been used to compose film scores, and new enhancements in the pipeline will include improvisational features for use in live jazz combos.

In the US, last year's strikes might soon have an off-Broadway echo. The Opera Company of Brooklyn (OCB) has just decided to throw out the agreement it signed in February with the local chapter of the musicians' union, which restricted its use of Sinfonia. In retaliation, the union filed a federal unfair labour practice complaint against OCB for voiding the pact. The OCB sees Sinfonia as central to their future strategy because it "allows a small company like us to present these great operas", insisted the board in a recent press release. Their view is that this technology will help them to put on more productions that will, in turn, employ more musicians.

But what of losing the live essence? Some fans may feel as if big business is trying to pull the wool over their eyes, thinking that the audience is too unsophisticated to notice, or care. Whether they will care as the use of Sinfonia, or similar devices, becomes widespread is another question. In the context of a big-budget musical with fantastic sets, special effects and highly amplified sound, just how important will it continue to be to have a full complement of live musicians in the pit?

"I don't think we're going to wake up to theatres filled with these devices," says Trubridge. "Andrew Lloyd Webber's new show The Woman in White is in rehearsals with orthodox instrumentalists and he is raving about the sound." Buoyed by the uptake in interest in live music over the past year, Trubridge remains philosophical: "I could see a time when, say, if things got really terrible with many musicians being replaced with technology that someone would say, 'Hey, why don't we have a live band?' and that would become trendy again. It's about peaks and troughs, and I just cannot see the complete removal of the band."

Susan Sarandon described David Bowie as
peopleSusan Sarandon reveals more on her David Bowie romance
Lewis Hamilton walks back to the pit lane with his Mercedes burning in the background
Formula 1
Arts and Entertainment
The new characters were announced yesterday at San Diego Comic Con
comic-con 2014
Arsenal supporters gather for a recent ‘fan party’ in New Jersey
Arts and Entertainment
No Devotion's Geoff Rickly and Stuart Richardson
musicReview: No Devotion, O2 Academy Islington, London
sportDidier Drogba returns to Chelsea on one-year deal
Arts and Entertainment
The Secret Cinema performance of Back to the Future has been cancelled again
ebookA unique anthology of reporting and analysis of a crucial period of history
newsComedy club forced to apologise as maggots eating a dead pigeon fall out of air-conditioning
Life and Style
Balmain's autumn/winter 2014 campaign, shot by Mario Sorrenti and featuring Binx Walton, Cara Delevingne, Jourdan Dunn, Ysaunny Brito, Issa Lish and Kayla Scott
fashionHow Olivier Rousteing is revitalising the house of Balmain
Arts and Entertainment
Christian Grey cradles Ana in the Fifty Shades of Grey film
filmFifty Shades of Grey trailer provokes moral outrage in US
Travel Shop
the manor
Up to 70% off luxury travel
on city breaks Find out more
Up to 70% off luxury travel
on chic beach resorts Find out more
sardina foodie
Up to 70% off luxury travel
on country retreats Find out more
Latest stories from i100
Have you tried new the Independent Digital Edition apps?
Independent Dating

By clicking 'Search' you
are agreeing to our
Terms of Use.

iJobs Job Widget
iJobs General

BI Developer - Sheffield - £35,000 ~ £40,000 DOE

£35000 - £40000 per annum + competitive: Progressive Recruitment: My client is...

Employment Solicitor

Highly Competitive Salary: Austen Lloyd: MANCHESTER - Senior Employment Solici...

Senior Risk Manager - Banking - London - £650

£600 - £650 per day: Orgtel: Conduct Risk Liaison Manager - Banking - London -...

Commercial Litigation Associate

Highly Attractive Package: Austen Lloyd: CITY - COMMERCIAL LITIGATION - GLOBAL...

Day In a Page

Best comedians: How the professionals go about their funny business, from Sarah Millican to Marcus Brigstocke

Best comedians: How the professionals go about their funny business

For all those wanting to know how stand-ups keep standing, here are some of the best moments
Jokes on Hollywood: 'With comedy film audiences shrinking, it’s time to move on'

Jokes on Hollywood

With comedy film audiences shrinking, it’s time to move on
Edinburgh Fringe 2014: The comedy highlights, from Bridget Christie to Jack Dee

Edinburgh Fringe 2014

The comedy highlights, from Bridget Christie to Jack Dee
Evan Davis: The BBC’s wolf in sheep’s clothing to take over at Newsnight

The BBC’s wolf in sheep’s clothing

What will Evan Davis be like on Newsnight?
Finding the names for America’s shame: What happens to the immigrants crossing the US-Mexico border without documents who never make it past the Arizona desert?

Finding the names for America’s shame

The immigrants crossing the US-Mexico border without documents who never make it past the Arizona desert
Inside a church for Born Again Christians: Speaking to God in a Manchester multiplex

Inside a church for Born Again Christians

As Britain's Anglican church struggles to establish its modern identity, one branch of Christianity is booming
Rihanna, Kim Kardashian and me: How Olivier Rousteing is revitalising the house of Balmain

Olivier Rousteing is revitalising the house of Balmain

Parisian couturier Pierre Balmain made his name dressing the mid-century jet set. Today, Olivier Rousteing – heir to the house Pierre built – is celebrating their 21st-century equivalents. The result? Nothing short of Balmania
Cancer, cardiac arrest, HIV and homelessness - and he's only 39

Incredible survival story of David Tovey

Tovey went from cooking for the Queen to rifling through bins for his supper. His is a startling story of endurance against the odds – and of a social safety net failing at every turn
Backhanders, bribery and abuses of power have soared in China as economy surges

Bribery and abuses of power soar in China

The bribery is fuelled by the surge in China's economy but the rules of corruption are subtle and unspoken, finds Evan Osnos, as he learns the dark arts from a master
Commonwealth Games 2014: Highland terriers stole the show at the opening ceremony

Highland terriers steal the show at opening ceremony

Gillian Orr explores why a dog loved by film stars and presidents is finally having its day
German art world rocked as artists use renowned fat sculpture to distil schnapps

Brewing the fat from artwork angers widow of sculptor

Part of Joseph Beuys' 1982 sculpture 'Fettecke' used to distil schnapps
BBC's The Secret History of Our Streets reveals a fascinating window into Britain's past

BBC takes viewers back down memory lane

The Secret History of Our Streets, which returns with three films looking at Scottish streets, is the inverse of Benefits Street - delivering warmth instead of cynicism
Joe, film review: Nicolas Cage delivers an astonishing performance in low budget drama

Nicolas Cage shines in low-budget drama Joe

Cage plays an ex-con in David Gordon Green's independent drama, which has been adapted from a novel by Larry Brown
How to make your own gourmet ice lollies, granitas, slushy cocktails and frozen yoghurt

Make your own ice lollies and frozen yoghurt

Think outside the cool box for this summer's tempting frozen treats
Ford Fiesta is UK's most popular car of all-time, with sales topping 4.1 million since 1976

Fiesta is UK's most popular car of all-time

Sales have topped 4.1 million since 1976. To celebrate this milestone, four Independent writers recall their Fiestas with pride