How a Hollywood computer made the stick of celery redundant

For more than 70 years, Foley artists have knocked coconut shells together, snapped vegetables and stamped in gravel pits to provide films with their sound effects. To them, a stick of celery or a frozen lettuce is not the staple of a decent salad but a bone ready to be broken. A heavy staple gun becomes a .44 Magnum, and scrunched cellophane a crackling log fire.

In the hands of an expert soundman, a pair of gloves produces the flapping of wings, squelching soapy hands conjure gory fight scenes, and the sound of actors smooching is given added lustre by the technician getting amorous with the side of his own wrist.

These traditional techniques have persisted even as cinematic visual effects have undergone multiple revolutions. Even today's most high-tech films like Toy Story 3, with their computer-generated imagery, still rely on the plain old Foley artist, who is often still using techniques pioneered in the first "talkies" (and remains consigned to the tail end of the credit reel).

However, if a team of American computer developers has its way, some of the practices perfected by these unsung heroes of the film industry could become obsolete.

The team will unveil a computer program this week which will generate sounds using similar modelling techniques to those employed in creating CGI graphics.

Their program builds a physical picture of the way sounds are created – for instance simulating the noise of a waterfall by constructing the component noises on a 3D virtual grid. If the new model proves successful, the existing, labour-intensive system of employing Foley artists to recreate every sound on a film could become largely automated.

Foley artists, while not resistant to change, believe that computer simulation can never completely replace the raw passion a human can bring to a soundtrack. "These newer ways of operating can remove a lot of the donkey-work from what we do but sound engineering in films is not simply about creating a sound, it is about creating an emotion using sound," said Pinewood Studios' resident Foley artist, Sandy Buchanan, whose recent film credits include Quantum of Solace and Tim Burton's adaptation of Alice in Wonderland.

"The real sound of a bone breaking would be quite boring if you just recorded it, but the sound of celery snapping, designed, produced and engineered by a professional, can be stomach-churning. For those sounds, the Foley artist cannot be replaced – but he will have to adapt."

Andy Farnell, a prominent sound technician who specialises in computer games, agrees: "My emotional response would be that you can never replace those techniques entirely."

The traditional art form is named after Jack Foley, who created the sound effects for Universal's first talkie, Showboat. The microphones used at the time could only accurately pick up dialogue, so background noises, like footsteps and doors closing, needed to be recreated in a studio. Foley began to develop ways of making these sounds and dubbing them over the film.

Since then, hundreds of ingenious techniques have been used to create almost all the background noises in Hollywood films, adding layers of texture that are taken for granted by viewers. Despite the ubiquity of these effects, they often go unnoticed – until the artists make a mistake.

The new system, developed by Hengchin Yeh, William Moss and colleagues at the University of North Carolina at Chapel Hill, synthesises sounds associated with liquids flowing or splashing.

Mr Moss explained that, when water flows or waves break, noise is generated by the vibration of air bubbles. "You can model the bubbles – they just resonate at a certain frequency depending on their size. It is surprising but that is the primary source of sound in liquids," he told New Scientist, adding: "The physics is pretty easy."

The program models the vibration of these bubbles on a 3D grid, in the same way that 3D figures are made in CGI films. Until recently the technology has not been able to produce realistic simulations of complex sounds. But developers believe that they will soon be able to accurately recreate most of the noises they need.

Creating the sounds

Heavy staple gun, Gun noises

Snapping celery, Broken bones

Metal rake dragged across metal, Screeching car brakes

Heavy phone book, Body punching

Tearing a head of cabbage, Paper shredder

Cellophane, Crackling fire

Metal laundry tub filled with metal trays, empty fizzy drink cans, hubcaps, cutlery, knives..., A "crash tube" used to simulate collisions

Cassette tape ribbon, Grass or brush

Pair of gloves, Bird wings flapping

Hand soap, Squishing noises

Wicker basket and flippers, Sea monster (as above)

The side of the wrist (wet), Adding gusto to kissing scenes

Leather jacket (twisted), Hammock swinging

Polystyrene, Sound of ice breaking

Rusty hinge/old chair, Creaking sound (hold against different surfaces for drastically different results)

Arrow/thin stick Whooshing noise or brush of clothing

Half-coconuts, stuffed with padding, Hoof noises (à la Monty Python)

Arts and Entertainment
Cold case: Aaron McCusker and Christopher Eccleston in ‘Fortitude’
tv Review: Sky Atlantic's ambitious new series began tonight with a feature-length special
Arts and Entertainment
'The Archers' has an audience of about five million
radioA growing number of listeners are voicing their discontent; so loudly that even the BBC's director-general seems worried
Arts and Entertainment
Ready to open the Baftas, rockers Kasabian are also ‘great film fans’
musicExclusive: Rockers promise an explosive opening to the evening
Arts and Entertainment
Henry VIII played by Damien Lewis
tvReview: Scheming queens-in-waiting, tangled lines of succession and men of lowly birth rising to power – sound familiar?
Arts and Entertainment
tv
PROMOTED VIDEO
Arts and Entertainment
Taylor Swift is heading to Norwich for Radio 1's Big Weekend

music
Arts and Entertainment
Beer as folk: Vincent Franklin and Cyril Nri (centre) in ‘Cucumber’
tvReview: This slice of gay life in Manchester has universal appeal
Have you tried new the Independent Digital Edition apps?
Arts and Entertainment

ebooksNow available in paperback
Arts and Entertainment

ebooks
Arts and Entertainment
‘A Day at the Races’ still stands up well today
film
Arts and Entertainment
‘The Royals’ – a ‘twisted, soapy take on England’s first family’
tvAnd its producers have already announced a second season...
Arts and Entertainment
Kraftwerk performing at the Neue Nationalgalerie (New National Gallery) museum in Berlin earlier this month
musicWhy a bunch of academics consider German electropoppers Kraftwerk worthy of their own symposium
Arts and Entertainment
Icelandic singer Bjork has been forced to release her album early after an online leak

music
Arts and Entertainment
Colin Firth as Harry Hart in Kingsman: The Secret Service

film
Arts and Entertainment
Brian Blessed as King Lear in the Guildford Shakespeare Company's performance of the play

theatre
Arts and Entertainment
In the picture: Anthony LaPaglia and Martin Freeman in 'The Eichmann Show'

tv
Arts and Entertainment
Anne Kirkbride and Bill Roache as Deirdre and Ken Barlow in Coronation Street

tvThe actress has died aged 60
Arts and Entertainment
Marianne Jean-Baptiste defends Joe Miller in Broadchurch series two

tv
Arts and Entertainment
The frill of it all: Hattie Morahan in 'The Changeling'

theatre
Arts and Entertainment
Gillian Anderson and David Duchovny may reunite for The X Files

tv
Arts and Entertainment
Jeremy Clarkson, left, and Richard Hammond upset the locals in South America
TV
News
A young woman punched a police officer after attending a gig by US rapper Snoop Dogg
people
Arts and Entertainment
Reese Witherspoon starring in 'Wild'

It's hard not to warm to Reese Witherspoon's heroismfilm
Arts and Entertainment
Word up: Robbie Coltrane as dictionary guru Doctor Johnson in the classic sitcom Blackadder the Third
books

Arts and Entertainment
The Oscar nominations are due to be announced today

Oscars 2015
Arts and Entertainment
Hacked off: Maisie Williams in ‘Cyberbully’

Maisie Williams single-handedly rises to the challenge

TV
Arts and Entertainment
Eddie Redmayne in The Theory of Everything and Benedict Cumberbatch in The Imitation Game are both nominated at the Bafta Film Awards
Latest stories from i100
Have you tried new the Independent Digital Edition apps?

ES Rentals

    Independent Dating
    and  

    By clicking 'Search' you
    are agreeing to our
    Terms of Use.

    Isis hostage crisis: The prisoner swap has only one purpose for the militants - recognition its Islamic State exists and that foreign nations acknowledge its power

    Isis hostage crisis

    The prisoner swap has only one purpose for the militants - recognition its Islamic State exists and that foreign nations acknowledge its power, says Robert Fisk
    Missing salvage expert who found $50m of sunken treasure before disappearing, tracked down at last

    The runaway buccaneers and the ship full of gold

    Salvage expert Tommy Thompson found sunken treasure worth millions. Then he vanished... until now
    Homeless Veterans appeal: ‘If you’re hard on the world you are hard on yourself’

    Homeless Veterans appeal: ‘If you’re hard on the world you are hard on yourself’

    Maverick artist Grayson Perry backs our campaign
    Assisted Dying Bill: I want to be able to decide about my own death - I want to have control of my life

    Assisted Dying Bill: 'I want control of my life'

    This week the Assisted Dying Bill is debated in the Lords. Virginia Ironside, who has already made plans for her own self-deliverance, argues that it's time we allowed people a humane, compassionate death
    Move over, kale - cabbage is the new rising star

    Cabbage is king again

    Sophie Morris banishes thoughts of soggy school dinners and turns over a new leaf
    11 best winter skin treats

    Give your moisturiser a helping hand: 11 best winter skin treats

    Get an extra boost of nourishment from one of these hard-working products
    Paul Scholes column: The more Jose Mourinho attempts to influence match officials, the more they are likely to ignore him

    Paul Scholes column

    The more Jose Mourinho attempts to influence match officials, the more they are likely to ignore him
    Frank Warren column: No cigar, but pots of money: here come the Cubans

    Frank Warren's Ringside

    No cigar, but pots of money: here come the Cubans
    Isis hostage crisis: Militant group stands strong as its numerous enemies fail to find a common plan to defeat it

    Isis stands strong as its numerous enemies fail to find a common plan to defeat it

    The jihadis are being squeezed militarily and economically, but there is no sign of an implosion, says Patrick Cockburn
    Virtual reality thrusts viewers into the frontline of global events - and puts film-goers at the heart of the action

    Virtual reality: Seeing is believing

    Virtual reality thrusts viewers into the frontline of global events - and puts film-goers at the heart of the action
    Homeless Veterans appeal: MP says Coalition ‘not doing enough’

    Homeless Veterans appeal

    MP says Coalition ‘not doing enough’ to help
    Larry David, Steve Coogan and other comedians share stories of depression in new documentary

    Comedians share stories of depression

    The director of the new documentary, Kevin Pollak, tells Jessica Barrett how he got them to talk
    Has The Archers lost the plot with it's spicy storylines?

    Has The Archers lost the plot?

    A growing number of listeners are voicing their discontent over the rural soap's spicy storylines; so loudly that even the BBC's director-general seems worried, says Simon Kelner
    English Heritage adds 14 post-war office buildings to its protected lists

    14 office buildings added to protected lists

    Christopher Beanland explores the underrated appeal of these palaces of pen-pushing
    Human skull discovery in Israel proves humans lived side-by-side with Neanderthals

    Human skull discovery in Israel proves humans lived side-by-side with Neanderthals

    Scientists unearthed the cranial fragments from Manot Cave in West Galilee