Boyd Tonkin: US election was a good night for the geeks - and a Tunbridge Wells cleric

The Week in Books

Anyone who tracked the US election campaign in the hope of enlightened debate over the great global issues of the age will soon have lost the will to live (or vote). However, on a tighter intellectual canvas, I enjoyed a pretty invigorating month. Nate Silver's game-changing FiveThirtyEight forecasting outfit has delivered a masterclass in the potential, and the limits, of political soothsaying. By Tuesday, Silver had the percentage probability of victory as 91-9 in favour of Obama. He didn't quite hit the bull's-eye with electoral-college votes, calling it 313-225 for the President. At the same time, the media kept up the dutiful fiction of a "cliffhanger". It was not.

Through the breadth of its sources, the detail of its analysis, the self-critical attention to its own methods and its speed and finesse in correcting for rogue results in the aggregation of polling data, FiveThirtyEight has set a standard that every other opinion-assessor will need to study. It's not rocket science - but it is the sustained, high-level application of probabilistic reasoning. As Silver acknowledges, his techniques owe much to a posthumously-published paper by an obscure Tunbridge Wells minister of the mid-18th century: "An Essay towards Solving a Problem in the Doctrine of Chances" by Thomas Bayes. Thanks to Bayesian principles, as Silver puts it in his deeply geeky but still engrossing book The Signal and the Noise: the art and science of prediction (Allen Lane, £25), "we can strive to be less subjective, less irrational, and less wrong". In practice, after Silver's intense road-testing of his theories, it began to look pretty clear that headline claims of a knife-edge, neck-and-neck race were baloney. Even a month ago, after the President's TV-debate débâcle in Denver, Silver still had the probability of his re-election at 62-38 per cent.

From baseball to poker, storms to earthquakes, credit crises to terrorist attacks, The Signal and the Noise argues that effective forecasting or even prediction (a stronger category for Silver) depend to a large degree on switching off the human propensity to spot shapes, patterns and meanings in data sets. They will often mislead and deceive: mere "noise". "Foxy forecasters", in contrast, know their limits, make use of prior experience, but continuously revise their assumptions. They know that "the key is determining whether the patterns represent noise or signal". Short-term weather forecasting - the closest this book comes to a genuine success story - has painfully learned to do that, as it shows that "chaos theory is a demon that can be tamed". As for the economic forecasters, many would be better off with tea-leaves and chicken guts.

On earthquakes, the book explains why the trial of scientists in the wake of the L'Aquila disaster in Italy in 2009 was a medieval absurdity. After his survey of the slow advances in seismic forecasting, Silver accepts "the Holy Grail of earthquake prediction will never be attained".

Which brings us to the celebrated bird whose shadow falls over his book, the "Black Swan": those extreme, outlier events that defy augury, and which Nassim Nicholas Taleb hunted down in his book of that name. Silver's Bayesian recipes work best in data-systems where Black Swans can never strike. Indeed, it was notable how, after Superstorm Sandy hit with all its Black Swan fury, the FiveThirtyEight blog sought to deny that this rampant outlier of a tempest could sway many voters at all.

It would be an error to set up Taleb simply as the nemesis of Silver. The latter seeks to help us make better forecasts. The former, as his forthcoming book Antifragile will argue, offers ways to think and act that embrace risk and surf uncertainty, whatever the strength of any prediction. Nonetheless, I would love to see the pair debate. What are the chances of that?

World-beating: Big History goes for broke

A massive deal (£1m. by some reports), a long haul (it's due no earlier than 2018), a big splash, a humongous theme: the projected "biography" of The World by Simon Sebag Montefiore for Weidenfeld & Nicolson shows that the book trade can still plan future projects on a Pharaonic scale. The sales triumph of his portrait of Jerusalem stiffened hopes that the market for page-turning, high-concept Big History has survived. The World will go for broke on that score. Inspiring ambition? Crazy hubris? Watch this space - but not very soon.

Ferrari wins Goncourt's grand prix

In this week's other momentous decision, announced as always at the Drouot restaurant in Paris, the Goncourt Prize has gone to Jérome Ferrari for his novel The Sermon on the Fall of Rome. The winning book in this year's contest for France's most august - and most sales-boosting - award for fiction is set in a bar in Corsica, where the novelist and philosophy teacher (now based in Abu Dhabi) used to live. It tells in almost fable-like form of the pitfalls and perils of utopian dreams (not so far from the US elections, maybe). In this country, MacLehose Press has just published a translation of Ferrari's Where I Left My Soul: one of several major French novels that over the past few years have, belatedly, tried to come to terms with the Algerian war, its dehumanising cruelties and its traumatic aftermaths. We'll have a review of the book next week.

Suggested Topics
PROMOTED VIDEO
Arts and Entertainment
Gothic revival: artist Dave McKean’s poster for Terror and Wonder: The Gothic Imagination
Exhibition
Arts and Entertainment
Diana Beard has left the Great British Bake Off 2014

TV
Have you tried new the Independent Digital Edition apps?
Arts and Entertainment
Lisa Kudrow, Courtney Cox and Jennifer Anniston reunite for a mini Friends sketch on Jimmy Kimmel Live

TV
Arts and Entertainment
TVDessert week was full of the usual dramas as 'bingate' ensued
Arts and Entertainment
Clara and the twelfth Doctor embark on their first adventure together
TVThe regulator received six complaints on Saturday night
Arts and Entertainment
Vinyl demand: a factory making the old-style discs
musicManufacturers are struggling to keep up with the resurgence in vinyl
Arts and Entertainment
David Baddiel concedes his show takes its inspiration from the hit US series 'Modern Family'
comedyNew comedy festival out to show that there’s more to Jewish humour than rabbi jokes
Arts and Entertainment
Puff Daddy: One Direction may actually be able to use the outrage to boost their credibility

music
Arts and Entertainment
Suha Arraf’s film ‘Villa Touma’ (left) is set in Ramallah and all the actresses are Palestinian

film
Arts and Entertainment
Madame Vastra and Jenny Flint kiss in Doctor Who episode 'Deep Breath'

TV
Arts and Entertainment
Steve Carell in the poster for new film 'Foxcatcher'
filmExclusive: First look at comic actor in first major serious role
Arts and Entertainment

TV
Arts and Entertainment
Kingston Road in Stockton is being filmed for the second series of Benefits Street
arts + entsFilming for Channel 4 has begun despite local complaints
Arts and Entertainment
Led Zeppelin

music
Arts and Entertainment
Radio presenter Scott Mills will be hitting the Strictly Come Dancing ballroom
TV
Arts and Entertainment

TV
Arts and Entertainment

TV
Arts and Entertainment
The Doctor and Clara have their first real heart to heart since he regenerated in 'Deep Breath'
tv
Arts and Entertainment
Beyonce performs in front of a Feminist sign at the MTV VMAs 2014

music
Arts and Entertainment
Miley Cyrus has taken home the prize for Video of the Year at the MTV Video Music Awards 2014

music
Arts and Entertainment
Peter Paige and Scott Lowell in Queer as Folk (Season 5)
tvA batch of shows that 'wouldn't get past a US network' could give tofu sales an unexpected lift
Arts and Entertainment
books... but seller will be hoping for more
Independent
Travel Shop
the manor
Up to 70% off luxury travel
on city breaks Find out more
santorini
Up to 70% off luxury travel
on chic beach resorts Find out more
sardina foodie
Up to 70% off luxury travel
on country retreats Find out more
Have you tried new the Independent Digital Edition apps?

ES Rentals

    Independent Dating
    and  

    By clicking 'Search' you
    are agreeing to our
    Terms of Use.

    Ukraine crisis: The phoney war is over as Russian troops and armour pour across the border

    The phoney war is over

    Russian troops and armour pour into Ukraine
    Potatoes could be off the menu as crop pests threaten UK

    Potatoes could be off the menu as crop pests threaten UK

    The world’s entire food system is under attack - and Britain is most at risk, according to a new study
    Gangnam smile: why the Chinese are flocking to South Korea to buy a new face

    Gangnam smile: why the Chinese are flocking to South Korea to buy a new face

    Seoul's plastic surgery industry is booming thanks to the popularity of the K-Pop look
    From Mozart to Orson Welles: Creative geniuses who peaked too soon

    Creative geniuses who peaked too soon

    After the death of Sandy Wilson, 90, who wrote his only hit musical in his twenties, John Walsh wonders what it's like to peak too soon and go on to live a life more ordinary
    Caught in the crossfire of a cyber Cold War

    Caught in the crossfire of a cyber Cold War

    Fears are mounting that Vladimir Putin has instructed hackers to target banks like JP Morgan
    Salomé's feminine wiles have inspired writers, painters and musicians for 2,000 years

    Salomé: A head for seduction

    Salomé's feminine wiles have inspired writers, painters and musicians for 2,000 years. Now audiences can meet the Biblical femme fatale in two new stage and screen projects
    From Bram Stoker to Stanley Kubrick, the British Library's latest exhibition celebrates all things Gothic

    British Library celebrates all things Gothic

    Forthcoming exhibition Terror and Wonder: The Gothic Imagination will be the UK's largest ever celebration of Gothic literature
    The Hard Rock Café's owners are embroiled in a bitter legal dispute - but is the restaurant chain worth fighting for?

    Is the Hard Rock Café worth fighting for?

    The restaurant chain's owners are currently embroiled in a bitter legal dispute
    Caribbean cuisine is becoming increasingly popular in the UK ... and there's more to it than jerk chicken at carnival

    In search of Caribbean soul food

    Caribbean cuisine is becoming increasingly popular in the UK ... and there's more to it than jerk chicken at carnival
    11 best face powders

    11 best face powders

    Sweep away shiny skin with our pick of the best pressed and loose powder bases
    England vs Norway: Roy Hodgson's hands tied by exploding top flight

    Roy Hodgson's hands tied by exploding top flight

    Lack of Englishmen at leading Premier League clubs leaves manager hamstrung
    Angel Di Maria and Cristiano Ronaldo: A tale of two Manchester United No 7s

    Di Maria and Ronaldo: A tale of two Manchester United No 7s

    They both inherited the iconic shirt at Old Trafford, but the £59.7m new boy is joining a club in a very different state
    Israel-Gaza conflict: No victory for Israel despite weeks of death and devastation

    Robert Fisk: No victory for Israel despite weeks of devastation

    Palestinians have won: they are still in Gaza, and Hamas is still there
    Mary Beard writes character reference for Twitter troll who called her a 'slut'

    Unlikely friends: Mary Beard and the troll who called her a ‘filthy old slut’

    The Cambridge University classicist even wrote the student a character reference
    America’s new apartheid: Prosperous white districts are choosing to break away from black cities and go it alone

    America’s new apartheid

    Prosperous white districts are choosing to break away from black cities and go it alone