Boyd Tonkin: US election was a good night for the geeks - and a Tunbridge Wells cleric

The Week in Books

Anyone who tracked the US election campaign in the hope of enlightened debate over the great global issues of the age will soon have lost the will to live (or vote). However, on a tighter intellectual canvas, I enjoyed a pretty invigorating month. Nate Silver's game-changing FiveThirtyEight forecasting outfit has delivered a masterclass in the potential, and the limits, of political soothsaying. By Tuesday, Silver had the percentage probability of victory as 91-9 in favour of Obama. He didn't quite hit the bull's-eye with electoral-college votes, calling it 313-225 for the President. At the same time, the media kept up the dutiful fiction of a "cliffhanger". It was not.

Through the breadth of its sources, the detail of its analysis, the self-critical attention to its own methods and its speed and finesse in correcting for rogue results in the aggregation of polling data, FiveThirtyEight has set a standard that every other opinion-assessor will need to study. It's not rocket science - but it is the sustained, high-level application of probabilistic reasoning. As Silver acknowledges, his techniques owe much to a posthumously-published paper by an obscure Tunbridge Wells minister of the mid-18th century: "An Essay towards Solving a Problem in the Doctrine of Chances" by Thomas Bayes. Thanks to Bayesian principles, as Silver puts it in his deeply geeky but still engrossing book The Signal and the Noise: the art and science of prediction (Allen Lane, £25), "we can strive to be less subjective, less irrational, and less wrong". In practice, after Silver's intense road-testing of his theories, it began to look pretty clear that headline claims of a knife-edge, neck-and-neck race were baloney. Even a month ago, after the President's TV-debate débâcle in Denver, Silver still had the probability of his re-election at 62-38 per cent.

From baseball to poker, storms to earthquakes, credit crises to terrorist attacks, The Signal and the Noise argues that effective forecasting or even prediction (a stronger category for Silver) depend to a large degree on switching off the human propensity to spot shapes, patterns and meanings in data sets. They will often mislead and deceive: mere "noise". "Foxy forecasters", in contrast, know their limits, make use of prior experience, but continuously revise their assumptions. They know that "the key is determining whether the patterns represent noise or signal". Short-term weather forecasting - the closest this book comes to a genuine success story - has painfully learned to do that, as it shows that "chaos theory is a demon that can be tamed". As for the economic forecasters, many would be better off with tea-leaves and chicken guts.

On earthquakes, the book explains why the trial of scientists in the wake of the L'Aquila disaster in Italy in 2009 was a medieval absurdity. After his survey of the slow advances in seismic forecasting, Silver accepts "the Holy Grail of earthquake prediction will never be attained".

Which brings us to the celebrated bird whose shadow falls over his book, the "Black Swan": those extreme, outlier events that defy augury, and which Nassim Nicholas Taleb hunted down in his book of that name. Silver's Bayesian recipes work best in data-systems where Black Swans can never strike. Indeed, it was notable how, after Superstorm Sandy hit with all its Black Swan fury, the FiveThirtyEight blog sought to deny that this rampant outlier of a tempest could sway many voters at all.

It would be an error to set up Taleb simply as the nemesis of Silver. The latter seeks to help us make better forecasts. The former, as his forthcoming book Antifragile will argue, offers ways to think and act that embrace risk and surf uncertainty, whatever the strength of any prediction. Nonetheless, I would love to see the pair debate. What are the chances of that?

World-beating: Big History goes for broke

A massive deal (£1m. by some reports), a long haul (it's due no earlier than 2018), a big splash, a humongous theme: the projected "biography" of The World by Simon Sebag Montefiore for Weidenfeld & Nicolson shows that the book trade can still plan future projects on a Pharaonic scale. The sales triumph of his portrait of Jerusalem stiffened hopes that the market for page-turning, high-concept Big History has survived. The World will go for broke on that score. Inspiring ambition? Crazy hubris? Watch this space - but not very soon.

Ferrari wins Goncourt's grand prix

In this week's other momentous decision, announced as always at the Drouot restaurant in Paris, the Goncourt Prize has gone to Jérome Ferrari for his novel The Sermon on the Fall of Rome. The winning book in this year's contest for France's most august - and most sales-boosting - award for fiction is set in a bar in Corsica, where the novelist and philosophy teacher (now based in Abu Dhabi) used to live. It tells in almost fable-like form of the pitfalls and perils of utopian dreams (not so far from the US elections, maybe). In this country, MacLehose Press has just published a translation of Ferrari's Where I Left My Soul: one of several major French novels that over the past few years have, belatedly, tried to come to terms with the Algerian war, its dehumanising cruelties and its traumatic aftermaths. We'll have a review of the book next week.

Suggested Topics
Arts and Entertainment
Ellie Levenson’s The Election book demystifies politics for children
bookNew children's book primes the next generation for politics
Arts and Entertainment
Pharrell Williams' “Happy” was the most searched-for song lyric of 2014
musicThe power of song never greater, according to our internet searches
Arts and Entertainment
Roffey says: 'All of us carry shame and taboo around about our sexuality. But I was determined not to let shame stop me writing my memoir.'
Arts and Entertainment
Call The Midwife: Miranda Hart as Chummy

tv Review: Miranda Hart and co deliver the festive goods

Arts and Entertainment
The cast of Downton Abbey in the 2014 Christmas special

tvReview: Older generation get hot under the collar this Christmas

Have you tried new the Independent Digital Edition apps?
Arts and Entertainment

ebooksNow available in paperback
Arts and Entertainment

Arts and Entertainment
Transformers: Age of Extinction was the most searched for movie in the UK in 2014

Arts and Entertainment
Mark Ronson has had two UK number two singles but never a number one...yet

Arts and Entertainment
Clara Amfo will take over from Jameela Jamil on 25 January

Arts and Entertainment
This is New England: Ken Cheeseman, Ann Dowd, Frances McDormand and Richard Jenkins in Olive Kitteridge

The most magnificently miserable show on television in a long timeTV
Arts and Entertainment
Andrea Faustini looks triumphant after hearing he has not made it through to Sunday's live final

Arts and Entertainment
Rhys says: 'I'm not playing it for laughs, but I have learnt that if you fall over on stage, people can enjoy that as much as an amazing guitar solo'
musicGruff Rhys on his rock odyssey, and the trouble with independence
Arts and Entertainment
Krysia and Daniel (Hand out press photograph provided by Sally Richardson)
How do today's composers answer the challenge of the classical giant?
Shenaz Treasurywala
Arts and Entertainment
Jason Watkins as Christopher Jefferies
Arts and Entertainment
Star Wars Director JJ Abrams: key character's names have been revealed
Arts and Entertainment
Pharrell Williams won two BBC Music Awards for Best Song and International Artist
Arts and Entertainment
Mark, Katie and Sanjay in The Apprentice boardroom
Latest stories from i100
Have you tried new the Independent Digital Edition apps?

ES Rentals

    Independent Dating

    By clicking 'Search' you
    are agreeing to our
    Terms of Use.

    War with Isis: The West needs more than a White Knight

    The West needs more than a White Knight

    Despite billions spent on weapons, the US has not been able to counter Isis's gruesome tactics, says Patrick Cockburn
    Return to Helmand: Private Davey Graham recalls the day he was shot by the Taliban

    'The day I was shot by the Taliban'

    Private Davey Graham was shot five times during an ambush in 2007 - it was the first, controversial photograph to show the dangers our soldiers faced in Helmand province
    Revealed: the best and worst airlines for delays

    Revealed: the best and worst airlines for delays

    Many flyers are failing to claim compensation to which they are entitled, a new survey has found
    The stories that defined 2014: From the Scottish independence referendum to the Ice Bucket Challenge, our writers voice their opinions

    The stories that defined 2014

    From the Scottish independence referendum to the Ice Bucket Challenge, our writers voice their opinions
    Stoke-on-Trent becomes first British city to be classified as 'disaster resilient' by the United Nations

    Disaster looming? Now you know where to head...

    Which British city has become the first to be awarded special 'resilience' status by the UN?
    Finally, a diet that works: Californian pastor's wildly popular Daniel Plan has seen his congregation greatly reduced

    Finally, a diet that works

    Californian pastor's wildly popular Daniel Plan has seen his congregation greatly reduced
    Say it with... lyrics: The power of song was never greater, according to our internet searches

    Say it with... lyrics

    The power of song was never greater, according to our internet searches
    Professor Danielle George: On a mission to bring back the art of 'thinkering'

    The joys of 'thinkering'

    Professor Danielle George on why we have to nurture tomorrow's scientists today
    Monique Roffey: The author on father figures, the nation's narcissism and New Year reflections

    Monique Roffey interview

    The author on father figures, the nation's narcissism and New Year reflections
    Introducing my anti-heroes of 2014

    Introducing my anti-heroes of 2014

    Their outrageousness and originality makes the world a bit more interesting, says Ellen E Jones
    DJ Taylor: Good taste? It's all a matter of timing...

    Good taste? It's all a matter of timing...

    It has been hard to form generally accepted cultural standards since the middle of the 19th century – and the disintegration is only going to accelerate, says DJ Taylor
    Olivia Jacobs & Ben Caplan: 'Ben thought the play was called 'Christian Love'. It was 'Christie in Love' - about a necrophiliac serial killer'

    How we met

    Olivia Jacobs and Ben Caplan
    Bill Granger recipes: Our chef's breakfasts will revitalise you in time for the New Year

    Bill Granger's healthy breakfasts

    Our chef's healthy recipes are perfect if you've overindulged during the festive season
    Transfer guide: From Arsenal to West Ham - what does your club need in the January transfer window?

    Who does your club need in the transfer window?

    Most Premier League sides are after a striker, but here's a full run down of the ins and outs that could happen over the next month
    The Last Word: From aliens at FA to yak’s milk in the Tour, here’s to 2015

    Michael Calvin's Last Word

    From aliens at FA to yak’s milk in the Tour, here’s to 2015