Boyd Tonkin: US election was a good night for the geeks - and a Tunbridge Wells cleric

The Week in Books

Anyone who tracked the US election campaign in the hope of enlightened debate over the great global issues of the age will soon have lost the will to live (or vote). However, on a tighter intellectual canvas, I enjoyed a pretty invigorating month. Nate Silver's game-changing FiveThirtyEight forecasting outfit has delivered a masterclass in the potential, and the limits, of political soothsaying. By Tuesday, Silver had the percentage probability of victory as 91-9 in favour of Obama. He didn't quite hit the bull's-eye with electoral-college votes, calling it 313-225 for the President. At the same time, the media kept up the dutiful fiction of a "cliffhanger". It was not.

Through the breadth of its sources, the detail of its analysis, the self-critical attention to its own methods and its speed and finesse in correcting for rogue results in the aggregation of polling data, FiveThirtyEight has set a standard that every other opinion-assessor will need to study. It's not rocket science - but it is the sustained, high-level application of probabilistic reasoning. As Silver acknowledges, his techniques owe much to a posthumously-published paper by an obscure Tunbridge Wells minister of the mid-18th century: "An Essay towards Solving a Problem in the Doctrine of Chances" by Thomas Bayes. Thanks to Bayesian principles, as Silver puts it in his deeply geeky but still engrossing book The Signal and the Noise: the art and science of prediction (Allen Lane, £25), "we can strive to be less subjective, less irrational, and less wrong". In practice, after Silver's intense road-testing of his theories, it began to look pretty clear that headline claims of a knife-edge, neck-and-neck race were baloney. Even a month ago, after the President's TV-debate débâcle in Denver, Silver still had the probability of his re-election at 62-38 per cent.

From baseball to poker, storms to earthquakes, credit crises to terrorist attacks, The Signal and the Noise argues that effective forecasting or even prediction (a stronger category for Silver) depend to a large degree on switching off the human propensity to spot shapes, patterns and meanings in data sets. They will often mislead and deceive: mere "noise". "Foxy forecasters", in contrast, know their limits, make use of prior experience, but continuously revise their assumptions. They know that "the key is determining whether the patterns represent noise or signal". Short-term weather forecasting - the closest this book comes to a genuine success story - has painfully learned to do that, as it shows that "chaos theory is a demon that can be tamed". As for the economic forecasters, many would be better off with tea-leaves and chicken guts.

On earthquakes, the book explains why the trial of scientists in the wake of the L'Aquila disaster in Italy in 2009 was a medieval absurdity. After his survey of the slow advances in seismic forecasting, Silver accepts "the Holy Grail of earthquake prediction will never be attained".

Which brings us to the celebrated bird whose shadow falls over his book, the "Black Swan": those extreme, outlier events that defy augury, and which Nassim Nicholas Taleb hunted down in his book of that name. Silver's Bayesian recipes work best in data-systems where Black Swans can never strike. Indeed, it was notable how, after Superstorm Sandy hit with all its Black Swan fury, the FiveThirtyEight blog sought to deny that this rampant outlier of a tempest could sway many voters at all.

It would be an error to set up Taleb simply as the nemesis of Silver. The latter seeks to help us make better forecasts. The former, as his forthcoming book Antifragile will argue, offers ways to think and act that embrace risk and surf uncertainty, whatever the strength of any prediction. Nonetheless, I would love to see the pair debate. What are the chances of that?

World-beating: Big History goes for broke

A massive deal (£1m. by some reports), a long haul (it's due no earlier than 2018), a big splash, a humongous theme: the projected "biography" of The World by Simon Sebag Montefiore for Weidenfeld & Nicolson shows that the book trade can still plan future projects on a Pharaonic scale. The sales triumph of his portrait of Jerusalem stiffened hopes that the market for page-turning, high-concept Big History has survived. The World will go for broke on that score. Inspiring ambition? Crazy hubris? Watch this space - but not very soon.

Ferrari wins Goncourt's grand prix

In this week's other momentous decision, announced as always at the Drouot restaurant in Paris, the Goncourt Prize has gone to Jérome Ferrari for his novel The Sermon on the Fall of Rome. The winning book in this year's contest for France's most august - and most sales-boosting - award for fiction is set in a bar in Corsica, where the novelist and philosophy teacher (now based in Abu Dhabi) used to live. It tells in almost fable-like form of the pitfalls and perils of utopian dreams (not so far from the US elections, maybe). In this country, MacLehose Press has just published a translation of Ferrari's Where I Left My Soul: one of several major French novels that over the past few years have, belatedly, tried to come to terms with the Algerian war, its dehumanising cruelties and its traumatic aftermaths. We'll have a review of the book next week.

Suggested Topics
Arts and Entertainment

Great British Bake Off
Have you tried new the Independent Digital Edition apps?
Arts and Entertainment

ebooksNow available in paperback
Arts and Entertainment

ebooks
Latest stories from i100
Have you tried new the Independent Digital Edition apps?
SPONSORED FEATURES

ES Rentals

    Independent Dating
    and  

    By clicking 'Search' you
    are agreeing to our
    Terms of Use.

    The long walk west: they fled war in Syria, only to get held up in Hungary – now hundreds of refugees have set off on foot for Austria

    They fled war in Syria...

    ...only to get stuck and sidetracked in Hungary
    From The Prisoner to Mad Men, elaborate title sequences are one of the keys to a great TV series

    Title sequences: From The Prisoner to Mad Men

    Elaborate title sequences are one of the keys to a great TV series. But why does the art form have such a chequered history?
    Giorgio Armani Beauty's fabric-inspired foundations: Get back to basics this autumn

    Giorgio Armani Beauty's foundations

    Sumptuous fabrics meet luscious cosmetics for this elegant look
    From stowaways to Operation Stack: Life in a transcontinental lorry cab

    Life from the inside of a trucker's cab

    From stowaways to Operation Stack, it's a challenging time to be a trucker heading to and from the Continent
    Kelis interview: The songwriter and sauce-maker on cooking for Pharrell and crying over potatoes

    Kelis interview

    The singer and sauce-maker on cooking for Pharrell
    Refugee crisis: David Cameron lowered the flag for the dead king of Saudi Arabia - will he do the same honour for little Aylan Kurdi?

    Cameron lowered the flag for the dead king of Saudi Arabia...

    But will he do the same honour for little Aylan Kurdi, asks Robert Fisk
    Our leaders lack courage in this refugee crisis. We are shamed by our European neighbours

    Our leaders lack courage in this refugee crisis. We are shamed by our European neighbours

    Humanity must be at the heart of politics, says Jeremy Corbyn
    Joe Biden's 'tease tour': Could the US Vice-President be testing the water for a presidential run?

    Joe Biden's 'tease tour'

    Could the US Vice-President be testing the water for a presidential run?
    Britain's 24-hour culture: With the 'leisured society' a distant dream we're working longer and less regular hours than ever

    Britain's 24-hour culture

    With the 'leisured society' a distant dream we're working longer and less regular hours than ever
    Diplomacy board game: Treachery is the way to win - which makes it just like the real thing

    The addictive nature of Diplomacy

    Bullying, betrayal, aggression – it may be just a board game, but the family that plays Diplomacy may never look at each other in the same way again
    Lady Chatterley's Lover: Racy underwear for fans of DH Lawrence's equally racy tome

    Fashion: Ooh, Lady Chatterley!

    Take inspiration from DH Lawrence's racy tome with equally racy underwear
    8 best children's clocks

    Tick-tock: 8 best children's clocks

    Whether you’re teaching them to tell the time or putting the finishing touches to a nursery, there’s a ticker for that
    Charlie Austin: Queens Park Rangers striker says ‘If the move is not right, I’m not going’

    Charlie Austin: ‘If the move is not right, I’m not going’

    After hitting 18 goals in the Premier League last season, the QPR striker was the great non-deal of transfer deadline day. But he says he'd preferred another shot at promotion
    Isis profits from destruction of antiquities by selling relics to dealers - and then blowing up the buildings they come from to conceal the evidence of looting

    How Isis profits from destruction of antiquities

    Robert Fisk on the terrorist group's manipulation of the market to increase the price of artefacts
    Labour leadership: Andy Burnham urges Jeremy Corbyn voters to think again in last-minute plea

    'If we lose touch we’ll end up with two decades of the Tories'

    In an exclusive interview, Andy Burnham urges Jeremy Corbyn voters to think again in last-minute plea