Boyd Tonkin: US election was a good night for the geeks - and a Tunbridge Wells cleric

The Week in Books

Anyone who tracked the US election campaign in the hope of enlightened debate over the great global issues of the age will soon have lost the will to live (or vote). However, on a tighter intellectual canvas, I enjoyed a pretty invigorating month. Nate Silver's game-changing FiveThirtyEight forecasting outfit has delivered a masterclass in the potential, and the limits, of political soothsaying. By Tuesday, Silver had the percentage probability of victory as 91-9 in favour of Obama. He didn't quite hit the bull's-eye with electoral-college votes, calling it 313-225 for the President. At the same time, the media kept up the dutiful fiction of a "cliffhanger". It was not.

Through the breadth of its sources, the detail of its analysis, the self-critical attention to its own methods and its speed and finesse in correcting for rogue results in the aggregation of polling data, FiveThirtyEight has set a standard that every other opinion-assessor will need to study. It's not rocket science - but it is the sustained, high-level application of probabilistic reasoning. As Silver acknowledges, his techniques owe much to a posthumously-published paper by an obscure Tunbridge Wells minister of the mid-18th century: "An Essay towards Solving a Problem in the Doctrine of Chances" by Thomas Bayes. Thanks to Bayesian principles, as Silver puts it in his deeply geeky but still engrossing book The Signal and the Noise: the art and science of prediction (Allen Lane, £25), "we can strive to be less subjective, less irrational, and less wrong". In practice, after Silver's intense road-testing of his theories, it began to look pretty clear that headline claims of a knife-edge, neck-and-neck race were baloney. Even a month ago, after the President's TV-debate débâcle in Denver, Silver still had the probability of his re-election at 62-38 per cent.

From baseball to poker, storms to earthquakes, credit crises to terrorist attacks, The Signal and the Noise argues that effective forecasting or even prediction (a stronger category for Silver) depend to a large degree on switching off the human propensity to spot shapes, patterns and meanings in data sets. They will often mislead and deceive: mere "noise". "Foxy forecasters", in contrast, know their limits, make use of prior experience, but continuously revise their assumptions. They know that "the key is determining whether the patterns represent noise or signal". Short-term weather forecasting - the closest this book comes to a genuine success story - has painfully learned to do that, as it shows that "chaos theory is a demon that can be tamed". As for the economic forecasters, many would be better off with tea-leaves and chicken guts.

On earthquakes, the book explains why the trial of scientists in the wake of the L'Aquila disaster in Italy in 2009 was a medieval absurdity. After his survey of the slow advances in seismic forecasting, Silver accepts "the Holy Grail of earthquake prediction will never be attained".

Which brings us to the celebrated bird whose shadow falls over his book, the "Black Swan": those extreme, outlier events that defy augury, and which Nassim Nicholas Taleb hunted down in his book of that name. Silver's Bayesian recipes work best in data-systems where Black Swans can never strike. Indeed, it was notable how, after Superstorm Sandy hit with all its Black Swan fury, the FiveThirtyEight blog sought to deny that this rampant outlier of a tempest could sway many voters at all.

It would be an error to set up Taleb simply as the nemesis of Silver. The latter seeks to help us make better forecasts. The former, as his forthcoming book Antifragile will argue, offers ways to think and act that embrace risk and surf uncertainty, whatever the strength of any prediction. Nonetheless, I would love to see the pair debate. What are the chances of that?

World-beating: Big History goes for broke

A massive deal (£1m. by some reports), a long haul (it's due no earlier than 2018), a big splash, a humongous theme: the projected "biography" of The World by Simon Sebag Montefiore for Weidenfeld & Nicolson shows that the book trade can still plan future projects on a Pharaonic scale. The sales triumph of his portrait of Jerusalem stiffened hopes that the market for page-turning, high-concept Big History has survived. The World will go for broke on that score. Inspiring ambition? Crazy hubris? Watch this space - but not very soon.

Ferrari wins Goncourt's grand prix

In this week's other momentous decision, announced as always at the Drouot restaurant in Paris, the Goncourt Prize has gone to Jérome Ferrari for his novel The Sermon on the Fall of Rome. The winning book in this year's contest for France's most august - and most sales-boosting - award for fiction is set in a bar in Corsica, where the novelist and philosophy teacher (now based in Abu Dhabi) used to live. It tells in almost fable-like form of the pitfalls and perils of utopian dreams (not so far from the US elections, maybe). In this country, MacLehose Press has just published a translation of Ferrari's Where I Left My Soul: one of several major French novels that over the past few years have, belatedly, tried to come to terms with the Algerian war, its dehumanising cruelties and its traumatic aftermaths. We'll have a review of the book next week.

Suggested Topics
Have you tried new the Independent Digital Edition apps?
Arts and Entertainment

ebooksNow available in paperback
Arts and Entertainment

Arts and Entertainment
Mark, Katie and Sanjay in The Apprentice boardroom
Arts and Entertainment

Film The critics but sneer but these unfashionable festive films are our favourites

Arts and Entertainment
Frances O'Connor and James Nesbitt in 'The Missing'

TV We're so close to knowing what happened to Oliver Hughes, but a last-minute bluff crushes expectations

Arts and Entertainment
Joey Essex will be hitting the slopes for series two of The Jump


Who is taking the plunge?
Arts and Entertainment
Katy Perry as an Ancient Egyptian princess in her latest music video for 'Dark Horse'

Arts and Entertainment
Dame Judi Dench, as M in Skyfall

Arts and Entertainment
Morrissey, 1988

Arts and Entertainment
William Pooley from Suffolk is flying out to Free Town, Sierra Leone, to continue working in health centres to fight Ebola after surviving the disease himself

Arts and Entertainment
The Newsroom creator Aaron Sorkin

Arts and Entertainment
Matt Berry (centre), the star of Channel 4 sitcom 'Toast of London'

TVA disappointingly dull denouement
Arts and Entertainment
Tales from the cryptanalyst: Benedict Cumberbatch in 'The Imitation Game'

Arts and Entertainment
Pixie Lott has been voted off Strictly Come Dancing 2014

Latest stories from i100
Have you tried new the Independent Digital Edition apps?

ES Rentals

    Independent Dating

    By clicking 'Search' you
    are agreeing to our
    Terms of Use.

    Homeless Veterans appeal: 'You look for someone who's an inspiration and try to be like them'

    Homeless Veterans appeal

    In 2010, Sgt Gary Jamieson stepped on an IED in Afghanistan and lost his legs and an arm. He reveals what, and who, helped him to make a remarkable recovery
    Could cannabis oil reverse the effects of cancer?

    Could cannabis oil reverse effects of cancer?

    As a film following six patients receiving the controversial treatment is released, Kate Hilpern uncovers a very slippery issue
    The Interview movie review: You can't see Seth Rogen and James Franco's Kim Jong Un assassination film, but you can read about it here

    The Interview movie review

    You can't see Seth Rogen and James Franco's Kim Jong Un assassination film, but you can read about it here
    Serial mania has propelled podcasts into the cultural mainstream

    How podcasts became mainstream

    People have consumed gripping armchair investigation Serial with a relish typically reserved for box-set binges
    Jesus Christ has become an unlikely pin-up for hipster marketing companies

    Jesus Christ has become an unlikely pin-up

    Kevin Lee Light, aka "Jesus", is the newest client of creative agency Mother while rival agency Anomaly has launched Sexy Jesus, depicting the Messiah in a series of Athena-style poses
    Rosetta space mission voted most important scientific breakthrough of 2014

    A memorable year for science – if not for mice

    The most important scientific breakthroughs of 2014
    Christmas cocktails to make you merry: From eggnog to Brown Betty and Rum Bumpo

    Christmas cocktails to make you merry

    Mulled wine is an essential seasonal treat. But now drinkers are rediscovering other traditional festive tipples. Angela Clutton raises a glass to Christmas cocktails
    5 best activity trackers

    Fitness technology: 5 best activity trackers

    Up the ante in your regimen and change the habits of a lifetime with this wearable tech
    Paul Scholes column: It's a little-known fact, but I have played one of the seven dwarves

    Paul Scholes column

    It's a little-known fact, but I have played one of the seven dwarves
    Fifa's travelling circus once again steals limelight from real stars

    Fifa's travelling circus once again steals limelight from real stars

    Club World Cup kicked into the long grass by the continued farce surrounding Blatter, Garcia, Russia and Qatar
    Frank Warren column: 2014 – boxing is back and winning new fans

    Frank Warren: Boxing is back and winning new fans

    2014 proves it's now one of sport's biggest hitters again
    Jeb Bush vs Hillary Clinton: The power dynamics of the two first families

    Jeb Bush vs Hillary Clinton

    Karen Tumulty explores the power dynamics of the two first families
    Stockholm is rivalling Silicon Valley with a hotbed of technology start-ups

    Stockholm is rivalling Silicon Valley

    The Swedish capital is home to two of the most popular video games in the world, as well as thousands of technology start-ups worth hundreds of millions of pounds – and it's all happened since 2009
    Did Japanese workers really get their symbols mixed up and display Santa on a crucifix?

    Crucified Santa: Urban myth refuses to die

    The story goes that Japanese store workers created a life-size effigy of a smiling "Father Kurisumasu" attached to a facsimile of Our Lord's final instrument of torture
    Jennifer Saunders and Kate Moss join David Walliams on set for TV adaptation of The Boy in the Dress

    The Boy in the Dress: On set with the stars

    Walliams' story about a boy who goes to school in a dress will be shown this Christmas