Boyd Tonkin: US election was a good night for the geeks - and a Tunbridge Wells cleric

The Week in Books

Anyone who tracked the US election campaign in the hope of enlightened debate over the great global issues of the age will soon have lost the will to live (or vote). However, on a tighter intellectual canvas, I enjoyed a pretty invigorating month. Nate Silver's game-changing FiveThirtyEight forecasting outfit has delivered a masterclass in the potential, and the limits, of political soothsaying. By Tuesday, Silver had the percentage probability of victory as 91-9 in favour of Obama. He didn't quite hit the bull's-eye with electoral-college votes, calling it 313-225 for the President. At the same time, the media kept up the dutiful fiction of a "cliffhanger". It was not.

Through the breadth of its sources, the detail of its analysis, the self-critical attention to its own methods and its speed and finesse in correcting for rogue results in the aggregation of polling data, FiveThirtyEight has set a standard that every other opinion-assessor will need to study. It's not rocket science - but it is the sustained, high-level application of probabilistic reasoning. As Silver acknowledges, his techniques owe much to a posthumously-published paper by an obscure Tunbridge Wells minister of the mid-18th century: "An Essay towards Solving a Problem in the Doctrine of Chances" by Thomas Bayes. Thanks to Bayesian principles, as Silver puts it in his deeply geeky but still engrossing book The Signal and the Noise: the art and science of prediction (Allen Lane, £25), "we can strive to be less subjective, less irrational, and less wrong". In practice, after Silver's intense road-testing of his theories, it began to look pretty clear that headline claims of a knife-edge, neck-and-neck race were baloney. Even a month ago, after the President's TV-debate débâcle in Denver, Silver still had the probability of his re-election at 62-38 per cent.

From baseball to poker, storms to earthquakes, credit crises to terrorist attacks, The Signal and the Noise argues that effective forecasting or even prediction (a stronger category for Silver) depend to a large degree on switching off the human propensity to spot shapes, patterns and meanings in data sets. They will often mislead and deceive: mere "noise". "Foxy forecasters", in contrast, know their limits, make use of prior experience, but continuously revise their assumptions. They know that "the key is determining whether the patterns represent noise or signal". Short-term weather forecasting - the closest this book comes to a genuine success story - has painfully learned to do that, as it shows that "chaos theory is a demon that can be tamed". As for the economic forecasters, many would be better off with tea-leaves and chicken guts.

On earthquakes, the book explains why the trial of scientists in the wake of the L'Aquila disaster in Italy in 2009 was a medieval absurdity. After his survey of the slow advances in seismic forecasting, Silver accepts "the Holy Grail of earthquake prediction will never be attained".

Which brings us to the celebrated bird whose shadow falls over his book, the "Black Swan": those extreme, outlier events that defy augury, and which Nassim Nicholas Taleb hunted down in his book of that name. Silver's Bayesian recipes work best in data-systems where Black Swans can never strike. Indeed, it was notable how, after Superstorm Sandy hit with all its Black Swan fury, the FiveThirtyEight blog sought to deny that this rampant outlier of a tempest could sway many voters at all.

It would be an error to set up Taleb simply as the nemesis of Silver. The latter seeks to help us make better forecasts. The former, as his forthcoming book Antifragile will argue, offers ways to think and act that embrace risk and surf uncertainty, whatever the strength of any prediction. Nonetheless, I would love to see the pair debate. What are the chances of that?

World-beating: Big History goes for broke

A massive deal (£1m. by some reports), a long haul (it's due no earlier than 2018), a big splash, a humongous theme: the projected "biography" of The World by Simon Sebag Montefiore for Weidenfeld & Nicolson shows that the book trade can still plan future projects on a Pharaonic scale. The sales triumph of his portrait of Jerusalem stiffened hopes that the market for page-turning, high-concept Big History has survived. The World will go for broke on that score. Inspiring ambition? Crazy hubris? Watch this space - but not very soon.

Ferrari wins Goncourt's grand prix

In this week's other momentous decision, announced as always at the Drouot restaurant in Paris, the Goncourt Prize has gone to Jérome Ferrari for his novel The Sermon on the Fall of Rome. The winning book in this year's contest for France's most august - and most sales-boosting - award for fiction is set in a bar in Corsica, where the novelist and philosophy teacher (now based in Abu Dhabi) used to live. It tells in almost fable-like form of the pitfalls and perils of utopian dreams (not so far from the US elections, maybe). In this country, MacLehose Press has just published a translation of Ferrari's Where I Left My Soul: one of several major French novels that over the past few years have, belatedly, tried to come to terms with the Algerian war, its dehumanising cruelties and its traumatic aftermaths. We'll have a review of the book next week.

Suggested Topics
Arts and Entertainment
Legendary charm: Clive Owen and Keira Knightley in 2004’s ‘King Arthur’
FilmGuy Ritchie is the latest filmmaker to tackle the legend
Arts and Entertainment
Corporate affair: The sitcom has become a satire of corporate culture in general

TV review

Broadcasting House was preparing for a visit from Prince Charles spoiler alert
Have you tried new the Independent Digital Edition apps?
Arts and Entertainment

ebooksNow available in paperback
Arts and Entertainment

ebooks
Arts and Entertainment
tvReview: There are some impressive performances by Claire Skinner and Lorraine Ashbourne in Inside No. 9, Nana's Party spoiler alert
Arts and Entertainment
Glastonbury's pyramid stage

Glastonbury Michael Eavis reveals final headline act 'most likely' British pair

Arts and Entertainment
Ewan McGregor looks set to play Lumiere in the Beauty and the Beast live action remake

Film Ewan McGregor joins star-studded Beauty and the Beast cast as Lumiere

Arts and Entertainment
Charlie feels the lack of food on The Island with Bear Grylls

TV

The Island with Bear Grylls under fire after male contestants kill and eat rare crocodile
Arts and Entertainment
Aaron Taylor-Johnson as Quicksilver and Elizabeth Olsen as Scarlet Witch, in a scene from Avengers: Age Of Ultron
filmReview: A great cast with truly spectacular special effects - but is Ultron a worthy adversaries for our superheroes? spoiler alert
Arts and Entertainment
Robin Ince performing in 2006
comedy
Arts and Entertainment
Beth (played by Jo Joyner) in BBC1's Ordinary Lies
tvReview: There’s bound to be a second series, but it needs to be braver spoiler alert
Arts and Entertainment
Paul Hollywood and Mary Berry, the presenters of The Great Comic Relief Bake Off 2015

TV
Arts and Entertainment
A still from Harold Ramis' original Groundhog Day film, released in 1993

Theatre
Arts and Entertainment
Christopher Eccleston (centre) plays an ex-policeman in this cliché-riddled thriller

TV review
Arts and Entertainment
Lena Headey looks very serious as Cersei Lannister in Game of Thrones

TV This TV review contains spoilers
Arts and Entertainment

film
Arts and Entertainment
Wiz Khalifa performs on stage during day one of the Wireless Festival at Perry Park in Birmingham

music
Arts and Entertainment
Festival-goers soak up the atmosphere at Glastonbury

music

Arts and Entertainment
Star Wars creator George Lucas

film

Arts and Entertainment

music

Arts and Entertainment
A shot from the forthcoming Fast and Furious 7

film

Arts and Entertainment
The new-look Top of the Pops could see Fearne Cotton returns as a host alongside Dermot O'Leary

TV

Arts and Entertainment
The leader of the Church of Scientology David Miscavige

TV

Arts and Entertainment
No half measures: ‘The Secret Life of the Pub’

Grace Dent on TV The Secret Life of the Pub is sexist, ageist and a breath of fresh air

  • Get to the point
Latest stories from i100
Have you tried new the Independent Digital Edition apps?

ES Rentals

    Independent Dating
    and  

    By clicking 'Search' you
    are agreeing to our
    Terms of Use.

    Not even the 'putrid throat' could stop the Ross Poldark swoon-fest'

    Not even the 'putrid throat' could stop the Ross Poldark swoon-fest'

    How a costume drama became a Sunday night staple
    Miliband promises no stamp duty for first-time buyers as he pushes Tories on housing

    Miliband promises no stamp duty for first-time buyers

    Labour leader pushes Tories on housing
    Aviation history is littered with grand failures - from the the Bristol Brabazon to Concorde - but what went wrong with the SuperJumbo?

    Aviation history is littered with grand failures

    But what went wrong with the SuperJumbo?
    Fear of Putin, Islamists and immigration is giving rise to a new generation of Soviet-style 'iron curtains' right across Europe

    Fortress Europe?

    Fear of Putin, Islamists and immigration is giving rise to a new generation of 'iron curtains'
    Never mind what you're wearing, it's what you're reclining on

    Never mind what you're wearing

    It's what you're reclining on that matters
    General Election 2015: Chuka Umunna on the benefits of immigration, humility – and his leader Ed Miliband

    Chuka Umunna: A virus of racism runs through Ukip

    The shadow business secretary on the benefits of immigration, humility – and his leader Ed Miliband
    Yemen crisis: This exotic war will soon become Europe's problem

    Yemen's exotic war will soon affect Europe

    Terrorism and boatloads of desperate migrants will be the outcome of the Saudi air campaign, says Patrick Cockburn
    Marginal Streets project aims to document voters in the run-up to the General Election

    Marginal Streets project documents voters

    Independent photographers Joseph Fox and Orlando Gili are uploading two portraits of constituents to their website for each day of the campaign
    Game of Thrones: Visit the real-life kingdom of Westeros to see where violent history ends and telly tourism begins

    The real-life kingdom of Westeros

    Is there something a little uncomfortable about Game of Thrones shooting in Northern Ireland?
    How to survive a social-media mauling, by the tough women of Twitter

    How to survive a Twitter mauling

    Mary Beard, Caroline Criado-Perez, Louise Mensch, Bunny La Roche and Courtney Barrasford reveal how to trounce the trolls
    Gallipoli centenary: At dawn, the young remember the young who perished in one of the First World War's bloodiest battles

    At dawn, the young remember the young

    A century ago, soldiers of the Empire – many no more than boys – spilt on to Gallipoli’s beaches. On this 100th Anzac Day, there are personal, poetic tributes to their sacrifice
    Dissent is slowly building against the billions spent on presidential campaigns – even among politicians themselves

    Follow the money as never before

    Dissent is slowly building against the billions spent on presidential campaigns – even among politicians themselves, reports Rupert Cornwell
    Samuel West interview: The actor and director on austerity, unionisation, and not mentioning his famous parents

    Samuel West interview

    The actor and director on austerity, unionisation, and not mentioning his famous parents
    General Election 2015: Imagine if the leading political parties were fashion labels

    Imagine if the leading political parties were fashion labels

    Fashion editor, Alexander Fury, on what the leaders' appearances tell us about them
    Phumzile Mlambo-Ngcuka: Home can be the unsafest place for women

    Phumzile Mlambo-Ngcuka: Home can be the unsafest place for women

    The architect of the HeForShe movement and head of UN Women on the world's failure to combat domestic violence