Boyd Tonkin: US election was a good night for the geeks - and a Tunbridge Wells cleric

The Week in Books

Anyone who tracked the US election campaign in the hope of enlightened debate over the great global issues of the age will soon have lost the will to live (or vote). However, on a tighter intellectual canvas, I enjoyed a pretty invigorating month. Nate Silver's game-changing FiveThirtyEight forecasting outfit has delivered a masterclass in the potential, and the limits, of political soothsaying. By Tuesday, Silver had the percentage probability of victory as 91-9 in favour of Obama. He didn't quite hit the bull's-eye with electoral-college votes, calling it 313-225 for the President. At the same time, the media kept up the dutiful fiction of a "cliffhanger". It was not.

Through the breadth of its sources, the detail of its analysis, the self-critical attention to its own methods and its speed and finesse in correcting for rogue results in the aggregation of polling data, FiveThirtyEight has set a standard that every other opinion-assessor will need to study. It's not rocket science - but it is the sustained, high-level application of probabilistic reasoning. As Silver acknowledges, his techniques owe much to a posthumously-published paper by an obscure Tunbridge Wells minister of the mid-18th century: "An Essay towards Solving a Problem in the Doctrine of Chances" by Thomas Bayes. Thanks to Bayesian principles, as Silver puts it in his deeply geeky but still engrossing book The Signal and the Noise: the art and science of prediction (Allen Lane, £25), "we can strive to be less subjective, less irrational, and less wrong". In practice, after Silver's intense road-testing of his theories, it began to look pretty clear that headline claims of a knife-edge, neck-and-neck race were baloney. Even a month ago, after the President's TV-debate débâcle in Denver, Silver still had the probability of his re-election at 62-38 per cent.

From baseball to poker, storms to earthquakes, credit crises to terrorist attacks, The Signal and the Noise argues that effective forecasting or even prediction (a stronger category for Silver) depend to a large degree on switching off the human propensity to spot shapes, patterns and meanings in data sets. They will often mislead and deceive: mere "noise". "Foxy forecasters", in contrast, know their limits, make use of prior experience, but continuously revise their assumptions. They know that "the key is determining whether the patterns represent noise or signal". Short-term weather forecasting - the closest this book comes to a genuine success story - has painfully learned to do that, as it shows that "chaos theory is a demon that can be tamed". As for the economic forecasters, many would be better off with tea-leaves and chicken guts.

On earthquakes, the book explains why the trial of scientists in the wake of the L'Aquila disaster in Italy in 2009 was a medieval absurdity. After his survey of the slow advances in seismic forecasting, Silver accepts "the Holy Grail of earthquake prediction will never be attained".

Which brings us to the celebrated bird whose shadow falls over his book, the "Black Swan": those extreme, outlier events that defy augury, and which Nassim Nicholas Taleb hunted down in his book of that name. Silver's Bayesian recipes work best in data-systems where Black Swans can never strike. Indeed, it was notable how, after Superstorm Sandy hit with all its Black Swan fury, the FiveThirtyEight blog sought to deny that this rampant outlier of a tempest could sway many voters at all.

It would be an error to set up Taleb simply as the nemesis of Silver. The latter seeks to help us make better forecasts. The former, as his forthcoming book Antifragile will argue, offers ways to think and act that embrace risk and surf uncertainty, whatever the strength of any prediction. Nonetheless, I would love to see the pair debate. What are the chances of that?

World-beating: Big History goes for broke

A massive deal (£1m. by some reports), a long haul (it's due no earlier than 2018), a big splash, a humongous theme: the projected "biography" of The World by Simon Sebag Montefiore for Weidenfeld & Nicolson shows that the book trade can still plan future projects on a Pharaonic scale. The sales triumph of his portrait of Jerusalem stiffened hopes that the market for page-turning, high-concept Big History has survived. The World will go for broke on that score. Inspiring ambition? Crazy hubris? Watch this space - but not very soon.

Ferrari wins Goncourt's grand prix

In this week's other momentous decision, announced as always at the Drouot restaurant in Paris, the Goncourt Prize has gone to Jérome Ferrari for his novel The Sermon on the Fall of Rome. The winning book in this year's contest for France's most august - and most sales-boosting - award for fiction is set in a bar in Corsica, where the novelist and philosophy teacher (now based in Abu Dhabi) used to live. It tells in almost fable-like form of the pitfalls and perils of utopian dreams (not so far from the US elections, maybe). In this country, MacLehose Press has just published a translation of Ferrari's Where I Left My Soul: one of several major French novels that over the past few years have, belatedly, tried to come to terms with the Algerian war, its dehumanising cruelties and its traumatic aftermaths. We'll have a review of the book next week.

Suggested Topics
Arts and Entertainment
Rhino Doodle by Jim Carter (Downton Abbey)

TV
Arts and Entertainment
Christian Grey cradles Ana in the Fifty Shades of Grey film

film
Arts and Entertainment
Chris Pratt stars in Guardians of the Galaxy
film
Arts and Entertainment
Comedian 'Weird Al' Yankovic

Is the comedy album making a comeback?

comedy
PROMOTED VIDEO
Have you tried new the Independent Digital Edition apps?
Arts and Entertainment
Sue Perkins and Mel Giedroyc, centre, are up for Best Female TV Comic for their presenting quips on The Great British Bake Off

TV
Arts and Entertainment
Martin Freeman as Lester Nygaard in the TV adaptation of 'Fargo'

TV
Arts and Entertainment
A scene from Shakespeare in Love at the Noel Coward Theatre
theatreReview: Shakespeare in Love has moments of sheer stage poetry mixed with effervescent fun
Arts and Entertainment
Dwayne 'The Rock' Johnson stars in Hercules

film
Arts and Entertainment
Standing the test of time: Michael J Fox and Christopher Lloyd in 'Back to the Future'

film
Arts and Entertainment
<p><strong>2008</strong></p>
<p>Troubled actor Robert Downey Jr cements his comeback from drug problems by bagging the lead role in Iron Man. Two further films follow</p>

film
Arts and Entertainment

theatre
Arts and Entertainment
Tycoons' text: Warren Buffett and Bill Gates both cite John Brookes' 'Business Adventures' as their favourite book

books
Arts and Entertainment
Panic! In The Disco's Brendon Urie performs on stage

music
Arts and Entertainment

film
Arts and Entertainment
Keira Knightley and Benedict Cumberbatch star in the Alan Turing biopic The Imitation Game

film
Arts and Entertainment

TV
Arts and Entertainment
Radio 4's Today programme host Evan Davis has been announced as the new face of Newsnight

TV
Arts and Entertainment
Pharrell Williams performing on the Main Stage at the Wireless Festival in Finsbury Park, north London

music
Arts and Entertainment
Carrie Mathison returns to the field in the fourth season of Showtime's Homeland

TV
Arts and Entertainment
Crowds soak up the atmosphere at Latitude Festival

music
Arts and Entertainment
Meyne Wyatt and Caren Pistorus arrive for the AACTA Aawrds in Sydney, Australia

TV
Arts and Entertainment
Rick Astley's original music video for 'Never Gonna Give You Up' has been removed from YouTube

music
Arts and Entertainment
Quentin Blake's 'Artists on the beach'

Artists unveils new exhibition inspired by Hastings beach

art
Arts and Entertainment
MusicFans were left disappointed after technical issues
Independent
Travel Shop
the manor
Up to 70% off luxury travel
on city breaks Find out more
santorini
Up to 70% off luxury travel
on chic beach resorts Find out more
sardina foodie
Up to 70% off luxury travel
on country retreats Find out more
Latest stories from i100
Have you tried new the Independent Digital Edition apps?

ES Rentals

    Independent Dating
    and  

    By clicking 'Search' you
    are agreeing to our
    Terms of Use.

    Evan Davis: The BBC’s wolf in sheep’s clothing to take over at Newsnight

    The BBC’s wolf in sheep’s clothing

    What will Evan Davis be like on Newsnight?
    Finding the names for America’s shame: What happens to the immigrants crossing the US-Mexico border without documents who never make it past the Arizona desert?

    Finding the names for America’s shame

    The immigrants crossing the US-Mexico border without documents who never make it past the Arizona desert
    Inside a church for Born Again Christians: Speaking to God in a Manchester multiplex

    Inside a church for Born Again Christians

    As Britain's Anglican church struggles to establish its modern identity, one branch of Christianity is booming
    Rihanna, Kim Kardashian and me: How Olivier Rousteing is revitalising the house of Balmain

    Olivier Rousteing is revitalising the house of Balmain

    Parisian couturier Pierre Balmain made his name dressing the mid-century jet set. Today, Olivier Rousteing – heir to the house Pierre built – is celebrating their 21st-century equivalents. The result? Nothing short of Balmania
    Cancer, cardiac arrest, HIV and homelessness - and he's only 39

    Incredible survival story of David Tovey

    Tovey went from cooking for the Queen to rifling through bins for his supper. His is a startling story of endurance against the odds – and of a social safety net failing at every turn
    Backhanders, bribery and abuses of power have soared in China as economy surges

    Bribery and abuses of power soar in China

    The bribery is fuelled by the surge in China's economy but the rules of corruption are subtle and unspoken, finds Evan Osnos, as he learns the dark arts from a master
    Commonwealth Games 2014: Highland terriers stole the show at the opening ceremony

    Highland terriers steal the show at opening ceremony

    Gillian Orr explores why a dog loved by film stars and presidents is finally having its day
    German art world rocked as artists use renowned fat sculpture to distil schnapps

    Brewing the fat from artwork angers widow of sculptor

    Part of Joseph Beuys' 1982 sculpture 'Fettecke' used to distil schnapps
    BBC's The Secret History of Our Streets reveals a fascinating window into Britain's past

    BBC takes viewers back down memory lane

    The Secret History of Our Streets, which returns with three films looking at Scottish streets, is the inverse of Benefits Street - delivering warmth instead of cynicism
    Joe, film review: Nicolas Cage delivers an astonishing performance in low budget drama

    Nicolas Cage shines in low-budget drama Joe

    Cage plays an ex-con in David Gordon Green's independent drama, which has been adapted from a novel by Larry Brown
    How to make your own gourmet ice lollies, granitas, slushy cocktails and frozen yoghurt

    Make your own ice lollies and frozen yoghurt

    Think outside the cool box for this summer's tempting frozen treats
    Ford Fiesta is UK's most popular car of all-time, with sales topping 4.1 million since 1976

    Fiesta is UK's most popular car of all-time

    Sales have topped 4.1 million since 1976. To celebrate this milestone, four Independent writers recall their Fiestas with pride
    10 best reed diffusers

    Heaven scent: 10 best reed diffusers

    Keep your rooms smelling summery and fresh with one of these subtle but distinctive home fragrances that’ll last you months
    Commonwealth Games 2014: Female boxers set to compete for first time

    Female boxers set to compete at Commonwealth Games for first time

    There’s no favourites and with no headguards anything could happen
    Five things we’ve learned so far about Manchester United under Louis van Gaal

    Five things we’ve learned so far about United under Van Gaal

    It’s impossible to avoid the impression that the Dutch manager is playing to the gallery a little