In praise of pragmatism

We're conditioned to prize principle above everything. But history shows that adapting to circumstances is more effective, says Tim Harford

You would think pragmatism needed no defenders. Tony Blair went to the country in 1997 declaring that New Labour was not a party of "outdated ideology. What counts is what works". Deng Xiaoping, the reformist Chinese leader who led his country from famine and chaos into a growth miracle, was fond of quoting an old Sichuan proverb: "No matter if it is a white cat or a black cat; as long as it can catch mice, it is a good cat". And here's a simple dictionary definition of pragmatism: "A reasonable and logical way of doing things or of thinking about problems that is based on dealing with specific situations instead of on ideas and theories".

What's to dislike about pragmatism? Nothing. But here's the problem: we pay lip service to the concept, but in practice we dislike pragmatism. We don't vote for genuinely pragmatic politicians. We don't invest in pragmatic businesses. The truth is that making pragmatism work requires effort, embarrassment, and compromise. We don't seem to be willing to pay what it costs.

Because the pragmatist tries to take each situation on its own merits and figure out a sensible way forward, pragmatism tends to look hesitant, messy, and prone to error. The ideologue, whether a left winger or a right winger, a corporate visionary or a pub philosopher, looks decisive in comparison. Ideology always offers a neat answer, whether through reference to Karl Marx, Milton Friedman or the latest corporate mission statement. The fact that the answer may simply be wrong is irrelevant to the dogmatist, because it needs no testing.

The poor pragmatist, by contrast, must endure the rigmarole of figuring out whether his or her approach actually worked, and embarrassingly, many sensible seeming ideas fail. Ten per cent of American businesses go bust each year, according to the economist Paul Ormerod – author of a book called, naturally enough, Why Most Things Fail. This is because the world is a complex place: Eric Beinhocker of the McKinsey Global Institute estimates that London's economy alone offers about 10 billion distinct products and services, many of which are themselves hugely sophisticated. Whether launching a new clothing label or reforming the National Health Service, when we try to improve a mind-bogglingly complex system we are very likely to make things worse before we make them better.

You might think this was an argument in favour of pragmatism – and of course, it is. But it also explains why pragmatism quickly becomes unappealing. The awkward truth for the pragmatist is that they will constantly be bumping into their own errors and trying to fix them. But if pragmatism is a painful process of continually correcting errors, ideology is a blissful path of being oblivious to them.

The Vietnam War is a case in point. It was initially masterminded by Robert McNamara, to whom President Lyndon Johnson effectively ceded decision-making authority. McNamara, renowned as a management genius after his time at the Ford motor company, believed that armed with enough business-school graduates, he could number-crunch his way to victory in South-East Asia. Unfortunately, McNamara's numbers never measured what really counted: his methods, so effective in Ford, didn't survive being transplanted to Vietnam.

The failure in Vietnam wasn't McNamara's fault alone. Recognising the problems on the ground and adjusting strategies to deal with the Viet Cong would have required painful changes to the way the army conducted itself. It seems that the top brass chose to lose rather than to adapt. As one senior general put it, according to John Nagl's Learning to Eat Soup with a Knife: "I'll be damned if I permit the United States army, its institutions, its doctrine, and its traditions to be destroyed just to win this lousy war."

Does that sound familiar? Much the same words could have been uttered by the Labour traditionalists ranged against Tony Blair in the mid-1990s, as he threatened to destroy the institutions, doctrine and traditions of the Labour party just to win that lousy election. David Cameron and Nick Clegg are also finding that their own backbenchers and party members thoroughly disapprove of their pragmatic agreement to govern in coalition. Pragmatism requires compromise and change, often a painful reality.

Pragmatism also requires evidence, which is time-consuming to gather, difficult to put across in a sound-bite, and, frankly, boring. Voters understand simple ideas such as welfare fraud, tax-dodging, "privatising the NHS", or "bureaucrats from the EU". Fine: that is politics. But sensible, pragmatic policy-making requires a mountain of detail that no voter could reasonably be expected to take an interest in. And if voters are not interested, politicians are unlikely to be interested, either.

Politicians and their advisors have repeatedly explained to me the problem: gathering evidence is all very well in theory, but in practice a minister will arrive at their post to discover her predecessor has done little to commission the kind of solid evidence that might be useful when, say, improving literacy standards in schools, or reducing re-offending rates of former prisoners.

When she asks how long it will take to produce her own evidence base, she'll be told three or four years, perhaps longer. Figuring that by then she'll be on to her next job, or perhaps even the job after that, they'll set about figuring out what to do immediately. And action without decent evidence is bound to be dogmatic, not pragmatic. Two years later, a new minister will arrive in seat, and the cycle of ignorance continues.

You might think it takes a special kind of person to make multi-billion-pound decisions despite being totally ignorant of what works, and perhaps politicians qualify. I suspect they are just the same as the rest of us. Archie Cochrane, a great doctor and epidemiologist who revolutionised the way the British medical establishment thought about evidence, railed against his colleagues' "God complex". He complained his fellow doctors thought they didn't need evidence because the answer was already obvious. The God complex seems to affect everyone: doctors, politicians, newspaper columnists and your boss. Perhaps we all fancy ourselves touched by the divine when it comes to spouting opinions in ignorance of the facts.

It's fascinating to reflect on the role of pragmatism in business. Compare the corporate culture of the two coasts of the USA – Silicon Valley versus Wall Street. In Silicon Valley, the mantra is "fail faster". Venture capitalists fund countless business projects on the assumption that most of them will fail. Rapid prototyping is the order of the day. Products are released in "beta" so that they can be tested against the needs of real users and fixed on a rolling basis. Google says it expects 80 per cent of its products and services to flop.

On Wall Street, instead of "fail faster" we have "too big to fail". Financial engineers constructed multi-billion dollar bets on the basis of theoretical models and scant data. (At the dawn of the financial crisis in 2007, there were $1,250,000,000,000,000 of derivatives contracts outstanding – over a million billion dollars of bets.) Traders were given performance bonuses on the basis of theoretical predictions of the outcome of these bets, rather than actually waiting years or even decades until the results became clear. It was the opposite of pragmatism. And it was a disaster.

So let's hear it for pragmatism: for trusting evidence rather than theory; for looking at the specifics of the situation rather than some overarching narrative; for preferring what works to what fits our preconceptions; and for being willing to test our ideas and change direction as is necessary.

But I am not holding my breath while waiting for an outburst of genuine pragmatism – particularly not in British politics. Remember Lady Thatcher's "You turn if you want to. The lady's not for turning"; Tony Blair was proud of the fact that he didn't have a reverse gear. I'd have trouble selling you a car that didn't turn or go backwards. But we seem to think of these as highly desirable qualities in prime ministers: British voters rewarded Thatcher and Blair for their self-professed lack of pragmatic adaptability with six general election victories. Pragmatism. Nice idea. Shame we don't vote for it.

Tim Harford is a 'Financial Times' columnist. His new book, 'Adapt: Why Success Always Starts with Failure', is published by Little, Brown (£20). To order a copy for £18 (free P&P), call Independent Books Direct on 08430 600 030, or visit

peopleTop Gear presenter and all-round controversialist is at it again
Life & Style
techHow a 'grey brick' took over the world of portable gaming
Aaron Ramsey celebrates after opening the scoring in Arsenal's win over Hull `
peopleActress speaks out against historic sexual assault claims, saying things have 'gone quite far now'

Have you tried new the Independent Digital Edition iPad app?
Coren Mitchell, who is the daughter of the late broadcaster Alan Coren and is married to comedian David Mitchell, produced a hand to make poker history at the 98th EPT main event.
peopleJournalist and TV presenter becomes first ever two-time winner of the European Poker Tour
Arts & Entertainment
A stranger calls: Martin Freeman in ‘Fargo’
tvReview: New 10-part series brims with characters and stories

Life & Style
Guests enjoy food and cocktail parings by Chefs Jimmy Bannos, Jimmy Bannos Jr, Daniel Rose and Mindy Segal with mixologists Josh King and Alex Gara at Bounty & Barrel: A Jack Daniel's Single Barrel Dinner Series at Heaven on Seven on April 9, 2014 in Chicago, Illinois.
food + drinkSprinkle Palcohol 'on almost any dish' for 'an extra kick' firm says...
Arts & Entertainment
Shaun Evans as Endeavour interviews a prisoner as he tries to get to the bottom of a police cover up
tvReview: Second series comes to close with startling tale of police corruption and child abuse
Arts & Entertainment
Schwarzenegger winning Mr. Universe 1969
arts + entsCan you guess the celebrity from these British Pathe News clips?
politicsLabour launches the 'completely hollow' Easter Clegg
Luis Suarez celebrates after scoring in Liverpool's 3-2 win over Norwich
sport Another hurdle is out of the way for Brendan Rodgers' side
Portrait of Queen Elizabeth-II by David Bailey which has been released to mark her 88th birthday
peoplePortrait released to mark monarch's 88th birthday
Arts & Entertainment
The star of the sitcom ‘Miranda’ is hugely popular with mainstream audiences
TVMiranda Hart lined up for ‘Generation Game’ revival
Life & Style
The writer, Gerda Saunders, with her mother, who also suffered with dementia before her death
healthGerda Saunders on the most formidable effect of her dementia
Arts & Entertainment
Last, but by no means least, is Tommy Cooper and the fez. This style of hat became a permanent trademark of his act.
comedyNot Like That, Like This centres on alleged domestic abuse
Travel Shop
the manor
Up to 70% off luxury travel
on city breaks Find out more
Up to 70% off luxury travel
on chic beach resorts Find out more
sardina foodie
Up to 70% off luxury travel
on country retreats Find out more
Have you tried new the Independent Digital Edition iPad app?
Independent Dating

By clicking 'Search' you
are agreeing to our
Terms of Use.

iJobs Job Widget
iJobs General

Geography Teacher

£130 - £140 per day: Randstad Education Ilford: Secondary Geography Teacher Lo...

Do you want to work in Education?

£55 - £70 per day: Randstad Education Cheshire: Are you a dynamic and energeti...

SEN Teaching Assistant

Negotiable: Randstad Education Group: SEN TAs, LSAs and Support Workers needed...

Private Client Senior Manager - Sheffield

£50000 - £60000 per annum: Pro-Recruitment Group: The Sheffield office of this...

Day In a Page

Rubin ‘Hurricane’ Carter: The man who could have been champion of the world - and the Bob Dylan song that immortalised him

The man who could have been champion of the world

Rubin ‘Hurricane’ Carter and the Bob Dylan song that immortalised him
Didn’t she do well?

Didn’t she do well?

Miranda Hart lined up for ‘Generation Game’ revival
The Middle East we must confront in the future will be a Mafiastan ruled by money

The Middle East we must confront in the future will be a Mafiastan ruled by money

In Iraq, mafiosi already run almost the entire oil output of the south of the country
Before they were famous

Before they were famous

Can you guess the celebrity from these British Pathe News clips?
Martin Freeman’s casting in Fargo is genius

Martin Freeman’s casting in Fargo is a stroke of genius

Series is brimming with characters and stories all its own
How I brokered a peace deal with Robert Mugabe: Roy Agyemang reveals the delicate diplomacy needed to get Zimbabwe’s President to sit down with the BBC

How I brokered a peace deal with Robert Mugabe

Roy Agyemang reveals the delicate diplomacy needed to get Zimbabwe’s President to sit down with the BBC
Video of British Muslims dancing to Pharrell Williams's hit Happy attacked as 'sinful'

British Muslims's Happy video attacked as 'sinful'

The four-minute clip by Honesty Policy has had more than 300,000 hits on YouTube
Church of England-raised Michael Williams describes the unexpected joys in learning about his family's Jewish faith

Michael Williams: Do as I do, not as I pray

Church of England-raised Williams describes the unexpected joys in learning about his family's Jewish faith
A History of the First World War in 100 moments: A visit to the Front Line by the Prime Minister's wife

A History of the First World War in 100 moments

A visit to the Front Line by the Prime Minister's wife
Comedian Jenny Collier: 'Sexism I experienced on stand-up circuit should be extinct'

Jenny Collier: 'Sexism on stand-up circuit should be extinct'

The comedian's appearance at a show on the eve of International Women's Day was cancelled because they had "too many women" on the bill
Cannes Film Festival: Ken Loach and Mike Leigh to fight it out for the Palme d'Or

Cannes Film Festival

Ken Loach and Mike Leigh to fight it out for the Palme d'Or
The concept album makes surprise top ten return with neolithic opus from Jethro Tull's Ian Anderson

The concept album makes surprise top ten return

Neolithic opus from Jethro Tull's Ian Anderson is unexpected success
Lichen is the surprise new ingredient on fine-dining menus, thanks to our love of Scandinavian and Indian cuisines

Lichen is surprise new ingredient on fine-dining menus

Emily Jupp discovers how it can give a unique, smoky flavour to our cooking
10 best baking books

10 best baking books

Planning a spot of baking this bank holiday weekend? From old favourites to new releases, here’s ten cookbooks for you
Jury still out on Manchester City boss Manuel Pellegrini

Jury still out on Pellegrini

Draw with Sunderland raises questions over Manchester City manager's ability to motivate and unify his players