Nigel Hawkes: And our survey says...nothing you can rely on

Behind the numbers

Share
Related Topics

Aberdeen is the most sleep-deprived city in Britain, Bristol the unhealthiest, London the smelliest. The average person spends £2,776.75 a year on keeping healthy, and married couples achieve their peak happiness two years, 11 months and eight days after tying the knot.

These "facts" – and let us not forget the disclosure that 48 per cent of women admit faking an orgasm, and 9 per cent do it all the time – were all published by British newspapers last week. They were all the result of surveys, the quickest way to a news editor's heart.

Surveys are proliferating like Japanese knotweed. They borrow the authority of statistics to lend an air of truth to otherwise implausible claims. And, remarkably, all the surveys listed above come from the same survey factory, based in Bristol (Britain's unhealthiest place, remember?).

A regional news agency, South West News Service, offers a complete survey service. For £2,500 they will originate the questions, perform the survey, compile the results, write the press release, then report it as if it were news. That is a bargain if the company commissioning the survey gets a mention in Metro, the Daily Mail, the Daily Mirror, the Daily Express, the Evening Standard, the Press Association, The Sun, the Daily Record, or the Daily Star, all of which ran one or more of these surveys.

The surveys are organised by a subsidiary of SWNS, the PR agency 72 Point, and done by OnePoll, using a panel of volunteers who are paid (modestly) for their participation. They can turn a survey round in a couple of days. For an extra £300 you can motivate the panel to respond even more enthusiastically.

So what's wrong? In statistical terms, plenty. The samples for these online surveys look large – typically, 3,000 or so – but they are neither random nor necessarily representative of the public at large. The results are often broken down city by city, to attract interest from local papers or to compile league tables, when the samples for each city are far too small to make such comparisons valid. No confidence intervals are quoted.

And the results are often given an absurd precision, in the knowledge that journalists are easily seduced by an exact number. Claiming that the average person spends £2,776.75 a year keeping healthy sounds as if somebody counted every penny. In truth, nobody really counted anything at all, or not to an accuracy of better than the nearest £100 or so.

So these surveys are largely meaningless. But SWNS's website has testimonials from Tony Gallagher, Editor of The Daily Telegraph ("Its ability to deliver high-quality stories day after day is simply remarkable"), from Chris Pharo, head of news at The Sun, ("excellent survey-led news stories and stats") and, more worryingly, the Central Office of Information.

You might also worry, if you care for press independence, that quite such a cosy relationship between PR and news-gathering isn't healthy. But it's only a bit of fun, surely? "Poor show, chaps: survey shows that nearly one in 10 women fake it between the sheets", as the Daily Mail headlined one of the surveys. It's not meant to be taken seriously, so aren't my criticisms a bit priggish?

Not really. Almost all national statistics, from crime to the GDP, come from surveys designed with huge care to get as near as possible to the right answer. Newspaper surveys bear about as much relation to these as a chicken nugget does to a three-star Michelin lunch. Newspapers who give them space are selling themselves cheap.

Nigel Hawkes is Director of Straight Statistics

React Now

Latest stories from i100
Have you tried new the Independent Digital Edition apps?
iJobs Job Widget
iJobs General

Marketing & PR Assistant - NW London

£15 - £17 per hour: Ashdown Group: Marketing & PR Assistant - Kentish Town are...

Senior Network Integration/Test Engineer

£250 - £300 per day: Orgtel: Senior Network Integration/Test Engineer Berkshir...

Software Developer - Newcastle - £30,000 - £37,000 + benefits

£30000 - £37000 per annum + attractive benefits: Ashdown Group: .NET Developer...

Trainee Recruitment Consultant

£20000 - £25000 per annum + OTE £40,000: SThree: SThree Group have been well e...

Day In a Page

Read Next
 

The truth about kids on holiday

Rosie Millard
 

August catch-up: Waiting on the telephone, tribute to Norm and my Desert Island Discs

John Rentoul
Middle East crisis: We know all too much about the cruelty of Isis – but all too little about who they are

We know all too much about the cruelty of Isis – but all too little about who they are

Now Obama has seen the next US reporter to be threatened with beheading, will he blink, asks Robert Fisk
Neanderthals lived alongside humans for centuries, latest study shows

Final resting place of our Neanderthal neighbours revealed

Bones dated to 40,000 years ago show species may have died out in Belgium species co-existed
Scottish independence: The new Scots who hold fate of the UK in their hands

The new Scots who hold fate of the UK in their hands

Scotland’s immigrants are as passionate about the future of their adopted nation as anyone else
Britain's ugliest buildings: Which monstrosities should be nominated for the Dead Prize?

Blight club: Britain's ugliest buildings

Following the architect Cameron Sinclair's introduction of the Dead Prize, an award for ugly buildings, John Rentoul reflects on some of the biggest blots on the UK landscape
eBay's enduring appeal: Online auction site is still the UK's most popular e-commerce retailer

eBay's enduring appeal

The online auction site is still the UK's most popular e-commerce site
Culture Minister Ed Vaizey: ‘lack of ethnic minority and black faces on TV is weird’

'Lack of ethnic minority and black faces on TV is weird'

Culture Minister Ed Vaizey calls for immediate action to address the problem
Artist Olafur Eliasson's latest large-scale works are inspired by the paintings of JMW Turner

Magic circles: Artist Olafur Eliasson

Eliasson's works will go alongside a new exhibition of JMW Turner at Tate Britain. He tells Jay Merrick why the paintings of his hero are ripe for reinvention
Josephine Dickinson: 'A cochlear implant helped me to discover a new world of sound'

Josephine Dickinson: 'How I discovered a new world of sound'

After going deaf as a child, musician and poet Josephine Dickinson made do with a hearing aid for five decades. Then she had a cochlear implant - and everything changed
Greggs Google fail: Was the bakery's response to its logo mishap a stroke of marketing genius?

Greggs gives lesson in crisis management

After a mishap with their logo, high street staple Greggs went viral this week. But, as Simon Usborne discovers, their social media response was anything but half baked
Matthew McConaughey has been singing the praises of bumbags (shame he doesn't know how to wear one)

Matthew McConaughey sings the praises of bumbags

Shame he doesn't know how to wear one. Harriet Walker explains the dos and don'ts of fanny packs
7 best quadcopters and drones

Flying fun: 7 best quadcopters and drones

From state of the art devices with stabilised cameras to mini gadgets that can soar around the home, we take some flying objects for a spin
Joey Barton: ‘I’ve been guilty of getting a bit irate’

Joey Barton: ‘I’ve been guilty of getting a bit irate’

The midfielder returned to the Premier League after two years last weekend. The controversial character had much to discuss after his first game back
Andy Murray: I quit while I’m ahead too often

Andy Murray: I quit while I’m ahead too often

British No 1 knows his consistency as well as his fitness needs working on as he prepares for the US Open after a ‘very, very up and down’ year
Ferguson: In the heartlands of America, a descent into madness

A descent into madness in America's heartlands

David Usborne arrived in Ferguson, Missouri to be greeted by a scene more redolent of Gaza and Afghanistan
BBC’s filming of raid at Sir Cliff’s home ‘may be result of corruption’

BBC faces corruption allegation over its Sir Cliff police raid coverage

Reporter’s relationship with police under scrutiny as DG is summoned by MPs to explain extensive live broadcast of swoop on singer’s home