The mysterious Dr Foster

Many of Britain's hospitals are putting lives in danger. So says a consultancy whose dire warning dominated the weekend headlines. But is it right? And should it be allowed so much influence? Nigel Hawkes ventures a second opinion

Who is this Dr Foster, the source of the weekend's headlines about the NHS? He seems to be saying that the elaborate system for inspecting hospitals that was set up – and recently reformed – by the Government is failing to spot some pretty obvious examples of bad medicine.

Thousands of patients dying, hospitals failing to respond to safety alerts or unexpected deaths, swabs and drill bits left inside patients after operations... Isn't this the kind of thing any respectable Government inspector might be expected to pick up on? What on earth is going on?

Dr Foster is not, of course, a doctor at all, but a witty name chosen by two journalists when they set up a healthcare analysis company eight years ago, planning to exploit the mass of data churned out by the NHS (..."Dr Foster went to Gloucester, in a shower of rain")

Tim Kelsey from The Sunday Times and Roger Taylor from the Financial Times saw an unexploited commercial opportunity in the work of Professor Sir Brian Jarman of Imperial College. Professor Jarman had devised a way of measuring how well hospitals perform by using the Hospital Episode Statistics (HES) produced by the NHS.

Kelsey and Taylor's timing was good. The Department of Health under Alan Milburn needed evidence to support and monitor progress in implementing the NHS Plan and, after some initial hesitation, embraced Dr Foster warmly. The first Good Hospital Guide under the Dr Foster imprint appeared in 2001. Hospitals were under notice to collaborate with Dr Foster, however little they liked doing it.

So keen was Milburn's successor, Patricia Hewitt, on the product that she bought the company. Under a deal negotiated in 2006, £12m of public money was invested in a joint venture between Dr Foster and the NHS body, the Information Centre for Health and Social Care, to create the Dr Foster Intelligence consultancy.

The fact that this deal went through without a competitive tender raised some eyebrows, and was heavily criticised by the National Audit Office (NAO). The department had paid too much, and had failed to give others a chance to bid, the NAO ruled.

Professor Denise Lievesley, a statistician who had become chief executive of the Information Centre, protested to her bosses in the NHS, and again in 2007 when a contract to provide material to the NHS Choices online information service was awarded to Dr Foster without (in her view) proper procurement procedures. She was eased out of her job, with a gagging clause preventing her from telling her side of the story.

So the irony of the weekend's stories is that a company granted at least one sweetheart deal – and possibly two – by the Department of Health has been the bringer of exactly the sort of bad news the department would rather not have heard.

There have been hints that the department has fallen out of love with Dr Foster. The consultancy lost the contract for NHS Choices in July 2008, and set up a rival website for its Good Hospital Guide. There are suggestions that the Information Centre plans to sell its stake in the joint venture.

That said, is what Dr Foster says about the NHS to be relied on?

Professor Jarman's method of comparing hospitals is called the Hospital Standardised Mortality Ratio, or HSMR. From the HES data, the number of patients dying after a range of different procedures in hospitals is available. All things being equal, good hospitals will kill fewer patients than bad ones. The difficulty is that all things are not equal.

Hospitals vary in many ways – the area they serve, the age of their patients, the efficiency with which they record the data. The HSMR figures incorporate corrections for these variables, so that at the end of the process one hospital can be compared directly with another. Professor Jarman is a leading world authority on this subject, so nobody doubts the probity of the process.

But many do question the results. One striking feature of this year's results is a sharp fall of 7 per cent in HSMRs across England. This is good news – if slightly too good to believe without careful scrutiny – because it implies that many fewer patients are dying in England's hospitals than in previous years. But the fact that HSMRs across the board have fallen so fast means that the target has moved. The results have been rebased so that a hospital that exactly matched the national average would score 100 – those with more deaths above 100, those with fewer below 100. This means that some hospitals who know they have improved appear to have done worse, because they haven't improved quite as much as the average. Others say the Dr Foster method misrepresents how good they are.

Alternative methods for calculating HSMRs exist, and in some cases paint a much more flattering picture.

One reason for this may be that hospitals do not invariably "code" their patients fully. If a patient has four or five co-morbidities (conditions that make survival less likely) then this should be taken into account. If they are not recorded properly, then a hospital will have a higher HSMR than it should. (There may even – perish the thought – be the suggestion that clever hospitals are exaggerating the co-morbidities to improve their HSMRs. It wouldn't be the first time a target has been "gamed" in the NHS.) Another possible source of error is that Dr Foster counts only deaths that occur in hospital. If patients are discharged and die the next day, at home or in a hospice, their deaths go unrecorded.

So the Good Hospital Guide should be seen for what it is: a sincere attempt to measure something very elusive but very important. But is it more reliable than the Care Quality Commission (CQC) verdicts? Dr Foster can be said to provide an important corrective. Both approaches have their virtues, but careful scrutiny and a degree of scepticism should accompany the reading of either.

PROMOTED VIDEO
Life and Style
ebookNow available in paperback
ebooks
ebookPart of The Independent’s new eBook series The Great Composers
Arts and Entertainment
Under the skin: Sarah Kane in May 1998
theatreThe story behind a new season of Sarah Kane plays
Arts and Entertainment
Preening: Johnny Depp in 'Mortdecai'
filmMortdecai becomes actor's fifth consecutive box office bomb
Sport
Bradford City's reward for their memorable win over Chelsea is a trip to face either Sunderland or Fulham (Getty)
football
News
Lars Andersen took up archery in his mid thirties
video
Voices
Focus E15 Mothers led a protest to highlight the lack of affordable housing in London
voicesLondon’s housing crisis amounts to an abuse of human rights, says Grace Dent
Latest stories from i100
Have you tried new the Independent Digital Edition apps?

ES Rentals

    Independent Dating
    and  

    By clicking 'Search' you
    are agreeing to our
    Terms of Use.

    iJobs Job Widget
    iJobs General

    Recruitment Genius: Warehouse Operations & Logistics Manager

    £38000 - £42000 per annum: Recruitment Genius: One of the UK's best performing...

    Recruitment Genius: GeoDatabase Specialist - Hazard Modelling

    £35000 - £43000 per annum: Recruitment Genius: Our award-winning client is one...

    Recruitment Genius: Compressed Air Pipework Installation Engineer

    £15000 - £21000 per annum: Recruitment Genius: This leading provider of Atlas ...

    Recruitment Genius: Operations Coordinator - Pallet Network

    £18000 - £20000 per annum: Recruitment Genius: Opportunity to join established...

    Day In a Page

    Woman who was sent to three Nazi death camps describes how she escaped the gas chamber

    Auschwitz liberation 70th anniversary

    Woman sent to three Nazi death camps describes surviving gas chamber
    DSK, Dodo the Pimp, and the Carlton Hotel

    The inside track on France's trial of the year

    Dominique Strauss-Kahn, Dodo the Pimp, and the Carlton Hotel:
    As provocative now as they ever were

    Sarah Kane season

    Why her plays are as provocative now as when they were written
    Murder of Japanese hostage has grim echoes of a killing in Iraq 11 years ago

    Murder of Japanese hostage has grim echoes of another killing

    Japanese mood was against what was seen as irresponsible trips to a vicious war zone
    Syria crisis: Celebrities call on David Cameron to take more refugees as one young mother tells of torture by Assad regime

    Celebrities call on David Cameron to take more Syrian refugees

    One young mother tells of torture by Assad regime
    The enemy within: People who hear voices in their heads are being encouraged to talk back – with promising results

    The enemy within

    People who hear voices in their heads are being encouraged to talk back
    'In Auschwitz you got used to anything'

    'In Auschwitz you got used to anything'

    Survivors of the Nazi concentration camp remember its horror, 70 years on
    Autumn/winter menswear 2015: The uniforms that make up modern life come to the fore

    Autumn/winter menswear 2015

    The uniforms that make up modern life come to the fore
    'I'm gay, and plan to fight military homophobia'

    'I'm gay, and plan to fight military homophobia'

    Army general planning to come out
    Iraq invasion 2003: The bloody warnings six wise men gave to Tony Blair as he prepared to launch poorly planned campaign

    What the six wise men told Tony Blair

    Months before the invasion of Iraq in 2003, experts sought to warn the PM about his plans. Here, four of them recall that day
    25 years of The Independent on Sunday: The stories, the writers and the changes over the last quarter of a century

    25 years of The Independent on Sunday

    The stories, the writers and the changes over the last quarter of a century
    Homeless Veterans appeal: 'Really caring is a dangerous emotion in this kind of work'

    Homeless Veterans appeal

    As head of The Soldiers' Charity, Martin Rutledge has to temper compassion with realism. He tells Chris Green how his Army career prepared him
    Wu-Tang Clan and The Sexual Objects offer fans a chance to own the only copies of their latest albums

    Smash hit go under the hammer

    It's nice to pick up a new record once in a while, but the purchasers of two latest releases can go a step further - by buying the only copy
    Geeks who rocked the world: Documentary looks back at origins of the computer-games industry

    The geeks who rocked the world

    A new documentary looks back at origins of the computer-games industry
    Belle & Sebastian interview: Stuart Murdoch reveals how the band is taking a new direction

    Belle & Sebastian is taking a new direction

    Twenty years ago, Belle & Sebastian was a fey indie band from Glasgow. It still is – except today, as prime mover Stuart Murdoch admits, it has a global cult following, from Hollywood to South Korea