The secrets society: Hundreds of historic files remain closed for no obvious reason. Brian Cathcart reports

IN THE Public Record Office at Kew in London, among the Foreign Office papers for 1938, is a bound sequence of documents on the 'Sudeten German Problem' in Czechoslovakia. That was the year of the Munich conference, when Hitler's claim to the Sudeten lands brought forth the most notorious surrender in the whole story of appeasement.

Some of the documents on Britain's role in this are missing from the volumes. In their place for many years was a single sheet saying 'Closed until 1989'. When 1989 came around, however, the papers were not released. Instead, the words 'Retained under section (3)4' were added, which means that the papers were inspected by government officials, and the decision was taken to withhold them from public inspection indefinitely.

What can these papers possibly contain to justify keeping them secret after 54 years which have seen the upheavals of a World War and a Cold War? What could British diplomats or spies have been up to that might still be sensitive today? Until Whitehall changes its mind, there is no way of knowing.

The case of the Sudeten German papers is one of hundreds which have turned up in the first attempt by British historians to catalogue the public records that they would like to read but are not allowed to, even though the usual 30-year period has passed.

The initiative, organised by the Institute of Contemporary British History (ICBH) in London, comes in response to an offer made last June by William Waldegrave, the minister responsible for open government.

Asked in a radio interview about the prospects for glasnost in public records, he said: 'I would like to invite serious historians to write to me . . . Those who want to write serious historical works will know, probably better than we do, of blocks of papers that could be of help to them that we could consider releasing.'

He has been taken at his word. With the support of dozens of Public Record Office regulars, the ICBH has identified a huge variety of closed files, and it will be reporting its findings to Mr Waldegrave at the end of the month. The meatier subjects covered include:

Nazi subversive operations in Britain during the war.

Pre-war Nazi sympathisers in high places in Britain.

Interrogation reports on German prisoners of war.

The abdication crisis of 1936.

The post-war Cabinet committee on subversive activities.

Sir Roger Casement, the Irishman executed for treason in 1916.

British Army action during the 1916 Easter Rising.

British irregular forces in Ireland 1919-21.

Sudeten Germans in Czechoslovakia in 1938.

Anglo-Iranian relations in 1953, the year of a coup in Tehran.

The attempt on Hitler's life in July 1944.

Full transcripts of intercepted German 'Enigma' signals.

Why is the Government keeping secrets about these things? The rules are clear: documents are released after 30 years unless they contain information which (a) might endanger national security, (b) might cause distress to individuals or their immediate descendants, or (c) was given on condition of confidentiality.

In some cases, it is possible to identify one of the three factors. The abdication papers, for example, are thought to be withheld because of possible distress to the Queen Mother. And immediate descendants of Irishmen who helped the British forces during the war of independence might well suffer distress if identified. But Sir Roger Casement? Nazi sympathisers? The Iranian coup?

Professor Kenneth Morgan, who has been studying the Anglo-Iranian papers, says it is 'ridiculous' that he is able to read material up to the year 1951, but not after. This means that the extent of British and American involvement in the coup of 1953 against the Prime Minister, Mossadeq, is at least partly obscured. 'It makes a total mockery of the work of the historian,' Professor Morgan says.

The official body which is supposed to safeguard the public interest in all this, the Lord Chancellor's Advisory Council on Public Records, chaired by the Master of the Rolls, includes reputable historians among its members. When government departments decide to withhold papers, they must justify the decision, file by file, to this panel.

The council, however, is a victim of a classic paradox of official secrecy: its members do not have security clearance, so they are not allowed to see the contents of the files being discussed. 'All we can do is ask awkward questions,' says Valerie Cromwell, a historian who has been a member. 'We are meant to see that things are run properly, but it's difficult in these circumstances to do a good job.'

Historians assume, in fact, that many papers are held back for quite innocent reasons, some because of past qualms, now irrelevant, some because the resources do not exist to process them, and some simply because they have been forgotten. The ICBH has identified a large number of files that may fall into this category. They include:

The International Whaling Agreement of 1939.

Aberystwyth hospitals and civil defence planning.

Black-market activity in the Second World War.

Private housing in Crawley in the 1950s.

The Poor Law in the 1930s.

Anglo-Swedish relations in 1941.

Food production in the Second World War.

Relations between Turkey and South Korea in 1957.

What could possibly be secret about these matters? There is a tendency to assume the worst, and nothing feeds a conspiracy theory so well as the concealment of evidence. Historians argue that it is often in the Government's interest to release a file, if only to defuse speculation.

That was the case with papers on police activities during a strike at Tonypandy in South Wales in 1911. Because the papers were held back for 75 years, it was thought that they must contain damning information about the role of the then Home Secretary, Winston Churchill, in encouraging police excesses. When they finally emerged, however, it was clear they had been kept back merely to conceal details of special police overtime and billeting arrangements. A similar anti-climax followed the recent release of papers on Rudolf Hess.

There is another paradox about public records. Most of the knowledge about files that have been withheld comes from the indexes of the Public Record Office, where tantalising blank spaces appear beside file headings.

But what about the cases where even the file headings are absent? And the papers that have never reached the index? These are the successful cover-ups. Lewis Johnman, another historian involved in the ICBH initiative, sums up the Catch-22: 'We don't know because we can't see, and we can't see because we don't know.'

Dr Johnman has been frustrated by one of the oddest secrecy cases of all. Four times in the first half of this century, the Government conducted a census of production, an all-embracing survey of British industry, for which every manufacturing company submitted details of its operations. Digests were made public, but the raw, company-by-company returns were not, because firms insisted that the information must not find its way to competitors.

Dr Johnman was interested in the raw returns, potentially a peerless record of industrial decline, and he thought that, at least in the case of the 1907 and 1912 censuses, the confidentiality factor would no longer apply. The Government explained that since the original promise of discretion had been made to the British industrial organisations of that time, it was the Confederation of British Industry that should have the last word. The CBI said no. Dr Johnman, and a number of other economic historians, are hoping that Mr Waldegrave will now change its mind.

(Photographs omitted)

News
A 1930 image of the Karl Albrecht Spiritousen and Lebensmittel shop, Essen. The shop was opened by Karl and Theo Albrecht’s mother; the brothers later founded Aldi
people
Arts and Entertainment
Standing the test of time: Michael J Fox and Christopher Lloyd in 'Back to the Future'
filmA cult movie event aims to immerse audiences of 80,000 in ‘Back to the Future’. But has it lost its magic?
Arts and Entertainment
Flora Spencer-Longhurst as Lavinia, William Houston as Titus Andronicus and Dyfan Dwyfor as Lucius
theatreThe Shakespeare play that proved too much for more than 100 people
News
exclusivePunk icon Viv Albertine on Sid Vicious, complacent white men, and why free love led to rape
PROMOTED VIDEO
Have you tried new the Independent Digital Edition apps?
News
ebookA unique anthology of reporting and analysis of a crucial period of history
Arts and Entertainment
Stir crazy: Noel Fielding in 'Luxury Comedy 2: Tales from Painted Hawaii'
comedyAs ‘Luxury Comedy’ returns, Noel Fielding on why mainstream success scares him and what the future holds for 'The Boosh'
Life and Style
Flow chart: Karl Landsteiner discovered blood types in 1900, yet scientists have still not come up with an explanation for their existence
lifeAll of us have one. Yet even now, it’s a matter of debate what they’re for
Arts and Entertainment
'Weird Al' Yankovic, or Alfred Matthew, at the 2014 Los Angeles Film Festival Screening of
musicHis latest video is an ode to good grammar. But what do our experts think he’s missed out?
Sport
New Real Madrid signing James Rodríguez with club president Florentino Perez
sportColombian World Cup star completes £63m move to Spain
Travel
Hotel Tour d’Auvergne in Paris launches pay-what-you-want
travelIt seems fraught with financial risk, but the policy has its benefits
Arts and Entertainment
booksThe best children's books for this summer
Life and Style
News to me: family events were recorded in the personal columns
techFamily events used to be marked in the personal columns. But now Facebook has usurped that
News
news
News
i100
Independent
Travel Shop
the manor
Up to 70% off luxury travel
on city breaks Find out more
santorini
Up to 70% off luxury travel
on chic beach resorts Find out more
sardina foodie
Up to 70% off luxury travel
on country retreats Find out more
Latest stories from i100
Have you tried new the Independent Digital Edition apps?
Independent Dating
and  

By clicking 'Search' you
are agreeing to our
Terms of Use.

iJobs Job Widget
iJobs General

Sustainability Manager

Competitive: The Green Recruitment Company: Job Title: Scheme Manager (BREEAM)...

Graduate Sustainability Professional

Flexible, depending on experience: The Green Recruitment Company: Job Title: T...

Programme Director - Conduct Risk - London

£850 - £950 per day: Orgtel: Programme Director - Conduct Risk - Banking - £85...

Project Coordinator/Order Entry, SC Clear

£100 - £110 per day: Orgtel: Project Coordinator/Order Entry Hampshire

Day In a Page

Noel Fielding's 'Luxury Comedy': A land of the outright bizarre

Noel Fielding's 'Luxury Comedy'

A land of the outright bizarre
What are the worst 'Word Crimes'?

What are the worst 'Word Crimes'?

‘Weird Al’ Yankovic's latest video is an ode to good grammar. But what do The Independent’s experts think he’s missed out?
Can Secret Cinema sell 80,000 'Back to the Future' tickets?

The worst kept secret in cinema

A cult movie event aims to immerse audiences of 80,000 in ‘Back to the Future’. But has it lost its magic?
Facebook: The new hatched, matched and dispatched

The new hatched, matched and dispatched

Family events used to be marked in the personal columns. But now Facebook has usurped the ‘Births, Deaths and Marriages’ announcements
Why do we have blood types?

Are you my type?

All of us have one but probably never wondered why. Yet even now, a century after blood types were discovered, it’s a matter of debate what they’re for
Honesty box hotels: You decide how much you pay

Honesty box hotels

Five hotels in Paris now allow guests to pay only what they think their stay was worth. It seems fraught with financial risk, but the honesty policy has its benefit
Commonwealth Games 2014: Why weight of pressure rests easy on Michael Jamieson’s shoulders

Michael Jamieson: Why weight of pressure rests easy on his shoulders

The Scottish swimmer is ready for ‘the biggest race of my life’ at the Commonwealth Games
Some are reformed drug addicts. Some are single mums. All are on benefits. But now these so-called 'scroungers’ are fighting back

The 'scroungers’ fight back

The welfare claimants battling to alter stereotypes
Amazing video shows Nasa 'flame extinguishment experiment' in action

Fireballs in space

Amazing video shows Nasa's 'flame extinguishment experiment' in action
A Bible for billionaires

A Bible for billionaires

Find out why America's richest men are reading John Brookes
Paranoid parenting is on the rise - and our children are suffering because of it

Paranoid parenting is on the rise

And our children are suffering because of it
For sale: Island where the Magna Carta was sealed

Magna Carta Island goes on sale

Yours for a cool £4m
Phone hacking scandal special report: The slide into crime at the 'News of the World'

The hacker's tale: the slide into crime at the 'News of the World'

Glenn Mulcaire was jailed for six months for intercepting phone messages. James Hanning tells his story in a new book. This is an extract
We flinch, but there are degrees of paedophilia

We flinch, but there are degrees of paedophilia

Child abusers are not all the same, yet the idea of treating them differently in relation to the severity of their crimes has somehow become controversial
The truth about conspiracy theories is that some require considering

The truth about conspiracy theories is that some require considering

For instance, did Isis kill the Israeli teenagers to trigger a war, asks Patrick Cockburn