Government Archives and Official Histories Debate

Full Debate: Read Full Debate

Lord Ahmad of Wimbledon

Main Page: Lord Ahmad of Wimbledon (Conservative - Life peer)

Government Archives and Official Histories

Lord Ahmad of Wimbledon Excerpts
Wednesday 10th July 2013

(11 years, 5 months ago)

Lords Chamber
Read Full debate Read Hansard Text
Lord Ahmad of Wimbledon Portrait Lord Ahmad of Wimbledon
- Hansard - -

My Lords, I thank my noble friend Lord Rodgers of Quarry Bank for initiating this debate. I am sure the House is fully aware of his longstanding interest in these matters and the great experience he brings to bear in debates such as these, as demonstrated by his contribution today. I also thank all noble Lords for the valuable contributions they made which raised several important questions. I hope that I am able to address most, if not all, of the issues. I will write on any questions left outstanding.

I also pay tribute to my noble friend for his work within the privy counsellors’ group, the “three wise men” as they are often referred to in this particular area. If debates such as this are about prompting interest, as a Minister in the Government, this was a new area for me. It has certainly prompted my interest, and I am looking forward to my visit to the National Archives in the next couple of weeks or so.

Turning first to official histories, my noble friend Lord Rodgers and the noble Lord, Lord Bew, referred to the reviews commissioned by the then Cabinet Secretary, the noble Lord, Lord O’Donnell, and conducted by Sir Joe Pilling and Mr Bill Hamilton. They recommended that the official history programme should be continued under the auspices of the Cabinet Office under the name “the public history programme”. They proposed substantial changes to raise the profile and relevance of the programme, including an increase in the involvement of sponsor departments and outside bodies, a revamping of the publishing arrangements and an enhancement to its governance procedures.

Several noble Lords referred to the fact that, given the current economic constraints, the Government do not plan to implement the proposed changes at the current time, and I will return to this. However, we are moving forward with the completion of the existing programme, which will conclude with the publication of The Official History of the Joint Intelligence Committee: Volume 2 in 2016. Work on this volume will, we hope, be completed by the end of 2015, after which point the recommendations will be revisited.

My noble friend Lord Rodgers referred to expense. Without incurring disproportionate expense, it is not possible to determine the overall cost of the current series of official histories. However, for the last year for which published costs are available, 2006-07, the net cost was £176,000. This cost includes fees and expenses of historians and research assistants and costs associated with publication, but excludes staff costs of Cabinet Office administrative support and accommodation-related overheads. Noble Lords will understand that until the future shape of any programme has been determined it will not be possible to estimate the likely future costs. I reiterate the words of my noble friend Lord McNally when he previously answered a debate on this subject:

“As for the official history programme, a good deal of work is already in progress, and I hope that we can review future work in happier economic circumstances. I emphasise again my enthusiasm for the programme of official histories. It would be a tragedy if we were to allow them to wither on the vine”.—[Official Report, 17/1/12; col. 547.]

I share his sentiments.

The noble Lord, Lord Hennessy, in his excellent contribution to today’s debate, referred with his usual aplomb to the histories of MI5 and the Secret Intelligence Service written, respectively, by Professor Christopher Andrew and Professor Keith Jeffery. I should clarify for the House that these were authorised histories, more akin to departmental histories, and were not commissioned under the official history programme. The noble Lord also suggested that an authorised or official history of GCHQ would be a valuable addition to those recent intelligence histories. In fact, nearly all of GCHQ’s records of the period roughly corresponding to that covered by Professor Jeffery’s history of SIS have already been released at the National Archives. I agree with the noble Lord that it is therefore open to any historian—indeed, we have historians in the Chamber—to write their own history of GCHQ. I look forward to such books being written.

Turning to the arrangements for preserving government archives, we have grounds to be optimistic given the progress made in a number of areas since 2008. First, on the responsibility for public record keeping, in line with the Public Records Act 1958, government departments are responsible for their records up to the point that they are transferred to the care of the National Archives. The National Archives provides departments with guidance and supervision, but decisions on which records to select for permanent preservation remain the departments’ own.

On guidance, in June 2009 the Cabinet Office and the National Archives revised the guidance on the management of private office papers. November 2010 saw the revision of the Civil Service Code, which now emphasises the importance of keeping accurate official records and handling information as openly as possible within the legal framework. In December 2010, the Cabinet Manual was issued, and this includes a section on official information and maintaining official records for departments. A question was raised by my noble friend Lord Rodgers about reminding Permanent Secretaries about their accountability for record keeping in their departments. It is from the Cabinet Manual that Permanent Secretaries should draw their guidance.

The noble Lord, Lord Prescott, raised several issues in his contribution, which I am sure we all found entertaining. To save on the high cost of file storage in central London, certain records have been outsourced to secure locations outside London. Regrettably, I am informed that mislabelling of the box containing the diaries of the noble Lord, Lord Prescott, led a more extensive search being required. I am sorry for any delay that that caused. However, I am sure that all noble Lords are delighted to learn that he has now perceived a positive response, and I am sure we are all looking forward to the publication of the noble Lord’s diaries; I am sure that they will make an entertaining read for us all.

Lord Stevenson of Balmacara Portrait Lord Stevenson of Balmacara
- Hansard - - - Excerpts

I am sure that my noble friend Lord Prescott can speak for himself, but I think his point was that there are points, particularly in today’s world, where it is vital for people to be able to respond quickly and precisely to allegations made, for whatever reason, in the press. I accept the Minister’s general point, but I do not think he responded to my noble friend’s point. Can he give us some assurance about how quickly these things can be dealt with in future?

Lord Ahmad of Wimbledon Portrait Lord Ahmad of Wimbledon
- Hansard - -

First, I have apologised for the delay. It has been recognised that that should not have happened. Of course measures have been taken to ensure that the archive records should be labelled properly. I give an assurance that that has been done.

Lord Prescott Portrait Lord Prescott
- Hansard - - - Excerpts

The labelling?

Lord Ahmad of Wimbledon Portrait Lord Ahmad of Wimbledon
- Hansard - -

I am sure that the noble Lord will agree with me that labelling matters; it is good to know whose diaries are where.

In response to another point raised by the noble Lord, Lord Prescott, the noble Lord, Lord Butler, is absolutely correct that former Ministers can see their papers within their former departments. I assure the House that this is also outlined in the Cabinet Manual, which is available online. The noble Lord, Lord Butler, also talked about the coverage of historical advisers and sections across Whitehall. The FCO still has a historical section, the head of which is Patrick Salmon. I will write to the noble Lord on the coverage of historical advisers across Whitehall in general and, of course, place a copy of that letter in the Library.

On other initiatives, the National Archives’ information management assessment programme began in 2008. To date, most of the departments of state and several key agencies have been assessed and the remainder will be assessed during 2013-14. The National Archives is also about to begin a series of ongoing reassessments. The published reports of these assessments highlight good practice and make targeted, pragmatic recommendations for improvement. The National Archives works with each department to develop an action plan to address any risks and issues identified in the report.

The noble Lord, Lord Bew, referred to the 20-year rule. As noble Lords will be aware, from 1 January this year central government began its 10-year transition from the previous 30-year rule to the new 20-year rule. To smooth this transition, the National Archives has, with the active participation of departments across government, comprehensively revised its guidance and processes for the selection and transfer of records. The National Archives has been tasked to collect and publish regular reports on departments’ progress in reviewing and selecting records for permanent preservation during the transition period. The most recent report, with returns from 84 departments and agencies, was published on the National Archives’ website on 1 July. This level of transparency around government’s records management is, I suggest, unprecedented. With these reports and the transition itself, we have come a long way from the days, prior to the Freedom of Information Act, when our best hopes for transparent government lay with such excellent initiatives as the one led by the noble Lord, Lord Waldegrave.

The noble Lord, Lord Stevenson, rightly raised digital records. Much work has been carried out to clarify and address the challenges presented by the shift from paper to digital records in the business of government. The National Archives now has greater confidence that the much discussed black hole in our history wrought by obsolete digital formats is unlikely to materialise on the scale that had once been feared. However, it is important that in the National Archives programme new technology is fully embraced. Digital continuity is also now taken much more seriously across government than it was five years ago. The programme of training instigated by the noble Lord, Lord O’Donnell, during his time as Cabinet Secretary has certainly aided a better understanding of our digital records and improved usability and accessibility. Of course, there remains the challenge of reviewing large volumes of digital records for sensitivity ahead of their potential release under the 20-year rule, and the National Archives is working with other expert bodies to develop solutions.

I am pressed for time but, in conclusion, we all recognise that there remains much to do to ensure that government records in all forms survive for future researchers and historians; indeed, that was expressed by all noble Lords today. However, I hope that noble Lords will take from today’s debate some reassurance that these issue continue to be explored and addressed and, more importantly, that much more of the Government’s work in this area is open to scrutiny by Members of this House than ever before.

The noble Lord, Lord Butler, said in his contribution that Governments need to look at history. He referred to the late Lady Thatcher and her policy of a panel of experts; I think that we can learn a great deal. The National Archives represents our history. I suppose, as a Minister of the current Government, that it is apt to finish with a quote from Sir Winston Churchill, who said:

“Study history, study history. In history lies all the secrets of statecraft”.

Lord Prescott Portrait Lord Prescott
- Hansard - - - Excerpts

And do not forget to label them.