Asked by: Lord Clement-Jones (Liberal Democrat - Life peer)
Question to the Cabinet Office:
To ask His Majesty's Government, further to the Written Answer by Baroness Neville-Rolfe on 19 February (HL2184), how many of the 20 Integrated Data Service projects and 600 Secure Research Service projects referred to in that answer have a lead researcher whose primary affiliation is given as (1) academic, (2) central government, (3) commercial, (4) local government, (5) non-commercial, and (6) the Office for National Statistics.
Answered by Baroness Neville-Rolfe - Minister of State (Cabinet Office)
The information requested falls under the remit of the UK Statistics Authority. A response to the noble Lord’s Parliamentary Question of 14 March is below and attached.
The Lord Clement-Jones CBE
House of Lords
London
SW1A 0PW
22 March 2024
Dear Lord Clement-Jones
As National Statistician and Chief Executive of the UK Statistics Authority, I am responding to your Parliamentary Question asking, further to the Written Answer by Baroness Neville-Rolfe on 19 February (HL2184), how many of the 20 Integrated Data Service (IDS) projects and 600 Secure Research Service (SRS) projects referred to in that answer have a lead researcher whose primary affiliation is given as (1) academic, (2) central government, (3) commercial, (4) local government, (5) non-commercial, and (6) the Office for National Statistics (ONS) (HL3276).
Of the monthly average of 600 projects running in the SRS during 2023, 382 were led by those affiliated with the academic community. There were no academic lead projects within the Integrated Data Service for the same period.
For the same period, the number of projects led by central government on the SRS was 43; these include agencies, public bodies, devolved administrations, ministerial and non-ministerial and public research bodies. The number of central government lead projects on the IDS was 10.
The number of commercial lead projects on SRS projects was 81; these include private sector organisations, primarily think tanks and consultancies. There were no lead researchers within this affiliation attached to the 20 IDS projects.
The number of local government affiliated lead projects in SRS was 6. There were no lead researchers within this affiliation attached to the 20 IDS projects.
The number of non-commercial affiliated lead projects in SRS was 69; these include those categorised as third sector/voluntary. There were no lead researchers within this affiliation attached to the 20 IDS projects.
The number of Office for National Statistics lead researchers on SRS projects was 19. The subsequent number for the 20 IDS projects was 10.
We have recently communicated the timetable for the transition to IDS to our SRS users and over the next year, the IDS will scale its data at pace and onboard a range of users from across all the aforementioned user groups in SRS, leading to a more varied distribution of user types accessing projects on the IDS. The IDS has an ever-growing list of prospective use cases that it will onboard throughout 2024 as the service scales its data catalogue and analytical tooling capabilities.
In light of your interest in the IDS and to provide additional context around the SRS and IDS figures in this and our previous responses, I would like to personally offer our team to come and showcase the service, discuss future prospects around the SRS and IDS and answer any further questions you have. We would be delighted to attend a location at your convenience, if this is an attractive proposition.
Yours sincerely,
Sir Ian Diamond
Asked by: Lord Clement-Jones (Liberal Democrat - Life peer)
Question to the Department for Science, Innovation & Technology:
To ask His Majesty's Government what plans they have, if any, to grant the Intelligence and Security Committee oversight of the National Security Online Information Team.
Answered by Viscount Camrose - Parliamentary Under Secretary of State (Department for Science, Innovation and Technology)
The role and remit of the Intelligence and Security Committee of Parliament (the ISC) is set out in the Justice and Security Act 2013 and accompanying Memorandum of Understanding agreed between the Committee and the Prime Minister.
The ISC oversees the policies, expenditure, administration and operations of MI5, SIS, GCHQ, Defence Intelligence, the Joint Intelligence Organisation, the National Security Secretariat and Homeland Security Group.
The National Security and Online Information Team is already overseen by the Science, Innovation and Technology Committee in the House of Commons and the Science and Technology Committee in the House of Lords. Consequently, there are no plans to grant the ISC additional oversight of NSOIT’s work.
Asked by: Lord Clement-Jones (Liberal Democrat - Life peer)
Question to the Department for Science, Innovation & Technology:
To ask His Majesty's Government what plans they have to ensure that the National Security Online Information Team does not target individuals in the course of its work.
Answered by Viscount Camrose - Parliamentary Under Secretary of State (Department for Science, Innovation and Technology)
The National Security and Online Information Team (NSOIT) tackles online attempts to manipulate the information environment while respecting the right to free speech, by only monitoring themes and trends - not individuals. The team is focused on threats posed by foreign states as well as risks to election integrity. NSOIT has policies and procedures in place, in accordance with all applicable legislation, to ensure that individuals are not monitored. In the limited circumstances where personal data might be inadvertently processed as part of NSOIT’s work, for example where personal data is embedded in text and cannot be automatically anonymised from social media posts, the team complies with the requirements of the Data Protection Act 2018, UK GDPR and Coordinated inauthentic behaviour.
As is the case with a range of national and international public and academic bodies, DSIT has trusted flagger status with the major social media platforms. NSOIT will only flag a social media post where that is in line with ministerial approved remits, the post appears to be in breach of the platform’s terms of service and is likely to cause harm. Social media platforms decide whether or not content is a breach of their terms of service and, if so, what action to take.
Asked by: Lord Clement-Jones (Liberal Democrat - Life peer)
Question to the Department for Science, Innovation & Technology:
To ask His Majesty's Government whether the National Security Online Information Team has trusted flagger status with any social media companies.
Answered by Viscount Camrose - Parliamentary Under Secretary of State (Department for Science, Innovation and Technology)
The National Security and Online Information Team (NSOIT) tackles online attempts to manipulate the information environment while respecting the right to free speech, by only monitoring themes and trends - not individuals. The team is focused on threats posed by foreign states as well as risks to election integrity. NSOIT has policies and procedures in place, in accordance with all applicable legislation, to ensure that individuals are not monitored. In the limited circumstances where personal data might be inadvertently processed as part of NSOIT’s work, for example where personal data is embedded in text and cannot be automatically anonymised from social media posts, the team complies with the requirements of the Data Protection Act 2018, UK GDPR and Coordinated inauthentic behaviour.
As is the case with a range of national and international public and academic bodies, DSIT has trusted flagger status with the major social media platforms. NSOIT will only flag a social media post where that is in line with ministerial approved remits, the post appears to be in breach of the platform’s terms of service and is likely to cause harm. Social media platforms decide whether or not content is a breach of their terms of service and, if so, what action to take.
Asked by: Lord Clement-Jones (Liberal Democrat - Life peer)
Question to the Cabinet Office:
To ask His Majesty's Government what was the cost of running the Office for National Statistics (ONS) Integrated Data Service in 2023; how many projects were active in the Integrated Data Service in 2023; and what are the equivalent figures for the ONS Secure Research Service for the same period.
Answered by Baroness Neville-Rolfe - Minister of State (Cabinet Office)
The information requested falls under the remit of the UK Statistics Authority.
A response to the Noble Lord’s Question of 5th February is attached.
The Lord Clement-Jones CBE
House of Lords London
SW1A 0AA
13 February 2024
Dear Lord Clement-Jones,
As National Statistician and Chief Executive of the UK Statistics Authority, I am responding to your Parliamentary Question asking (1) what was the cost of running the Office for National Statistics (ONS) Integrated Data Service in 2023; (2) how many projects were active in the Integrated Data Service in 2023; and (3, 4) what are the equivalent figures for the ONS Secure Research Service for the same period (HL2184).
The approximate costs of running the nascent Integrated Data Service in 2023 were £4,200,000, including infrastructure costs that permit future scaling of the service.
There were 20 active projects within the Integrated Data Service in 2023.
The cost of running the ONS Secure Research Service in 2023 were £7,000,000.
The Secure Research Service had a total of 842 projects during 2023. On average, there were around 600 live projects at any one time during 2023.
Equivalent operating costs and projects numbers should be interpreted with caution. The Integrated Data Service (IDS) is in development and currently operates within a BETA maturity phase. In September 2023 IDS received Digital Economy Act (2017) accreditation for data provision, making IDS the first cloud-native trusted research environment to be accredited for data provision under the legislation and opening the opportunity to scale.
The IDS is built to be future proofed, to better enable the Government’s data sharing agenda in a more effective and efficient way. The IDS will grow at pace over the remainder of the programme with a pipeline of additional and transformational capability, data, projects and users which exceed the capabilities of the Secure Research Service (SRS). Improved data integration and cross-sector collaboration enabled through cloud technologies will drive significant uptake.
The SRS is a long-standing and mature Trusted Research Environment which has operated in its current form since 2017, having previously operated as the Virtual Microdata Laboratory (VML) from 2004. The SRS grew rapidly upon achieving DEA accreditation in 2019, which enabled greater expansion of its data catalogue and user base. An improved trajectory is anticipated for the IDS with many SRS’s data sets, as well as projects (where applicable) migrating to the IDS as part of a transition that is underway.
Yours sincerely.
Professor Sir Ian Diamond
Asked by: Lord Clement-Jones (Liberal Democrat - Life peer)
Question to the Cabinet Office:
To ask His Majesty's Government, further to the Written Answer by Baroness Neville-Rolfe on 11 December (HL589) where they stated that "before laying the National Procurement Policy Statement in Parliament a Minister of the Crown must carry out such consultation as the Minister considers appropriate", how they intend to consult relevant stakeholders, such as providers of goods and services, prior to laying that statement.
Answered by Baroness Neville-Rolfe - Minister of State (Cabinet Office)
The Cabinet Office will develop and deliver its approach to consultation in line with the requirements in Section 13 of the Procurement Act.
Asked by: Lord Clement-Jones (Liberal Democrat - Life peer)
Question to the Cabinet Office:
To ask His Majesty's Government whether they will provide a complete list of (1) data sets, and (2) projects which are currently active within the Office for National Statistics Integrated Data Service.
Answered by Baroness Neville-Rolfe - Minister of State (Cabinet Office)
The information requested falls under the remit of the UK Statistics Authority.
Please see the letter attached from the National Statistician and Chief Executive of the UK Statistics Authority.
The Lord Clement-Jones
House of Lords
London
SW1A 0PW
24 January 2024
Dear Lord Clement-Jones
As National Statistician and Chief Executive of the UK Statistics Authority, I am responding to your Parliamentary Question asking if we will provide a complete list of (1) data sets, and (2) projects which are currently active within the Office for National Statistics’ (ONS) Integrated Data Service (IDS) (HL1623).
The IDS currently has 92 datasets ingested into the service. These datasets are available to accredited analysts and researchers from both the government’s analytical function and the wider research communities.
In terms of analysis taking place within the service, there are currently 15 live analytical projects within the IDS. While this is the number of live projects, there are other analysis proposals at a conceptual or approvals stage that will support policy development.
Future information on analyses and data will be made available in due course to ensure continued transparency of data and analysis within the IDS, in line with other Trusted Research Environments, such as the ONS’s Secure Research Service.
To ensure full transparency, a complete list of data sets and projects are listed in Annex A and Annex B respectively.
Yours sincerely,
Professor Sir Ian Diamond
Annex A:
A complete list of datasets which are currently within the Integrated Data Service.
Data Set Name |
Valuation Office Agency (VOA) |
Pluto Business to Business Matrix |
Energy Performance Certificate |
Annual Survey of Hours and Earnings (ASHE) |
Standard Industrial Classification/Standard Occupational Classification (SIC/SOC) References |
Annual Population Survey |
Business Register Employment Survey |
ONS Births |
ONS Deaths |
GP Registration aggregate count |
Aggregate Age/Sex counts for mid-year pop stats |
Aggregate Age/Sex count for mid-year internal migration |
Aggregate Age/Sex counts for UK regular Forces and Gurkhas |
Aggregate Age/Sex counts for by prison, age and sex |
Personal Demographics Services – Flag 4 National monthly July 2022 |
Statistical Population Dataset v4.1 |
Long Term International Passenger Survey (IPS) |
Dynamic Population Model (DPM) International Emigration monthly |
International Immigration monthly |
Integrated Data Asset – Energy Performance Certificates |
Integrated Data Asset – Ordnance Survey Private Outside Space |
Integrated Data Asset – Land Registry Price Paid |
Geographical Look ups |
Annual Survey of Hours and Earnings (ASHE) Attribute Data |
Population Statistics; Synthetic |
Regions (December 2019) England Boundaries Generalised Clipped (BGC) |
Census 2021 – MVP |
Labour Force Survey UK – People |
Labour Force Survey UK – Household |
Labour Force Survey UK – Longitudinal |
Business Enterprise R&D (BERD) |
Business Structure Database (BSD) |
Annual Survey of Hours and Earnings (ASHE)-Census 2011 |
Update to Births |
Update to Deaths |
Redelivery of Census 2021 (extra variables) |
Hospital Episodes Statistics (HES) |
General Practitioner Episodes Statistics (GPES) |
Census 2021 linked to Labour Force Survey (LFS) |
ONS Mortality |
Indices of Depravation |
Mid-Year Population Estimates |
Small Area Population Estimates |
Business Register Employment Survey (BRES Un indexed) |
Census 2011 Origin Destination EW |
ONS Geography Boundary Products |
ONS Geography Products |
Aggregated Workplace Zone Geography |
Census 2011 Output Tables |
Census 2011 Output Tables Long |
England Wales Indices of Multiple Deprivation (IMD) Lookup |
National Travel Survey Data |
Census 2021 Output Tables |
Census 2021 Output Tables Long |
OpenStreet Map Data |
DfT Origin Destination Pairs |
Bus Timetable Data |
Journey Times to Key Services |
Trip End Model Program |
International Passenger Survey (IPS) |
(Nomis – Claimant accounts |
Nomis – Jobseeker allowances |
Nomis – Population estimates |
Nomis – Annual Business Inquiry |
Nomis – Business Register Employment Survey (BRES) |
UK Small Area gross value added (GVA) estimates |
Police Crime Data |
Synthesizing Census Data |
Business Enterprise Research and Development - Great Britain |
Monthly Business Survey - UK |
International Trade in Services - UK |
Annual Foreign Direct Investment Survey - UK |
Annual Purchases Survey - UK |
Quarterly Capital Expenditure Survey - UK |
E-commerce Survey - UK |
UK Manufacturers’ Sales by Product Survey |
COVID-19 Vaccine Opinions Survey - England |
Low Carbon and Renewable Energy Economy Survey - UK |
Census 1991 Individual - Great Britain |
Census 2001 Individual - UK |
Effects of Tax and Benefits - UK |
Foreign Direct Investment - UK |
Mergers & Acquisitions Survey - UK |
Public Health Research Database |
General Lifestyle Survey – Great Britain |
Monthly Business Survey for Construction and Allied Trades GB |
Labour Force Survey Longitudinal, Household & Personal - UK |
Business Register Employment Survey (BRES – Indexed against Business Index only) |
Annual Acquisition and Disposals of Capital Assets Survey - UK |
Census 1991 Household - Great Britain |
Annual Survey of Goods and Services - UK |
Census 2001 Household - UK |
Annex B
A complete list of projects which are currently active within the Integrated Data Service.
Project Title |
Annual Survey of Hours and Earnings (ASHE) - ONS/HMT levelling up |
Testing Bayesian methods for Demographic Accounting |
Exploring Census 2021 Data to identify specific industry sectors or economic activity groups that require further analysis |
Describing the interaction of climate and health in global official statistics. |
Evaluating placed based programmes (DLUHC / ONS project) |
Count of usual resident stratified by sex, age, ethnic group and deprivation for various geographies in England |
Energy Efficiency of Housing |
Exploring the health drivers of economic inactivity |
Intermediate Consumption |
Producing estimates of school aged children, by Local Authority, and pupil characteristics |
Mobility and Geospatial Programme |
Department for Levelling Up Housing and Communities Subnational Expenditure by Local Authority District |
Synthesizing the Census for and in the IDS |
Differences between Census 2021 and ONS household surveys in relation to the estimates of Welsh language ability |
XGOV Levelling-up analysis |
Asked by: Lord Clement-Jones (Liberal Democrat - Life peer)
Question to the Home Office:
To ask His Majesty's Government whether Amazon Web Services has the right under its contract with the Home Office, agreed on 30 November, to move Home Office data out of the UK when it deems it necessary to provide the services initiated by the customer, as stated in the GDPR Data Processing Addendum attached to the contract.
Answered by Lord Sharpe of Epsom - Parliamentary Under-Secretary (Home Office)
The supplier shall not process or otherwise transfer Home Office data outside of the United Kingdom unless the prior written consent of the Home Office has been obtained.
Asked by: Lord Clement-Jones (Liberal Democrat - Life peer)
Question to the Home Office:
To ask His Majesty's Government whether Amazon Web Services has the right to refuse an inspection from an independent auditor under its contract with the Home Office, agreed on 30 November, given that the contract states that the Home Office does not have a right to audit or inspect Amazon Web Services' physical infrastructure.
Answered by Lord Sharpe of Epsom - Parliamentary Under-Secretary (Home Office)
The supplier shall not process or otherwise transfer Home Office data outside of the United Kingdom unless the prior written consent of the Home Office has been obtained.
Asked by: Lord Clement-Jones (Liberal Democrat - Life peer)
Question to the Home Office:
To ask His Majesty's Government why the new contract between the Home Office and Amazon Web Services, agreed on 30 November, is triple the cost of the Home Office's previous procurement of cloud computing services from Amazon Web Services in 2019.
Answered by Lord Sharpe of Epsom - Parliamentary Under-Secretary (Home Office)
The supplier shall not process or otherwise transfer Home Office data outside of the United Kingdom unless the prior written consent of the Home Office has been obtained.