Office for National Statistics: Databases
(asked on 16th January 2024) - View Source
Question to the Cabinet Office:
To ask His Majesty's Government whether they will provide a complete list of (1) data sets, and (2) projects which are currently active within the Office for National Statistics Integrated Data Service.
The information requested falls under the remit of the UK Statistics Authority.
Please see the letter attached from the National Statistician and Chief Executive of the UK Statistics Authority.
The Lord Clement-Jones
House of Lords
London
SW1A 0PW
24 January 2024
Dear Lord Clement-Jones
As National Statistician and Chief Executive of the UK Statistics Authority, I am responding to your Parliamentary Question asking if we will provide a complete list of (1) data sets, and (2) projects which are currently active within the Office for National Statistics’ (ONS) Integrated Data Service (IDS) (HL1623).
The IDS currently has 92 datasets ingested into the service. These datasets are available to accredited analysts and researchers from both the government’s analytical function and the wider research communities.
In terms of analysis taking place within the service, there are currently 15 live analytical projects within the IDS. While this is the number of live projects, there are other analysis proposals at a conceptual or approvals stage that will support policy development.
Future information on analyses and data will be made available in due course to ensure continued transparency of data and analysis within the IDS, in line with other Trusted Research Environments, such as the ONS’s Secure Research Service.
To ensure full transparency, a complete list of data sets and projects are listed in Annex A and Annex B respectively.
Yours sincerely,
Professor Sir Ian Diamond
Annex A:
A complete list of datasets which are currently within the Integrated Data Service.
Data Set Name |
Valuation Office Agency (VOA) |
Pluto Business to Business Matrix |
Energy Performance Certificate |
Annual Survey of Hours and Earnings (ASHE) |
Standard Industrial Classification/Standard Occupational Classification (SIC/SOC) References |
Annual Population Survey |
Business Register Employment Survey |
ONS Births |
ONS Deaths |
GP Registration aggregate count |
Aggregate Age/Sex counts for mid-year pop stats |
Aggregate Age/Sex count for mid-year internal migration |
Aggregate Age/Sex counts for UK regular Forces and Gurkhas |
Aggregate Age/Sex counts for by prison, age and sex |
Personal Demographics Services – Flag 4 National monthly July 2022 |
Statistical Population Dataset v4.1 |
Long Term International Passenger Survey (IPS) |
Dynamic Population Model (DPM) International Emigration monthly |
International Immigration monthly |
Integrated Data Asset – Energy Performance Certificates |
Integrated Data Asset – Ordnance Survey Private Outside Space |
Integrated Data Asset – Land Registry Price Paid |
Geographical Look ups |
Annual Survey of Hours and Earnings (ASHE) Attribute Data |
Population Statistics; Synthetic |
Regions (December 2019) England Boundaries Generalised Clipped (BGC) |
Census 2021 – MVP |
Labour Force Survey UK – People |
Labour Force Survey UK – Household |
Labour Force Survey UK – Longitudinal |
Business Enterprise R&D (BERD) |
Business Structure Database (BSD) |
Annual Survey of Hours and Earnings (ASHE)-Census 2011 |
Update to Births |
Update to Deaths |
Redelivery of Census 2021 (extra variables) |
Hospital Episodes Statistics (HES) |
General Practitioner Episodes Statistics (GPES) |
Census 2021 linked to Labour Force Survey (LFS) |
ONS Mortality |
Indices of Depravation |
Mid-Year Population Estimates |
Small Area Population Estimates |
Business Register Employment Survey (BRES Un indexed) |
Census 2011 Origin Destination EW |
ONS Geography Boundary Products |
ONS Geography Products |
Aggregated Workplace Zone Geography |
Census 2011 Output Tables |
Census 2011 Output Tables Long |
England Wales Indices of Multiple Deprivation (IMD) Lookup |
National Travel Survey Data |
Census 2021 Output Tables |
Census 2021 Output Tables Long |
OpenStreet Map Data |
DfT Origin Destination Pairs |
Bus Timetable Data |
Journey Times to Key Services |
Trip End Model Program |
International Passenger Survey (IPS) |
(Nomis – Claimant accounts |
Nomis – Jobseeker allowances |
Nomis – Population estimates |
Nomis – Annual Business Inquiry |
Nomis – Business Register Employment Survey (BRES) |
UK Small Area gross value added (GVA) estimates |
Police Crime Data |
Synthesizing Census Data |
Business Enterprise Research and Development - Great Britain |
Monthly Business Survey - UK |
International Trade in Services - UK |
Annual Foreign Direct Investment Survey - UK |
Annual Purchases Survey - UK |
Quarterly Capital Expenditure Survey - UK |
E-commerce Survey - UK |
UK Manufacturers’ Sales by Product Survey |
COVID-19 Vaccine Opinions Survey - England |
Low Carbon and Renewable Energy Economy Survey - UK |
Census 1991 Individual - Great Britain |
Census 2001 Individual - UK |
Effects of Tax and Benefits - UK |
Foreign Direct Investment - UK |
Mergers & Acquisitions Survey - UK |
Public Health Research Database |
General Lifestyle Survey – Great Britain |
Monthly Business Survey for Construction and Allied Trades GB |
Labour Force Survey Longitudinal, Household & Personal - UK |
Business Register Employment Survey (BRES – Indexed against Business Index only) |
Annual Acquisition and Disposals of Capital Assets Survey - UK |
Census 1991 Household - Great Britain |
Annual Survey of Goods and Services - UK |
Census 2001 Household - UK |
Annex B
A complete list of projects which are currently active within the Integrated Data Service.
Project Title |
Annual Survey of Hours and Earnings (ASHE) - ONS/HMT levelling up |
Testing Bayesian methods for Demographic Accounting |
Exploring Census 2021 Data to identify specific industry sectors or economic activity groups that require further analysis |
Describing the interaction of climate and health in global official statistics. |
Evaluating placed based programmes (DLUHC / ONS project) |
Count of usual resident stratified by sex, age, ethnic group and deprivation for various geographies in England |
Energy Efficiency of Housing |
Exploring the health drivers of economic inactivity |
Intermediate Consumption |
Producing estimates of school aged children, by Local Authority, and pupil characteristics |
Mobility and Geospatial Programme |
Department for Levelling Up Housing and Communities Subnational Expenditure by Local Authority District |
Synthesizing the Census for and in the IDS |
Differences between Census 2021 and ONS household surveys in relation to the estimates of Welsh language ability |
XGOV Levelling-up analysis |