Published by: NISRA Statistical Support Branch
Lead Statistician: Norma Broomfield
Telephone: 028 9038 8481
Overview
This report presents findings on public awareness of NISRA (Northern Ireland Statistics and Research Agency) and trust in official statistics in Northern Ireland. The questions were asked in the Northern Ireland Continuous Household Survey (CHS) between September and November 2023. The report also monitors changes over time and includes comparisons with the Office for National Statistics (ONS), where appropriate. The figures presented in this report were obtained from a representative sample of the Northern Ireland population (1,354 persons) and are therefore estimates. The key findings are:
Awareness
- Public awareness of NISRA was moderate in 2023 with almost half of respondents (48%) indicating that they had heard of the Agency before being contacted about the survey. This is similar to 2022, when 49% of respondents had heard of NISRA.
Trust
Public trust in NISRA, as an institution, is high (83%). Of those that had heard of NISRA, 93% stated that they trusted the Agency.
Public trust in the statistics produced by NISRA is also high (85%).
Value
- The statistics produced by NISRA are valued, with 89% of respondents agreeing that statistics produced by NISRA are important to understand Northern Ireland.
Political Interference
- Four-fifths (80%) of respondents agree that statistics produced by NISRA are free from political interference.
Introduction
Official Statistics in Northern Ireland are produced by Government Departments, and in some cases Arm’s Length Bodies. The data collection, production, presentation and dissemination of official statistics are governed by the Code of Practice for Statistics.
This Code plays an essential role in ensuring that statistics published by government command public confidence through demonstrating trustworthiness and providing high quality statistics that enhance public value.
NISRA is an Agency within the Department of Finance and provides statistical services across government in Northern Ireland. The majority of Northern Ireland official statistics are produced by NISRA staff and NISRA branches can be found within all Northern Ireland Departments, and several Arm’s Length Bodies. NISRA has been measuring the levels of public confidence or trust in the Agency and in the statistics it produces since the Code was produced in 2009. These levels are monitored by the Agency and used to inform communication and marketing strategies.
In the UK, the Office for National Statistics (ONS) is the largest producer of official statistics. Public trust in the ONS and the statistics it produces are also monitored and this report contains comparisons between NISRA and ONS. The ONS survey samples respondents in England, Scotland and Wales whilst the NISRA survey samples respondents in Northern Ireland. The most recent ONS survey was conducted in 2023 (Public Confidence in Official Statistics 2023 (ONS)).
Detailed tables are published alongside this report. These include the source data for all the charts and commentary and additional breakdowns (see Appendix B).
Differences are only noted in the commentary when they are likely to represent a real difference taking account of the margin of error in the sample-based estimates (see ‘Survey Estimates’ in Appendix A for further detail).
1. Awareness of NISRA
Current year, 2023
Just under half of respondents (48%) said they had heard of NISRA before being contacted about the survey.
Comparison over time
Awareness is similar to 2022, when 49% of respondents had heard of NISRA, but lower than in 2020 and 2021 (during the COVID-19 pandemic), when 58% and 55% of respondents respectively had heard of NISRA.
Although awareness of NISRA has decreased since 2020 and 2021, awareness is still notably higher than in 2019 and previous years, prior to the COVID-19 pandemic (Chart 1).
Chart 1: Awareness of NISRA (2009-2023)
Comparison with ONS
Public awareness of NISRA remains lower than awareness of ONS, with three quarters (74%) of respondents in 2023 reporting having heard of ONS. The difference between public awareness levels for NISRA and ONS has narrowed since 2018, which was prior to the start of the COVID-19 pandemic (Chart 2).
Chart 2: Awareness of NISRA (2014-2023) and ONS (2014-2023)
2. Awareness of NISRA Statistics
Awareness of NISRA statistics, where not previously heard of NISRA
Respondents who had not previously heard of NISRA were asked whether they had heard of specific NISRA statistics. 35% of these respondents had not heard of any of the statistics listed, while 4% had heard of all the statistics. A more detailed breakdown is available in the accompanying tables (see Appendix B).
61% of respondents who had not previously heard of NISRA were aware of the Northern Ireland Census, while 40% were aware of statistics on hospital waiting times and 38% had heard of the unemployment rate. Less than 1 in 13 (7%) of these respondents had heard of statistics on journeys made by walking, cycling or public transport in Northern Ireland (Chart 3).
Chart 3: Awareness of specific NISRA statistics for respondents who were not aware of NISRA, 2023
Awareness of statistics produced by NISRA, where heard of NISRA
Respondents who had heard of NISRA were asked whether they were aware that NISRA produced certain statistics. Of these respondents, 19% were aware that NISRA produced all the listed statistics while 8% were unaware that NISRA produced any of the listed statistics. A more detailed breakdown is available in the accompanying tables (see Appendix B).
Awareness was highest for the Northern Ireland Census (87%), followed by statistics on the number of people who live in Northern Ireland (73%), the number of deaths (64%) and the unemployment rate (60%). Statistics on the percentage of journeys made by walking, cycling or public transport (28%) were the least recognised as being produced by NISRA.
Chart 4: Aware NISRA produces specific statistics for respondents who were aware of NISRA, 2023
3. Trust in NISRA
Current year, 2023
Trust in NISRA as an institution is high, with 83% of all respondents trusting NISRA a great deal or tending to trust NISRA. Most of the remaining respondents (13%) didn’t know whether they trusted NISRA or not, while 4% of respondents tended to distrust or distrusted NISRA greatly (Chart 5). Trust in NISRA was higher among those who had heard of NISRA (94%). Further detail is available in the accompanying tables (see Appendix B).
Comparison over time
There is no significant difference in the level of trust in NISRA between 2023 and 2022 (Chart 5).When only respondents who expressed an opinion are considered, i.e. excluding ‘don’t knows’, trust in NISRA is slightly lower than in 2021, and similar to the levels of trust in 2019 and 2016. Trust in NISRA in 2023 is significantly higher than in 2014.
Chart 5: Trust in NISRA (2014-2023)
Comparison with ONS
Trust in NISRA is similar to trust in ONS (83%) (Chart 6). However, when only those who gave an opinion are considered, trust levels are higher for NISRA.
Chart 6: Trust in NISRA (2023) and ONS (2023) as institutions
Comparison with other institutions
Trust in NISRA is significantly higher than trust in the media, elected bodies and the Civil Service (Chart 7).
Across all institutions, trust is lowest for the media (36%) and elected bodies (24%), while 77% of respondents said they trust the Civil Service.
A higher proportion of respondents don’t know if they trust NISRA or not (13%) compared to other institutions.
Chart 7: Trust in institutions, 2023
4. Trust in NISRA Statistics
Current year, 2023
The majority of respondents (85%) trust NISRA statistics a great deal or tend to trust them while 4% of respondents distrust NISRA statistics greatly or tend to distrust them. The remaining respondents (11%) don’t know whether they trust NISRA statistics or not (Chart 8).
Trust in NISRA statistics is higher among those who have heard of NISRA as an institution (95%). Further detail is available in the accompanying tables (see Appendix B).
Comparison over time
There was no significant difference in trust in NISRA statistics between 2023 and 2022. However, for those respondents who expressed an opinion, trust in NISRA statistics was significantly higher in 2023 compared to 2019 and earlier years.
Chart 8: Trust in NISRA statistics (2014-2023)
Comparison with ONS
The level of trust in NISRA statistics (85%) is higher than the level of trust in ONS statistics (82%). While more respondents answered ‘don’t know’ with regard to NISRA statistics (11%) than for ONS statistics (4%), the level of distrust in NISRA statistics (4%) is notably lower than the level of distrust in ONS statistics (14%) (Chart 9).
Chart 9: Trust in statistics produced by NISRA (2023) and ONS (2023)
5. Value
Current year, 2023
The majority of respondents (89%) agree that the statistics produced by NISRA are important to understand Northern Ireland. Most of the remaining respondents (7%) don’t know, while 4% of respondents disagree that statistics produced by NISRA are important to understand Northern Ireland (Chart 10).
Comparison over time
Amongst respondents who had a view, the proportion agreeing that NISRA statistics are important to understand Northern Ireland is similar to 2022.
Chart 10: NISRA statistics are important to understand Northern Ireland (2016-2023)
Comparison with ONS
The percentage of respondents who agree that the statistics produced are important to understand their country is higher for NISRA (89%) than for ONS (87%).
While NISRA respondents are more likely to answer ‘don’t know’ (7%) than ONS respondents (4%), the percentage of respondents who disagree is notably lower for NISRA (4%) than it is for ONS (9%) (Chart 11).
Chart 11: Statistics produced are important to understand our country, NISRA (2023) and ONS (2023)
6. Political Interference
Current year, 2023
Four-fifths (80%) of respondents agree that statistics produced by NISRA are free from political interference. Less than 1 in 10 (7%) of respondents disagree that NISRA statistics are free from political interference whilst the remaining respondents (13%) answered that they ‘don’t know’ (Chart 12).
Comparison over time
When all respondents are considered, the level of agreement that NISRA statistics are free from political interference is similar to 2022. However, when only those who expressed an opinion are considered, agreement has fallen since 2022.
The percentage of respondents disagreeing that NISRA statistics are free from political interference has increased slightly since 2022 but remains significantly lower than 2014 and 2016.
Chart 12: NISRA statistics are free from political interference (2014-2023)
Comparison with ONS
In comparison, 67% of respondents agree that statistics produced by ONS are free from political interference (Chart 13). This is significantly lower than the NISRA figure.
Chart 13: Statistics produced are free from political interference, NISRA (2023) and ONS (2023)
7. Confidentiality
Current year, 2023
Eighty-five percent of respondents (85%) agree that personal information provided to NISRA will be kept confidential while 7% disagree. The remaining respondents ‘don’t know’ (8%) (Chart 14).
Comparison over time
The level of agreement that personal information provided to NISRA will be kept confidential has dropped since 2022. When only those respondents who expressed an opinion are considered, the level of agreement is significantly lower than in 2019 to 2022 but similar to 2016 and 2014.
The percentage of respondents in 2023 who disagreed with the statement is higher than in the previous four years (2019 to 2022) but similar to the level seen in 2014 and 2016.
Chart 14: Personal information provided to NISRA will be kept confidential (2014-2023)
Comparison with ONS
In comparison, 88% of ONS respondents in 2023 agree that personal information provided to ONS will be kept confidential. This is significantly higher than for NISRA (Chart 15).
Chart 15: Belief that personal information provided will be kept confidential, NISRA (2023) and ONS (2023)
Useful links
- Previous bulletins in this series
- Summary infographics
- Statistics produced by NISRA
- Code of Practice for Statistics
- ONS - Public Confidence in Official Statistics
Official Statistics
These official statistics are produced in compliance with the Code of Practice for Statistics.
Our statistical practice is regulated by the Office for Statistics Regulation (OSR). OSR sets the standards of trustworthiness, quality and value in the Code of Practice for Statistics that all producers of official statistics should adhere to. You are welcome to contact us directly with any comments about how we meet these standards by emailing Norma.Broomfield@nisra.gov.uk. Alternatively, you can contact OSR by emailing regulation@statistics.gov.uk or via the OSR website.
Appendix A: Methodology and Quality Information
Data Source
This report presents the results of questions relating to Public Awareness and Trust in Official Statistics in Northern Ireland that were included in the Continuous Household Survey (CHS). The CHS is one of the largest continuous surveys carried out in Northern Ireland, designed and administered by the Central Survey Unit (CSU), NISRA. Prior to 2018, the questions were included as a module within the NI Omnibus Survey but following the temporary suspension of the NI Omnibus Survey in 2018, the questions were moved to the CHS. Both surveys use probabilistic sampling to select a representative sample of the general population, aged 16 and over, resident in private households. This means that comparisons can continue to be made over time and significance tests carried out to determine if observed differences are likely to be real or due to sampling error.
Each year CSU sets the content of the CHS questionnaire in consultation with clients. The questionnaire consists of both an overall household interview, and an individual interview with each person aged 16 and over. Both the household and individual questionnaires consist of core items that are included each year, and modules that recur on a regular cycle. Core items include household and individual demographics, accommodation, tenure, internet access, environmental issues, domestic tourism, participation in sports, arts and leisure, employment status, health and section 75 classifications. Interviews are spread over 12 months from April to March, with the module on ‘Public Awareness and Trust in Official Statistics’ normally included during the Autumn months (September to November in 2023). The questions included in the 2023 module are available in Appendix C of this report.
Data Collection
The CHS is based on a systematic random sample of approximately 9,000 addresses drawn each year from the NISRA Address Register. The NISRA Address Register is maintained by Census Branch and is created by merging the POINTER database (maintained by Land and Property Services) with additional records, and removing duplicates and communal establishments. The interviews are spread over the 12 months from April to March. Data are collected through face-to-face interviews using CAPI (Computer Assisted Personal Interviewing) or telephone interviews using CATI (Computer-assisted telephone interviewing). Of the 2,340 addresses selected for interview from September to November 2023, 1,354 persons participated in this module of the survey.
Survey Estimates
Surveys gather information from a sample rather than from the whole population. Results from surveys are always estimates, not precise figures. This means that they have a margin of error which can have an impact on how changes in the numbers should be interpreted, especially in the short term. An estimate of the margin of error due to the sampling process can be calculated and used to produce an interval of values known as a confidence interval. This has been taken into account when carrying out significance tests.
Significance tests were carried out to determine if there were likely to be real differences between respondent groups. The significance tests were carried out at 5% significance level and only differences which were statistically significant (p<0.05) are included in this report. This means that there is at least a 95% probability that there is a genuine difference between the views of, for example, respondents in 2022 and respondents in 2023 and the difference between these two samples is not simply explained by chance.
Weighting
The CHS aspires to interview everyone aged 16 or over at a selected household, but non-response either by the household as a whole or by individuals within the household introduces non-response bias to the results. To counter this, weights are applied to the analysis on the basis of age and sex. Weights are calculated based on how the age and sex profile of the survey respondents differs from that of the latest mid-year population estimates published by NISRA. The 2022 mid-year estimates (published in August 2023) were used for the 2023/24 CHS. This weighting process adjusts the results to those that would have been achieved if the sample had been drawn as a random sample of adults across Northern Ireland, thus allowing inferences to be made about the population. The percentages given in the tables in this report are based on weighted data. The totals in the tables are not weighted.
Quality Checks
Both CAPI and CATI allow plausibility and consistency checks to be incorporated within the questionnaire to improve data quality. Data returned is coded and fully validated by CHS statistical staff, including treatment of outliers and detailed consistency checking including non-credible checks. A 100% check of all coded data is undertaken to ensure that coding procedures are of a high standard.
On receipt of the CHS data, Statistical Support Branch validate and perform quality checks on the data. Range and plausibility checks are performed for returned and derived variables and the data are also checked for ‘missing values’. The data are compared with previous years to identify any unusual trends or distributions, or values that lie outside expected norms. All anomalies are queried with CHS staff who can re-check the coding and source data.
Impact of the COVID-19 pandemic
Due to the COVID-19 pandemic, data collection for the CHS moved from face-to-face interviewing to telephone mode in March 2020. This required a reduction in the number of questions in the overall questionnaire. While the Public Awareness and Trust in Official Statistics questions were unaltered, the change in data collection mode and the number of questions may have altered how people responded to the survey. In July 2022, face-to-face interviewing was reinstated alongside telephone interviewing, thus making the survey dual modality. In 2023/24, interviewers were advised that face to face interviewing should be used where possible.
The achieved response rate for the CHS was also lower than normal in 2020/21 (16% compared to 55%) and slightly lower than normal in 2021/22 (41%). As a result the 2020 Public Awareness and Trust in Official Statistics module ran for an additional three months (October 2020 to March 2021). While this has maintained the precision of the 2020 estimates and enabled comparisons with 2021 and other years in the time series, the timing of the 2020 module does not align as well with other years. The achieved response rate for the CHS in 2023/24 was 50%. More information is available on the NISRA website.
Further Information
More information on the methodology used to produce these official statistics and the quality of the data is available in the Background Quality Report.
Appendix B: Detailed tables
Detailed tables including the source data for all the charts and commentary and additional breakdowns are published alongside this report. A full list of tables is provided below:
Appendix C: Survey Questions
The following questions were included in the Continuous Household Survey (CHS) between September and November 2023:
Public Awareness and Trust in Official Statistics Questions (2023)