• Supermarket Sweep: Measuring inflation with over a billion scanner beeps
    Mar 24 2026
    Miles and guests unpack how the ONS is collecting the prices from more than a billion supermarket checkout and online sales to measure UK inflation. Transcript Scanner data podcast transcript Miles: Hello and welcome to statistically speaking, the official podcast of the UK's Office for National Statistics. I'm Miles Fletcher, and in this episode, we're taking an in depth look at a very big change in how the ONS produces its estimates of inflation, no longer the sole preserve of clipboard wielding prices collectors roaming the supermarket aisles. The digital revolution has now fully arrived. From this month, the UK's inflation indices are now partly based on millions of prices data gathered directly from the tills or scanners, to be precise. How is it all done? What is the role of Taylor Swift in all this? Yes, there is one. And what are the benefits for economists, decision makers and all of us ordinary folk who worry about the cost of living. Here to unpack it all for us is Mike Hardy, who has led the project here at the ONS, and top economist and former member of the Bank of England Monetary Policy Committee, Jonathan Haskel, professor of economics at Imperial College London. Professor to start with you: to understand what's changed, it'd probably be helpful to remind ourselves how consumer prices inflation has until now been calculated. Essentially, it was the ONS and its agents checking the prices of 1000s of items on a monthly basis to see how they changed. Jonathan: Yeah, that's right, and the ONS has gone to an enormous amount of effort in order to make that collection representative and make it consistent. But of course, in the modern era of scanner, data, computers, e commerce, things like that, there are other ways of doing it. I guess the important point, which Mike can talk about some more, is that one of the things that we know from statistics is that having a big sample isn't necessarily going to be better if you have a representative sample to start with. So I think one of the interesting points about all of this is whilst the scanner data is collecting many more data points, it's a fascinating check on the representativeness or otherwise of the ONS survey and the procedures thus far as to whether the actual average of all of that will turn out to be very different or similar to what's done before. It's a great advantage to have all of this extra data, but one shouldn't overstate either the advantage or use it as a way of rubbishing what the ONS has been doing in the past. Miles: So to put it this way, perhaps then, what the ONS has traditionally been doing in collecting prices, is to take this big monthly snapshot of retailing and prices, and what people have been paying for items. What it's got now, what it's moving to in the digital age is moving from a still picture, perhaps to a rolling 4k video, and from that, it can find out exactly what has been missed out of the inflation calculations previously. Jonathan: Well, I'll just put a little bit of a spin on that. One of the things that the price collectors do, and they're very, very careful to do, is to make sure that that snapshot is consistent across the snapshots, if you sort of see what I mean. So there is a bit of a rolling element to those snapshots already, because, for example, if you're going to collect the price of, let us say, Ladies jeans, which is something that I was doing with the price collector recently, you want to be sure you collect the price for the same good over time. And the point about the price collectors is they're extremely conscientious about making sure that, in the case of ladies jeans, they are coloured blue. They've got either a flared leg or not a flared leg. They've got the same number of pockets, they've got the same amount of stitching, they've got different decorations on them. To make sure that those goods remain the same is actually very important, and that's something actually which the hand collection can do. And as I say, I think that means that the snapshot element is maybe not quite the right metaphor, if I may say, miles. It is the relation. It's a consistent element over time, a consistent snapshot if that's using a metaphor Miles: That said it's more than just blindly following the same list of products every month. But nonetheless, the traditional way of doing things has had significant. What do you think those are? Jonathan: I guess the limitations are that when one is collecting a sample, any kind of sample at all, one is always doing one's best to try to hope that that's a representative sample, and having more data then is going to help if it turns out that the sample is unrepresentative. So I think that's one part of it. I think the other part of it is, of course, it's becoming increasingly costly to hand collect these numbers, and you know, like any public agency, one wants to be as careful as one possibly can with taxpayers money. ...
    Show more Show less
    34 mins
  • The road ahead for the ONS: a conversation with Darren Tierney
    Jan 27 2026
    Late last summer, Darren Tierney stepped into the newly created role of Permanent Secretary at a pivotal moment for the organisation. In a new episode of Statistically Speaking our host Miles Fletcher sits down with Darren to talk about what happens next. TRANSCRIPT MILES FLETCHER Hello and welcome to another episode of Statistically Speaking, the official podcast of the Office for National Statistics. I'm Miles Fletcher. Now, if you've followed the UK news much over the past year, you'll know the ONS has been under more scrutiny than at any point in its history, questions about trust, priorities, its core economic data and whether the organisation has simply been trying to do too much at once, have all been very publicly aired. Today's episode is about what happens next. Late last summer, Darren Tierney stepped into the newly created role of Permanent Secretary at a moment when some of the UK's most relied upon statistics, especially those based on the Labor Force Survey, were under real pressure. In this conversation, we'll talk about Darren's background in government, running large, complex public services and helping to craft and enact key policies. We'll explore how data has shaped his career so far, and what he found when he arrived at the ONS. We'll also dig into some of the hardest questions facing the organisation, and what absolutely has to be fixed first, what may need to stop, how user expectations are being balanced with that and how full confidence in official statistics can be restored. This isn't just an internal reset. What the ONS does and how well it does it matters to policymakers, businesses and the public alike. So join us as we talk about focus, priorities, and the road ahead. So then Darren, to begin at the beginning, you're not an economist or statistician by profession yourself. What motivated you to take leadership of what is the central organisation in UK statistics? DARREN TIERNEY Sure, well look as a non-statistician you can imagine I was a little bit daunted when this prospect first came along for precisely that reason. I was kind of worried that maybe not being a statistician or an economist might be a real drawback but as I thought more about the job, and more about what was needed for the organisation at the time, and with the split of the roles, I thought actually, I can really help. But what really drew me to the role was that although I'm not a statistician, Iv'e been an avid consumer of ONS products for the 25 years that I've been a policy wonk in Whitehall. And going from a good policy professional to a great one, requires both access to good data and also a real understanding of it and knowing how to use it. And it's that background that kind of helped me and really got me into it, and so I saw it as a real opportunity to come and help an organisation that really couldn't be any more consequential for the UK. MILES FLETCHER The Devereux review said that what was needed was someone with really serious operational experience, having run serious civil service operations, and you bring plenty of that. Could you just detail some of that? You've had a very strong rise, you know, through the ranks of the civil service. Just trace that for us, if you would. DT Yeah. So I started life in what was the old Prescott empire of DETR, which was environment and transport in the regions as a policy wonk working on aviation. I then went and joined the Ministry of Justice, where I spent three years in the private offices of Harriet Harman, Jack Straw and Ken Clarke, and that kind of real frontline policy making, as it were, is the thing that I did a lot of in the first half of my career. The second half of my career, which is much more relevant to the ONS, was centred around transformation and change. And again, I spent about 12 years or so in the MOJ, and my senior career there was about transforming systems and running big programs. And I went from there to international trade, just after the Referendum, where like a lot of officials at the time, I was quite keen to run to where the energy or the fire was after Brexit. But I didn't fancy working DExEU, and this new department called Trade seemed quite interesting. So I went there, and again, this was a kind of brand new department, and it grew from a few hundred people to about four and a half thousand. And so that kind of building and running the department as a strategy director for investments and exports, I guess those two experiences in justice and trade are the two that I rely on most in this role. MF So you spent time in the corridors of power then, the ministerial heights of the civil service, but also having to try and make the machine run efficiently as well, and to deliver public services and achieve policies in the real world. What role has data played in that? And what sort of statistics were you using? What sort of insights were you getting? Can ...
    Show more Show less
    35 mins
  • Crime data: Numbers, narratives and nuance
    Oct 21 2025
    In "Crime: Numbers, Narratives and Nuance" our host Miles Fletcher speaks with Nick Stripe, Joint Head of Crime Statistics at the ONS and John Rentoul, leading commentator on crime, policing, and the media, about the challenges in interpreting crime data. Transcript MILES FLETCHER Hello and welcome to another episode of Statistically Speaking – the official podcast on the UK's Office for National Statistics. The time we're returning to the scene of a major statistical topic we've touched on before but amid a new and sometimes highly polarised public debate, one we think fully bears further investigation: how best to understand and interpret the crime figures produced and published by ONS. Helping us with our enquiries is Nick Stripe, Joint Head of Crime Statistics at the ONS. It's his job to assemble and present the complex statistical picture of crime revealed in two very large and sometimes conflicting data sources. We also have an independent witness in the highly experiences shape of John Rentoul, Chief Political Commentator for the Independent and visiting professor at Kings College London. He'll be talking about the use and possible abuse of crime figures in the media and political debate. Are the statistics and those who produce them doing enough to enable the public to understand properly the prevalence and nature of crime in our society today? Nick, a big question to start with, some people think crime is going down, other people insist it's going up. Who's right? NICK STRIPE Well, it's a question that sounds simple, doesn't it? And it's a question I get asked quite a lot. But if you think about the concept of crime, you soon realize that it covers a really huge range of actions and behaviours. If I was a chief constable trying to reduce crime in my area, I'd want to know what kinds of crimes are causing the biggest problems. So, is it theft, robbery, violence? Domestic abuse? sexual offenses? Maybe it's fraud. And even if you tell me it's theft, then there's still a broad spectrum. So, is that burglary from houses? Is it theft of vehicles? Is it people having things snatched off them in the street? Is there a new thing about theft from doorsteps? Each of those types of theft would have its own trends, patterns and challenges. So, what I'm really saying is that whilst I understand your desire for a single answer, the real stories are in the detail of those different crime types. But I will come back to your question, is crime going up or down? Broadly speaking, I would say we're experiencing much less crime now than we did 20 or 30 years ago. Many crime types have been declining at a fairly steady rate since the mid 1990s and in more recent years, probably since we started to emerge from the pandemic, crime levels have broadly flattened out at that lower level. But some types of crime are rising now, some are still falling, and some are changing in ways that reflect shifts in society, shifts in technology and shifts in policing. MF That's the complex and highly nuanced picture, and it's the one that is designed to best serve those who make policies around crime, those who try to contain crime, those who try to fight it? NS That's right, Miles. And it's a picture that we get from drawing on several different data sources. There are two main ones. One is police recorded crime, and the second one is our independent survey of crime across England and Wales. And then we can use other data sources to provide richness for certain crime types, or to triangulate what we're seeing in those main data sources. And when we pull all of that together, we try and give a rich, nuanced, accurate picture for policy and policing. MF That's the aim of the statistics, but when it comes to public debate and public perceptions, do we risk misleading people by not being able to come up with a single barometer of crime? You can't go on the ONS website and see whether overall offending is up or down for example, or is that a completely pointless exercise? NS Well as I said, different crime types will have different things acting on them at any one point in time. But what we can do, for example through the crime survey, that has measured what I'm going to call traditional types of crime experienced by us as the public. So that's things like theft, that's things like violence, that's things like criminal damage, and in the last 10 years or so, that also includes fraud. And when we look at those types of crimes, we can see that, if you want a single figure, the numbers have come down. And that's when I say that over the last 30 years, there's been a big reduction in crime. If you take violence, theft and criminal damage, about 30 years ago, four in 10 of us, about 40% of us, every year would experience one of those types of crime. Now it's one in 10 of us. So, I can give you that picture for ...
    Show more Show less
    38 mins
  • Migration: The needle in the data haystack
    Jul 23 2025
    With migration continuing to make headlines in the media, we unpack what actually defines a "migrant", and how the UK's largest producer of official statistics goes about counting them. We also shed light on the misuse of migration figures. Transcript MILES FLETCHER Hello and a very warm welcome to a new series of Statistically Speaking - the official podcast of the UK Office for National Statistics. This is where we hear from the people producing the nation's most important numbers, about how they do it and what the statistics are saying. Now it's hard to think of one statistic that could be said to have been more influential these past few years than net international migration. Suffice to say it's the one ONS statistic that probably draws more media attention than any other. But to fully understand the migration figures, and the swirling debate around them, we'd say it pays to know a little about how they are put together. And the first thing you need to know about that is what, or who, is a migrant in the first place. As usual, to unpack and explain the migration statistics we have the top experts from the ONS and beyond. Mary Gregory is director of population statistics here at the ONS. Madeleine Sumption is director of the Migration Observatory at the University of Oxford, and new chair of the National Statistician's Advisory Panel on Migration. And to help us understand how the numbers are used and abused in public debate, we're also delighted to welcome Hannah Smith, senior political journalist at fact checking charity Full Fact. Welcome to you all. Madeleine, to start with you if I may, with that fundamental question, quite simply, what is a migrant? MADELEINE SUMPTION Well, there are actually lots of different definitions of a migrant and we use different definitions at different points in time. The standard definition of migration that we use in this country is long term migration, so people moving for at least 12 months, and so the Office for National Statistics figures on immigration, emigration and net migration are all using that definition. And people in that data, they're migrants regardless of whether they are British or not British. So you could have a British person who's gone to live overseas for a few years and coming back they would be counted, in theory, at least in the data, as a migrant. There are other definitions though that are very useful for policy. So sometimes people talk about migrants, meaning people who don't have British citizenship, and the value of that is that these are people who are subject to immigration control, effectively that the Home Office is regulating their status. But it's also sometimes quite useful not to look at whether someone's a citizen now, because of course people can change their citizenship, and many migrants to the UK do become British citizens. So it can be useful to look at whether someone has migrated in the past. The standard definition for that is whether someone is born abroad. But now we've got all these exciting new data sets from administrative data, and so there's a new definition that's creeping in and being used a lot, which is someone who was a non-citizen at the time they registered for their National Insurance Number, regardless of whether they've subsequently become a British citizen. So it's a bit confusing sometimes for the external user, because for various reasons, we have to have all of these different definitions. You just have to know which one you're looking at at any point in time. MILES FLETCHER But the basic headline definition, as far as the ONS is concerned -and I guess internationally too because it's important that these figures are comparable- is that it is a person traveling from one country to another for a period of 12 months. MADELEINE SUMPTION That's right MILES FLETCHER And I guess that is something that is perhaps not widely understood. People understand that migration has a degree of permanence, so they move from one country to another, and yet you can be a migrant in quite a sort of transient way. MADELEINE SUMPTION That's right, we have short term migrants as well. So we have a lot of people who come to this country to do seasonal work. For example, they spend up to six months in the country. Then you have people who are long term migrants by the ONS definition and they may spend two to three years here, for example, if they're a worker or an international student. So you're right. I think in people's minds, often when they think about who is a migrant and who comes to mind, they will typically think of someone who is moving permanently. But actually a lot of migrants to the UK only stay for a couple of years. MILES FLETCHER And none of these people, when it comes to measuring them, none of these people arrive Paddington Bear style with labels around their necks saying "I am a migrant". The ONS in measuring...
    Show more Show less
    33 mins
  • Green Data: Measuring the Environment
    Aug 2 2024
    In this episode we explore how the ONS measures our natural environment and the green economy. Relevant datasets: ONS Environmental Accounts Transcript MILES FLETCHER Welcome again to Statistically Speaking, the official podcast of the UK's Office for National Statistics. I'm Miles Fletcher and this time we're getting back to nature as we explore the work of the ONS in measuring the economic and social value of the natural environment. Is classical economic growth - as measured by gross domestic product or GDP - always achieved at the expense of the environment? What price can we put on the amenities our environment provides? What is the green economy and what are green jobs? And what are the key data to watch as policymakers strive for net zero carbon emissions, while also seeking to improve national prosperity? Our guides through the rich and perhaps under explored landscape of environmental data are ONS's Deputy Director for Environmental Statistics Analysis, Ian Townsend; Head of Natural Capital Accounts, Gemma Thomas; and Sophie Barrand, Monetary Accounts lead in the Environmental Accounts team. Welcome to you all. Ian to come to you first. The ONS is mainly known for measuring the economy and the population of the UK. So, what exactly is its role when it comes to the environment? What are we seeking to achieve? What do we do? What do we publish? IAN TOWNSEND So the environment is quite a broad topic that links with a lot of other issues and a lot of different national and devolved government departments and other related bodies producing statistics on the environment. And with all that range of statistics, we tend to focus at the ONS on the intersections between our environment and both the economy and society. This includes measuring what we call the Low Carbon and renewable energy economy, how many green jobs there are, the greenhouse gas emissions produced by different economic sectors, and valuing the services that nature provides to us, as well as providing rapid insights into what people and business think about climate change in the environment and their actions or indeed otherwise. MF And what are the major publications that come out of the ONS that people ought to be looking at to get a sense of what we're saying about the environment and its value? IT So I mentioned a couple in the introduction there - things like low carbon and renewable energy economy, green jobs, etc... and our emissions figures. But perhaps one that is quite worth bringing to the fore is our natural capital accounts. So, it's something we've done for several years, which basically looks at the value that ecosystems provide to nature and ecosystems provide to us, and the services that provides. So, we bring this out as a report every year - have done so for several years - and that looks beyond the economy, beyond gross domestic product, to look at all those natural resources and we found that in 2021, the total value of all those natural assets was around one and a half trillion pounds. It's such a big figure, I think it can be quite hard for people to grasp. But a useful comparison might be that it's not that far off the 1.7 trillion pounds that homes in the UK were valued at in 2021 as well. MF It's very difficult to arrive at a financial figure or value like that. Can you just give us a brief explanation of how it's calculated? IT Sure. So, there are internationally agreed guidelines that we follow around how to measure or indeed account for the current value of what natural capital could provide for us and our current and future generations. And all that process, all those guidelines are aligned with how we measure the GDP in the economy. It's really quite a complex exercise and includes things like the value of trees, rivers, peatlands, and many other habitats and natural resources in them. We've been developing and improving these approaches for probably at least 10 years, and probably have some of the most developed accounts in this form globally. Our estimates have improved over the years. But there are some things that we don't cover. So, in a way, this is probably best seen as a kind of partial and minimum value, even though it's already very large. And it's also part of a wider mission that the ONS has to capture the value of what's called missing capital, things that we don't currently measure so well in gross domestic product. So that's including social capital as well as natural capital. So that's called 'inclusive wealth' and that's another publication the ONS produces that people might be interested to have a look at. MF And it's important, I guess, to have this economic value of the environment so that can be compared against the traditional measure of economic progress and prosperity, which of course is GDP. And it's sometimes – and we've heard this in other podcasts - because GDP is like the big ...
    Show more Show less
    35 mins
  • AI: The Future of Data
    May 20 2024
    With the public release of large language models like Chat GPT putting Artificial Intelligence (AI) firmly on our radar, this episode explores what benefits this technology might hold for statistics and analysis, as well as policymaking and public services. Joining host, Miles Fletcher, to discuss the groundbreaking work being done in this area by the Office for National Statistics (ONS) and across the wider UK Government scene are: Osama Rahman, Director of the ONS Data Science Campus; Richard Campbell, Head of Reproducible Data Science and Analysis; and Sam Rose, Deputy Director of Advanced Analytics and Head of Data Science and AI at the Department for Transport. Transcript MILES FLETCHER Welcome again to Statistically Speaking, the official podcast of the UK's Office for National Statistics. I'm Miles Fletcher and, if you've been a regular listener to these podcasts, you'll have heard plenty of the natural intelligence displayed by my ONS colleagues. This time though, we're looking into the artificial stuff. We'll discuss the work being done by the ONS to take advantage of this great technological leap forward; what's going on with AI across the wider UK Government scene; and also talk about the importance of making sure every use of AI is carried out safely and responsibly. Guiding us through that are my ONS colleagues - with some of the most impressive job titles we've had to date - Osama Rahman is Director of the Data Science Campus. Richard Campbell is Head of Reproducible Data Science and Analysis. And completing our lineup, Sam Rose, Deputy Director of Advanced Analytics and head of data science and AI at the Department for Transport. Welcome to you all. Osama let's kick off then with some clarity on this AI thing. It's become the big phrase of our time now of course but when it comes to artificial intelligence and public data, what precisely are we talking about? OSAMA RAHMANSo artificial intelligence quite simply is the simulation of human intelligence processes by computing systems, and the simulation is the important bit, I think. Actually, people talk about data science, and they talk about machine learning - there's no clear-cut boundaries between these things, and there's a lot of overlap. So, you think about data science. It's the study of data to extract meaningful insights. It's multidisciplinary – maths, stats, computer programming, domain expertise, and you analyse large amounts of data to ask and answer questions. And then you think about machine learning. So that focuses on the development of computer algorithms that improve automatically through experience and by the use of data. So, in other words, machine learning enables computers to learn from data and make decisions or predictions without explicitly being programmed to do so. So, if you think about some of the stuff we do at the ONS, it's very important to be able to take a job and match it to an industrial classification - so that was a manually intensive process and now we use a lot of machine learning to guide that. So, machine learning is essentially a form of AI. MILES FLETCHERSo is it fair to say then that the reason, or one of the main reasons, people are talking so much about AI now is because of the public release of these large language models? The chat bots if you like, to simpletons like me, the ChatGPT's and so forth. You know, they seem like glorified search engines or Oracles - you ask them a question and they tell you everything you need to know. OSAMA RAHMANSo that's a form of AI and the one everyone's interested in. But it's not the only form – like I said machine learning, some other applications in data science, where we try in government, you know, in trying to detect fraud and error. So, it's all interlinked. MILES FLETCHERWhen the ONS asked people recently for one of its own surveys, about how aware the public are about artificial intelligence, 42% of people said they used it in their home recently. What sort of things would people be using it for in the home? What are these everyday applications of AI and I mean, is this artificial intelligence strictly speaking? OSAMA RAHMANIf you use Spotify, or Amazon music or YouTube music, they get data on what music you listen to, and they match that with people who've been listening to similar music, and they make recommendations for you. And that's one of the ways people find out about new music or new movies if you use Netflix, so that's one pretty basic application, that I think a lot of people are using in the home. MILES FLETCHERAnd when asked about what areas of AI they'd like to know more about, more than four in 10 adults reported that they'd like to know better how to judge the accuracy of information. I guess this is where the ONS might come in. Rich then, if I could just ask you to explain what we've been up to, what the Data Science Campus has been up to, to actually bring the power of artificial intelligence to our ...
    Show more Show less
    34 mins
  • Communicating Uncertainty: How to better understand an estimate.
    Mar 25 2024
    The ONS podcast returns, this time looking at the importance of communicating uncertainty in statistics. Joining host Miles Fletcher to discuss is Sir Robert Chote, Chair of the UKSA; Dr Craig McLaren, of the ONS; and Professor Mairi Spowage, director of the Fraser of Allander Institute. Transcript MILES FLETCHER Welcome back to Statistically Speaking, the official podcast of the UK's Office for National Statistics. I'm Miles Fletcher and to kick off this brand new season we're going to venture boldly into the world of uncertainty. Now, it is of course the case that nearly all important statistics are in fact estimates. They may be based on huge datasets calculated with the most robust methodologies, but at the end of the day they are statistical judgments subject to some degree of uncertainty. So, how should statisticians best communicate that uncertainty while still maintaining trust in the statistics themselves? It's a hot topic right now and to help us understand it, we have another cast of key players. I'm joined by the chair of the UK Statistics Authority Sir Robert Chote, Dr. Craig McLaren, head of national accounts and GDP here at the ONS, and from Scotland by Professor Mairi Spowage, director of the renowned Fraser of Allander Institute at the University of Strathclyde. Welcome to you all. Well, Sir Robert, somebody once famously said that decimal points in GDP is an economist's way of showing they've got a sense of humour. And well, that's quite amusing - particularly if you're not an economist - there's an important truth in there isn't there? When we say GDP has gone up by 0.6%. We really mean that's our best estimate. SIR ROBERT CHOTE It is. I mean, I've come at this having been a consumer of economic statistics for 30 years in different ways. I started out as a journalist on the Independent and the Financial Times writing about the new numbers as they were published each day, and then I had 10 years using them as an economic and fiscal forecaster. So I come at this very much from the spirit of a consumer and am now obviously delighted to be working with producers as well. And you're always I think, conscious in those roles of the uncertainty that lies around particular economic estimates. Now, there are some numbers that are published, they are published once, and you are conscious that that's the number that stays there. But there is uncertainty about how accurately that is reflecting the real world position and that's naturally the case. You then have the world of in particular, the national accounts, which are numbers, where you have initial estimates that the producer returns to and updates as the information sets that you have available to draw your conclusions develops over time. And it's very important to remember on the national accounts that that's not a bug, that's a feature of the system. And what you're trying to do is to measure a very complicated set of transactions you're trying to do in three ways, measuring what the economy produces, measuring incomes, measuring expenditure. You do that in different ways with information that flows in at different times. So it's a complex task and necessarily the picture evolves. So I think from the perspective of a user, it's important to be aware of the uncertainty and it's important when you're presenting and publishing statistics to help people engage with that, because if you are making decisions based on statistics, if you're simply trying to gain an understanding of what's going on in the economy or society, generally speaking you shouldn't be betting the farm on the assumption that any particular number is, as you say, going to be right to decimal places. And the more that producers can do to help people engage with that in an informed and intelligent way, and therefore mean that decisions that people take on the basis of this more informed the better. MF So it needs to be near enough to be reliable, but at the same time we need to know about the uncertainty. So how near is the system at the moment as far as these important indicators are concerned to getting that right? SRC Well, I think there's an awful lot of effort that goes into ensuring that you are presenting on the basis of the information set that you have the best available estimates that you can, and I think there's an awful lot of effort that goes into thinking about quality, that thinks about quality assurance when these are put together, that thinks about the communication how they mesh in with the rest of the, for example, the economic picture that you have, so you can reasonably assure yourself that you're providing people with the best possible estimate that you can at any given moment. But at the same time, you want to try to guide people by saying, well, this is an estimate, there's no guarantee that this is going to exactly reflect the real world, the more that you can do to put some sort of numerical ...
    Show more Show less
    33 mins
  • ONS: Year in Review 2023
    Dec 21 2023
    In this episode Miles is joined by the National Statistician, Sir Ian Diamond, to reflect on what has been a busy and transformative year at the Office for National Statistics. Transcript MILES FLETCHER This is "Statistically Speaking", the official podcast of the UK Office for National Statistics, I'm Miles Fletcher. This is our 20th episode, in fact, a milestone of sorts, though not a statistically significant one. What is significant is that we're joined, once again, to look back at the highlights from another 12 months here at the ONS by none other than the National Statistician himself, Professor Sir Ian Diamond. Ian, thanks for joining us again. The year started for you with being reappointed as the national statistician. As 2023 developed, how glad did you feel to be back? SIR IAN DIAMOND Of course, you know, I was hugely privileged to be invited to continue. It's one of the most exciting things you could ever do and I will continue to do everything in my power to bring great statistics to the service of our nation. MF To business then, and this time last year, we sat in this very room talking about the results of Census 2021, which were coming in quite fresh then. And we've seen the fastest growth of the population, you told us, since the baby boom of the early 1960s. Over the course of the year much more data has become available from that census and this time, we've been able to make it available for people in much richer ways, including interactive maps, create your own data set tools. What does that say about the population data generally and the way that people can access and use it now? How significant is that there's that sort of development? SID Well I think we need to recognise that the sorts of things that we can do now, with the use of brilliant technology, brilliant data science and brilliant computing is enabling us to understand our population more, to be able to make our data more accessible. 50, 60, 70 years ago, 150 years ago, we would have just produced in about six or seven years after the census, a report with many, many tables and people would have just been able to look at those tables. Now, we're able to produce data which enables people to build their own tables, to ask questions of data. It's too easy to say, tell me something interesting, you know, the population of Dorset is this. Okay, that's fine, but actually he wants to know much more about whether that's high or low. You want to know much more about the structure of the population, what its needs for services are, I could go on and on. And each individual will have different questions to ask of the data, and enabling each individual to ask those questions which are important to them, and therefore for the census to be more used, is I think, an incredibly beautiful thing. MF And you can go onto the website there and create a picture... SID Anyone can go onto the website, anyone can start to ask whatever questions they want of the data. And to get very clearly, properly statistically disclosed answers which enable them to use those data in whatever way they wish to. MF And it's a demonstration of obviously the richness of data that's available now from all kinds of sources, and behind that has been a discussion of, that's gone on here in the ONS and beyond this year, about what the future holds for population statistics and how we can develop those and bring those on. There's been a big consultation going on at the moment. What's the engagement with that consultation been like? SID Well the engagement's been great, we've had around 700 responses, and it addresses some fundamental questions. So the census is a really beautiful thing. But at the same time, the census, the last one done the 21st of March 2021, was out of date by the 22nd of March 2021, and more and more out of date as you go on and many of our users say to us, that they want more timely data. Also by its very nature a census is a pretty constrained data set. We in our country have never been prepared to ask for example, income on the census yet this is one of the most demanded questions. We don't ask it because it is believed that it is too sensitive. And so there are many, many, many questions that we simply can't ask because of space. There are many more questions that we simply cannot ask in the granularity that we want to. We've been doing some work recently to reconcile the differences between estimates in the number of Welsh speakers from surveys with estimates on the number of people in the census who report they speak Welsh. Frankly, it would be better if we were able to ask them to get information in a more granular way. And so while the census is an incredibly beautiful thing, we also need to recognise that as time goes on, the technology and the availability of data allowing us to link data becomes much more of a great opportunity that we have been undertaking a ...
    Show more Show less
    27 mins