Skip to main content
SearchLoginLogin or Signup

Models: What Are They and Should We Believe Them?

During the COVID-19 outbreak we have often seen predictions of the epidemic created using models. These influence important decisions about disease control measures. But we hear that predictions made by models change, so how much can we trust them?

Published onJun 22, 2022
Models: What Are They and Should We Believe Them?
·

Abstract

During the COVID-19 outbreak we have often seen predictions of the epidemic created using models. These influence important decisions about disease control measures. But we hear that predictions made by models change, so how much can we trust them? In this talk, I discuss what models are, their limitations, and why their predictions have uncertainty. Having a better understanding of models will help us be better consumers of the information they provide.

With training in both mathematics and biology, Alun L. Lloyd, Ph.D. is a mathematical biologist who primarily works on modeling the spread of infectious diseases. He was born and raised in Wales, which is part of the United Kingdom. As an undergraduate, he studied mathematics at Trinity College, Cambridge University, before moving to the University of Oxford to do a doctorate in Zoology. He came to the US in 1999, first at the Institute of Advanced Study (Princeton, NJ)--a place whose most famous faculty member was Albert Einstein. Since 2003 he has been at NC State, where he is now Drexel Professor of Mathematics and Director of the Biomathematics Graduate Program. His work takes him to many beautiful locations around the world, including Australia, South Africa, Peru, and many places in Europe and the US. When Dr. Lloyd is not thinking about math or biology, he loves to hike, particularly in the mountains and the desert of Utah and Arizona.

Models: What Are They and Should We Believe Them? (Alun L. Lloyd)

This video was originally produced for an audience of entering first-year and transfer students at NC State University as a part of an interdisciplinary experience. It is available for noncommercial reuse under a Creative Commons Attribution Noncommercial 4.0 License, https://creativecommons.org/licenses/by-nc/4.0/.

TRANSCRIPT

SUPPLEMENTAL MATERIALS

  1. The Modeling Process

    • Modeling is usually seen as an iterative process. Observations of the real world lead to some idea of the processes that govern the system. These governing processes are translated into a mathematical model of the system. For example, Newton’s Laws of Motion might be used to describe the motion of a body in a physics problem. The model is then used to make predictions. Those predictions are compared against data---observations of what actually happens or happened in the real world. Discrepancies between observed and predicted behavior reflect errors or inaccuracies in the model. Sometimes this tells us that we didn’t understand the system as well as we thought, for instance we might learn that some particular process is more important than we initially thought. We update the model in light of our improved understanding. New predictions are generated from the updated model, and those are again tested against reality. This continues until the model is believed to be a sufficiently accurate representation.

      Image shows a simple circular flow chart. At the top is a box labeled "Data", to the right is a box labeled "Biological Processes", at the bottom is a box labeled "Mathematical Model", and to the left is a box labeled "Model Predictions". All of the boxes are connected in the sequence above by black arrows.

      The Modeling Process

  2. Uncertainties in Forecasts: The Cone of Uncertainty for Hurricane Forecasts

  3. Ensemble Forecasts: Do Different Models Agree or Disagree?

    • Explanation of Ensemble Forecasting

      Image of the North Atlantic. Currents are represented with various colored lines.

      Example cone of uncertainty (Hurricane Dorian, September 2019; image from NOAA/National Hurricane Center)

    • We see predictions from 17 different models, each over a 5 day period (time labeled in hours: 24, 48, 72, 96, 120). In this example, we see the different models all give fairly similar predictions over the first couple of days, but then some pretty significant differences emerge over the longer time periods. 

  4. Improvements in Models

    • “10-Years Later, Did We Learn Anything from Hurricane Katrina?” talks about how our ability to predict hurricanes has improved over the years. They make an interesting comparison between the cone of uncertainty that was given at the time (2005) and one that was generated using the models available ten years later (2015). The smaller cone of uncertainty from the 2015 models is a testament to the improved understanding of the forces shaping hurricanes that came during that decade.

Comments
0
comment
No comments here