CovidSim

Last updated
CovidSim
Original author(s) Neil Ferguson
Repository https://github.com/mrc-ide/covid-sim
Written in C++
License GNU General Public License v3.0

CovidSim is an epidemiological model for COVID-19 developed by Imperial College COVID-19 Response Team, led by Neil Ferguson. [1] The Imperial College study addresses the question: If complete suppression is not feasible, what is the best strategy combining incomplete suppression and control that is feasible and leads to acceptable outcomes? [2]

Contents

History

CovidSim is an agent-based model and was based on an earlier influenza model. [3]

The codebase for the model was initially constructed c. 2005. [4]

Informing policy decisions

For UK Prime Minister Boris Johnson, [4] it was, according to David Adam writing in The Atlantic , "a critical factor in jolting the UK government into changing its policy on the pandemic" and order a nationwide lockdown to limit the spread of the Coronavirus. [5] [1] [6] [7]

Software

In May 2020, a C++ derivative of the code was released to GitHub. [8]

As of May 2023, the current release tag is v0.15.0. [9] Additionally, an Anaconda package exists with release v0.8.0 [10]

The software should be distinguished from the ICL's COVID-19 Scenario Analysis Tool (currently Version 4 [11] ), which is hosted under the domain name https://www.covidsim.org, but according to the research documentation is relying on the model combined with a squire model, which is the underlying transmission model in the absence of vaccination. [12] [13] Further details are available under ICL's Report 33. [14]

Code reviews and expert opinions

Note that the mentioned model ships with and is marked with a list of warnings and user information, e.g. no support, stochastic nature/kernel, criticality of input parameters etc. [15] [16]

Soundness

American programmer John Carmack said in April 2020 that he worked on the code before it was released to the public, when it was a single 15,000-line C programming language file and "some of the functions looked like they were machine translated from Fortran", but that "it fared a lot better going through the gauntlet of code analysis tools I hit it with than a lot of more modern code". [17] [18]

Shortcomings

New Scientist reported in March 2020 that one group from the New England Complex Systems Institute reviewing the model suggested that it contained "systematic errors". [19] [20] British newspaper The Telegraph reported that some software engineers who reviewed the new code called it "totally unreliable" and a "buggy mess". [21]

In the opinion of University of Oxford computer scientist Michael Wooldridge, the code was "developed without the ceremony and rigor" of professional products, which is not untypical for research software and often intended to be not understood by third parties, or to be reused; and "while the extensive criticism about relaxed software engineering practices is perhaps justified, it was not fundamentally flawed". [22]

Model characteristics

Reproducibility

An independent review by Codecheck led by Dr Stephen Eglen of the University of Cambridge confirmed that they were able to reproduce the key findings from the response team's report by using the software. [17] [23] [24] A June 2020 editorial in Nature declared the original CovidSim codebase met the requirements of scientific reproducibility. [25]

Uncertainty

Further research exists to identify the following three sources of uncertainty in the simulation: [26] [27] parametric uncertainty, model structure uncertainty and scenario uncertainty: [28] The simulation output depends critically on the inputs and can change up to 300% based on 940 parameters, of which 19 are considered most sensitive. Model structure and scenario uncertainty must therefore be understood. [28]

The results obtained by Imperial using the model are consistent with other models that make similar assumptions. [2]

Extensibility

Calibration of the model has been hampered by the lack of testing, especially the poor understanding of the prevalence of asymptomatic infection, however the Imperial College team makes reasonable assumptions. The model's reliance on a simplified picture of social interactions limits its extensibility to counterfactuals. The general nature of conclusions based on such a model can be expected to be similar to those of a simple compartmental model. [2]

See also

Related Research Articles

<span class="mw-page-title-main">Eclipse (software)</span> Software development environment

Eclipse is an integrated development environment (IDE) used in computer programming. It contains a base workspace and an extensible plug-in system for customizing the environment. It is the second-most-popular IDE for Java development, and, until 2016, was the most popular. Eclipse is written mostly in Java and its primary use is for developing Java applications, but it may also be used to develop applications in other programming languages via plug-ins, including Ada, ABAP, C, C++, C#, Clojure, COBOL, D, Erlang, Fortran, Groovy, Haskell, JavaScript, Julia, Lasso, Lua, NATURAL, Perl, PHP, Prolog, Python, R, Ruby, Rust, Scala, and Scheme. It can also be used to develop documents with LaTeX and packages for the software Mathematica. Development environments include the Eclipse Java development tools (JDT) for Java and Scala, Eclipse CDT for C/C++, and Eclipse PDT for PHP, among others.

<span class="mw-page-title-main">Embeddable Linux Kernel Subset</span>

The Embeddable Linux Kernel Subset (ELKS), formerly known as Linux-8086, is a Linux-like operating system kernel. It is a subset of the Linux kernel, intended for 16-bit computers with limited processor and memory resources such as machines powered by Intel 8086 and compatible microprocessors not supported by 32-bit Linux.

<span class="mw-page-title-main">Sandboxie</span> Open-source sandboxing computer program

Sandboxie is an open-source OS-level virtualization solution for Microsoft Windows. It is a sandboxing solution that creates an isolated operating environment in which applications can run without permanently modifying the local system. This virtual environment allows for controlled testing of untrusted programs and web surfing.

<span class="mw-page-title-main">Robotics simulator</span> Simulator to create applications for physical robots

A robotics simulator is a simulator used to create an application for a physical robot without depending on the physical machine, thus saving cost and time. In some case, such applications can be transferred onto a physical robot without modification.

OpenMM is a library for performing molecular dynamics simulations on a wide variety of hardware architectures. First released in January 2010, it was written by Peter Eastman at the Vijay S. Pande lab at Stanford University. It is notable for its implementation in the Folding@home project's core22 kernel. Core22, also developed at the Pande lab, uses OpenMM to perform protein dynamics simulations on GPUs via CUDA and OpenCL. During the COVID-19 pandemic, a peak of 280,000 GPUs were estimated to be running OpenMM via core22.

FlexSim is a discrete-event simulation software package developed by FlexSim Software Products, Inc. The FlexSim product family currently includes the general purpose FlexSim product and healthcare systems modeling environment.

<span class="mw-page-title-main">Minibloq</span> Graphical development environment

Minibloq is a graphical development environment for Arduino and other platforms. Its main objective is to help in teaching programming. It is specially used in robotics at elementary, middle and high schools. It's widely used in Argentina, where in the San Luis province alone, more than 60000 children have been trained with this software in public schools.

<span class="mw-page-title-main">Atom (text editor)</span> Free and open-source text and source code editor

Atom is a free and open-source text and source-code editor for macOS, Linux, and Windows with support for plug-ins written in JavaScript, and embedded Git control. Developed by GitHub, Atom was released on June 25, 2015.

CloudSim is a framework for modeling and simulation of cloud computing infrastructures and services. Originally built primarily at the Cloud Computing and Distributed Systems (CLOUDS) Laboratory, the University of Melbourne, Australia, CloudSim has become one of the most popular open source cloud simulators in the research and academia. CloudSim is completely written in Java. The latest version of CloudSim is CloudSim v6.0.0-beta on GitHub.

<span class="mw-page-title-main">Neil Ferguson (epidemiologist)</span> British epidemiologist and researcher

Neil Morris Ferguson is a British epidemiologist and professor of mathematical biology, who specialises in the patterns of spread of infectious disease in humans and animals. He is the director of the Jameel Institute, and of the MRC Centre for Global Infectious Disease Analysis, and head of the Department of Infectious Disease Epidemiology in the School of Public Health and Vice-Dean for Academic Development in the Faculty of Medicine, all at Imperial College London.

The COVID-19 pandemic in Malawi is part of the worldwide pandemic of coronavirus disease 2019 caused by severe acute respiratory syndrome coronavirus 2. The virus was confirmed to have reached Malawi on 2 April 2020. It has spread to all districts of Malawi.

The COVID-19 pandemic in Djibouti was a part of the worldwide pandemic of coronavirus disease 2019 caused by severe acute respiratory syndrome coronavirus 2. The virus spread to Djibouti in March 2020. It is a novel infectious disease caused by severe acute respiratory syndrome coronavirus 2. Model-based simulations for Djibouti indicate that the 95% confidence interval for the time-varying reproduction number R t has been rising since August 2020 and exceeded 1.0 until April 2021.

<span class="mw-page-title-main">COVID-19 pandemic in Sierra Leone</span> Viral pandemic in Sierra Leone

The COVID-19 pandemic in Sierra Leone is part of the ongoing worldwide pandemic of coronavirus disease 2019 caused by severe acute respiratory syndrome coronavirus 2. The virus was confirmed to have reached Sierra Leone on 31 March 2020.

<span class="mw-page-title-main">Open-source ventilator</span> Ventilator of freely-licensed design

An open-source ventilator is a disaster-situation ventilator made using a freely licensed (open-source) design, and ideally, freely available components and parts. Designs, components, and parts may be anywhere from completely reverse-engineered or completely new creations, components may be adaptations of various inexpensive existing products, and special hard-to-find and/or expensive parts may be 3D-printed instead of purchased. As of early 2020, the levels of documentation and testing of open-source ventilators was well below scientific and medical-grade standards.

The Imperial College COVID-19 Response Team is a group of experts from Imperial College London studying the COVID-19 pandemic and informing the government of the United Kingdom, and governments and public health agencies around the world. The team comprises scientists from the MRC Centre for Global Infectious Disease Analysis, the Jameel Institute, the Imperial College Business School and the Department of Mathematics. The Imperial College COVID-19 Response Team is led by Professor Neil Ferguson, Director of the Jameel Institute and MRC GIDA.

<span class="mw-page-title-main">COVID-19 apps</span> Mobile apps designed to aid contact tracing

COVID-19 apps include mobile-software applications for digital contact-tracing - i.e. the process of identifying persons ("contacts") who may have been in contact with an infected individual - deployed during the COVID-19 pandemic.

The MRC Centre for Global Infectious Disease Analysis is a Medical Research Council funded research centre at Imperial College London and a WHO collaborating centre. It is part of the Department of Infectious Disease Epidemiology at School of Public Health within the Imperial College Faculty of Medicine. Neil Ferguson is the director of the centre, along with four associate directors: Christl Donnelly, Azra Ghani, Nicholas Grassly, and Timothy Hallett. The centre also collaborates UK Health Protection Agency, and the US Centre for Disease Control. The centre's main research areas are disease outbreak analysis and modelling, vaccines, global health analytics, antimicrobial resistance, and developing methods and tools for studying these areas. The centre was previously called the MRC Centre for Outbreak Analysis and Modelling.

Software for COVID-19 pandemic mitigation takes many forms. It includes mobile apps for contact tracing and notifications about infection risks, vaccine passports, software for enabling – or improving the effectiveness of – lockdowns and social distancing, Web software for the creation of related information services, and research and development software. A common issue is that few apps interoperate, reducing their effectiveness.

GitHub Copilot is a code completion tool developed by GitHub and OpenAI that assists users of Visual Studio Code, Visual Studio, Neovim, and JetBrains integrated development environments (IDEs) by autocompleting code. Currently available by subscription to individual developers and to businesses, the generative artificial intelligence software was first announced by GitHub on 29 June 2021, and works best for users coding in Python, JavaScript, TypeScript, Ruby, and Go. In March 2023 GitHub announced plans for "Copilot X", which will incorporate a chatbot based on GPT-4, as well as support for voice commands, into Copilot.

References

  1. 1 2 Adam D (April 2020). "Special report: The simulations driving the world's response to COVID-19". Nature. 580 (7803): 316–318. Bibcode:2020Natur.580..316A. doi: 10.1038/d41586-020-01003-6 . PMID   32242115. S2CID   214771531.
  2. 1 2 3 Eubank S, Eckstrand I, Lewis B, Venkatramanan S, Marathe M, Barrett CL (April 2020). "Commentary on Ferguson, et al., "Impact of Non-pharmaceutical Interventions (NPIs) to Reduce COVID-19 Mortality and Healthcare Demand"". Bulletin of Mathematical Biology. 82 (4): 52. doi:10.1007/s11538-020-00726-x. PMC   7140590 . PMID   32270376. CC-BY icon.svg Text was copied from this source, which is available under a Creative Commons Attribution 4.0 International License.
  3. ↑ Panovska-Griffiths J, Kerr CC, Waites W, Stuart RM (January 2021). "Mathematical modeling as a tool for policy decision making: Applications to the COVID-19 pandemic". Handbook of Statistics. 44: 291–326. doi: 10.1016/bs.host.2020.12.001 . ISBN   9780323852005. PMC   7857083 .
  4. 1 2 Bostock B (April 25, 2020), "How 'Professor Lockdown' helped save tens of thousands of lives worldwide — and carried COVID-19 into Downing Street", Business Insider
  5. ↑ "Report 9 - Impact of non-pharmaceutical interventions (NPIs) to reduce COVID-19 mortality and healthcare demand". Imperial College London. Retrieved 2021-03-10.
  6. ↑ Kelland K (March 17, 2020). "Sobering coronavirus study prompted Britain to toughen its approach". Reuters.
  7. ↑ Tufekci Z (April 2, 2020). "Don't Believe the COVID-19 Models.That's not what they're for". The Atlantic .
  8. ↑ mrc-ide/covid-sim, MRC Centre for Global Infectious Disease Analysis, 2021-03-08, retrieved 2021-03-09
  9. ↑ "Release v0.15.0 · mrc-ide/covid-sim". GitHub. Retrieved 2021-04-05.
  10. ↑ "Covid Sim :: Anaconda.org". anaconda.org. Retrieved 2021-04-05.
  11. ↑ "Covid-19 Scenario Analysis". covidsim.org. Retrieved 2021-04-05.
  12. ↑ "SEIR transmission model of COVID-19". mrc-ide.github.io. Retrieved 2021-04-05.
  13. ↑ Consulting, Bio Nano. "Covid-19 Scenario Analysis". covidsim.org. Retrieved 2021-04-05.
  14. ↑ "Report 33 - Modelling the allocation and impact of a COVID-19 vaccine". Imperial College London. Retrieved 2021-04-05.
  15. ↑ "mrc-ide/covid-sim". GitHub. Retrieved 2021-04-05.
  16. ↑ "COVID-19 planning tools". Imperial College London. Retrieved 2021-04-05.
  17. 1 2 Scheuber A, van Elsland SL (June 2020). "Codecheck confirms reproducibility of COVID-19 model results". Imperial News. Imperial College London. Retrieved 2021-03-10.
  18. ↑ @ID_AA_Carmack (April 27, 2020). "Before the GitHub team started working on the code it was a single 15k line C file that had been worked on for a decade, and some of the functions looked like they were machine translated from Fortran" (Tweet) – via Twitter.
  19. ↑ Shen C, Taleb NN, Bar-Yam Y (17 March 2020). "Review of Ferguson et al "Impact of non-pharmaceutical interventions..."". New England Complex Systems Institute. Retrieved 2021-03-13.
  20. ↑ Hamzelou J (March 23, 2020), "UK's scientific advice on coronavirus is a cause for concern", New Scientist
  21. ↑ Boland H (May 16, 2020). "Coding that led to lockdown was 'totally unreliable' and a 'buggy mess', say experts". The Telegraph. Retrieved May 22, 2020.
  22. ↑ Wooldridge M. "The Software that Led to the Lockdown". cacm.acm.org. Retrieved 2021-03-09.
  23. ↑ "Codecheck confirms reproducibility of COVID-19 model results". Mirage News. 2 June 2020. Retrieved 6 June 2020.
  24. ↑ Eglen SJ (29 May 2020). "CODECHECK certificate 2020-010". Geneva, Switzerland. doi:10.5281/zenodo.3865491 . Retrieved 2020-10-14.{{cite journal}}: Cite journal requires |journal= (help) PDF report available.
  25. ↑ Singh Chawla D (June 2020). "Critiqued coronavirus simulation gets thumbs up from code-checking efforts" (PDF). Nature. 582 (7812): 323–324. Bibcode:2020Natur.582..323S. doi: 10.1038/d41586-020-01685-y . PMID   32546864. S2CID   219700526 . Retrieved 2020-10-14.
  26. ↑ Winsberg E (2019), "Computer Simulations in Science", in Zalta EN (ed.), The Stanford Encyclopedia of Philosophy (Winter 2019 ed.), Metaphysics Research Lab, Stanford University, retrieved 2021-03-09
  27. ↑ Leung K, Wu JT (February 2021). "Quantifying the uncertainty of CovidSim". Nature Computational Science. 1 (2): 98–99. doi: 10.1038/s43588-021-00031-0 . ISSN   2662-8457.
  28. 1 2 Edeling W, Arabnejad H, Sinclair R, Suleimenova D, Gopalakrishnan K, Bosak B, et al. (February 2021). "The impact of uncertainty on predictions of the CovidSim epidemiological code". Nature Computational Science. 1 (2): 128–135. doi: 10.1038/s43588-021-00028-9 . hdl: 11245.1/4bf2b164-6e12-40aa-93f0-54e41abf1d42 .
  29. ↑ Rice K, Wynne B, Martin V, Ackland GJ (October 2020). "Effect of school closures on mortality from coronavirus disease 2019: old and new predictions". BMJ. 371: m3588. doi:10.1136/bmj.m3588. PMC   7536648 . PMID   33028597.
  30. ↑ "An automation toolkit for complex simulation tasks — FabSim3 Initial Release documentation". fabsim3.readthedocs.io. Retrieved 2021-04-02.
  31. ↑ Wouter Edeling; Hamid Arabnejad; Robert C Sinclair; Diana Suleimenova; Krishnakumar Gopalakrishnan; Bartosz Bosak; Derek Groen; Imran Mahmood Qureshi Hashmi; Daan Crommelin (2021-01-16), FabCovidSim, doi:10.5281/zenodo.4445290 , retrieved 2021-04-02
  32. ↑ Richardson, Robin A.; Wright, David W.; Edeling, Wouter; Jancauskas, Vytautas; Lakhlili, Jalal; Coveney, Peter V. (2020-04-29). "EasyVVUQ: A Library for Verification, Validation and Uncertainty Quantification in High Performance Computing". Journal of Open Research Software. 8: 11. doi: 10.5334/jors.303 . ISSN   2049-9647.
  33. ↑ "wedeling/EasyVVUQ". GitHub. Retrieved 2021-04-02.
  34. ↑ Laydon, Daniel J.; Mishra, Swapnil; Hinsley, Wes R.; Samartsidis, Pantelis; Flaxman, Seth; Gandy, Axel; Ferguson, Neil M.; Bhatt, Samir (2021-02-24). "Impact of the Tier system on SARS-CoV-2 transmission in the UK between the first and second national lockdowns". medRxiv   10.1101/2021.02.23.21252277v1 .

Further reading

This page is based on this Wikipedia article
Text is available under the CC BY-SA 4.0 license; additional terms may apply.
Images, videos and audio are available under their respective licenses.