David Hand (statistician)

Last updated

David Hand

Brainwash Festival 2015 - David Hand (1).jpg
Hand in 2015
Born
David John Hand

(1950-06-30) 30 June 1950 (age 73)
Peterborough, England
Alma mater University of Oxford (BA)
University of Southampton (PhD)
Awards Guy Medal (2002)
George Box Medal (2016)
Scientific career
Fields Statistics
Machine learning
Data mining
Data science
Big data [1]
Institutions Open University
Imperial College London
Winton Capital Management [2]
Thesis The Classification of Incomplete Vectors  (1977)
Doctoral advisor Bruce Godfrey Batchelor  [ Wikidata ] [3]
Website www.imperial.ac.uk/people/d.j.hand OOjs UI icon edit-ltr-progressive.svg

David John Hand OBE FBA (born 30 June 1950 in Peterborough) [2] [4] is a British statistician. [1] His research interests include multivariate statistics, classification methods, pattern recognition, computational statistics and the foundations of statistics. [5] He has written technical books on statistics, data mining, finance, classification methods, and measuring wellbeing, as well as science popularisation books including The Improbability Principle: Why Coincidences, Miracles, and Rare Events Happen Every Day; [6] Dark Data: Why What You Don't Know Matters; [7] and Statistics: A Very Short Introduction. In 1991 he launched the journal Statistics and Computing .

Contents

Education

Hand was educated at the University of Oxford and the University of Southampton where he was awarded a PhD in 1977 [8] for research supervised by Bruce Godfrey Batchelor  [ Wikidata ]. [3]

Career and research

Hand served as professor of statistics at the Open University from 1988 until 1999, when he moved to Imperial College London, where he is now[ when? ] Emeritus Professor of Mathematics. Between 2010 and 2018 he took an extended sabbatical to serve as chief scientific advisor at Winton Capital Management. [2] He served as president of the Royal Statistical Society from 2008 to 2009, then again in 2010 after Bernard Silverman stood down. [9]

Books

Hand has published 31 books, inter alia:

Articles

Hand has published over 300 scientific articles, inter alia:

Awards and honours

Hand has received various awards for his work, including being elected Honorary Fellow of the Institute of Actuaries in 1999, the Guy Medal in Silver of the Royal Statistical Society in 2002, the IEEE ICDM Outstanding Contributions Award in 2004, the Credit Collections and Risk Award for Contributions to the Credit Industry in 2012, the George Box Medal for Business and Industrial Statistics in 2016, and the International Federation of Classification Societies Research Medal in 2019. He was appointed Officer of the Order of the British Empire (OBE) in the 2013 New Year Honours for services to research and innovation. [22] [23] He was elected a Fellow of the British Academy (FBA) in 2003. [4]

In April 2013 until June 2021 he served on the board of the board of the UK Statistics Authority as a non-executive director [24] and served on the European Statistical Advisory Committee, advising the European Commission from 2016 to 2021. He chaired the Administrative Data Research Network from 2014 to 2017 and serves on many other advisory committees, including chairing the Advisory Board of the ONS's Centre for Applied Data Ethics and the National Statistician's Expert User Advisory Committee.

Related Research Articles

<span class="mw-page-title-main">Statistics</span> Study of the collection, analysis, interpretation, and presentation of data

Statistics is the discipline that concerns the collection, organization, analysis, interpretation, and presentation of data. In applying statistics to a scientific, industrial, or social problem, it is conventional to begin with a statistical population or a statistical model to be studied. Populations can be diverse groups of people or objects such as "all people living in a country" or "every atom composing a crystal". Statistics deals with every aspect of data, including the planning of data collection in terms of the design of surveys and experiments.

Accuracy and precision are two measures of observational error. Accuracy is how close a given set of measurements are to their true value, while precision is how close the measurements are to each other.

Social statistics is the use of statistical measurement systems to study human behavior in a social environment. This can be accomplished through polling a group of people, evaluating a subset of data obtained about a group of people, or by observation and statistical analysis of a set of data that relates to people and their behaviors.

There are two main uses of the term calibration in statistics that denote special types of statistical inference problems. Calibration can mean

Level of measurement or scale of measure is a classification that describes the nature of information within the values assigned to variables. Psychologist Stanley Smith Stevens developed the best-known classification with four levels, or scales, of measurement: nominal, ordinal, interval, and ratio. This framework of distinguishing levels of measurement originated in psychology and has since had a complex history, being adopted and extended in some disciplines and by some scholars, and criticized or rejected by others. Other classifications include those by Mosteller and Tukey, and by Chrisman.

<span class="mw-page-title-main">Receiver operating characteristic</span> Diagnostic plot of binary classifier ability

A receiver operating characteristic curve, or ROC curve, is a graphical plot that illustrates the performance of a binary classifier model at varying threshold values.

In statistics, classification is the problem of identifying which of a set of categories (sub-populations) an observation belongs to. Examples are assigning a given email to the "spam" or "non-spam" class, and assigning a diagnosis to a given patient based on observed characteristics of the patient.

The law of truly large numbers, attributed to Persi Diaconis and Frederick Mosteller, states that with a large enough number of independent samples, any highly implausible result is likely to be observed. Because we never find it notable when likely events occur, we highlight unlikely events and notice them more. The law is often used to falsify different pseudo-scientific claims; as such, it is sometimes criticized by fringe scientists.

In predictive analytics, data science, machine learning and related fields, concept drift or drift is an evolution of data that invalidates the data model. It happens when the statistical properties of the target variable, which the model is trying to predict, change over time in unforeseen ways. This causes problems because the predictions become less accurate as time passes. Drift detection and drift adaptation are of paramount importance in the fields that involve dynamically changing data and data models.

<span class="mw-page-title-main">Adrian Smith (statistician)</span> British statistician (born 1946)

Sir Adrian Frederick Melhuish Smith, PRS is a British statistician who is chief executive of the Alan Turing Institute and president of the Royal Society.

Sir Roy Malcolm Anderson is a leading international authority on the epidemiology and control of infectious diseases. He is the author, with Robert May, of the most highly cited book in this field, entitled Infectious Diseases of Humans: Dynamics and Control. His early work was on the population ecology of infectious agents before focusing on the epidemiology and control of human infections. His published research includes studies of the major viral, bacterial and parasitic infections of humans, wildlife and livestock. This has included major studies on HIV, SARS, foot and mouth disease, bovine tuberculosis, bovine spongiform encephalopathy (BSE), influenza A, antibiotic resistant bacteria, the neglected tropical diseases and most recently COVID-19. Anderson is the author of over 650 peer-reviewed scientific articles with an h-index of 125.

Some approaches in the branch of historic metrology are highly speculative and can be qualified as pseudoscience.

<span class="mw-page-title-main">D. J. Bartholomew</span> British statistician

David John Bartholomew was a British statistician who was president of the Royal Statistical Society between 1993 and 1995. He was professor of statistics at the London School of Economics between 1973 and 1996.

Optimal Discriminant Analysis (ODA) and the related classification tree analysis (CTA) are exact statistical methods that maximize predictive accuracy. For any specific sample and exploratory or confirmatory hypothesis, optimal discriminant analysis (ODA) identifies the statistical model that yields maximum predictive accuracy, assesses the exact Type I error rate, and evaluates potential cross-generalizability. Optimal discriminant analysis may be applied to > 0 dimensions, with the one-dimensional case being referred to as UniODA and the multidimensional case being referred to as MultiODA. Optimal discriminant analysis is an alternative to ANOVA and regression analysis.

Statistics education is the practice of teaching and learning of statistics, along with the associated scholarly research.

<span class="mw-page-title-main">Nancy Reid</span> Canadian statistician

Nancy Margaret Reid is a Canadian theoretical statistician. She is a professor at the University of Toronto where she holds a Canada Research Chair in Statistical Theory. In 2015 Reid became Director of the Canadian Institute for Statistical Sciences.

<span class="mw-page-title-main">David T. Jones (scientist)</span> British bioinformatician

David Tudor Jones is a Professor of Bioinformatics, and Head of Bioinformatics Group in the University College London. He is also the director in Bloomsbury Center for Bioinformatics, which is a joint Research Centre between UCL and Birkbeck, University of London and which also provides bioinformatics training and support services to biomedical researchers. In 2013, he is a member of editorial boards for PLoS ONE, BioData Mining, Advanced Bioinformatics, Chemical Biology & Drug Design, and Protein: Structure, Function and Bioinformatics.

<span class="mw-page-title-main">Data science</span> Interdisciplinary field of study on deriving knowledge and insights from data

Data science is an interdisciplinary academic field that uses statistics, scientific computing, scientific methods, processes, algorithms and systems to extract or extrapolate knowledge and insights from potentially noisy, structured, or unstructured data.

David L. Banks is an American statistician at Duke University.

Nicholas Irving Fisher is an Australian statistician and entrepreneur. He was a statistical researcher at the CSIRO for over 30 years and has founded the analytics company ValueMetrics Australia. He has contributed to the development and applications of directional statistics in geosciences, and statistical methods for quality improvement, specifically performance measurement for enterprises.

References

  1. 1 2 David Hand publications indexed by Google Scholar OOjs UI icon edit-ltr-progressive.svg
  2. 1 2 3 Anon (2007). "Hand, Prof. David John" . Who's Who (online Oxford University Press  ed.). Oxford: A & C Black. doi:10.1093/ww/9780199540884.013.U4000379.(Subscription or UK public library membership required.)
  3. 1 2 David Hand at the Mathematics Genealogy Project OOjs UI icon edit-ltr-progressive.svg
  4. 1 2 Prof David Hand Authorised Biography at Debrett's People of Today. Accessed 27 January 2011.
  5. "Professor David Hand". Imperial College London . Retrieved 27 January 2011.
  6. 1 2 The Improbability Principle: Why Coincidences, Miracles and Rare Events Happen All the Time. Farrar Straus Giroux. ISBN   978-0-374-17534-4
  7. 1 2 Dark Data: Why What You Don’t Know Matters ISBN   978-0691182377
  8. Hand, David John (1977). The Classification of Incomplete Vectors (PhD thesis). University of Southampton. OCLC   1116600745. EThOS   uk.bl.ethos.458058.
  9. "Past President". The Royal Statistical Society. Archived from the original on 17 March 2012. Retrieved 27 January 2011.
  10. (with Mannila H. and Smyth P). Principles of Data Mining. MIT Press. ISBN   978-0262082907
  11. Measurement Theory and Practice: the World Through Quantification. Wiley, ISBN   978-0470685679
  12. (with Paul Allin). The Wellbeing of Nations: Meaning, Motive and Measurement. Wiley. ISBN   978-1-118-48957-4
  13. 2020. (with Paul Allin) From GDP to Sustainable Wellbeing: Changing Statistics or Changing Lives? Palgrave Macmillan, ISBN   978-3030530846
  14. Hand, D. J.; Henley, W. E. (1997). "Statistical Classification Methods in Consumer Credit Scoring: A Review". Journal of the Royal Statistical Society. Series A (Statistics in Society). 160 (3): 523–541. doi:10.1111/j.1467-985X.1997.00078.x. JSTOR   2983268. S2CID   18547380.
  15. Hand, David J.; Blunt, Gordon; Kelly, Mark G.; Adams, Niall M. (2000). "Data Mining for Fun and Profit". Statistical Science. 15 (2): 111–126. JSTOR   2676725.
  16. Hand, David J.; Yu, Keming (2001). "Idiot's Bayes: Not So Stupid after All?". International Statistical Review / Revue Internationale de Statistique. 69 (3): 385–398. doi:10.2307/1403452. JSTOR   1403452.
  17. Bolton, Richard J.; Hand, David J. (2002). "Statistical Fraud Detection: A Review". Statistical Science. 17 (3). doi: 10.1214/ss/1042727940 .
  18. Hand, David J. (2006). "Classifier Technology and the Illusion of Progress". Statistical Science. 21. doi: 10.1214/088342306000000060 . S2CID   16325617.
  19. with Ross Quinlan, Qiang Yang, Philip S. Yu and Zhou Zhihua et al.. Knowledge and Information Systems 14.1: 1-37 doi : 10.1007/s10115-007-0114-2
  20. Hand, David J. (2009). "Measuring classifier performance: A coherent alternative to the area under the ROC curve". Machine Learning. 77: 103–123. doi: 10.1007/s10994-009-5119-5 . hdl: 10044/1/18420 . S2CID   207211591.
  21. Hand, David J. (2018). "Statistical challenges of administrative and transaction data". Journal of the Royal Statistical Society, Series A (Statistics in Society). 181 (3): 555–605. doi: 10.1111/rssa.12315 . hdl: 10044/1/61527 . S2CID   126301517.
  22. "No. 60367". The London Gazette (Supplement). 29 December 2012. p. 11.
  23. "New Year Honours List 2013 - General List" (PDF). Cabinet Office. Retrieved 29 December 2012.
  24. "Appointments to the Board of the UK Statistics Authority | Imperial News | Imperial College London". Imperial News. Retrieved 7 June 2019.