List of unsolved problems in statistics

Last updated April 06, 2022

There are many longstanding unsolved problems in mathematics for which a solution has still not yet been found. The notable unsolved problems in statistics are generally of a different flavor; according to John Tukey,^[1] "difficulties in identifying problems have delayed statistics far more than difficulties in solving problems." A list of "one or two open problems" (in fact 22 of them) was given by David Cox.^[2]

Inference and testing

How to detect and correct for systematic errors , especially in sciences where random errors are large (a situation Tukey termed uncomfortable science).
The Graybill–Deal estimator is often used to estimate the common mean of two normal populations with unknown and possibly unequal variances. Though this estimator is generally unbiased, its admissibility remains to be shown.^[3]
Meta-analysis : Though independent p-values can be combined using Fisher's method, techniques are still being developed to handle the case of dependent p-values.
Behrens–Fisher problem : Yuri Linnik showed in 1966 that there is no uniformly most powerful test for the difference of two means when the variances are unknown and possibly unequal. That is, there is no exact test (meaning that, if the means are in fact equal, one that rejects the null hypothesis with probability exactly α) that is also the most powerful for all values of the variances (which are thus nuisance parameters). Though there are many approximate solutions (such as Welch's t-test), the problem continues to attract attention^[4] as one of the classic problems in statistics.
Multiple comparisons : There are various ways to adjust p-values to compensate for the simultaneous or sequential testing of hypothesis. Of particular interest is how to simultaneously control the overall error rate, preserve statistical power, and incorporate the dependence between tests into the adjustment. These issues are especially relevant when the number of simultaneous tests can be very large, as is increasingly the case in the analysis of data from DNA microarrays.^{[ citation needed ]}
Bayesian statistics : A list of open problems in Bayesian statistics has been proposed.^[5]

Experimental design

As the theory of Latin squares is a cornerstone in the design of experiments, solving the problems in Latin squares could have immediate applicability to experimental design.^{[ citation needed ]}

Problems of a more philosophical nature

Sampling of species problem : How is a probability updated when there is unanticipated new data?^[6]
Doomsday argument : How valid is the probabilistic argument that claims to predict the future lifetime of the human race given only an estimate of the total number of humans born so far?
Exchange paradox : Issues arise within the subjectivistic interpretation of probability theory; more specifically within Bayesian decision theory.^{[ citation needed ]} This is still an open problem among the subjectivists as no consensus has been reached yet. Examples include:
- The two envelopes problem
- The necktie paradox
Sunrise problem : What is the probability that the sun will rise tomorrow? Very different answers arise depending on the methods used and assumptions made.

Notes

↑ Tukey, John W. (1954). "Unsolved Problems of Experimental Statistics". Journal of the American Statistical Association. 49 (268): 706–731. doi:10.2307/2281535. JSTOR 2281535.
↑ Cox, D. R. (1984). "Present Position and Potential Developments: Some Personal Views: Design of Experiments and Regression". Journal of the Royal Statistical Society. Series A (General). 147 (2): 306–315. doi:10.2307/2981685. JSTOR 2981685.
↑ Pal, Nabendu; Lim, Wooi K. (1997). "A note on second-order admissibility of the Graybill-Deal estimator of a common mean of several normal populations". Journal of Statistical Planning and Inference. 63: 71–78. doi:10.1016/S0378-3758(96)00202-9.
↑ Fraser, D.A.S.; Rousseau, J. (2008). "Studentization and deriving accurate p-values" (PDF). Biometrika. 95: 1–16. doi:10.1093/biomet/asm093.
↑ Jordan, M. I. (2011). "What are the open problems in Bayesian statistics?" (PDF). The ISBA Bulletin. 18 (1): 1–5.
↑ Zabell, S. L. (1992). "Predicting the unpredictable". Synthese. 90 (2): 205. doi:10.1007/bf00485351. S2CID 9416747.

Related Research Articles

In statistics, an estimator is a rule for calculating an estimate of a given quantity based on observed data: thus the rule, the quantity of interest and its result are distinguished. For example, the sample mean is a commonly used estimator of the population mean.

Statistics is the discipline that concerns the collection, organization, analysis, interpretation, and presentation of data. In applying statistics to a scientific, industrial, or social problem, it is conventional to begin with a statistical population or a statistical model to be studied. Populations can be diverse groups of people or objects such as "all people living in a country" or "every atom composing a crystal". Statistics deals with every aspect of data, including the planning of data collection in terms of the design of surveys and experiments.

A statistical hypothesis test is a method of statistical inference used to decide whether the data at hand sufficiently support a particular hypothesis.

In statistics, point estimation involves the use of sample data to calculate a single value which is to serve as a "best guess" or "best estimate" of an unknown population parameter. More formally, it is the application of a point estimator to the data to obtain a point estimate.

In mathematical statistics, the Fisher information is a way of measuring the amount of information that an observable random variable X carries about an unknown parameter θ of a distribution that models X. Formally, it is the variance of the score, or the expected value of the observed information. In Bayesian statistics, the asymptotic distribution of the posterior mode depends on the Fisher information and not on the prior. The role of the Fisher information in the asymptotic theory of maximum-likelihood estimation was emphasized by the statistician Ronald Fisher. The Fisher information is also used in the calculation of the Jeffreys prior, which is used in Bayesian statistics.

Estimation theory is a branch of statistics that deals with estimating the values of parameters based on measured empirical data that has a random component. The parameters describe an underlying physical setting in such a way that their value affects the distribution of the measured data. An estimator attempts to approximate the unknown parameters using the measurements. In estimation theory, two approaches are generally considered:

This glossary of statistics and probability is a list of definitions of terms and concepts used in the mathematical sciences of statistics and probability, their sub-disciplines, and related fields. For additional related terms, see Glossary of mathematics.

In statistics, the Behrens–Fisher problem, named after Walter Behrens and Ronald Fisher, is the problem of interval estimation and hypothesis testing concerning the difference between the means of two normally distributed populations when the variances of the two populations are not assumed to be equal, based on two independent samples.

In statistics, resampling is any of a variety of methods for doing one of the following:

Estimating the precision of sample statistics by using subsets of available data (jackknifing) or drawing randomly with replacement from a set of data points (bootstrapping)
Permutation tests are exact tests: Exchanging labels on data points when performing significance tests
Validating models by using random subsets

The James–Stein estimator is a biased estimator of the mean, $, of (possibly) correlated Gaussian distributed random vectors with unknown means .$

Bootstrapping is any test or metric that uses random sampling with replacement, and falls under the broader class of resampling methods. Bootstrapping assigns measures of accuracy to sample estimates. This technique allows estimation of the sampling distribution of almost any statistic using random sampling methods.

In estimation theory and decision theory, a Bayes estimator or a Bayes action is an estimator or decision rule that minimizes the posterior expected value of a loss function. Equivalently, it maximizes the posterior expectation of a utility function. An alternative way of formulating an estimator within Bayesian statistics is maximum a posteriori estimation.

In statistics, the bias of an estimator is the difference between this estimator's expected value and the true value of the parameter being estimated. An estimator or decision rule with zero bias is called unbiased. In statistics, "bias" is an objective property of an estimator. Bias can also be measured with respect to the median, rather than the mean, in which case one distinguishes median-unbiased from the usual mean-unbiasedness property. Bias is a distinct concept from consistency. Consistent estimators converge in probability to the true value of the parameter, but may be biased or unbiased; see bias versus consistency for more.

Tukey's range test, also known as Tukey's test, Tukey method, Tukey's honest significance test, or Tukey's HSDtest, is a single-step multiple comparison procedure and statistical test. It can be used to find means that are significantly different from each other.

In statistical theory, a U-statistic is a class of statistics that is especially important in estimation theory; the letter "U" stands for unbiased. In elementary statistics, U-statistics arise naturally in producing minimum-variance unbiased estimators.

Exact statistics, such as that described in exact test, is a branch of statistics that was developed to provide more accurate results pertaining to statistical testing and interval estimation by eliminating procedures based on asymptotic and approximate statistical methods. The main characteristic of exact methods is that statistical tests and confidence intervals are based on exact probability statements that are valid for any sample size.

In statistics, a generalized p-value is an extended version of the classical p-value, which except in a limited number of applications, provides only approximate solutions.

In the comparison of various statistical procedures, efficiency is a measure of quality of an estimator, of an experimental design, or of a hypothesis testing procedure. Essentially, a more efficient estimator, experiment, or test needs fewer observations than a less efficient one to achieve a given error performance. An efficient estimator is characterized by a small variance or mean square error, indicating that there is a small deviance between the estimated value and the "true" value.

References

Linnik, Jurii (1968). Statistical Problems with Nuisance Parameters. American Mathematical Society. ISBN 0-8218-1570-9.
Sawilowsky, Shlomo S. (2002). "Fermat, Schubert, Einstein, and Behrens–Fisher: The Probable Difference Between Two Means When σ₁ ≠ σ₂". Journal of Modern Applied Statistical Methods. 1 (2). doi: 10.22237/jmasm/1036109940 .

This page is based on this Wikipedia article
Text is available under the CC BY-SA 4.0 license; additional terms may apply.
Images, videos and audio are available under their respective licenses.

[1] Tukey, John W. (1954). "Unsolved Problems of Experimental Statistics". Journal of the American Statistical Association. 49 (268): 706–731. doi:10.2307/2281535. JSTOR 2281535.

[2] Cox, D. R. (1984). "Present Position and Potential Developments: Some Personal Views: Design of Experiments and Regression". Journal of the Royal Statistical Society. Series A (General). 147 (2): 306–315. doi:10.2307/2981685. JSTOR 2981685.

[3] Pal, Nabendu; Lim, Wooi K. (1997). "A note on second-order admissibility of the Graybill-Deal estimator of a common mean of several normal populations". Journal of Statistical Planning and Inference. 63: 71–78. doi:10.1016/S0378-3758(96)00202-9.

[4] Fraser, D.A.S.; Rousseau, J. (2008). "Studentization and deriving accurate p-values" (PDF). Biometrika. 95: 1–16. doi:10.1093/biomet/asm093.

[5] Jordan, M. I. (2011). "What are the open problems in Bayesian statistics?" (PDF). The ISBA Bulletin. 18 (1): 1–5.

[6] Zabell, S. L. (1992). "Predicting the unpredictable". Synthese. 90 (2): 205. doi:10.1007/bf00485351. S2CID 9416747.

[1]

[2]

[3]

[4]

[5]

[6]