Best linear unbiased prediction

In statistics, best linear unbiased prediction (BLUP) is used in linear mixed models for the estimation of random effects. BLUP was derived by Charles Roy Henderson in 1950 but the term "best linear unbiased predictor" (or "prediction") seems not to have been used until 1962. ^[1] "Best linear unbiased predictions" (BLUPs) of random effects are similar to best linear unbiased estimates (BLUEs) (see Gauss–Markov theorem) of fixed effects. The distinction arises because it is conventional to talk about estimating fixed effects but about predicting random effects, but the two terms are otherwise equivalent. (This is a bit strange since the random effects have already been "realized"; they already exist. The use of the term "prediction" may be because in the field of animal breeding in which Henderson worked, the random effects were usually genetic merit, which could be used to predict the quality of offspring (Robinson ^[1] page 28)). However, the equations for the "fixed" effects and for the random effects are different.

In practice, it is often the case that the parameters associated with the random effect(s) term(s) are unknown; these parameters are the variances of the random effects and residuals. Typically the parameters are estimated and plugged into the predictor, leading to the empirical best linear unbiased predictor (EBLUP). Notice that by simply plugging in the estimated parameter into the predictor, additional variability is unaccounted for, leading to overly optimistic prediction variances for the EBLUP.^{[ citation needed ]}

Best linear unbiased predictions are similar to empirical Bayes estimates of random effects in linear mixed models, except that in the latter case, where weights depend on unknown values of components of variance, these unknown variances are replaced by sample-based estimates.

Example

Suppose that the model for observations {Y_j ; j = 1, ..., n} is written as

${\displaystyle Y_{j}=\mu +x_{j}^{T}\beta +\xi _{j}+\varepsilon _{j},\,}$

where ${\displaystyle \mu }$ is the mean of all observations ${\displaystyle Y}$, and ξ_j and ε_j represent the random effect and observation error for observation j, and suppose they are uncorrelated and have known variances σ_ξ² and σ_ε², respectively. Further, x_j is a vector of independent variables for the jth observation and ${\displaystyle \beta }$ is a vector of regression parameters.

The BLUP problem of providing an estimate of the observation-error-free value for the kth observation,

${\displaystyle {\widetilde {Y}}_{k}=\mu +x_{k}^{T}\beta +\xi _{k},}$

can be formulated as requiring that the coefficients of a linear predictor, defined as

${\displaystyle {\widehat {Y}}_{k}=\sum _{j=1}^{n}c_{j,k}Y_{j},}$

should be chosen so as to minimise the variance of the prediction error,

${\displaystyle V=\operatorname {Var} ({\widetilde {Y}}_{k}-{\widehat {Y}}_{k}),}$

subject to the condition that the predictor is unbiased,

${\displaystyle \operatorname {E} ({\widetilde {Y}}_{k}-{\widehat {Y}}_{k})=0.}$

BLUP vs BLUE

In contrast to the case of best linear unbiased estimation, the "quantity to be estimated", ${\displaystyle {\widetilde {Y}}_{k}}$, not only has a contribution from a random element but one of the observed quantities, specifically ${\displaystyle Y_{k}}$ which contributes to ${\displaystyle {\widehat {Y}}_{k}}$, also has a contribution from this same random element.

In contrast to BLUE, BLUP takes into account known or estimated variances. ^[2]

History of BLUP in breeding

Henderson explored breeding from a statistical point of view. His work assisted the development of the selection index (SI) and estimated breeding value (EBV). These statistical methods influenced the artificial insemination stud rankings used in the United States. These early statistical methods are confused with the BLUP now common in livestock breeding.

The actual term BLUP originated out of work at the University of Guelph in Canada by Daniel Sorensen and Brian Kennedy, in which they extended Henderson's results to a model that includes several cycles of selection. ^[3] This model was popularized by the University of Guelph in the dairy industry under the name BLUP. Further work by the University showed BLUP's superiority over EBV and SI leading to it becoming the primary genetic predictor^{[ citation needed ]}.

There is thus confusion between the BLUP model popularized above with the best linear unbiased prediction statistical method which was too theoretical for general use. The model was supplied for use on computers to farmers.

In Canada, all dairies report nationally. The genetics in Canada were shared making it the largest genetic pool and thus source of improvements. This and BLUP drove a rapid increase in Holstein cattle quality.

See also

• Kriging
• Minimum mean square error

Notes

1. Robinson, G.K. (1991). "That BLUP is a Good Thing: The Estimation of Random Effects". Statistical Science . 6 (1): 15–32. doi: 10.1214/ss/1177011926 . JSTOR   2245695. MR   1108815. Zbl   0955.62500.
2. Stanek, Edward J. III; Well, Arnold; Ockene, Ira (1999). "Why not routinely use best linear unbiased predictors (BLUPs) as estimates of cholesterol, per cent fat from kcal and physical activity?". Statistics in Medicine. 18 (21): 2943–2959. doi:10.1002/(sici)1097-0258(19991115)18:21<2943::aid-sim241>3.0.co;2-0. PMID   10523752.
3. Sorensen, D. A.; Kennedy, B. W. (1 May 1984). "Estimation of Response to Selection Using Least-Squares and Mixed Model Methodology". Journal of Animal Science. 58 (5): 1097–1106. doi:10.2527/jas1984.5851097x.

References

• Henderson, C.R. (1975). "Best linear unbiased estimation and prediction under a selection model". Biometrics . 31 (2): 423–447. doi:10.2307/2529430. JSTOR   2529430. PMID   1174616.
• Liu, Xu-Qing; Rong, Jian-Ying; Liu, Xiu-Ying (2008). "Best linear unbiased prediction for linear combinations in general mixed linear models". Journal of Multivariate Analysis . 99 (8): 1503–1517. doi:10.1016/j.jmva.2008.01.004.