Spectrum bias

Last updated

In biostatistics, spectrum bias refers to the phenomenon that the performance of a diagnostic test may vary in different clinical settings because each setting has a different mix of patients. [1] Because the performance may be dependent on the mix of patients, performance at one clinic may not be predictive of performance at another clinic. [2] These differences are interpreted as a kind of bias. Mathematically, the spectrum bias is a sampling bias and not a traditional statistical bias; this has led some authors to refer to the phenomenon as spectrum effects, [3] whilst others maintain it is a bias if the true performance of the test differs from that which is 'expected'. [2] Usually the performance of a diagnostic test is measured in terms of its sensitivity and specificity and it is changes in these that are considered when referring to spectrum bias. However, other performance measures such as the likelihood ratios may also be affected by spectrum bias. [2]

Generally spectrum bias is considered to have three causes. [2] The first is due to a change in the case-mix of those patients with the target disorder (disease) and this affects the sensitivity. The second is due to a change in the case-mix of those without the target disorder (disease-free) and this affects the specificity. The third is due to a change in the prevalence, and this affects both the sensitivity and specificity. [4] This final cause is not widely appreciated, but there is mounting empirical evidence [4] [5] as well as theoretical arguments [6] which suggest that it does indeed affect a test's performance.

Examples where the sensitivity and specificity change between different sub-groups of patients may be found with the carcinoembryonic antigen test [7] and urinary dipstick tests. [8]

Diagnostic test performances reported by some studies may be artificially overestimated if it is a case-control design where a healthy population ('fittest of the fit') is compared with a population with advanced disease ('sickest of the sick'); that is two extreme populations are compared, rather than typical healthy and diseased populations. [9]

If properly analyzed, recognition of heterogeneity of subgroups can lead to insights about the test's performance in varying populations. [3]

See also

Related Research Articles

Statistical bias, in the mathematical field of statistics, is a systematic tendency in which the methods used to gather data and generate statistics present an inaccurate, skewed or biased depiction of reality. Statistical bias exists in numerous stages of the data collection and analysis process, including: the source of the data, the methods used to collect the data, the estimator chosen, and the methods used to analyze the data. Data analysts can take various measures at each stage of the process to reduce the impact of statistical bias in their work. Understanding the source of statistical bias can help to assess whether the observed results are close to actuality. Issues of statistical bias has been argued to be closely linked to issues of statistical validity.

<span class="mw-page-title-main">Diagnosis of HIV/AIDS</span> Immunological test

HIV tests are used to detect the presence of the human immunodeficiency virus (HIV), the virus that causes acquired immunodeficiency syndrome (AIDS), in serum, saliva, or urine. Such tests may detect antibodies, antigens, or RNA.

<span class="mw-page-title-main">Physical examination</span> Process by which a medical professional investigates the body of a patient for signs of disease

In a physical examination, medical examination, or clinical examination, a medical practitioner examines a patient for any possible medical signs or symptoms of a medical condition. It generally consists of a series of questions about the patient's medical history followed by an examination based on the reported symptoms. Together, the medical history and the physical examination help to determine a diagnosis and devise the treatment plan. These data then become part of the medical record.

In medical or research imaging, an incidental imaging finding is an unanticipated finding which is not related to the original diagnostic inquiry. As with other types of incidental medical findings, they may represent a diagnostic, ethical, and philosophical dilemma because their significance is unclear. While some coincidental findings may lead to beneficial diagnoses, others may lead to overdiagnosis that results in unnecessary testing and treatment, sometimes called the "cascade effect".

Hypereosinophilic syndrome is a disease characterized by a persistently elevated eosinophil count in the blood for at least six months without any recognizable cause, with involvement of either the heart, nervous system, or bone marrow.

In evidence-based medicine, likelihood ratios are used for assessing the value of performing a diagnostic test. They use the sensitivity and specificity of the test to determine whether a test result usefully changes the probability that a condition exists. The first description of the use of likelihood ratios for decision rules was made at a symposium on information theory in 1954. In medicine, likelihood ratios were introduced between 1975 and 1980.

<span class="mw-page-title-main">Positive and negative predictive values</span> In biostatistics, proportion of true positive and true negative results

The positive and negative predictive values are the proportions of positive and negative results in statistics and diagnostic tests that are true positive and true negative results, respectively. The PPV and NPV describe the performance of a diagnostic test or other statistical measure. A high result can be interpreted as indicating the accuracy of such a statistic. The PPV and NPV are not intrinsic to the test ; they depend also on the prevalence. Both PPV and NPV can be derived using Bayes' theorem.

<span class="mw-page-title-main">Primary care physician</span> US term for medical professional providing first-line care

A primary care physician (PCP) is a physician who provides both the first contact for a person with an undiagnosed health concern as well as continuing care of varied medical conditions, not limited by cause, organ system, or diagnosis. The term is primarily used in the United States. In the past, the equivalent term was 'general practitioner' in the US; however in the United Kingdom and other countries the term general practitioner is still used. With the advent of nurses as PCPs, the term PCP has also been expanded to denote primary care providers.

Transudate is extravascular fluid with low protein content and a low specific gravity. It has low nucleated cell counts and the primary cell types are mononuclear cells: macrophages, lymphocytes and mesothelial cells. For instance, an ultrafiltrate of blood plasma is transudate. It results from increased fluid pressures or diminished colloid oncotic forces in the plasma.

The McMurray test, also known as the McMurray circumduction test is used to evaluate individuals for tears in the meniscus of the knee. A tear in the meniscus may cause a pedunculated tag of the meniscus which may become jammed between the joint surfaces.

<span class="mw-page-title-main">Sensitivity and specificity</span> Statistical measures of the performance of a binary classification test

In medicine and statistics, sensitivity and specificity mathematically describe the accuracy of a test that reports the presence or absence of a medical condition. If individuals who have the condition are considered "positive" and those who do not are considered "negative", then sensitivity is a measure of how well a test can identify true positives and specificity is a measure of how well a test can identify true negatives:

<span class="mw-page-title-main">Stool guaiac test</span> Test for the presence for occult blood

The stool guaiac test or guaiac fecal occult blood test (gFOBT) is one of several methods that detects the presence of fecal occult blood. The test involves placing a fecal sample on guaiac paper and applying hydrogen peroxide which, in the presence of blood, yields a blue reaction product within seconds.

Allen Caruthers Steere is an American rheumatologist. He is a professor of rheumatology at Harvard University and previously at Tufts University and Yale University. Steere and his mentor, Stephen Malawista of Yale University, are credited with discovering and naming Lyme disease, and he has published almost 300 scholarly articles on Lyme disease during his more than 40 years of studies of this infection. At a ceremony in Hartford, Connecticut in 1998, Governor John G. Rowland declared September 24 to be "Allen C. Steere Day."

<span class="mw-page-title-main">Medical test</span> Medical procedure

A medical test is a medical procedure performed to detect, diagnose, or monitor diseases, disease processes, susceptibility, or to determine a course of treatment. Medical tests such as, physical and visual exams, diagnostic imaging, genetic testing, chemical and cellular analysis, relating to clinical chemistry and molecular diagnostics, are typically performed in a medical setting.

A clinical prediction rule or clinical probability assessment specifies how to use medical signs, symptoms, and other findings to estimate the probability of a specific disease or clinical outcome.

Malignant pleural effusion is a condition in which cancer causes an abnormal amount of fluid to collect between the thin layers of tissue (pleura) lining the outside of the lung and the wall of the chest cavity. Lung cancer and breast cancer account for about 50-65% of malignant pleural effusions. Other common causes include pleural mesothelioma and lymphoma.

<span class="mw-page-title-main">George Canellos</span> American oncologist and cancer researcher

George P. Canellos is an American oncologist and cancer researcher. His research career spans many decades, as well as several areas of therapeutic agents for the treatment of malignant diseases. He is perhaps most known for his work with Vincent T. DeVita in which he developed the combination chemotherapy CMF, which was one of the first combination therapies for breast cancer. The two also collaborated to create the MOPP regimen for Hodgkin's lymphoma.

<span class="mw-page-title-main">Anti–citrullinated protein antibody</span> Autoantibodies

Anti-citrullinated protein antibodies (ACPAs) are autoantibodies that are directed against peptides and proteins that are citrullinated. They are present in the majority of patients with rheumatoid arthritis. Clinically, cyclic citrullinated peptides (CCP) are frequently used to detect these antibodies in patient serum or plasma.

A rectovaginal examination is a type of gynecological examination used to supplement a pelvic examination. In the rectovaginal examination, a doctor or other health care provider places one finger in the vagina and another in the rectum to assess the rectovaginal septum. The examiner will look for any scarring or masses that may indicate cancer or another disease. Typically, a rectovaginal examination is performed to assess pelvic pain, rectal symptoms, or a pelvic mass. It can also provide a sample for fecal occult blood testing.

Delirium is a common and serious problem, particularly impacting older adults during hospitalization, acute illness, ICU stay, or surgery. Created in 1990 by Dr. Sharon Inouye, the Confusion Assessment Method (CAM) rapidly became among the most widely used tools for identification of delirium, since it provided a quick, accurate, and standardized approach.

References

  1. Ransohoff DF, Feinstein AR (1978). "Problems of spectrum and bias in evaluating the efficacy of diagnostic tests". N. Engl. J. Med. 299 (17): 926–30. doi:10.1056/NEJM197810262991705. PMID   692598.
  2. 1 2 3 4 Willis BH (2008). "Spectrum bias why clinicians need to be cautious when applying diagnostic test studies". Family Practice. 25 (5): 390–96. doi: 10.1093/fampra/cmn051 . PMID   18765409.
  3. 1 2 Mulherin SA, Miller WC (2002). "Spectrum bias or spectrum effect? Subgroup variation in diagnostic test evaluation" (PDF). Ann. Intern. Med. 137 (7): 598–602. doi:10.7326/0003-4819-137-7-200210010-00011. PMID   12353947. S2CID   35752032.
  4. 1 2 Willis, BH (2012). "Evidence that disease prevalence may affect the performance of diagnostic tests with an implicit threshold: a cross sectional study". BMJ Open . 2 (1): e000746. doi:10.1136/bmjopen-2011-000746. PMC   3274715 . PMID   22307105. Open Access logo PLoS transparent.svg
  5. Leeflang MM, Bossuyt PM, Irwig L., Diagnostic test accuracy may vary with prevalence: implications for evidence-based diagnosis, J Clin Epidemiol. 2009 Jan;62(1) 5–12.
  6. Goehring C, Perrier A, Morabia A (2004). "Spectrum bias: a quantitative and graphical analysis of the variability of medical diagnostic test performance". Statistics in Medicine. 23 (1): 125–35. doi:10.1002/sim.1591. PMID   14695644. S2CID   24636826.
  7. Fletcher RH (1986). "Carcinoembryonic antigen". Ann. Intern. Med. 104 (1): 66–73. doi:10.7326/0003-4819-104-1-66. PMID   3510056.
  8. Lachs MS, Nachamkin I, Edelstein PH, Goldman J, Feinstein AR, Schwartz JS (1992). "Spectrum bias in the evaluation of diagnostic tests: lessons from the rapid dipstick test for urinary tract infection". Ann. Intern. Med. 117 (2): 135–40. doi:10.7326/0003-4819-117-2-135. PMID   1605428. S2CID   25381473.
  9. Rutjes AWS, Reitsma JB, Vandenbroucke JP, Glas AS, Bossuyt PMM, Case-control and two-gate designs in diagnostic accuracy studies, Clin Chem 2005;51(8):1335–41.