Proteus phenomenon

Last updated

The Proteus phenomenon is the tendency in science for early replications of a work to contradict the original findings, a consequence of publication bias. [1] It is akin to the winner's curse. [2]

The term was coined by John Ioannidis and Thomas A. Trikalinos in 2005 named after the Greek god Proteus who could rapidly change his appearance. [3] A 2013 paper argued that the phenomenon might be "desirable or even optimal" from a scientific standpoint. [4]

See also

Related Research Articles

In published academic research, publication bias occurs when the outcome of an experiment or research study biases the decision to publish or otherwise distribute it. Publishing only results that show a significant finding disturbs the balance of findings in favor of positive results. The study of publication bias is an important topic in metascience.

<span class="mw-page-title-main">Data dredging</span> Misuse of data analysis

Data dredging is the misuse of data analysis to find patterns in data that can be presented as statistically significant, thus dramatically increasing and understating the risk of false positives. This is done by performing many statistical tests on the data and only reporting those that come back with significant results.

<i>PLOS Medicine</i> Academic journal

PLOS Medicine is a peer-reviewed weekly medical journal covering the full spectrum of the medical sciences. It began operation on October 19, 2004, as the second journal of the Public Library of Science (PLOS), a non-profit open access publisher. All content in PLOS Medicine is published under the Creative Commons "by-attribution" license. To fund the journal, the publication's business model requires in most cases that authors pay publication fees. The journal was published online and in a printed format until 2005 and is now only published online. The journal's acting chief editor is Clare Stone, who replaced the previous chief editor, Larry Peiperl, in 2018.

"Publish or perish" is an aphorism describing the pressure to publish academic work in order to succeed in an academic career. Such institutional pressure is generally strongest at research universities. Some researchers have identified the publish or perish environment as a contributing factor to the replication crisis.

Open access citation advantage (OACA), sometimes known as FUTON bias, is a type of bias whereby scholars tend to cite academic journals with open access (OA)—that is, journals that make their full text available on the Internet without charge —in preference to toll-access publications. The concept was introduced, under the FUTON bias name, by UK medical researcher Reinhard Wentz in a letter to The Lancet in 2002.

Citation impact or citation rate is a measure of how many times an academic journal article or book or author is cited by other articles, books or authors. Citation counts are interpreted as measures of the impact or influence of academic work and have given rise to the field of bibliometrics or scientometrics, specializing in the study of patterns of academic impact through citation analysis. The importance of journals can be measured by the average citation rate, the ratio of number of citations to number articles published within a given time period and in a given index, such as the journal impact factor or the citescore. It is used by academic institutions in decisions about academic tenure, promotion and hiring, and hence also used by authors in deciding which journal to publish in. Citation-like measures are also used in other fields that do ranking, such as Google's PageRank algorithm, software metrics, college and university rankings, and business performance indicators.

<i>PLOS One</i> Peer-reviewed open-access scientific journal

PLOS One is a peer-reviewed open access mega journal published by the Public Library of Science (PLOS) since 2006. The journal covers primary research from any discipline within science and medicine. The Public Library of Science began in 2000 with an online petition initiative by Nobel Prize winner Harold Varmus, formerly director of the National Institutes of Health and at that time director of Memorial Sloan–Kettering Cancer Center; Patrick O. Brown, a biochemist at Stanford University; and Michael Eisen, a computational biologist at the University of California, Berkeley, and the Lawrence Berkeley National Laboratory.

<span class="mw-page-title-main">Paul J. Zak</span> American neuroeconomist

Paul J. Zak is an American neuroeconomist.

<span class="mw-page-title-main">John Ioannidis</span> American scientist (born 1965)

John P. A. Ioannidis is a Greek-American physician-scientist, writer and Stanford University professor who has made contributions to evidence-based medicine, epidemiology, and clinical research. Ioannidis studies scientific research itself, meta-research primarily in clinical medicine and the social sciences.

<span class="mw-page-title-main">SKF-83,959</span> Chemical compound

SKF-83,959 is a synthetic benzazepine derivative used in scientific research which acts as an agonist at the D1–D2 dopamine receptor heteromer. It behaves as a full agonist at the D1 protomer and a high-affinity partial agonist at the D2 protomer. It was further shown to act as an allosteric modulator of the sigma-1 receptor. SKF-83,959 additionally inhibits sodium channels as well as delayed rectifier potassium channels. SKF-83,959 is a racemate that consists of the R-(+)- and S-(−)-enantiomers MCL-202 and MCL-201, respectively.

<span class="mw-page-title-main">Why Most Published Research Findings Are False</span> 2005 essay written by John Ioannidis

"Why Most Published Research Findings Are False" is a 2005 essay written by John Ioannidis, a professor at the Stanford School of Medicine, and published in PLOS Medicine. It is considered foundational to the field of metascience.

<span class="mw-page-title-main">Criticism of science</span> Critical observation of science

Criticism of science addresses problems within science in order to improve science as a whole and its role in society. Criticisms come from philosophy, from social movements like feminism, and from within science itself.

The decline effect may occur when scientific claims receive decreasing support over time. The term was first described by parapsychologist Joseph Banks Rhine in the 1930s to describe the disappearing of extrasensory perception (ESP) of psychic experiments conducted by Rhine over the course of study or time. In its more general term, Cronbach, in his review article of science "Beyond the two disciplines of scientific psychology" referred to the phenomenon as "generalizations decay." The term was once again used in a 2010 article by Jonah Lehrer published in The New Yorker.

Culturomics is a form of computational lexicology that studies human behavior and cultural trends through the quantitative analysis of digitized texts. Researchers data mine large digital archives to investigate cultural phenomena reflected in language and word usage. The term is an American neologism first described in a 2010 Science article called Quantitative Analysis of Culture Using Millions of Digitized Books, co-authored by Harvard researchers Jean-Baptiste Michel and Erez Lieberman Aiden.

White hat bias (WHB) is a purported "bias leading to the distortion of information in the service of what may be perceived to be righteous ends", which consist of both cherry picking the evidence and publication bias. Public health researchers David Allison and Mark Cope first discussed this bias in a 2010 paper and explained the motivation behind it in terms of "righteous zeal, indignation toward certain aspects of industry", and other factors.

Scholarly peer review or academic peer review is the process of having a draft version of a researcher's methods and findings reviewed by experts in the same field. Peer review is widely used for helping the academic publisher decide whether the work should be accepted, considered acceptable with revisions, or rejected for official publication in an academic journal, a monograph or in the proceedings of an academic conference. If the identities of authors are not revealed to each other, the procedure is called dual-anonymous peer review.

<span class="mw-page-title-main">Replication crisis</span> Observed inability to reproduce scientific studies

The replication crisis is an ongoing methodological crisis in which the results of many scientific studies are difficult or impossible to reproduce. Because the reproducibility of empirical results is an essential part of the scientific method, such failures undermine the credibility of theories building on them and potentially call into question substantial parts of scientific knowledge.

Metascience is the use of scientific methodology to study science itself. Metascience seeks to increase the quality of scientific research while reducing inefficiency. It is also known as "research on research" and "the science of science", as it uses research methods to study how research is done and find where improvements can be made. Metascience concerns itself with all fields of research and has been described as "a bird's eye view of science". In the words of John Ioannidis, "Science is the best thing that has happened to human beings ... but we can do it better."

Aditya Bhushan Pant is an Indian toxicologist, neurobiologist and a scientist at the Indian Institute of Toxicology Research. He is known for his studies in the fields of developmental toxicology, in vitro experiments as well as pesticides and is a member of the Neurobiology Task force of the Department of Biotechnology. His studies have been documented by way of a number of articles and ResearchGate, an online repository of scientific articles has listed 121 of them. Besides, he has contributed chapters to books published by others and is an associate editor of the Annals of Neurosciences journal of the Indian Academy of Neurosciences. He is a recipient for the Shakuntala Amir Chand Prize of the Indian Council of Medical Research in 2007. The Department of Biotechnology of the Government of India awarded him the National Bioscience Award for Career Development, one of the highest Indian science awards, for his contributions to biosciences, in 2012.

Animal Study Registry is an online registry for the preregistration of research studies involving animals. Animal Study Registry was launched in January 2019 and can be used by scientists worldwide.

References

  1. Pfeiffer, Thomas; Bertram, Lars; Ioannidis, John (2011). "Quantifying selective reporting and the Proteus phenomenon for multiple datasets with similar bias". PLoS ONE . 6 (3): e18362. Bibcode:2011PLoSO...618362P. doi: 10.1371/journal.pone.0018362 . PMC   3066227 . PMID   21479240.
  2. Button, Katherine S.; et al. (2013). "Power failure: why small sample size undermines the reliability of neuroscience". Nature Reviews Neuroscience . 14 (5): 365–376. doi: 10.1038/nrn3475 . PMID   23571845.
  3. Ioannidis, JP; Trikalinos, TA (2005). "Early extreme contradictory estimates may appear in published research: The Proteus phenomenon in molecular genetics research and randomised trials". Journal of Clinical Epidemiology . 58 (6): 543–549. doi:10.1016/j.jclinepi.2004.10.019. PMID   15878467.
  4. de Winter, Joost; Happee, Riender (20 June 2013). "Why Selective Publication of Statistically Significant Results Can Be Effective". PLOS ONE. 8 (6): e66463. Bibcode:2013PLoSO...866463D. doi: 10.1371/journal.pone.0066463 . PMC   3688764 . PMID   23840479.