Role of chance in scientific discoveries

Original description of this image as published in a research article:

"We serendipitously imaged an intensely green fluorescent false moray (family Chlopsidae) eel while studying biofluorescent coral during a 2011 expedition to Little Cayman Island in the Caribbean Sea. To our knowledge, this marked the first time that a brightly green fluorescent vertebrate was imaged in its natural habitat."

The role of chance, or " luck ", in science comprises all ways in which unexpected discoveries are made.

Many domains, especially psychology, are concerned with the way science interacts with chance — particularly "serendipity" (accidents that, through sagacity, are transformed into opportunity). Psychologist Kevin Dunbar and colleagues estimate that between 30% and 50% of all scientific discoveries are accidental in some sense (see examples below). ^[2]

Psychologist Alan A. Baumeister says a scientist must be "sagacious" (attentive and clever) to benefit from an accident. ^[3] Dunbar quotes Louis Pasteur's saying that "Chance favors only the prepared mind". The prepared mind, Dunbar suggests, is one trained for observational rigor. Dunbar adds that there is a great deal of writing about the role that serendipity ("happy accidents") plays in the scientific method. ^{[2] [4] [5] [6]}

Research suggests that scientists are taught various heuristics and practices that allow their investigations to benefit, and not suffer, from accidents. ^{[2] [7]} First, careful control conditions allow scientists to properly identify something as "unexpected". Once a finding is recognized as legitimately unexpected and in need of explaining, researchers can attempt to explain it: They work across various disciplines, with various colleagues, trying various analogies in order to understand the first curious finding. ^[2]

Preparing to make discoveries

A model based on the work of Kevin Dunbar and Jonathan Fugelsang. The two say that the first step is to realize a result is unexpected and unexplained.

Accidental discoveries have been a topic of discussion especially from the 20th century onwards. Kevin Dunbar and Jonathan Fugelsang say that somewhere between 33% and 50% of all scientific discoveries are unexpected. This helps explain why scientists often call their discoveries "lucky", and yet scientists themselves may not be able to detail exactly what role luck played (see also introspection illusion). Dunbar and Fugelsang believe scientific discoveries are the result of carefully prepared experiments, but also "prepared minds". ^[2]

The author Nassim Nicholas Taleb calls science "anti-fragile". That is, science can actually use — and benefit from — the chaos of the real world. While some methods of investigation are fragile in the face of human error and randomness, the scientific method relies on randomness in many ways. Taleb believes that the more anti-fragile the system, the more it will flourish in the real world. ^{[8] [9]} According to M. K. Stoskopf, it is in this way that serendipity is often the "foundation for important intellectual leaps of understanding" in science. ^[10]

The word "Serendipity" is frequently understood as simply "a happy accident", but Horace Walpole used the word 'serendipity' to refer to a certain kind of happy accident: the kind that can only be exploited by a "sagacious" or clever person. ^{[10] [11]} Thus Dunbar and Fugelsang talk about, not just luck or chance in science, but specifically "serendipity" in science. ^[2]

Dunbar and Fugelsang suggest that the process of discovery often starts when a researcher finds bugs in their experiment. These unexpected results lead a researcher to self-doubt, and to try and fix what they think is an error in their own methodology. The first recourse is to explain the error using local hypotheses (e.g. analogies typical of the discipline). This process is also local in the sense that the scientist is relatively independent or else working with one partner. Eventually, the researcher decides that the error is too persistent and systematic to be a coincidence. Self-doubt is complete, and so the methods shift to become more broad: The researcher begins to think of theoretical explanations for the error, sometimes seeking the help of colleagues across different domains of expertise. The highly controlled, cautious, curious and even social aspects of the scientific method are what make it well suited for identifying persistent systematic errors (anomalies). ^{[2] [7]}

Albert Hofmann, the Swiss chemist who discovered LSD's psychedelic properties when he tried ingesting it at his lab, wrote

It is true that my discovery of LSD was a chance discovery, but it was the outcome of planned experiments and these experiments took place in the framework of systematic pharmaceutical, chemical research. It could better be described as serendipity. ^[12]

Dunbar and colleagues cite the discoveries of Hofmann and others as having involved serendipity. In contrast, the mind can be "prepared" in ways that obstruct serendipity — making new knowledge difficult or impossible to take in. Psychologist Alan A. Baumeister describes at least one such instance: Researcher Robert Heath failed to recognize evidence of "pleasure brain circuits" (in the septal nuclei). When Heath stimulated the brains of his schizophrenic patients, some of them reported feeling pleasure — a finding that Heath could have explored. Heath, however, was "prepared" (based on prior beliefs) for patients to report alertness, and when other patients did, it was on the reports of alertness that Heath focused his investigations. Heath failed to realize he had seen something unexpected and unexplained. ^[3]

The brain

Fugelsang and Dunbar observe scientists while they work together in labs or analyze data, but they also use experimental settings and even neuroimaging. ^[2] fMRI investigation found that unexpected findings were associated with particular brain activity. Unexpected findings were found to activate the prefrontal cortex as well as the left hemisphere in general. This suggests that unexpected findings provoke more attention, and the brain applies more linguistic, conscious systems to help explain those findings. This supports the idea that scientists are using particular abilities that exist to some extent in all humans. ^{[2] [13]}

Absent sagacity, a chance observation of an important phenomenon will have no impact, and the observer may be denied historical attribution for the discovery.

Alan A. Baumeister ^[3]

On the other hand, Dunbar and Fugelsang say that an ingenious experimental design (and control conditions) may not be enough for the researcher to properly appreciate when a finding is "unexpected". Serendipitous discoveries often requires certain mental conditions in the investigator beyond rigor. For example, a scientist must know all about what is expected before they can be surprised, and this requires experience in the field. ^[2] Researchers also require the sagacity to know to invest in the most curious findings. ^[3]

Serendipitous discoveries

Main article: List of discoveries influenced by chance circumstances

Royston Roberts says that various discoveries required a degree of genius, but also some lucky element for that genius to act on. ^[14] Richard Gaughan writes that accidental discoveries result from the convergence of preparation, opportunity, and desire. ^[15]

An example of luck in science is when drugs under investigation become known for different, unexpected uses. This was the case for minoxidil (an antihypertensive vasodilator that was subsequently found to also slow hair loss and promote hair regrowth in some people) and for sildenafil (a medicine for pulmonary arterial hypertension, now familiar as "Viagra", used to treat erectile dysfunction).

The hallucinogenic effects of lysergic acid diethylamide (LSD) were discovered by Albert Hofmann, who was originally working with the substance to try and treat migraines and bleeding after childbirth. Hofmann experienced mental distortions and suspected it may have been the effects of LSD. He decided to test this hypothesis on himself by taking what he thought was "an extremely small quantity": 250 micrograms. For comparison, a typical dose of LSD for recreational use in the modern day is 50 micrograms. Hofmann's description of what he experienced as a result of taking so much LSD is regarded by Royston Roberts as "one of the most frightening accounts in recorded medical history". ^[14]

See also

• Belief in luck
• Discovery (observation)
• List of multiple discoveries
• Multiple discovery

References

1. David F Gruber; Jean P Gaffney; Shaadi Mehr; Rob DeSalle; John S Sparks; Jelena Platisa; Vincent A Pieribone (2015). "Adaptive Evolution of Eel Fluorescent Proteins from Fatty Acid Binding Proteins Produces Bright Fluorescence in the Marine Environment". PLOS One . 10 (11): e0140972. Bibcode:2015PLoSO..1040972G. doi: 10.1371/JOURNAL.PONE.0140972 . ISSN   1932-6203. PMC   4641735 . PMID   26561348. Wikidata   Q24810539.
2. Dunbar, Kevin N; Fugelsang, Jonathan A (2004-10-27). "Causal thinking in science: How scientists and students interpret the unexpected". In Gorman, Michael E.; Tweney, Ryan D.; Gooding, David C.; Kincannon, Alexandra P. (eds.). Scientific and Technological Thinking. Psychology Press. p. 57-79. ISBN   978-1-4106-1131-4.
3. Baumeister, Alan A. (2006). "Serendipity and the Cerebral Localization of Pleasure". Journal of the History of the Neurosciences. 15 (2): 92–98. doi:10.1080/09647040500274879. ISSN   0964-704X. PMID   16608738. S2CID   9170432.
4. Darden, Lindley (2002). "Strategies for Discovering Mechanisms: Schema Instantiation, Modular Subassembly, Forward/Backward Chaining". Philosophy of Science. 69 (S3). Cambridge University Press (CUP): S354–S365. doi:10.1086/341858. ISSN   0031-8248. S2CID   62134473.
5. Thagard, P. (2000). How Scientists Explain Disease. Book collections on Project MUSE. Princeton University Press. ISBN   978-0-691-05083-6.
6. Kulkarni, Deepak; Simon, Herbert A. (1988). "The Processes of Scientific Discovery: The Strategy of Experimentation". Cognitive Science. 12 (2). Wiley: 139–175. doi: 10.1207/s15516709cog1202_1 . ISSN   0364-0213. S2CID   6294288.
7. Oliver, Jack E. (1991-12-31). "Chapter 2". The Incomplete Guide to the Art of Discovery. Columbia University Press. doi:10.7312/oliv91558. hdl:1813/83. ISBN   978-0-231-88432-7.
8. Taleb, Nassim Nicholas. "Antifragility — or— The Property Of Disorder-Loving Systems". edge.org. Archived from the original on 2013-05-07.
9. Taleb, Nassim Nicholas (2010) [2007-04-17]. The Black Swan (Second Edition: The Impact of the Highly Improbable: With a New Section: On Robustness and Fragility ed.). New York. N.Y: Random House. ISBN   978-1-4000-6351-2.
10. Stoskopf, M. K. (2005-01-01). "Observation and Cogitation: How Serendipity Provides the Building Blocks of Scientific Discovery". ILAR Journal. 46 (4): 332–337. doi: 10.1093/ilar.46.4.332 . ISSN   1084-2020. PMID   16179740.
11. Merton, Robert K.; Barber, Elinor (2004) [1958]. The Travels and Adventures of Serendipity: A Study in Sociological Semantics and the Sociology of Science . Princeton University Press. ISBN   0691117543.
12. "Stanislav Grof interviews Dr. Albert Hofmann, 1984" (PDF). Maps Bulletin. 11 (2). Big Sur: Esalen Institute. Fall 2001.
13. Gazzaniga, M. S. (2000-07-01). "Cerebral specialization and interhemispheric communication: Does the corpus callosum enable the human condition?". Brain. 123 (7): 1293–1326. doi: 10.1093/brain/123.7.1293 . PMID   10869045.
14. Roberts, Royston M. (1991-01-16). Serendipity: Accidental Discoveries in Science. New York Chichester Brisbane...[etc.]: Wiley. ISBN   0-471-60203-5.
15. Gaughan, Richard (2010). Accidental Genius: The World's Greatest By-Chance Discoveries . Metro Books. ISBN   978-1-4351-2557-5.