Woozle effect

Last updated

Piglet and Pooh go in circles hunting a Woozle--but the tracks they follow are merely their own. Winnie-the-Pooh 51.png
Piglet and Pooh go in circles hunting a Woozle—but the tracks they follow are merely their own.

The Woozle effect, also known as evidence by citation, [1] occurs when a source is widely cited for a claim that the source does not adequately support, giving said claim undeserved credibility. If results are not replicated and no one notices that a key claim was never well-supported in its original publication, faulty assumptions may affect further research.

Contents

The Woozle effect is somewhat similar to circular reporting in journalism, where someone makes a questionable claim, and a journalist unthinkingly accepts the claim and republishes it without realizing its dubious and unreliable origins. In turn, other journalists and the public then continue to repeat and duplicate the unsupported claim.

Origin and definition

A Woozle is an imaginary character in the A. A. Milne book Winnie-the-Pooh , published in 1926. In chapter three, "In which Pooh and Piglet Go Hunting and Nearly Catch a Woozle", Winnie-the-Pooh and Piglet start following tracks left in snow believing they are the tracks of an imaginary animal called a woozle . The tracks keep multiplying until Christopher Robin explains to them that they have been following their own tracks in circles around a spinney. [2]

Prior to the introduction of the specific term "Woozle effect", the underlying concept dates back over 60 years. Bevan (1953), writing about scientific methodology and research errors in the field of psychology, uses the term "scientific woozle hunters". [3] Wohlwill (1963) refers to a "hunt for the woozle" in social science research, [4] and Stevens (1971) cautions readers about woozles in the study of a misquoted letter. [5]

The term "woozle effect" was coined by Beverly D. Houghton in 1979 [6] [7] [8] during a panel discussion, in order: "...to critique the burgeoning belief in a myth/archetype [of] the batterer emerging from the [then] virtually nonexistent literature and the popular press." [9] More recently she described the effect as "reification-by-accretion". [10] Other researchers have attributed the term to Richard Gelles (1980), [11] and to Gelles and Murray A. Straus (1988). [12] [13] Gelles and Straus argue that the woozle effect describes a pattern of bias seen within social sciences and which is identified as leading to multiple errors in individual and public perception, academia, policy making, and government. A woozle is also a claim, made about research, that is not supported by original findings. [14] According to Donald G. Dutton, a woozle effect, or a woozle, occurs when frequent citation of previous publications that lack evidence misleads individuals, groups and the public into thinking or believing there is evidence, and non-facts become urban myths and factoids. [15] The creation of woozles is often linked to the changing of language from qualified ("it may", "it might", "it could") to absolute form ("it is"), firming up language and introducing ideas and views not held by an original author or supported by evidence. [16]

Dutton sees the woozle effect as an example of confirmation bias and links it to belief perseverance and groupthink. [17] Because in the social sciences empirical evidence may be based on experiential reports rather than objective measurements, there may be a tendency for researchers to align evidence with expectation. According to Dutton, it is also possible that the social sciences may be likely to align with contemporary views and ideals of social justice, leading to bias in favor of those ideals. [18] Gambrill (2012) links the woozle effect to the processes that create pseudoscience. [19] Gambrill and Reiman (2011) also link it with more deliberate propaganda techniques; they also identify introductory phrases like "Every one knows ...", "It is clear that ...", "It is obvious that ...", "It is generally agreed that ..." as alarm bells that what follows might be a Woozle line of reasoning. [20]

Examples

In 1980, Gelles [21] illustrated the Woozle effect, showing how work by Gelles (1974) based on a small sample and published in The Violent Home [22] by Straus, who had written the foreword for Gelles's book, was presented as if it applied to a large sample. [23] [24] Both of these were then cited by Langley & Levy in their 1977 book, Wife Beating: The Silent Crisis. [25] In the 1998 book Intimate Violence, Gelles and Straus use the Winnie-the-Pooh woozle to illustrate how poor practice in research and self-referential research causes older research to be taken as fresh evidence causing error and bias. [15]

One notable example of the effect can be seen in citations of "Addiction Rare in Patients Treated with Narcotics", a letter to the editor by Jane Porter and Hershel Jick published by the New England Journal of Medicine in 1980. The letter, which was five sentences long and unlikely to have been peer reviewed according to a NEJM spokesperson, [26] reported findings from analysis of medical records regarding the use of pain medication for hospital patients and concluded that "despite widespread use of narcotic drugs in hospitals, the development of addiction is rare in medical patients with no history of addiction". [27] Although the study only concerned use of narcotics in hospital settings, over time it was increasingly cited to support claims that addiction to painkillers was similarly uncommon among patients prescribed narcotics to take at home. [26] The authors of a 2017 letter published in the NEJM concerning the original 1980 letter found 608 citations of Porter and Jick, with a "sizable increase" after the release of OxyContin in 1995: [28] Purdue Pharma, the manufacturers of OxyContin, cited the Porter and Jick study, as well as others, to argue that it carried a low risk of addiction. [29] In 2007, Purdue and three of the company's senior executives pleaded guilty to federal criminal charges that they had misled regulators, physicians and patients about the addiction risk associated with taking OxyContin. [28] The 1980 study was also misrepresented in both academic and non-academic publications: it was described as an "extensive study" by Scientific American , whilst Time said that it was a "landmark study" showing that "exaggerated fear that patients would become addicted" to opiates was "basically unwarranted", [26] and an article in the journal Seminars in Oncology claimed that the Porter and Jick study examined cancer patients when the letter made no mention of what illnesses the patients were suffering from. [30] The authors of the 2017 NEJM letter suggested that the inappropriate citations of the 1980 study played a role in the North American opioid epidemic by under-representing the risk of addiction: [28] the page for the Porter and Jick letter on the Journal's website now includes a note informing the reader that it "has been 'heavily and uncritically cited' as evidence that addiction is rare with opioid therapy". [27]

In a study conducted by the Vera Institute of Justice, Weiner and Hala (2008) reported some of the research-related difficulties associated with measuring human trafficking. [31] They describe and map the unfolding of the Woozle effect in connection with prevalence estimates of human trafficking. Searching the relevant literature between 1990 and 2006, Weiner and Hala found 114 prevalence estimates in 45 publications. Only one of the publications cited original research, and several prevalence estimates appeared unsourced. [31] The authors concluded that the sources they reviewed lacked citations, adequate operational definition, and discussion of methodology. [31] Stransky and Finkelhor (2008/2012) criticize the general methodology involved in human trafficking research. They cite the Woozle effect [32] and post a prominent warning on the first page of their report cautioning against citing any specific estimates they present, as the close inspection of the figures "...reveals that none are based on a strong scientific foundation." [33]

Gambrill and Reiman (2011) analyze scientific papers and mass-market communications about social anxiety and conclude that many of them engage in disease mongering by presenting the disease model of social anxiety as an incontrovertible fact by resorting to unchallenged repetition techniques and by leaving out of the discourse any competing theories. Gambrill and Reiman further note that even after educating their subjects about the tell-tale signs of such techniques, many of them still failed to pick up the signs in a practical test. [20]

Geraldine Hoff Doyle claimed to have been the inspiration for the "We Can Do It!" poster, achieving fame and honors when her statement - likely false - was repeated without confirmation. We Can Do It! NARA 535413 - Restoration 2.jpg
Geraldine Hoff Doyle claimed to have been the inspiration for the "We Can Do It!" poster, achieving fame and honors when her statement – likely false – was repeated without confirmation.

James J. Kimble gives as an example the 1994–2015 historiography of the 1943 American "We Can Do It!" wartime poster. After Michigan resident Geraldine Hoff Doyle said in 1994 that she was the real-life model for the poster, many sources repeated her assertion without checking the two foundational assumptions: that Doyle was the young factory worker pictured in a 1942 wartime photograph, and that the photograph had inspired commercial artist J. Howard Miller to create the poster. Though some media representations described the connection as unconfirmed, many more enthusiastically endorsed it. The weight of these multiple endorsements gave Doyle's story a "convincing" authority, despite the lack of authority in establishing the connection. In 2015, Kimble found the original photographic print of the factory worker, its caption identifying the young woman as Naomi Parker, working in California in March 1942, when Doyle was still in high school. [34]

See also

Related Research Articles

<span class="mw-page-title-main">Morphine</span> Pain medication of the opiate family

Morphine, formerly also called morphia, is an opiate that is found naturally in opium, a dark brown resin produced by drying the latex of opium poppies. It is mainly used as an analgesic. There are numerous methods used to administer morphine: oral; sublingual; via inhalation; injection into a muscle, injection under the skin, or injection into the spinal cord area; transdermal; or via rectal suppository. It acts directly on the central nervous system (CNS) to induce analgesia and alter perception and emotional response to pain. Physical and psychological dependence and tolerance may develop with repeated administration. It can be taken for both acute pain and chronic pain and is frequently used for pain from myocardial infarction, kidney stones, and during labor. Its maximum effect is reached after about 20 minutes when administered intravenously and 60 minutes when administered by mouth, while the duration of its effect is 3–7 hours. Long-acting formulations of morphine are available as MS-Contin, Kadian, and other brand names as well as generically.

<span class="mw-page-title-main">Oxycodone</span> Opioid medication

Oxycodone, sold under various brand names such as Roxicodone, Endone, and OxyContin, is a semi-synthetic opioid used medically for treatment of moderate to severe pain. It is highly addictive and is a commonly abused drug. It is usually taken by mouth, and is available in immediate-release and controlled-release formulations. Onset of pain relief typically begins within fifteen minutes and lasts for up to six hours with the immediate-release formulation. In the United Kingdom, it is available by injection. Combination products are also available with paracetamol (acetaminophen), ibuprofen, naloxone, naltrexone, and aspirin.

<span class="mw-page-title-main">Pain management</span> Interdisciplinary approach for easing pain

Pain management is an aspect of medicine and health care involving relief of pain in various dimensions, from acute and simple to chronic and challenging. Most physicians and other health professionals provide some pain control in the normal course of their practice, and for the more complex instances of pain, they also call on additional help from a specific medical specialty devoted to pain, which is called pain medicine.

<span class="mw-page-title-main">Opioid</span> Psychoactive chemical

Opioids are a class of drugs that derive from, or mimic, natural substances found in the opium poppy plant. Opioids work in the brain to produce a variety of effects, including pain relief. As a class of substances, they act on opioid receptors to produce morphine-like effects.

<span class="mw-page-title-main">Opioid use disorder</span> Medical condition

Opioid use disorder (OUD) is a substance use disorder characterized by cravings for opioids, continued use despite physical and/or psychological deterioration, increased tolerance with use, and withdrawal symptoms after discontinuing opioids. Opioid withdrawal symptoms include nausea, muscle aches, diarrhea, trouble sleeping, agitation, and a low mood. Addiction and dependence are important components of opioid use disorder.

<span class="mw-page-title-main">Buprenorphine</span> Opioid used to treat pain & opioid use disorder

Buprenorphine, sold under the brand name Subutex among others, is an opioid used to treat opioid use disorder, acute pain, and chronic pain. It can be used under the tongue (sublingual), in the cheek (buccal), by injection, as a skin patch (transdermal), or as an implant. For opioid use disorder, the patient must have moderate opioid withdrawal symptoms before buprenorphine can be administered under direct observation of a health-care provider.

<span class="mw-page-title-main">Naltrexone</span> Medication

Naltrexone, sold under the brand name Revia among others, is a medication primarily used to manage alcohol use or opioid use disorder by reducing cravings and feelings of euphoria associated with substance use disorder. It has also been found effective in the treatment of other addictions and may be used for them off-label. An opioid-dependent person should not receive naltrexone before detoxification. It is taken by mouth or by injection into a muscle. Effects begin within 30 minutes, though a decreased desire for opioids may take a few weeks to occur.

A methadone clinic is a medical facility where medications for opioid use disorder (MOUD) are dispensed-—historically and most commonly methadone, although buprenorphine is also increasingly prescribed. Medically assisted drug therapy treatment is indicated in patients who are opioid-dependent or have a history of opioid dependence. Methadone is a schedule II (USA) opioid analgesic, that is also prescribed for pain management. It is a long-acting opioid that can delay the opioid withdrawal symptoms that patients experience from taking short-acting opioids, like heroin, and allow time for withdrawal management. In the United States, by law, patients must receive methadone under the supervision of a physician, and dispensed through the Opioid Treatment Program (OTP) certified by the Substance Abuse and Mental Health Services Administration and registered with the Drug Enforcement Administration.

<span class="mw-page-title-main">Purdue Pharma</span> American pharmaceutical company (1892–2019 bankruptcy)

Purdue Pharma L.P., formerly the Purdue Frederick Company (1892–2019), was an American privately held pharmaceutical company founded by John Purdue Gray. It was sold to Arthur, Mortimer, and Raymond Sackler in 1952, and then owned principally by the Sackler family and their descendants.

<span class="mw-page-title-main">Nalfurafine</span> Antipruritic drug

Nalfurafine is an antipruritic that is marketed in Japan for the treatment of uremic pruritus in individuals with chronic kidney disease undergoing hemodialysis. It activates the κ-opioid receptor (KOR) and is potent, selective, and centrally active. It was the first selective KOR agonist approved for clinical use. It has also been dubiously referred to as the "first non-narcotic opioid drug" in history.

Domestic violence against men is violence or other physical abuse towards men in a domestic setting, such as in marriage or cohabitation. As with domestic violence against women, violence against men may constitute a crime, but laws vary between jurisdictions. Intimate partner violence (IPV) against men is generally less recognized by society than intimate partner violence against women, which can act as a further block to men reporting their situation or otherwise seeking help.

Undertreatment of pain is the absence of pain management therapy for a person in pain when treatment is indicated.

<span class="mw-page-title-main">Opioid epidemic in the United States</span> Ongoing overuse of opioid medication in the US

There is an ongoing opioid epidemic in the United States, originating out of both medical prescriptions and illegal sources. It has been called "one of the most devastating public health catastrophes of our time". The opioid epidemic unfolded in three waves. The first wave of the epidemic in the United States began in the late 1990s, according to the Centers for Disease Control and Prevention (CDC), when opioids were increasingly prescribed for pain management, resulting in a rise in overall opioid use throughout subsequent years. The second wave was from an expansion in the heroin market to supply already addicted people. The third wave starting in 2013 was marked by a steep 1,040% increase in the synthetic opioid-involved death rate as synthetic opioids flooded the US market.

"Addiction Rare in Patients Treated with Narcotics" is the title of a letter to the editor written by Jane Porter and Hershel Jick and published in the January 10, 1980, issue of The New England Journal of Medicine. The letter analyzed data on patients who had been treated with opioids in a hospital setting, and concluded that addiction was uncommon among such patients. It has since been frequently misrepresented to claim that opioids are not addictive when prescribed for use at home. This misrepresentation has been blamed for contributing to the opioid epidemic in the United States.

David Juurlink is a Canadian pharmacologist and internist. He is head of the Clinical Pharmacology and Toxicology division at Sunnybrook Health Sciences Centre in Toronto, Ontario, as well as a medical toxicologist at the Ontario Poison Centre and a scientist at the Institute for Clinical Evaluative Sciences. He is known for researching adverse effects caused by drug interactions, with some of this research funded by a New Investigator Award from the Canadian Institutes for Health Research. He has been very critical of his fellow physicians' regular prescribing of dangerous opioids like Tramadol and fentanyl. In June 2017, he published a letter analyzing citations to "Addiction Rare in Patients Treated with Narcotics", a 1980 letter in The New England Journal of Medicine that has often been cited to claim that opioids like OxyContin are rarely addictive.

Hershel M. Jick was an American medical researcher and associate professor of medicine at Boston University School of Medicine, where he was the director of the Boston Collaborative Drug Surveillance Program.

<span class="mw-page-title-main">Richard Sackler</span> American billionaire (born 1945)

Richard Stephen Sackler is an American businessman and physician who was the chairman and president of Purdue Pharma, a former company best known as the developer of OxyContin, whose initiation of the opioid epidemic in the United States became the subject of many lawsuits and fines, filing for bankruptcy in 2019. It has been claimed that Richard Sackler's Purdue is among "the worst drug dealers in history" and the Sackler family have been described as the "most evil family in America". The company's downfall was the subject of the 2021 Hulu miniseries Dopesick and the 2023 Netflix miniseries Painkiller, in which Sackler is portrayed by Michael Stuhlbarg and Matthew Broderick, respectively.

Massachusetts v. Purdue is a lawsuit filed on August 14, 2018, suing the Stamford, Connecticut-based company Purdue Pharma LP, which created and manufactures OxyContin, "one of the most widely used and prescribed opioid drugs on the market", and Purdue's owners, the Sacklers accusing them of "widespread fraud and deception in the marketing of opioids, and contributing to the opioid crisis, the nationwide epidemic that has killed thousands." Purdue denied the allegations.

<span class="mw-page-title-main">Timeline of the opioid epidemic</span>

The timeline of the opioid epidemic includes selected events related to the origins of Stamford, Connecticut-based Purdue Pharma, the Sackler family, the development and marketing of oxycodone, selected FDA activities related to the abuse and misuse of opioids, the recognition of the opioid epidemic, the social impact of the crisis, lawsuits against Purdue and the Sackler family.

<span class="mw-page-title-main">Mitragynine</span> Opioid analgesic compound

Mitragynine is an indole-based alkaloid and the most abundant active alkaloid in the Southeast Asian plant Mitragyna speciosa, commonly known as kratom. The total alkaloid concentration in dried leaves ranges from 0.5 to 1.5%. In Thai varieties, mitragynine is the most abundant component while 7-hydroxymitragynine is a minor constituent. In Malaysian kratom varieties, mitragynine is present at lower concentration. Such preparations are orally consumed and typically involve dried kratom leaves which are brewed into tea or ground and placed into capsules. Mitragynine consumption for medicinal and recreation purposes dates back centuries, although early use was primarily limited to Southeast Asian countries such as Indonesia and Thailand where the plant grows indigenously. Recently, mitragynine use has spread throughout Europe and the Americas as both a recreational and medicinal drug. While research into the effects of kratom have begun to emerge, investigations on the active compound mitragynine are less common.

References

  1. Straus, Murray A. (July 2010). "Thirty Years of Denying the Evidence on Gender Symmetry in Partner Violence: Implications for Prevention and Treatment". Partner Abuse. 1 (3): 332–362. doi:10.1891/1946-6560.1.3.332. ISSN   1946-6560. S2CID   73291235.
  2. Milne, A. A. (1926). "3". Winnie The Pooh (1st ed.). London: Methuen & Co Ltd. In Which Pooh and Piglet Go Hunting and Nearly Catch a Woozle
  3. Bevan, William (1953). Modern Psychologists: Scientific Woozle Hunters?: An Opinion in Outline. E. Munksgaard.
  4. Wohlwill, Joachim F. (1963). "Piaget's system as a source of empirical research". Merrill-Palmer Quarterly of Behavior and Development. 9 (4): 253–262. JSTOR   23082932.
  5. Stevens, Joan (1971). "Woozles in Brontëland: A cautionary tale". Studies in Bibliography. 24: 99–108. JSTOR   40371529.
  6. Houghton, Beverly D. (November 1979). Panel Presentation: Review of Research on Women Abuse. Annual meeting of the American Society of Criminology. Philadelphia.
  7. Gelles (1980).
  8. Malone, Jean; Tyree, Andrea; O'Leary, K. Daniel (August 1989). "Generalization and Containment: Different Effects of Past Aggression for Wives and Husbands". Journal of Marriage and Family. 51 (3): 687–697. doi:10.2307/352168. JSTOR   352168. Gelles (1980) suggested that the 'woozle' effect, first named by Houghton (1979), is operating in the cycle-of-violence area to magnify findings and to ignore peculiarities of sampling issues.
  9. Suss (2021), p. 86.
  10. Suss (2021), p. 25.
  11. Nilsen, Linda (2012). Father-Daughter Relationships: Contemporary Research and Issues. New York: Routledge Academic. p. 4. ISBN   978-1-84872-933-9.
  12. Dutton, Donald D.; Corvo, Kenneth (2006). "Transforming a flawed policy: A call to revive psychology and science in domestic violence research and practice". Aggression and Violent Behavior. 11 (5): 466. CiteSeerX   10.1.1.337.1019 . doi:10.1016/j.avb.2006.01.007.
  13. Ehrensaft, Miriam K. (2009). "Intimate partner violence: Persistence of myths and implications for intervention". Children and Youth Services Review. 30 (3): 279–286. doi:10.1016/j.childyouth.2007.10.005.
  14. Gelles & Straus (1988), p.  28.
  15. 1 2 Gelles & Straus (1988) , p.  39
  16. Dutton (2006), p. 28.
  17. Dutton (2006), p. 109.
  18. Dutton (2006), p. 110.
  19. Eileen Gambrill (2012). Critical Thinking in Clinical Practice: Improving the Quality of Judgments and Decisions (3rd ed.). John Wiley & Sons. p. 109. ISBN   978-0-470-90438-1.
  20. 1 2 Gambrill, E.; Reiman, A. (2011). "A Propaganda Index for Reviewing Problem Framing in Articles and Manuscripts: An Exploratory Study". PLoS ONE . 6 (5): e19516. Bibcode:2011PLoSO...619516G. doi: 10.1371/journal.pone.0019516 . PMC   3102054 . PMID   21647426.
  21. Gelles (1980), p. 880.
  22. Gelles (1974).
  23. Gelles (1974), pp. 13–17.
  24. Gelles (1980), "The 'Woozle Effect' begins when one investigator reports a finding, such as Gelles (1974) report...In the 'Woozle Effect,' a second investigator will then cite the first study's data, but without the qualifications (such as done by Straus, 1974a). Others will then cite both reports and the qualified data gain the status of generalizable 'truth.'"
  25. Roger Langley; Richard C. Levy (1977). Wife Beating: The Silent Crisis . Dutton. ISBN   978-0-87690-231-8.
  26. 1 2 3 Zhang, Sarah (2 June 2017). "The One-Paragraph Letter From 1980 That Fueled the Opioid Crisis". theatlantic.com . Retrieved 28 May 2020.
  27. 1 2 Porter, Jane; Jick, Hershel (1980). "Addiction Rare in Patients Treated with Narcotics". New England Journal of Medicine . 302 (2) (published 10 January 1980): 123. doi: 10.1056/NEJM198001103020221 . ISSN   1533-4406. PMID   7350425.
  28. 1 2 3 Leung, Pamela; Macdonald, Erin; Dhalla, Irfan; Juurlink, David (2017). "A 1980 Letter on the Risk of Opioid Addiction". New England Journal of Medicine . 376 (22) (published 1 June 2017): 2194–2195. doi: 10.1056/NEJMc1700150 . PMID   28564561.
  29. Van Zee, Art (February 2009). "The Promotion and Marketing of OxyContin: Commercial Triumph, Public Health Tragedy". American Journal of Public Health . 99 (2): 221–227. doi:10.2105/AJPH.2007.131714. PMC   2622774 . PMID   18799767.
  30. Kaplan, Karen (31 May 2017). "How a 5-sentence letter helped fuel the opioid addiction crisis". LATimes.com . Retrieved 28 May 2020.
  31. 1 2 3 Weiner, Neil A.; Hala, Nicole (2008). Measuring human trafficking: Lessons from New York City (PDF) (Report). Vera Institute of Justice . Retrieved 5 February 2014.
  32. Stransky & Finkelhor (2012), p. 3.
  33. Stransky & Finkelhor (2012), p. 1.
  34. Kimble, James J. (Summer 2016). "Rosie's Secret Identity, or, How to Debunk a Woozle by Walking Backward through the Forest of Visual Rhetoric". Rhetoric and Public Affairs. 19 (2): 245–274. doi:10.14321/rhetpublaffa.19.2.0245. ISSN   1094-8392. S2CID   147767111.

Sources