Black swan theory

Last updated

A black swan (Cygnus atratus) in Australia Black swan jan09.jpg
A black swan (Cygnus atratus) in Australia

The black swan theory or theory of black swan events is a metaphor that describes an event that comes as a surprise, has a major effect, and is often inappropriately rationalized after the fact with the benefit of hindsight. The term is based on an ancient Roman saying expressing the European presumption that black swans did not exist until Dutch mariners saw them in Australia in 1697, and the term was then reinterpreted to mean an unforeseen and consequential event. [1]

Contents

The theory was developed by Nassim Nicholas Taleb, starting in 2001, to explain:

  1. The disproportionate role of high-profile, hard-to-predict, and rare events that are beyond the realm of normal expectations in history, science, finance, and technology.
  2. The non-computability of the probability of consequential rare events using scientific methods (owing to the very nature of small probabilities).
  3. The psychological biases that blind people, both individually and collectively, to uncertainty and to the substantial role of rare events in historical affairs.

Taleb's "black swan theory" (which differs from the earlier philosophical versions of the problem) refers only to statistically unexpected events of large magnitude and consequence and their dominant role in history. Such events, considered extreme outliers, collectively play vastly larger roles than regular occurrences. [2] :xxi More technically, in the scientific monograph "Silent Risk", [3] Taleb mathematically defines the black swan problem as "stemming from the use of degenerate metaprobability". [3]

Background

The phrase "black swan" derives from a Latin expression; its oldest known occurrence is from the 2nd-century Roman poet Juvenal's characterization in his Satire VI of something being "rara avis in terris nigroque simillima cygno" ("a bird as rare upon the earth as a black swan"). [4] :165 [5] [6] When the phrase was coined, the black swan was presumed by Romans not to exist. [1] The importance of the metaphor lies in its analogy to the fragility of any system of thought. A set of conclusions is potentially undone once any of its fundamental postulates is disproved. In this case, the observation of a single black swan would be the undoing of the logic of any system of thought, as well as any reasoning that followed from that underlying logic.

Juvenal's phrase was a common expression in 16th century London as a statement of impossibility. [7] The London expression derives from the Old World presumption that all swans must be white because all historical records of swans reported that they had white feathers. [8] In that context, a black swan was impossible or at least nonexistent.

However, in 1697, Dutch explorers led by Willem de Vlamingh became the first Europeans to see black swans, in Western Australia. [1] The term subsequently metamorphosed to connote the idea that a perceived impossibility might later be disproved. Taleb notes that in the 19th century, John Stuart Mill used the black swan logical fallacy as a new term to identify falsification. [9]

Black swan events were discussed by Taleb in his 2001 book Fooled By Randomness , which concerned financial events. His 2007 book The Black Swan extended the metaphor to events outside financial markets. Taleb regards almost all major scientific discoveries, historical events, and artistic accomplishments as "black swans"—undirected and unpredicted. He gives the rise of the Internet, the personal computer, World War I, the dissolution of the Soviet Union, and the September 11, 2001 attacks as examples of black swan events. [2] :prologue

Taleb asserts: [10]

What we call here a Black Swan (and capitalize it) is an event with the following three attributes.

First, it is an outlier, as it lies outside the realm of regular expectations, because nothing in the past can convincingly point to its possibility. Second, it carries an extreme 'impact'. Third, in spite of its outlier status, human nature makes us concoct explanations for its occurrence after the fact, making it explainable and predictable.

I stop and summarize the triplet: rarity, extreme 'impact', and retrospective (though not prospective) predictability. A small number of Black Swans explains almost everything in our world, from the success of ideas and religions, to the dynamics of historical events, to elements of our own personal lives.

Identifying

Based on the author's criteria:

  1. The event is a surprise (to the observer).
  2. The event has a major effect.
  3. After the first recorded instance of the event, it is rationalized by hindsight, as if it could have been expected; that is, the relevant data were available but unaccounted for in risk mitigation programs. The same is true for the personal perception by individuals.

According to Taleb, the COVID-19 pandemic was not a black swan, as it was expected with great certainty that a global pandemic would eventually take place. [11] [12] Instead, it is considered a white swan—such an event has a major effect, but is compatible with statistical properties. [11] [12]

Coping with black swans

The practical aim of Taleb's book is not to attempt to predict events which are unpredictable, but to build robustness against negative events while still exploiting positive events. Taleb contends that banks and trading firms are very vulnerable to hazardous black swan events and are exposed to unpredictable losses. On the subject of business, and quantitative finance in particular, Taleb critiques the widespread use of the normal distribution model employed in financial engineering, calling it a Great Intellectual Fraud. Taleb elaborates the robustness concept as a central topic of his later book, Antifragile: Things That Gain From Disorder .

In the second edition of The Black Swan, Taleb provides "Ten Principles for a Black-Swan-Robust Society". [2] :374–78 [13]

Taleb states that a black swan event depends on the observer. For example, what may be a Black Swan surprise for a turkey is not a Black Swan surprise to its butcher; hence the objective should be to "avoid being the turkey" by identifying areas of vulnerability to "turn the Black Swans white". [14]

Epistemological approach

Taleb claims that his black swan is different from the earlier philosophical versions of the problem, specifically in epistemology (as associated with David Hume, John Stuart Mill, Karl Popper, and others), as it concerns a phenomenon with specific statistical properties which he calls, "the fourth quadrant". [15]

Taleb's problem is about epistemic limitations in some parts of the areas covered in decision making. These limitations are twofold: philosophical (mathematical) and empirical (human-known) epistemic biases. The philosophical problem is about the decrease in knowledge when it comes to rare events because these are not visible in past samples and therefore require a strong a priori (extrapolating) theory; accordingly, predictions of events depend more and more on theories when their probability is small. In the "fourth quadrant", knowledge is uncertain and consequences are large, requiring more robustness.[ citation needed ]

According to Taleb, thinkers who came before him who dealt with the notion of the improbable (such as Hume, Mill, and Popper) focused on the problem of induction in logic, specifically, that of drawing general conclusions from specific observations. [16] The central and unique attribute of Taleb's black swan event is that it is high-impact. His claim is that almost all consequential events in history come from the unexpected – yet humans later convince themselves that these events are explainable in hindsight.[ citation needed ]

One problem, labeled the ludic fallacy by Taleb, is the belief that the unstructured randomness found in life resembles the structured randomness found in games. This stems from the assumption that the unexpected may be predicted by extrapolating from variations in statistics based on past observations, especially when these statistics are presumed to represent samples from a normal distribution. These concerns often are highly relevant in financial markets, where major players sometimes assume normal distributions when using value at risk models, although market returns typically have fat tail distributions. [17]

Taleb said: [10]

I don't particularly care about the usual. If you want to get an idea of a friend's temperament, ethics, and personal elegance, you need to look at him under the tests of severe circumstances, not under the regular rosy glow of daily life. Can you assess the danger a criminal poses by examining only what he does on an ordinary day? Can we understand health without considering wild diseases and epidemics? Indeed the normal is often irrelevant. Almost everything in social life is produced by rare but consequential shocks and jumps; all the while almost everything studied about social life focuses on the 'normal,' particularly with 'bell curve' methods of inference that tell you close to nothing. Why? Because the bell curve ignores large deviations, cannot handle them, yet makes us confident that we have tamed uncertainty. Its nickname in this book is GIF, Great Intellectual Fraud.

More generally, decision theory, which is based on a fixed universe or a model of possible outcomes, ignores and minimizes the effect of events that are "outside the model". For instance, a simple model of daily stock market returns may include extreme moves such as Black Monday (1987), but might not model the breakdown of markets following the September 11, 2001 attacks. Consequently, the New York Stock Exchange and Nasdaq exchange remained closed till September 17, 2001, the most protracted shutdown since the Great Depression. [18] A fixed model considers the "known unknowns", but ignores the "unknown unknowns", made famous by a statement of Donald Rumsfeld. [19] The term "unknown unknowns" appeared in a 1982 New Yorker article on the aerospace industry, which cites the example of metal fatigue, the cause of crashes in Comet airliners in the 1950s. [20]

Deterministic chaotic dynamics reproducing the Black Swan Event have been researched in economics. [21] That is in agreement with Taleb's comment regarding some distributions which are not usable with precision, but which are more descriptive, such as the fractal, power law, or scalable distributions and that awareness of these might help to temper expectations. [22] Beyond this, Taleb emphasizes that many events simply are without precedent, undercutting the basis of this type of reasoning altogether.[ citation needed ]

Taleb also argues for the use of counterfactual reasoning when considering risk. [10] :p. xvii [23]

See also

Related Research Articles

<span class="mw-page-title-main">Value at risk</span> Estimated potential loss for an investment under a given set of conditions

Value at risk (VaR) is a measure of the risk of loss of investment/Capital. It estimates how much a set of investments might lose, given normal market conditions, in a set time period such as a day. VaR is typically used by firms and regulators in the financial industry to gauge the amount of assets needed to cover possible losses.

<i>The Logic of Scientific Discovery</i> 1959 book by Karl Popper

The Logic of Scientific Discovery is a 1959 book about the philosophy of science by the philosopher Karl Popper. Popper rewrote his book in English from the 1934 German original, titled Logik der Forschung. Zur Erkenntnistheorie der modernen Naturwissenschaft, which literally translates as, "Logic of Research: On the Epistemology of Modern Natural Science"'.

<span class="mw-page-title-main">Nassim Nicholas Taleb</span> Lebanese-American author (born 1960)

Nassim Nicholas Taleb is a Lebanese-American essayist, mathematical statistician, former option trader, risk analyst, and aphorist whose work concerns problems of randomness, probability, and uncertainty.

In economics, Knightian uncertainty is a lack of any quantifiable knowledge about some possible occurrence, as opposed to the presence of quantifiable risk. The concept acknowledges some fundamental degree of ignorance, a limit to knowledge, and an essential unpredictability of future events.

In a view of the future, a wild card is a low-probability, large-effect event. This concept may be introduced into anticipatory decision-making activity in order to increase the ability of organizations and governments to adapt to surprises arising in turbulent (business) environments. Such sudden and unique incidents might constitute turning points in the evolution of a certain trend or system. Wild cards may or may not be announced by weak signals, which are incomplete and fragmented data from which foresight information might be inferred.

A fat-tailed distribution is a probability distribution that exhibits a large skewness or kurtosis, relative to that of either a normal distribution or an exponential distribution. In common usage, the terms fat-tailed and heavy-tailed are sometimes synonymous; fat-tailed is sometimes also defined as a subset of heavy-tailed. Different research communities favor one or the other largely for historical reasons, and may have differences in the precise definition of either.

Financial risk modeling is the use of formal mathematical and econometric techniques to measure, monitor and control the market risk, credit risk, and operational risk on a firm's balance sheet, on a bank's trading book, or re a fund manager's portfolio value; see Financial risk management. Risk modeling is one of many subtasks within the broader area of financial modeling.

Black swan is the common name for Cygnus atratus, an Australasian waterfowl.

In statistics and decision theory, kurtosis risk is the risk that results when a statistical model assumes the normal distribution, but is applied to observations that have a tendency to occasionally be much farther from the average than is expected for a normal distribution.

The RiskMetrics variance model was first established in 1989, when Sir Dennis Weatherstone, the new chairman of J.P. Morgan, asked for a daily report measuring and explaining the risks of his firm. Nearly four years later in 1992, J.P. Morgan launched the RiskMetrics methodology to the marketplace, making the substantive research and analysis that satisfied Sir Dennis Weatherstone's request freely available to all market participants.

<i>The Black Swan: The Impact of the Highly Improbable</i> 2007 book by Nassim Nicholas Taleb

The Black Swan: The Impact of the Highly Improbable is a 2007 book by Nassim Nicholas Taleb, who is a former options trader. The book focuses on the extreme impact of rare and unpredictable outlier events—and the human tendency to find simplistic explanations for these events, retrospectively. Taleb calls this the Black Swan theory.

The ludic fallacy, proposed by Nassim Nicholas Taleb in his book The Black Swan (2007), is "the misuse of games to model real-life situations". Taleb explains the fallacy as "basing studies of chance on the narrow world of games and dice". The adjective ludic originates from the Latin noun ludus, meaning "play, game, sport, pastime".

<span class="mw-page-title-main">68–95–99.7 rule</span> Shorthand used in statistics

In statistics, the 68–95–99.7 rule, also known as the empirical rule, is a shorthand used to remember the percentage of values that lie within an interval estimate in a normal distribution: 68%, 95%, and 99.7% of the values lie within one, two, and three standard deviations of the mean, respectively.

<span class="mw-page-title-main">Taleb distribution</span> Type of probability distribution in economics

In economics and finance, a Taleb distribution is the statistical profile of an investment which normally provides a payoff of small positive returns, while carrying a small but significant risk of catastrophic losses. The term was coined by journalist Martin Wolf and economist John Kay to describe investments with a "high probability of a modest gain and a low probability of huge losses in any period."

Tail risk, sometimes called "fat tail risk," is the financial risk of an asset or portfolio of assets moving more than three standard deviations from its current price, above the risk of a normal distribution. Tail risks include low-probability events arising at both ends of a normal distribution curve, also known as tail events. However, as investors are generally more concerned with unexpected losses rather than gains, a debate about tail risk is focused on the left tail. Prudent asset managers are typically cautious with the tail involving losses which could damage or ruin portfolios, and not the beneficial tail of outsized gains.

Extreme risks are risks of very bad outcomes or "high consequence", but of low probability. They include the risks of terrorist attack, biosecurity risks such as the invasion of pests, and extreme natural disasters such as major earthquakes.

Mathematical finance, also known as quantitative finance and financial mathematics, is a field of applied mathematics, concerned with mathematical modeling of financial markets.

The Lindy effect is a theorized phenomenon by which the future life expectancy of some non-perishable things, like a technology or an idea, is proportional to their current age. Thus, the Lindy effect proposes the longer a period something has survived to exist or be used in the present, the longer its remaining life expectancy. Longevity implies a resistance to change, obsolescence, or competition, and greater odds of continued existence into the future. Where the Lindy effect applies, mortality rate decreases with time. Mathematically, the Lindy effect corresponds to lifetimes following a Pareto probability distribution.

<span class="mw-page-title-main">Dragon king theory</span> Event that is both extremely large in effect and of unique origins

Dragon king is a double metaphor for an event that is both extremely large in size or effect and born of unique origins relative to its peers. DK events are generated by or correspond to mechanisms such as positive feedback, tipping points, bifurcations, and phase transitions, that tend to occur in nonlinear and complex systems, and serve to amplify Dragon king events to extreme levels. By understanding and monitoring these dynamics, some predictability of such events may be obtained.

Skin in the Game: Hidden Asymmetries in Daily Life is a 2018 nonfiction book by Nassim Nicholas Taleb, a former options trader with a background in the mathematics of probability and statistics.

References

  1. 1 2 3 Haworth, David (10 June 2021). "Friday essay: a rare bird — how Europeans got the black swan so wrong". theconversation.com. Retrieved 28 March 2024.
  2. 1 2 3 Taleb, Nassim Nicholas (2010) [2007]. The Black Swan: The Impact of the Highly Improbable (2nd ed.). London: Penguin. ISBN   978-0-14103459-1 . Retrieved 25 April 2020.
  3. 1 2 Taleb, Nassim Nicholas (2015), Doing Statistics Under Fat Tails: The Program , retrieved 20 January 2016
  4. Puhvel, Jaan (Summer 1984). "The Origin of Etruscan tusna ("Swan")". The American Journal of Philology. 105 (2). Johns Hopkins University Press: 209–212. doi:10.2307/294875. JSTOR   294875.
  5. Juvenal; Persius; Ramsay, George Gilbert. "Satire 6". Satires. WikiSource. Retrieved 23 April 2020. 'Do you say no worthy wife is to be found among all these crowds?' Well, let her be handsome, charming, rich and fertile; let her have ancient ancestors ranged about her halls; let her be more chaste than the dishevelled Sabine maidens who stopped the war—a prodigy as rare upon the earth as a black swan!
  6. Iuvenalis; Bucheler. "Liber II Satura VI". Saturae (in Latin). WikiSource. Retrieved 23 April 2020. 'nullane de tantis gregibus tibi digna uidetur?' sit formonsa, decens, diues, fecunda, uetustos porticibus disponat auos, intactior omni crinibus effusis bellum dirimente Sabina, rara auis in terris nigroque simillima cycno
  7. "Black swan". forexglossary.com. Archived from the original on 9 November 2022. Retrieved 22 September 2021.
  8. Taleb, Nassim Nicholas. "Opacity". fooledbyrandomness.com. Retrieved 20 January 2016.
  9. Hammond, Peter (October 2009), "Adapting to the entirely unpredictable: black swans, fat tails, aberrant events, and hubristic models", WERI Bulletin, no. 1, UK: Warwick, retrieved 20 January 2016
  10. 1 2 3 Taleb, Nassim Nicholas (22 April 2007). "The Black Swan: Chapter 1: The Impact of the Highly Improbable". The New York Times. Retrieved 20 January 2016.
  11. 1 2 "The Pandemic Isn't a Black Swan but a Portent of a More Fragile Global System". The New Yorker . 21 April 2020.
  12. 1 2 Taleb, Nassim Nicholas (25 March 2020). "Corporate Socialism: The Government is Bailing Out Investors & Managers Not You". medium.com.
  13. Taleb, Nassim Nicholas (7 April 2009), Ten Principles for a Black Swan Robust World (PDF), Fooled by randomness, retrieved 20 January 2016
  14. Webb, Allen (December 2008). "Taking improbable events seriously: An interview with the author of The Black Swan (Corporate Finance)" (PDF). McKinsey Quarterly. McKinsey. p. 3. Archived from the original (Interview; PDF) on 7 September 2012. Retrieved 23 May 2012. Taleb: In fact, I tried in The Black Swan to turn a lot of black swans white! That's why I kept going on and on against financial theories, financial-risk managers, and people who do quantitative finance.
  15. Taleb (2008)
  16. Taleb, Nassim Nicholas (April 2007). The Black Swan: The Impact of the Highly Improbable (1st ed.). London: Penguin. p. 400. ISBN   978-1-84614045-7 . Retrieved 23 May 2012.
  17. Trevir Nath, "Fat Tail Risk: What It Means and Why You Should Be Aware Of It", NASDAQ, 2015
  18. Palka A Chopra, "All You Need to Know About Trading During a Black Swan Event", mastertrust, 2020
  19. "Transcript". www.defense.gov. Archived from the original on 3 September 2014.
  20. Newhouse, J. (14 June 1982), "A reporter at large: a sporty game: i-betting the company", The New Yorker, pp. 48–105
  21. Orlando, Giuseppe; Zimatore, Giovanna (14 August 2020). "Business cycle modeling between financial crises and black swans: Ornstein–Uhlenbeck stochastic process vs Kaldor deterministic chaotic model". Chaos: An Interdisciplinary Journal of Nonlinear Science. 30 (8): 083129. Bibcode:2020Chaos..30h3129O. doi:10.1063/5.0015916. ISSN   1054-1500. PMID   32872798. S2CID   235909725.
  22. Gelman, Andrew (April 2007). "Nassim Taleb's "The Black Swan"". Statistical Modeling, Causal Inference, and Social Science. Columbia University. Retrieved 23 May 2012.
  23. Gangahar, Anuj (16 April 2008). "Market Risk: Mispriced risk tests market faith in a prized formula". The Financial Times. New York. Archived from the original on 20 April 2008. Retrieved 23 May 2012.

Bibliography