Information hazard

Last updated

An information hazard, or infohazard, [1] is "a risk that arises from the dissemination of (true) information that may cause harm or enable some agent to cause harm," as defined by philosopher Nick Bostrom in 2011, or as defined in the concept of information sensitivity. It is an idea that contradicts the idea of freedom of information as it states that some types of information are too dangerous for every single person to have access to, as they could either be harmed by it or harm others. [2] This is sometimes why information is classified based on its sensitivity. One example would be instructions for creating a thermonuclear weapon. [3] Following these instructions could cause massive amounts of harm to others, therefore limiting who has access to this information is important in preventing harm to others.

Contents

Classification

According to Bostrom, there are two defined major categories of information hazard. The first is the "adversarial hazard" [3] which is where some information can be purposefully used by a bad actor to hurt others. The other category is where the harm is not purposeful, but is merely an unintended consequence that harms the person who learns it. [3]

Bostrom also proposes several subsets of these major categories, including the following types: [3]

In biotechnology

According to Bostrom, data hazards are of particular interest to the fields of biology and pathology. Knowledge of potentially dangerous strains of disease can cause widespread panic if picked up by media or third parties through fearmongering or improper analysis of disease outbreaks by untrained people. [5] Some experts in these fields want to improve the peer review process in order to avoid these issues by stopping the release of unverified information.

Additionally, the availability of information on DNA sequences of diseases or the chemical makeup of toxins could lead to adversarial hazards, as bad actors could use this information in order to recreate these biohazards on their own. [6]

In information security

According to Bostrom, the concept of information hazards is also relevant to information security. Many government, public, and private entities have information that could be classified as a data hazard that could harm others if leaked. This could be the result of an adversarial hazard or an idea hazard. To avoid this, many organizations implement security controls depending on their own needs or the needs laid out by regulatory bodies. [7]

An example of this Health Insurance Portability and Accountability Act which in part works to avoid the loss of information about medical patients in the United States which could result in adversarial hazards. Part of this act is designed to create a standardized means of concealing information that could be used to harm others by keeping the information available only to those who have to know it. [8]

In law

Willful blindness is an attempt to avoid obscuring or misleading a case by avoiding the idea that a fact is true if it cannot be proven from the knowledge. This is an attempt to avoid information hazards that could harm a legal case by putting false or assumed information in the mind of the jury. [9]

In literature

The idea of forbidden knowledge that can harm the person who knows it is found in many stories in the 16th and 17th centuries. In it, these stories imply or explicitly state that some knowledge is dangerous for the viewer or for others and is better left hidden. [10]

The idea of an information hazard overlaps with the idea of a harmful trend or social contagion. In it, knowledge of certain trends can result in their replication, such as in the case of certain viral trends that can be physically dangerous to those who attempt them. [11]

See also

Related Research Articles

<span class="mw-page-title-main">Risk management</span> Identification, evaluation and control of risks

Risk management is the identification, evaluation, and prioritization of risks, followed by the minimization, monitoring, and control of the impact or probability of those risks occurring.

The precautionary principle is a broad epistemological, philosophical and legal approach to innovations with potential for causing harm when extensive scientific knowledge on the matter is lacking. It emphasizes caution, pausing and review before leaping into new innovations that may prove disastrous. Critics argue that it is vague, self-cancelling, unscientific and an obstacle to progress.

In criminal law, mens rea is the mental state of a defendant who is accused of committing a crime. In common law jurisdictions, most crimes require proof both of mens rea and actus reus before the defendant can be found guilty.

In economics, a moral hazard is a situation where an economic actor has an incentive to increase its exposure to risk because it does not bear the full costs of that risk. For example, when a corporation is insured, it may take on higher risk knowing that its insurance will pay the associated costs. A moral hazard may occur where the actions of the risk-taking party change to the detriment of the cost-bearing party after a financial transaction has taken place.

<span class="mw-page-title-main">Risk assessment</span> Estimation of risk associated with exposure to a given set of hazards

Risk assessment determines possible mishaps, their likelihood and consequences, and the tolerances for such events. The results of this process may be expressed in a quantitative or qualitative fashion. Risk assessment is an inherent part of a broader risk management strategy to help reduce any potential risk-related consequences.

<span class="mw-page-title-main">Safety</span> State of being secure from harm, injury, danger, or other non-desirable outcomes

Safety is the state of being "safe", the condition of being protected from harm or other danger. Safety can also refer to the control of recognized hazards in order to achieve an acceptable level of risk.

<span class="mw-page-title-main">Nick Bostrom</span> Philosopher and writer (born 1973)

Nick Bostrom is a Swedish philosopher known for his work on existential risk, the anthropic principle, human enhancement ethics, whole brain emulation, superintelligence risks, and the reversal test. He was the founding director of the now dissolved Future of Humanity Institute at the University of Oxford and is now Principal Researcher at the Macrostrategy Research Initiative.

A superintelligence is a hypothetical agent that possesses intelligence surpassing that of the brightest and most gifted human minds. "Superintelligence" may also refer to a property of problem-solving systems whether or not these high-level intellectual competencies are embodied in agents that act in the world. A superintelligence may or may not be created by an intelligence explosion and associated with a technological singularity.

In criminal law, criminal negligence is an offence that involves a breach of an objective standard of behaviour expected of a defendant. It may be contrasted with strictly liable offences, which do not consider states of mind in determining criminal liability, or offenses that requires mens rea, a mental state of guilt.

<span class="mw-page-title-main">Human extinction</span> Hypothetical end of the human species

Human extinction is the hypothetical end of the human species, either by population decline due to extraneous natural causes, such as an asteroid impact or large-scale volcanism, or via anthropogenic destruction (self-extinction), for example by sub-replacement fertility.

<span class="mw-page-title-main">Duty of care</span> Type of legal obligation

In tort law, a duty of care is a legal obligation that is imposed on an individual, requiring adherence to a standard of reasonable care to avoid careless acts that could foreseeably harm others, and lead to claim in negligence. It is the first element that must be established to proceed with an action in negligence. The claimant must be able to show a duty of care imposed by law that the defendant has breached. In turn, breaching a duty may subject an individual to liability. The duty of care may be imposed by operation of law between individuals who have no current direct relationship but eventually become related in some manner, as defined by common law.

<span class="mw-page-title-main">Environmental hazard</span> Harmful substance, a condition or an event

Environmental hazards are those hazards that affect biomes or ecosystems. Well known examples include oil spills, water pollution, slash and burn deforestation, air pollution, ground fissures, and build-up of atmospheric carbon dioxide. Physical exposure to environmental hazards is usually involuntary

In criminal law and in the law of tort, recklessness may be defined as the state of mind where a person deliberately and unjustifiably pursues a course of action while consciously disregarding any risks flowing from such action. Recklessness is less culpable than malice, but is more blameworthy than carelessness.

<span class="mw-page-title-main">Future of Humanity Institute</span> Defunct Oxford interdisciplinary research centre

The Future of Humanity Institute (FHI) was an interdisciplinary research centre at the University of Oxford investigating big-picture questions about humanity and its prospects. It was founded in 2005 as part of the Faculty of Philosophy and the Oxford Martin School. Its director was philosopher Nick Bostrom, and its research staff included futurist Anders Sandberg and Giving What We Can founder Toby Ord.

In most common law jurisdictions, an element of a crime is one of a set of facts that must all be proven to convict a defendant of a crime. Before a court finds a defendant guilty of a criminal offense, the prosecution must present evidence that, even when opposed by any evidence the defense may choose, is credible and sufficient to prove beyond a reasonable doubt that the defendant committed each element of the particular crime charged. The component parts that make up any particular crime vary now depending on the crime.

<span class="mw-page-title-main">Hazard</span> Situation or object that can cause damage

A hazard is a potential source of harm. Substances, events, or circumstances can constitute hazards when their nature would potentially allow them to cause damage to health, life, property, or any other interest of value. The probability of that harm being realized in a specific incident, combined with the magnitude of potential harm, make up its risk. This term is often used synonymously in colloquial speech.

<span class="mw-page-title-main">Risk</span> Possibility of something bad happening

In simple terms, risk is the possibility of something bad happening. Risk involves uncertainty about the effects/implications of an activity with respect to something that humans value, often focusing on negative, undesirable consequences. Many different definitions have been proposed. One international standard definition of risk is the "effect of uncertainty on objectives".

In computer security, a threat is a potential negative action or event enabled by a vulnerability that results in an unwanted impact to a computer system or application.

Existential risk from AI refers to the idea that substantial progress in artificial general intelligence (AGI) could lead to human extinction or an irreversible global catastrophe.

<i>The Precipice: Existential Risk and the Future of Humanity</i> 2020 book about existential risks by Toby Ord

The Precipice: Existential Risk and the Future of Humanity is a 2020 non-fiction book by the Australian philosopher Toby Ord, a senior research fellow at the Future of Humanity Institute in Oxford. It argues that humanity faces unprecedented risks over the next few centuries and examines the moral significance of safeguarding humanity's future.

References

  1. Wortmann, Fletcher (28 August 2019). "Infohazard Warning: How Internal Memes Infect Your Brain". Psychology Today . Retrieved 14 May 2021.
  2. Bostrom, Nick (2011). "Information Hazards: A Typology of Potential Harms from Knowledge" (PDF). Review of Contemporary Philosophy . 10: 44–79.
  3. 1 2 3 4 5 6 7 Bostrom, Nick. "Information Hazards: A Typology of Potential Harms from Knowledge" (PDF). Review of Contemporary Philosophy. 10: 44–79.
  4. Levack, B.P (1987). The Witch-Hunt in Early Modern Europe.
  5. Esvelt, Kevin M. (2018-10-04). Coyne, Carolyn B. (ed.). "Inoculating science against potential pandemics and information hazards". PLOS Pathogens. 14 (10): e1007286. doi: 10.1371/journal.ppat.1007286 . ISSN   1553-7374. PMC   6171951 . PMID   30286188.
  6. Lewis, Gregory; Millett, Piers; Sandberg, Anders; Snyder-Beattie, Andrew; Gronvall, Gigi (May 2019). "Information Hazards in Biotechnology". Risk Analysis. 39 (5): 975–981. Bibcode:2019RiskA..39..975L. doi: 10.1111/risa.13235 . ISSN   0272-4332. PMC   6519142 . PMID   30419157.
  7. Force, Joint Task (2020-12-10). Security and Privacy Controls for Information Systems and Organizations (Report). National Institute of Standards and Technology.
  8. Edemekong, Peter F.; Annamaraju, Pavan; Haydel, Micelle J. (2023), "Health Insurance Portability and Accountability Act", StatPearls, Treasure Island (FL): StatPearls Publishing, PMID   29763195 , retrieved 2023-11-12
  9. Freeman, Jason B. (2020-07-29). "Willful Blindness and Corporate Liability". Freeman Law. Retrieved 2023-11-14.
  10. Ginzburg, Carlo (1976). "High and Low: The Theme of Forbidden Knowledge in the Sixteenth and Seventeenth Centuries". Past and Present (73): 28–41. doi:10.1093/past/73.1.28. ISSN   0031-2746.
  11. "Dangerous Social Media Challenges: Understanding Their Appeal to Kids". HealthyChildren.org. 9 April 2018. Retrieved 2023-11-14.