Metaculus

Last updated
Metaculus Inc.
Metaculus front page.png
Metaculus front page
Type of business Benefit corporation
Available inEnglish
Founded2015;9 years ago (2015)
Headquarters Santa Cruz, California, United States
Area servedWorldwide
Founder(s)
CEODeger Turan
Employees
  • 25 (2023)
URL metaculus.com
RegistrationOptional
Current statusActive

Metaculus is an American reputation-based, massive online prediction solicitation and aggregation engine. [1] One of the focuses of Metaculus is predicting the timing, nature and impact of scientific and technological advances and breakthroughs. [2] [3]

Contents

Reward system

Three types of predictions can be made: probability predictions to binary questions that resolve as either 'yes' or 'no', numerical-range predictions, and date-range predictions. [2] Users can contribute to the community prediction for any given question, leave comments and discuss prediction strategies with other users. [4] Users can suggest new questions which, after moderation, will be opened to the community. [4]

Users can earn points for successful predictions (or lose points for unsuccessful predictions), and track their own predictive progress. [4] The scoring awards points both for being right and for being more right than the community. [5]

In January 2020, Metaculus introduced the Bentham Prize, which awards bi-weekly monetary prizes of $300, $200 and $100 to the first, second and third most valuable user contributions. [6] The following month, Metaculus introduced the Li Wenliang prize, which awards a number of different monetary prizes to questions, forecasts and analyses related to the COVID-19 outbreak. [7]

History

Data scientist Max Wainwright and physicists Greg Laughlin and Anthony Aguirre launched the site in 2015. [2] [4] In June 2017, the Metaculus Prediction was launched, which is a system for aggregating user predictions. [8] The Metaculus Prediction, on average, outperforms the median of the community's predictions when evaluated using the Brier or Log scoring rules. [9]

In 2021, Metaculus received an Effective altruism infrastructure fund grant worth $300k. [10] In 2022, Metaculus received a $5.5m grant from Open Philanthropy. [11] In October 2022, Metaculus received $20k funding from the FTX future fund, 3 weeks before the bankruptcy of FTX. [12]

In 2022 the organization announced it reached 1,000,000 individual predictions, and that it was restructured as a public-benefit corporation, it is committed to the following goals, its new charter compels it to rapport annually on its progress in achieving these goals: [13]

  1. Fostering the growth, learning, and development of the forecasting and forecasting research communities.
  2. Supporting stakeholders who are serving the public good by informing their decision making.
  3. Increasing public access to information regarding forecasts of public interest.

In 2024 Metaculus announced it would open source access to its platform, but it has not done so yet. [14]

See also

Related Research Articles

<span class="mw-page-title-main">Future</span> Time after the present

The future is the time after the past and present. Its arrival is considered inevitable due to the existence of time and the laws of physics. Due to the apparent nature of reality and the unavoidability of the future, everything that currently exists and will exist can be categorized as either permanent, meaning that it will exist forever, or temporary, meaning that it will end. In the Occidental view, which uses a linear conception of time, the future is the portion of the projected timeline that is anticipated to occur. In special relativity, the future is considered absolute future, or the future light cone.

<span class="mw-page-title-main">Max Tegmark</span> Swedish-American cosmologist

Max Erik Tegmark is a Swedish-American physicist, machine learning researcher and author. He is best known for his book Life 3.0 about what the world might look like as artificial intelligence continues to improve. Tegmark is a professor at the Massachusetts Institute of Technology and the president of the Future of Life Institute.

<span class="mw-page-title-main">Prediction</span> Statement about a future event

A prediction or forecast is a statement about a future event or about future data. Predictions are often, but not always, based upon experience or knowledge of forecasters. There is no universal agreement about the exact difference between "prediction" and "estimation"; different authors and disciplines ascribe different connotations.

Forecasting is the process of making predictions based on past and present data. Later these can be compared (resolved) against what happens. For example, a company might estimate their revenue in the next year, then compare it against the actual results creating a variance actual analysis. Prediction is a similar but more general term. Forecasting might refer to specific formal statistical methods employing time series, cross-sectional or longitudinal data, or alternatively to less formal judgmental methods or the process of prediction and resolution itself. Usage can vary between areas of application: for example, in hydrology the terms "forecast" and "forecasting" are sometimes reserved for estimates of values at certain specific future times, while the term "prediction" is used for more general estimates, such as the number of times floods will occur over a long period.

<span class="mw-page-title-main">National Weather Service</span> U.S. forecasting agency of the National Oceanic and Atmospheric Administration

The National Weather Service (NWS) is an agency of the United States federal government that is tasked with providing weather forecasts, warnings of hazardous weather, and other weather-related products to organizations and the public for the purposes of protection, safety, and general information. It is a part of the National Oceanic and Atmospheric Administration (NOAA) branch of the Department of Commerce, and is headquartered in Silver Spring, Maryland, within the Washington metropolitan area. The agency was known as the United States Weather Bureau from 1890 until it adopted its current name in 1970.

Prediction markets, also known as betting markets, information markets, decision markets, idea futures or event derivatives, are open markets that enable the prediction of specific outcomes using financial incentives. They are exchange-traded markets established for trading bets in the outcome of various events. The market prices can indicate what the crowd thinks the probability of the event is. A typical prediction market contract is set up to trade between 0 and 100%. The most common form of a prediction market is a binary option market, which will expire at the price of 0 or 100%. Prediction markets can be thought of as belonging to the more general concept of crowdsourcing which is specially designed to aggregate information on particular topics of interest. The main purposes of prediction markets are eliciting aggregating beliefs over an unknown future outcome. Traders with different beliefs trade on contracts whose payoffs are related to the unknown future outcome and the market prices of the contracts are considered as the aggregated belief.

<span class="mw-page-title-main">Futures studies</span> Study of postulating possible, probable, and preferable futures

Futures studies, futures research, futurism, or futurology is the systematic, interdisciplinary and holistic study of social/technological advancement, and other environmental trends; often for the purpose of exploring how people will live and work in the future. Predictive techniques, such as forecasting, can be applied, but contemporary futures studies scholars emphasize the importance of systematically exploring alternatives. In general, it can be considered as a branch of the social sciences and an extension to the field of history. Futures studies seeks to understand what is likely to continue and what could plausibly change. Part of the discipline thus seeks a systematic and pattern-based understanding of past and present, and to explore the possibility of future events and trends.

Affective forecasting, also known as hedonic forecasting or the hedonic forecasting mechanism, is the prediction of one's affect in the future. As a process that influences preferences, decisions, and behavior, affective forecasting is studied by both psychologists and economists, with broad applications.

Predictive analytics is a form of business analytics applying machine learning to generate a predictive model for certain business applications. As such, it encompasses a variety of statistical techniques from predictive modeling and machine learning that analyze current and historical facts to make predictions about future or otherwise unknown events. It represents a major subset of machine learning applications; in some contexts, it is synonymous with machine learning.

Effective altruism (EA) is a 21st-century philosophical and social movement that advocates "using evidence and reason to figure out how to benefit others as much as possible, and taking action on that basis". People who pursue the goals of effective altruism, sometimes called effective altruists, often donate to charities or choose careers with the aim of maximizing positive impact.

Earning to give involves deliberately pursuing a high-earning career for the purpose of donating a significant portion of earned income, typically because of a desire to do effective altruism. Advocates of earning to give contend that maximizing the amount one can donate to charity is an important consideration for individuals when deciding what career to pursue.

<span class="mw-page-title-main">William MacAskill</span> Scottish philosopher and ethicist (born 1987)

William David MacAskill is a Scottish philosopher and author, as well as one of the originators of the effective altruism movement. He was a Research Fellow at the Global Priorities Institute at the University of Oxford, co-founded Giving What We Can, the Centre for Effective Altruism and 80,000 Hours, and is the author of Doing Good Better (2015) and What We Owe the Future (2022), and the co-author of Moral Uncertainty (2020).

The Good Judgment Project (GJP) is an organization dedicated to "harnessing the wisdom of the crowd to forecast world events". It was co-created by Philip E. Tetlock, decision scientist Barbara Mellers, and Don Moore, all professors at the University of Pennsylvania.

<span class="mw-page-title-main">Unanimous A.I.</span> American technology company specializing in artificial swarm intelligence

Unanimous AI is an American technology company provides artificial swarm intelligence (ASI) technology. Unanimous AI provides a "human swarming" platform "swarm.ai" that allows distributed groups of users to collectively predict answers to questions. This process has resulted in successful predictions of major events such as the Kentucky Derby, the Oscars, the Stanley Cup, Presidential Elections, and the World Series.

Eva Love Vivalt is a Canadian economist. She is currently an Assistant Professor of Economics at the University of Toronto and the director of the Global Priorities Institute at the University of Oxford.

A superforecaster is a person who makes forecasts that can be shown by statistical means to have been consistently more accurate than the general public or experts. Superforecasters sometimes use modern analytical and statistical methodologies to augment estimates of base rates of events; research finds that such forecasters are typically more accurate than experts in the field who do not use analytical and statistical techniques. The term "superforecaster" is a trademark of Good Judgment Inc.

<span class="mw-page-title-main">Sam Bankman-Fried</span> American entrepreneur convicted of fraud (born 1992)

Samuel Benjamin Bankman-Fried, commonly known as SBF, is an American entrepreneur who was convicted of fraud and related crimes in November 2023. Bankman-Fried founded the FTX cryptocurrency exchange and was celebrated as a "poster boy" for crypto. At the peak of his net worth, he was ranked the 41st-richest American in the Forbes 400.

Caroline Ellison is an American former business executive and quantitative trader who was the CEO of Alameda Research, the trading firm affiliated with the cryptocurrency exchange FTX and founded by FTX founder Sam Bankman-Fried. In 2022, she pleaded guilty to fraud, money laundering, and conspiracy charges related to her role at Alameda Research.

The bankruptcy of FTX, a Bahamas-based cryptocurrency exchange, began in November 2022. The collapse of FTX, caused by a spike in customer withdrawals that exposed an $8 billion hole in FTX's accounts, served as the impetus for its bankruptcy. Prior to its collapse, FTX was the third-largest cryptocurrency exchange by volume and had over one million users.

<span class="mw-page-title-main">Manifold (prediction market)</span> Online reputation-based prediction market

Manifold, formerly known as Manifold Markets, is an online prediction market platform. Users engage in competitive forecasting using play money called 'mana'. Topics on Manifold have included the 2024 United States presidential election and the Oscars.

References

  1. Aguirre, Anthony (January 24, 2016). "Predicting the Future (of Life)". Future of Life Institute . Archived from the original on Mar 26, 2019. Retrieved March 16, 2019.
  2. 1 2 3 Mann, Adam (December 17, 2018). "The power of prediction markets". Nature . Retrieved March 16, 2019.
  3. Robitzski, Dan (2018-12-17). "This site keeps track of Elon Musk's predictions about the future". Futurism. Retrieved March 16, 2019.
  4. 1 2 3 4 Shelton, Jim (2016-11-02). "Metaculus: a prediction website with an eye on science and technology". YaleNews . Retrieved March 16, 2019.
  5. Metaculus, "FAQ".
  6. Besiroglu, Tamay (January 15, 2020). "The Bentham prize". Metaculus. Retrieved 22 January 2020.
  7. Besiroglu, Tamay (February 13, 2020). "The Li Wenliang prize series for forecasting the COVID-19 outbreak". Metaculus. Retrieved 15 February 2020.
  8. "What is the Metaculus Prediction?". Metaculus (FAQ). Archived from the original on 2022-11-10. Retrieved 2022-11-13. ... the Metaculus Prediction uses a sophisticated model to calibrate and weight each user
  9. Forecasting the Future: Can The Hive Mind Let Us Predict the Future?, in Futurism, published September 16th 2016, retrieved March 16, 2019
  10. "May-August 2021: EA Infrastructure Fund Grants". Effective Altruism Funds. Retrieved 2023-05-14.
  11. Metaculus (2022-07-28). "Metaculus Awarded $5.5M Grant to Advance Forecasting as a Public Good". Medium. Retrieved 2023-05-14.
  12. Metaculus (2022-10-12). "Metaculus Launches the 'Forecasting Our World In Data' Project to Probe the Long-Term Future". Medium. Retrieved 2023-05-14.
  13. "Becoming a Public Benefit Corporation, Hitting 1 Million Predictions, and Three New AI Forecasting Roles". www.metaculus.com. 2022-09-12. Retrieved 2024-07-14.
  14. "Open Sourcing Metaculus". www.metaculus.com. 2024-06-05. Retrieved 2024-07-14.