Metaculus

Last updated
Metaculus Inc.
Metaculus front page.png
Metaculus front page
Type of business Private
Available inEnglish
Founded2015;9 years ago (2015)
Headquarters Santa Cruz, California, United States
Area servedWorldwide
Founder(s)
CEODeger Turan
Employees
  • 25 (2023)
URL metaculus.com
RegistrationOptional
Current statusActive

Metaculus is an American reputation-based, massive online prediction solicitation and aggregation engine. [1] One of the focuses of Metaculus is predicting the timing, nature and impact of scientific and technological advances and breakthroughs. [2] [3]

Contents

Reward system

Three types of predictions can be made: probability predictions to binary questions that resolve as either 'yes' or 'no', numerical-range predictions, and date-range predictions. [2] Users can contribute to the community prediction for any given question, leave comments and discuss prediction strategies with other users. [4] Users can suggest new questions which, after moderation, will be opened to the community. [4]

Users can earn points for successful predictions (or lose points for unsuccessful predictions), and track their own predictive progress. [4] The scoring awards points both for being right and for being more right than the community. [5]

In January 2020, Metaculus introduced the Bentham Prize, which awards bi-weekly monetary prizes of $300, $200 and $100 to the first, second and third most valuable user contributions. [6] The following month, Metaculus introduced the Li Wenliang prize, which awards a number of different monetary prizes to questions, forecasts and analyses related to the COVID-19 outbreak. [7]

History

Data scientist Max Wainwright and physicists Greg Laughlin and Anthony Aguirre launched the site in 2015. [2] [4]

In June 2017, the Metaculus Prediction was launched, which is a system for aggregating user predictions. [8] The Metaculus Prediction, on average, outperforms the median of the community's predictions when evaluated using the Brier or Log scoring rules. [9]

In 2021, Metaculus received an Effective altruism infrastructure fund grant worth $300k. [10] In 2022, Metaculus received a $5.5m grant from Open Philanthropy. [11] In October 2022, Metaculus received $20k funding from the FTX future fund, 3 weeks before the bankruptcy of FTX. [12]

See also

Related Research Articles

<span class="mw-page-title-main">Future</span> Time after the present

The future is the time after the past and present. Its arrival is considered inevitable due to the existence of time and the laws of physics. Due to the apparent nature of reality and the unavoidability of the future, everything that currently exists and will exist can be categorized as either permanent, meaning that it will exist forever, or temporary, meaning that it will end. In the Occidental view, which uses a linear conception of time, the future is the portion of the projected timeline that is anticipated to occur. In special relativity, the future is considered absolute future, or the future light cone.

<span class="mw-page-title-main">Max Tegmark</span> Swedish-American cosmologist

Max Erik Tegmark is a Swedish-American physicist, machine learning researcher and author. He is best known for his book Life 3.0 about what the world might look like as artificial intelligence continues to improve. Tegmark is a professor at the Massachusetts Institute of Technology and the president of the Future of Life Institute.

<span class="mw-page-title-main">Prediction</span> Statement about a future event

A prediction or forecast is a statement about a future event or about future data. Predictions are often, but not always, based upon experience or knowledge of forecasters. There is no universal agreement about the exact difference between "prediction" and "estimation"; different authors and disciplines ascribe different connotations.

Forecasting is the process of making predictions based on past and present data. Later these can be compared (resolved) against what happens. For example, a company might estimate their revenue in the next year, then compare it against the actual results creating a variance actual analysis. Prediction is a similar but more general term. Forecasting might refer to specific formal statistical methods employing time series, cross-sectional or longitudinal data, or alternatively to less formal judgmental methods or the process of prediction and resolution itself. Usage can vary between areas of application: for example, in hydrology the terms "forecast" and "forecasting" are sometimes reserved for estimates of values at certain specific future times, while the term "prediction" is used for more general estimates, such as the number of times floods will occur over a long period.

Prediction markets, also known as betting markets, information markets, decision markets, idea futures or event derivatives, are open markets that enable the prediction of specific outcomes using financial incentives. They are exchange-traded markets established for trading bets in the outcome of various events. The market prices can indicate what the crowd thinks the probability of the event is. A typical prediction market contract is set up to trade between 0 and 100%. The most common form of a prediction market is a binary option market, which will expire at the price of 0 or 100%. Prediction markets can be thought of as belonging to the more general concept of crowdsourcing which is specially designed to aggregate information on particular topics of interest. The main purposes of prediction markets are eliciting aggregating beliefs over an unknown future outcome. Traders with different beliefs trade on contracts whose payoffs are related to the unknown future outcome and the market prices of the contracts are considered as the aggregated belief.

Economic forecasting is the process of making predictions about the economy. Forecasts can be carried out at a high level of aggregation—for example for GDP, inflation, unemployment or the fiscal deficit—or at a more disaggregated level, for specific sectors of the economy or even specific firms. Economic forecasting is a measure to find out the future prosperity of a pattern of investment and is the key activity in economic analysis. Many institutions engage in economic forecasting: national governments, banks and central banks, consultants and private sector entities such as think-tanks, companies and international organizations such as the International Monetary Fund, World Bank and the OECD. A broad range of forecasts are collected and compiled by "Consensus Economics". Some forecasts are produced annually, but many are updated more frequently.

<span class="mw-page-title-main">Futures studies</span> Study of postulating possible, probable, and preferable futures

Futures studies, futures research, futurism, or futurology is the systematic, interdisciplinary and holistic study of social/technological advancement, and other environmental trends; often for the purpose of exploring how people will live and work in the future. Predictive techniques, such as forecasting, can be applied, but contemporary futures studies scholars emphasize the importance of systematically exploring alternatives. In general, it can be considered as a branch of the social sciences and an extension to the field of history. Futures studies seeks to understand what is likely to continue and what could plausibly change. Part of the discipline thus seeks a systematic and pattern-based understanding of past and present, and to explore the possibility of future events and trends.

<span class="mw-page-title-main">Rosetta@home</span> BOINC based volunteer computing project researching protein folding

Rosetta@home is a volunteer computing project researching protein structure prediction on the Berkeley Open Infrastructure for Network Computing (BOINC) platform, run by the Baker lab. Rosetta@home aims to predict protein–protein docking and design new proteins with the help of about fifty-five thousand active volunteered computers processing at over 487,946 GigaFLOPS on average as of September 19, 2020. Foldit, a Rosetta@home videogame, aims to reach these goals with a crowdsourcing approach. Though much of the project is oriented toward basic research to improve the accuracy and robustness of proteomics methods, Rosetta@home also does applied research on malaria, Alzheimer's disease, and other pathologies.

<i>LessWrong</i> Rationality-focused community blog

LessWrong is a community blog and forum focused on discussion of cognitive biases, philosophy, psychology, economics, rationality, and artificial intelligence, among other topics.

Effective altruism (EA) is a 21st-century philosophical and social movement that advocates "using evidence and reason to figure out how to benefit others as much as possible, and taking action on that basis". People who pursue the goals of effective altruism, sometimes called effective altruists, may choose careers based on the amount of good that they expect the career to achieve or donate to charities based on the goal of maximising positive impact. They may work on the prioritization of scientific projects, entrepreneurial ventures, and policy initiatives estimated to save the most lives or reduce the most suffering.

Earning to give involves deliberately pursuing a high-earning career for the purpose of donating a significant portion of earned income, typically because of a desire to do effective altruism. Advocates of earning to give contend that maximizing the amount one can donate to charity is an important consideration for individuals when deciding what career to pursue.

<span class="mw-page-title-main">William MacAskill</span> Scottish philosopher and ethicist (born 1987)

William David MacAskill is a Scottish philosopher and author, as well as one of the originators of the effective altruism movement. He is an associate professor at the Global Priorities Institute at the University of Oxford and is Director of the Forethought Foundation for Global Priorities Research. He was a Research Fellow at the Global Priorities Institute at the University of Oxford, co-founded Giving What We Can, the Centre for Effective Altruism and 80,000 Hours, and is the author of Doing Good Better (2015) and What We Owe the Future (2022), and the co-author of Moral Uncertainty (2020).

The Good Judgment Project (GJP) is an organization dedicated to "harnessing the wisdom of the crowd to forecast world events". It was co-created by Philip E. Tetlock, decision scientist Barbara Mellers, and Don Moore, all professors at the University of Pennsylvania.

PredictIt is a New Zealand-based online prediction market that offers exchanges on political and financial events. PredictIt is owned and operated by Victoria University of Wellington with support from Aristotle, Inc. The company's office is located in Washington, D.C.

A superforecaster is a person who makes forecasts that can be shown by statistical means to have been consistently more accurate than the general public or experts. Superforecasters sometimes use modern analytical and statistical methodologies to augment estimates of base rates of events; research finds that such forecasters are typically more accurate than experts in the field who do not use analytical and statistical techniques. The term "superforecaster" is a trademark of Good Judgment Inc.

<span class="mw-page-title-main">Zoe Health Study</span> COVID-19 mobile research app

The Zoe Health Study, formerly the COVID Symptom Study, is a health research project of British company Zoe Limited which uses a mobile app that runs on Android and iOS.

<span class="mw-page-title-main">Sam Bankman-Fried</span> American entrepreneur, convicted of fraud (born 1992)

Samuel Benjamin Bankman-Fried, commonly known as SBF, is an American entrepreneur who was convicted of fraud and related crimes in November 2023. Bankman-Fried founded the FTX cryptocurrency exchange and was celebrated as a "poster boy" for crypto. At the peak of his net worth, he was ranked the 41st-richest American in the Forbes 400.

Caroline Ellison is an American former business executive and quantitative trader who served as the CEO of Alameda Research, the trading firm affiliated with the cryptocurrency exchange FTX and founded by FTX founder Sam Bankman-Fried. In 2022, she pleaded guilty to fraud, money laundering, and conspiracy charges related to her role at Alameda Research.

The bankruptcy of FTX, a Bahamas-based cryptocurrency exchange, began in November 2022. The collapse of FTX, caused by a spike in customer withdrawals that exposed an $8 billion hole in FTX’s accounts, served as the impetus for its bankruptcy. Prior to its collapse, FTX was the third-largest cryptocurrency exchange by volume and had over one million users.

<span class="mw-page-title-main">Manifold (prediction market)</span> Online reputation-based prediction market

Manifold, formerly known as Manifold Markets, is an online prediction market platform. Users engage in competitive forecasting using play money called 'mana'. Topics on Manifold have included the 2024 United States presidential election and the Oscars.

References

  1. Aguirre, Anthony (January 24, 2016). "Predicting the Future (of Life)". Future of Life Institute . Archived from the original on Mar 26, 2019. Retrieved March 16, 2019.
  2. 1 2 3 Mann, Adam (December 17, 2018). "The power of prediction markets". Nature . Retrieved March 16, 2019.
  3. Robitzski, Dan (2018-12-17). "This site keeps track of Elon Musk's predictions about the future". Futurism. Retrieved March 16, 2019.
  4. 1 2 3 4 Shelton, Jim (2016-11-02). "Metaculus: a prediction website with an eye on science and technology". YaleNews . Retrieved March 16, 2019.
  5. Metaculus, "FAQ".
  6. Besiroglu, Tamay (January 15, 2020). "The Bentham prize". Metaculus. Retrieved 22 January 2020.
  7. Besiroglu, Tamay (February 13, 2020). "The Li Wenliang prize series for forecasting the COVID-19 outbreak". Metaculus. Retrieved 15 February 2020.
  8. "What is the Metaculus Prediction?". Metaculus (FAQ). Archived from the original on 2022-11-10. Retrieved 2022-11-13. ... the Metaculus Prediction uses a sophisticated model to calibrate and weight each user
  9. Forecasting the Future: Can The Hive Mind Let Us Predict the Future?, in Futurism, published September 16th 2016, retrieved March 16, 2019
  10. "May-August 2021: EA Infrastructure Fund Grants". Effective Altruism Funds. Retrieved 2023-05-14.
  11. Metaculus (2022-07-28). "Metaculus Awarded $5.5M Grant to Advance Forecasting as a Public Good". Medium. Retrieved 2023-05-14.
  12. Metaculus (2022-10-12). "Metaculus Launches the 'Forecasting Our World In Data' Project to Probe the Long-Term Future". Medium. Retrieved 2023-05-14.