Metaculus

Last updated
Metaculus Inc.
Metaculus front page.png
Metaculus front page
Type of business Benefit corporation
Available inEnglish
Founded2015;9 years ago (2015)
Headquarters Santa Cruz, California, United States
Area servedWorldwide
Founder(s)
CEODeger Turan
Employees
  • 25 (2023)
URL metaculus.com
RegistrationOptional
Current statusActive

Metaculus is an American reputation-based, massive online prediction solicitation and aggregation engine. [1] One of the focuses of Metaculus is predicting the timing, nature and impact of scientific and technological advances and breakthroughs. [2] [3]

Contents

Reward system

Three types of predictions can be made: probability predictions to binary questions that resolve as either 'yes' or 'no', numerical-range predictions, and date-range predictions. [2] Users can contribute to the community prediction for any given question, leave comments and discuss prediction strategies with other users. [4] Users can suggest new questions which, after moderation, will be opened to the community. [4]

Users can earn points for successful predictions (or lose points for unsuccessful predictions), and track their own predictive progress. [4] The scoring awards points both for being right and for being more right than the community. [5]

In January 2020, Metaculus introduced the Bentham Prize, which awards bi-weekly monetary prizes of $300, $200 and $100 to the first, second and third most valuable user contributions. [6] The following month, Metaculus introduced the Li Wenliang prize, which awards a number of different monetary prizes to questions, forecasts and analyses related to the COVID-19 outbreak. [7]

History

Data scientist Max Wainwright and physicists Greg Laughlin and Anthony Aguirre launched the site in 2015. [2] [4] In June 2017, the Metaculus Prediction was launched, which is a system for aggregating user predictions. [8] The Metaculus Prediction, on average, outperforms the median of the community's predictions when evaluated using the Brier or Log scoring rules. [9]

In 2021, Metaculus received an Effective altruism infrastructure fund grant worth $300k. [10] In 2022, Metaculus received a $5.5m grant from Open Philanthropy. [11] In October 2022, Metaculus received $20k funding from the FTX future fund, 3 weeks before the bankruptcy of FTX. [12]

In 2022 the organization announced it reached 1,000,000 individual predictions, and that it was restructured as a public-benefit corporation, it is committed to the following goals, its new charter compels it to rapport annually on its progress in achieving these goals: [13]

  1. Fostering the growth, learning, and development of the forecasting and forecasting research communities.
  2. Supporting stakeholders who are serving the public good by informing their decision making.
  3. Increasing public access to information regarding forecasts of public interest.

In 2024, Metaculus rewrote their website code and released it under the BSD-2-Clause License. [14] [15] [16]

See also

Related Research Articles

<span class="mw-page-title-main">Weather forecasting</span> Science and technology application

Weather forecasting is the application of science and technology to predict the conditions of the atmosphere for a given location and time. People have attempted to predict the weather informally for millennia and formally since the 19th century.

<span class="mw-page-title-main">Max Tegmark</span> Swedish-American cosmologist

Max Erik Tegmark is a Swedish-American physicist, machine learning researcher and author. He is best known for his book Life 3.0 about what the world might look like as artificial intelligence continues to improve. Tegmark is a professor at the Massachusetts Institute of Technology and the president of the Future of Life Institute.

<span class="mw-page-title-main">Prediction</span> Statement about a future event

A prediction or forecast is a statement about a future event or about future data. Predictions are often, but not always, based upon experience or knowledge of forecasters. There is no universal agreement about the exact difference between "prediction" and "estimation"; different authors and disciplines ascribe different connotations.

<span class="mw-page-title-main">National Weather Service</span> U.S. forecasting agency of the National Oceanic and Atmospheric Administration

The National Weather Service (NWS) is an agency of the United States federal government that is tasked with providing weather forecasts, warnings of hazardous weather, and other weather-related products to organizations and the public for the purposes of protection, safety, and general information. It is a part of the National Oceanic and Atmospheric Administration (NOAA) branch of the Department of Commerce, and is headquartered in Silver Spring, Maryland, within the Washington metropolitan area. The agency was known as the United States Weather Bureau from 1890 until it adopted its current name in 1970.

Prediction markets, also known as betting markets, information markets, decision markets, idea futures or event derivatives, are open markets that enable the prediction of specific outcomes using financial incentives. They are exchange-traded markets established for trading bets in the outcome of various events. The market prices can indicate what the crowd thinks the probability of the event is. A typical prediction market contract is set up to trade between 0 and 100%. The most common form of a prediction market is a binary option market, which will expire at the price of 0 or 100%. Prediction markets can be thought of as belonging to the more general concept of crowdsourcing which is specially designed to aggregate information on particular topics of interest. The main purposes of prediction markets are eliciting aggregating beliefs over an unknown future outcome. Traders with different beliefs trade on contracts whose payoffs are related to the unknown future outcome and the market prices of the contracts are considered as the aggregated belief.

<span class="mw-page-title-main">AccuWeather</span> American weather forecast service corporation

AccuWeather Inc. is a private-sector American media company that provides commercial weather forecasting services.

<span class="mw-page-title-main">Futures studies</span> Study of postulating possible, probable, and preferable futures

Futures studies, futures research, futurism research, futurism, or futurology is the systematic, interdisciplinary and holistic study of social/technological advancement, and other environmental trends; often for the purpose of exploring how people will live and work in the future. Predictive techniques, such as forecasting, can be applied, but contemporary futures studies scholars emphasize the importance of systematically exploring alternatives. In general, it can be considered as a branch of the social sciences and an extension to the field of history. Futures studies seeks to understand what is likely to continue and what could plausibly change. Part of the discipline thus seeks a systematic and pattern-based understanding of past and present, and to explore the possibility of future events and trends.

Effective altruism (EA) is a 21st-century philosophical and social movement that advocates impartially calculating benefits and prioritizing causes to provide the greatest good. It is motivated by "using evidence and reason to figure out how to benefit others as much as possible, and taking action on that basis". People who pursue the goals of effective altruism, who are sometimes called effective altruists, follow a variety of approaches proposed by the movement, such as donating to selected charities and choosing careers with the aim of maximizing positive impact. The movement has achieved significant popularity outside of academia, spurring the creation of university-based institutes, research centers, advisory organizations and charities, which, collectively, have donated several hundreds of millions of dollars.

Earning to give involves deliberately pursuing a high-earning career for the purpose of donating a significant portion of earned income, typically because of a desire to do effective altruism. Advocates of earning to give contend that maximizing the amount one can donate to charity is an important consideration for individuals when deciding what career to pursue.

<span class="mw-page-title-main">William MacAskill</span> Scottish philosopher and ethicist (born 1987)

William David MacAskill is a Scottish philosopher and author, as well as one of the originators of the effective altruism movement. He was a Research Fellow at the Global Priorities Institute at the University of Oxford, co-founded Giving What We Can, the Centre for Effective Altruism and 80,000 Hours, and is the author of Doing Good Better (2015) and What We Owe the Future (2022), and the co-author of Moral Uncertainty (2020).

The Good Judgment Project (GJP) is an organization dedicated to "harnessing the wisdom of the crowd to forecast world events". It was co-created by Philip E. Tetlock, decision scientist Barbara Mellers, and Don Moore, all professors at the University of Pennsylvania.

<span class="mw-page-title-main">Augur (software)</span> Decentralized prediction market platform

Augur is a decentralized prediction market platform built on the Ethereum blockchain. Augur is developed by Forecast Foundation, which was founded in 2014 by Jack Peterson, Joey Krug, and Jeremy Gardner. Forecast Foundation is advised by Ron Bernstein, founder of now-defunct company Intrade, and Ethereum founder Vitalik Buterin.

<span class="mw-page-title-main">Unanimous A.I.</span> American technology company specializing in artificial swarm intelligence

Unanimous AI is an American technology company provides artificial swarm intelligence (ASI) technology. Unanimous AI provides a "human swarming" platform "swarm.ai" that allows distributed groups of users to collectively predict answers to questions. This process has resulted in successful predictions of major events such as the Kentucky Derby, the Oscars, the Stanley Cup, Presidential Elections, and the World Series.

A superforecaster is a person who makes forecasts that can be shown by statistical means to have been consistently more accurate than the general public or experts. Superforecasters sometimes use modern analytical and statistical methodologies to augment estimates of base rates of events; research finds that such forecasters are typically more accurate than experts in the field who do not use analytical and statistical techniques, though this has been overstated in some sources. The term "superforecaster" is a trademark of Good Judgment Inc.

<span class="mw-page-title-main">Zoe Health Study</span> COVID-19 mobile research app

The Zoe Health Study, formerly the COVID Symptom Study, is a health research project of British company Zoe Limited which uses a mobile app that runs on Android and iOS.

<span class="mw-page-title-main">Sam Bankman-Fried</span> American entrepreneur convicted of fraud (born 1992)

Samuel Benjamin Bankman-Fried, commonly known as SBF, is an American entrepreneur who was convicted of fraud and related crimes in November 2023. Bankman-Fried founded the FTX cryptocurrency exchange and was celebrated as a "poster boy" for crypto, with FTX having a global reach with more than 130 international affiliates. At the peak of his net worth, he was ranked the 41st-richest American in the Forbes 400.

FTX Trading Ltd., commonly known as FTX, is a bankrupt company that formerly operated a cryptocurrency exchange and crypto hedge fund. The exchange was founded in 2019 by Sam Bankman-Fried and Gary Wang and collapsed in 2022 after massive fraud perpetrated by Bankman-Fried and his partner Caroline Ellison forced the company to file for Chapter 11 bankruptcy.

Caroline Ellison is an American former business executive and quantitative trader who was the CEO of Alameda Research, a trading firm affiliated with the cryptocurrency exchange FTX and founded by FTX founder Sam Bankman-Fried. Ellison was terminated from her position after FTX and Alameda filed for bankruptcy. In 2022, Ellison pleaded guilty to two counts of wire fraud, two counts of conspiracy to commit wire fraud, conspiracy to commit securities fraud and conspiracy to commit money laundering.

The bankruptcy of FTX, a Bahamas-based cryptocurrency exchange, began in November 2022. The collapse of FTX, caused by a spike in customer withdrawals that exposed an $8 billion hole in FTX's accounts, served as the impetus for its bankruptcy. Prior to its collapse, FTX was the third-largest cryptocurrency exchange by volume and had over one million users.

<span class="mw-page-title-main">Manifold (prediction market)</span> Online reputation-based prediction market

Manifold, formerly known as Manifold Markets, is an online prediction market platform. Users engage in competitive forecasting using play money called 'mana', as well as 'Sweepcash,' which can be withdrawn for real money, or donated to charity. Topics on Manifold have included the 2024 United States presidential election and the Oscars. Sweepstakes are US only and 18+. All states are eligible except Washington, Michigan, Idaho, and Delaware.

References

  1. Aguirre, Anthony (January 24, 2016). "Predicting the Future (of Life)". Future of Life Institute . Archived from the original on Mar 26, 2019. Retrieved March 16, 2019.
  2. 1 2 3 Mann, Adam (December 17, 2018). "The power of prediction markets". Nature . Retrieved March 16, 2019.
  3. Robitzski, Dan (2018-12-17). "This site keeps track of Elon Musk's predictions about the future". Futurism. Retrieved March 16, 2019.
  4. 1 2 3 4 Shelton, Jim (2016-11-02). "Metaculus: a prediction website with an eye on science and technology". YaleNews . Retrieved March 16, 2019.
  5. Metaculus, "FAQ".
  6. Besiroglu, Tamay (January 15, 2020). "The Bentham prize". Metaculus. Retrieved 22 January 2020.
  7. Besiroglu, Tamay (February 13, 2020). "The Li Wenliang prize series for forecasting the COVID-19 outbreak". Metaculus. Retrieved 15 February 2020.
  8. "What is the Metaculus Prediction?". Metaculus (FAQ). Archived from the original on 2022-11-10. Retrieved 2022-11-13. ... the Metaculus Prediction uses a sophisticated model to calibrate and weight each user
  9. Forecasting the Future: Can The Hive Mind Let Us Predict the Future?, in Futurism, published September 16th 2016, retrieved March 16, 2019
  10. "May-August 2021: EA Infrastructure Fund Grants". Effective Altruism Funds. Retrieved 2023-05-14.
  11. Metaculus (2022-07-28). "Metaculus Awarded $5.5M Grant to Advance Forecasting as a Public Good". Medium. Retrieved 2023-05-14.
  12. Metaculus (2022-10-12). "Metaculus Launches the 'Forecasting Our World In Data' Project to Probe the Long-Term Future". Medium. Retrieved 2023-05-14.
  13. "Becoming a Public Benefit Corporation, Hitting 1 Million Predictions, and Three New AI Forecasting Roles". www.metaculus.com. 2022-09-12. Retrieved 2024-07-14.
  14. Turan, Deger (June 21, 2024) [June 5, 2024]. "Open Sourcing Metaculus". metaculus.com. Retrieved July 14, 2024.
  15. Chevalier, Sylvain (October 7, 2024). "A Massive Rewrite, A Slate of Improvements, and Going Open Source". Metaculus. Archived from the original on October 7, 2024.
  16. "Metaculus/metaculus". GitHub . Retrieved October 14, 2024.