Media Bias/Fact Check

Last updated
Media Bias/Fact Check
Media Bias Fact Check wordmark.png
Founded2015;9 years ago (2015)
Headquarters Greensboro, North Carolina
OwnerDave M. Van Zandt [1]
URL mediabiasfactcheck.com OOjs UI icon edit-ltr-progressive.svg
Current statusActive

Media Bias/Fact Check (MBFC) is an American website founded in 2015 by Dave M. Van Zandt. [1] It considers four main categories and multiple subcategories in assessing the "political bias" and "factual reporting" of media outlets, [2] [3] relying on a self-described "combination of objective measures and subjective analysis". [4] [5]

Contents

It is widely used, but has been criticized for its methodology. [6] Scientific studies [7] using its ratings note that ratings from Media Bias/Fact Check show high agreement with an independent fact checking dataset from 2017, [8] with NewsGuard [9] and with BuzzFeed journalists. [10]

Methodology

Four main categories are used by MBFC to assess political bias and factuality of a source. These are: (1) use of wording and headlines (2) fact-checking and sourcing (3) choice of stories and (4) political affiliation. MBFC additionally considers subcategories such as bias by omission, bias by source selection, and loaded use of language. [2] [11] A source's "Factual Reporting" is rated on a seven-point scale from "Very high" down to "Very low". [12]

Chart showing the degree of bias and factual ratings given to Consumer Reports Consumer Reports - MBFC Bias and Credibility 2023-05-07.png
Chart showing the degree of bias and factual ratings given to Consumer Reports

Political bias ratings are American-centric [11] [13] and are "extreme-left", "left", "left-center", "least biased", "right-center", "right", and "extreme-right". [14]

The category "Pro-science" [3] is used to indicate "evidence based" or "legitimate science". MBFC also associates sources with warning categories such as "Conspiracy/Pseudoscience", "Questionable Sources" and "Satire". [3]

Fact checks are carried out by independent reviewers who are associated with the International Fact-Checking Network (IFCN) and follow the International Fact-Checking Network Fact-checkers’ Code of Principles, which was developed by the Poynter Institute. [15] [11] A source may be credited with high "Factual Reporting" and still show "Political bias" in its presentation of those facts, for example, through its use of emotional language. [16] [17] [18]

Reception

Media Bias/Fact Check has been used in studies of mainstream media, social media, and disinformation, [19] [8] [20] [21] among them single- and cross-platform studies of services including TikTok, 4chan, Reddit, Twitter, Facebook, Instagram, and Google Web Search. [22]

Scientific studies [23] using its ratings note that ratings from Media Bias/Fact Check show high agreement with an independent fact checking dataset from 2017, [8] with NewsGuard [9] and with BuzzFeed journalists. [10] When MBFC factualness ratings of ‘mostly factual’ or higher were compared to an independent fact checking dataset's ‘verified’ and ‘suspicious’ news sources, the two datasets showed “almost perfect” inter-rater reliability. [8] [20] [24] A 2022 study that evaluated sharing of URLs on Twitter and Facebook in March and April 2020 and 2019, to compare the prevalence of misinformation, reports that scores from Media Bias/Fact Check correlate strongly with those from NewsGuard (r = 0.81). [9]

A comparison of five fact checking datasets frequently used as "groundtruth lists" has suggested that choosing one groundtruth list over another has little impact on the evaluation of online content. [8] [20] In some cases, MBFC has been selected because it categorizes sources using a larger range of labels than other rating services. [8] MBFC offers the largest dataset covering biased and low factual news sources. Over a 4-year span, the percentage of links that could be categorized with MBFC was found to be very consistent. Research also suggests that the bias and factualness of a news source are unlikely to change over time. [8] [20]

The site has been used by researchers at the University of Michigan to create a tool called the "Iffy Quotient", which draws data from Media Bias/Fact Check and NewsWhip to track the prevalence of "fake news" and questionable sources on social media. [25] [26]

A 2018 year-in-review and prospective on fact-checking from the Poynter Institute (which develops PolitiFact [27] ) noted a proliferation of credibility score projects, including Media/Bias Fact Check, writing that "While these projects are, in theory, a good addition to the efforts combating misinformation, they have the potential to misfire," and stating that "Media Bias/Fact Check is a widely cited source for news stories and even studies about misinformation, despite the fact that its method is in no way scientific." [6] Also in 2018, a writer in the Columbia Journalism Review described Media Bias/Fact Check as "an armchair media analysis" [28] and characterized their assessments as "subjective assessments [that] leave room for human biases, or even simple inconsistencies, to creep in". [29] A study published in Scientific Reports wrote: "While [Media Bias/Fact Check's] credibility is sometimes questioned, it has been regarded as accurate enough to be used as ground-truth for e.g. media bias classifiers, fake news studies, and automatic fact-checking systems." [19]

See also

Related Research Articles

Disinformation is false information deliberately spread to deceive people. Disinformation is an orchestrated adversarial activity in which actors employ strategic deceptions and media manipulation tactics to advance political, military, or commercial goals. Disinformation is implemented through attacks that "weaponize multiple rhetorical strategies and forms of knowing—including not only falsehoods but also truths, half-truths, and value judgements—to exploit and amplify culture wars and other identity-driven controversies."

Fact-checking is the process of verifying the factual accuracy of questioned reporting and statements. Fact-checking can be conducted before or after the text or content is published or otherwise disseminated. Internal fact-checking is such checking done in-house by the publisher to prevent inaccurate content from being published; when the text is analyzed by a third party, the process is called external fact-checking.

<span class="mw-page-title-main">Misinformation</span> Incorrect or misleading information

Misinformation is incorrect or misleading information. Misinformation can exist without specific malicious intent; disinformation is distinct in that it is deliberately deceptive and propagated. Misinformation can include inaccurate, incomplete, misleading, or false information as well as selective or half-truths. In January 2024, the World Economic Forum identified misinformation and disinformation, propagated by both internal and external interests, to "widen societal and political divides" as the most severe global risks within the next two years.

Claims of media bias in the United States generally focus on the idea of media outlets reporting news in a way that seems partisan. Other claims argue that outlets sometimes sacrifice objectivity in pursuit of growth or profits.

The Poynter Institute for Media Studies is a non-profit journalism school and research organization in St. Petersburg, Florida, United States. The school is the owner of the Tampa Bay Times newspaper and the International Fact-Checking Network. It also operates PolitiFact.

<span class="mw-page-title-main">PolitiFact</span> American nonprofit fact-checking website

PolitiFact.com is an American nonprofit project operated by the Poynter Institute in St. Petersburg, Florida, with offices there and in Washington, D.C. It began in 2007 as a project of the Tampa Bay Times, with reporters and editors from the newspaper and its affiliated news media partners reporting on the accuracy of statements made by elected officials, candidates, their staffs, lobbyists, interest groups and others involved in U.S. politics. Its journalists select original statements to evaluate and then publish their findings on the PolitiFact.com website, where each statement receives a "Truth-O-Meter" rating. The ratings range from "True" for statements the journalists deem as accurate to "Pants on Fire" for claims the journalists deem as "not accurate and makes a ridiculous claim".

<span class="mw-page-title-main">Post-truth politics</span> Political culture where facts are considered irrelevant

Post-truth politics, also described as post-factual politics or post-reality politics, amidst varying academic and dictionary definitions of the term, refer to a recent historical period where political culture is marked by public anxiety about what claims can be publicly accepted facts.

Fake news websites are websites on the Internet that deliberately publish fake news—hoaxes, propaganda, and disinformation purporting to be real news—often using social media to drive web traffic and amplify their effect. Unlike news satire, fake news websites deliberately seek to be perceived as legitimate and taken at face value, often for financial or political gain. Such sites have promoted political falsehoods in India, Germany, Indonesia and the Philippines, Sweden, Mexico, Myanmar, and the United States. Many sites originate in, or are promoted by, Russia, or North Macedonia among others. Some media analysts have seen them as a threat to democracy. In 2016, the European Parliament's Committee on Foreign Affairs passed a resolution warning that the Russian government was using "pseudo-news agencies" and Internet trolls as disinformation propaganda to weaken confidence in democratic values.

<span class="mw-page-title-main">Fake news</span> False or misleading information presented as real

Fake news or information disorder is false or misleading information presented as news. Fake news often has the aim of damaging the reputation of a person or entity, or making money through advertising revenue. Although false news has always been spread throughout history, the term fake news was first used in the 1890s when sensational reports in newspapers were common. Nevertheless, the term does not have a fixed definition and has been applied broadly to any type of false information presented as news. It has also been used by high-profile people to apply to any news unfavorable to them. Further, disinformation involves spreading false information with harmful intent and is sometimes generated and propagated by hostile foreign actors, particularly during elections. In some definitions, fake news includes satirical articles misinterpreted as genuine, and articles that employ sensationalist or clickbait headlines that are not supported in the text. Because of this diversity of types of false news, researchers are beginning to favour information disorder as a more neutral and informative term.

<i>Palmer Report</i> American liberal fake news website

The Palmer Report is an American liberal fake news website, founded in 2016 by Bill Palmer. It is known for making unsubstantiated or false claims, producing hyperpartisan content, and publishing conspiracy theories, especially on matters relating to Donald Trump and Russia. Fact-checkers have debunked numerous Palmer Report stories, and organizations including the Columbia Journalism Review and the German Marshall Fund have listed the site among false content producers or biased websites.

<span class="mw-page-title-main">Occupy Democrats</span> American left-wing political Facebook page and website

Occupy Democrats is an American left-wing media outlet built around a Facebook page and corresponding website. Established in 2012, it publishes hyperpartisan content, clickbait, and false information. Posts originating from the Occupy Democrats Facebook page are among the most widely shared political content on Facebook.

The People's Voice is an American fake news website based in Los Angeles. The site was founded as Your News Wire in 2014 by Sean Adl-Tabatabai and his husband, Sinclair Treadway. In November 2018, it rebranded itself as NewsPunch. Your News Wire was revived as a separate website in November 2020, and has continued publishing hoaxes similar to those in NewsPunch. In 2023, NewsPunch adopted its current name, The People's Voice.

<span class="mw-page-title-main">Media coverage of the COVID-19 pandemic</span> Aspect of viral outbreak

Media coverage of the COVID-19 pandemic has varied by country, time period and media outlet. News media has simultaneously kept viewers informed about current events related to the pandemic, and contributed to misinformation or fake news.

<span class="mw-page-title-main">Ad Fontes Media</span> Media watchdog organization

Ad Fontes Media, Inc. is a Colorado-based, media watchdog, public benefit corporation primarily known for its Media Bias Chart, which rates media sources in terms of political bias and reliability. The organization was founded in 2018 by patent attorney Vanessa Otero with the goal of combating political polarization and media bias. Ad Fontes Media uses a panel of analysts across the political spectrum to evaluate articles for the Chart.

Disinformation attacks are strategic deception campaigns involving media manipulation and internet manipulation, to disseminate misleading information, aiming to confuse, paralyze, and polarize an audience. Disinformation can be considered an attack when it occurs as an adversarial narrative campaign that weaponizes multiple rhetorical strategies and forms of knowing—including not only falsehoods but also truths, half-truths, and value-laden judgements—to exploit and amplify identity-driven controversies. Disinformation attacks use media manipulation to target broadcast media like state-sponsored TV channels and radios. Due to the increasing use of internet manipulation on social media, they can be considered a cyber threat. Digital tools such as bots, algorithms, and AI technology, along with human agents including influencers, spread and amplify disinformation to micro-target populations on online platforms like Instagram, Twitter, Google, Facebook, and YouTube.

<span class="mw-page-title-main">Wikipedia and fact-checking</span> Culture and practice of fact-checking in Wikipedia

Wikipedia's volunteer editor community has the responsibility of fact-checking Wikipedia's content. Their aim is to curb the dissemination of misinformation and disinformation by the website.

<span class="mw-page-title-main">Ground News</span> News aggregator service

Ground News is a news aggregator service that allows users to compare media coverage from across the political spectrum. It was founded in 2018 and is based in Kitchener, Ontario.

PoliticusUSA is an American left-wing website that publishes hyperpartisan clickbait. Its content has been described by academic studies and journalistic reports as "unreliable," "misleading," and "fake". It is among the most popular U.S. political websites.

References

  1. 1 2 "About". Media Bias/Fact Check. Retrieved 2019-03-30.
  2. 1 2 Larsen, Meng Zhen; Haupt, Michael R.; McMann, Tiana; Cuomo, Raphael E.; Mackey, Tim K. (January 2023). "The Influence of News Consumption Habits and Dispositional Traits on Trust in Medical Scientists". International Journal of Environmental Research and Public Health. 20 (10): 5842. doi: 10.3390/ijerph20105842 . ISSN   1660-4601. PMC   10218345 . PMID   37239568.
  3. 1 2 3 Barclay, Donald A. (25 June 2018). Fake News, Propaganda, and Plain Old Lies: How to Find Trustworthy Information in the Digital Age. Rowman & Littlefield. p. 186. ISBN   978-1-5381-0890-1.
  4. "LibGuides: Journalism Reporting Resources: Fact Checking Resources". guides.library.illinois.edu. University of Illinois Urbana-Champaign. Retrieved 2024-07-10.
  5. "Partnerships | Computational Social Science Lab". The University of Pennsylvania. Retrieved 2024-07-10.
  6. 1 2 Funke, Daniel; Mantzarlis, Alexios (December 18, 2018). "Here's what to expect from fact-checking in 2019". Poynter.
  7. Lin, Hause; Lasser, Jana; Lewandowsky, Stephan; Cole, Rocky; Gully, Andrew; Rand, David G; Pennycook, Gordon (2023-09-05). Contractor, Noshir (ed.). "High level of correspondence across different news domain quality rating sets". PNAS Nexus. 2 (9). doi:10.1093/pnasnexus/pgad286. ISSN   2752-6542. PMC   10500312 . PMID   37719749.
  8. 1 2 3 4 5 6 7 Weld, Galen; Glenski, Maria; Althoff, Tim (22 May 2021). "Political Bias and Factualness in News Sharing across more than 100,000 Online Communities". Proceedings of the International AAAI Conference on Web and Social Media. 15: 796–807. arXiv: 2102.08537 . doi:10.1609/icwsm.v15i1.18104. ISSN   2334-0770. S2CID   231942492 . Retrieved 8 June 2023.
  9. 1 2 3 Broniatowski, David A.; Kerchner, Daniel; Farooq, Fouzia; Huang, Xiaolei; Jamison, Amelia M.; Dredze, Mark; Quinn, Sandra Crouse; Ayers, John W. (12 January 2022). "Twitter and Facebook posts about COVID-19 are less likely to spread misinformation compared to other health topics". PLOS ONE. 17 (1): e0261768. Bibcode:2022PLoSO..1761768B. doi: 10.1371/journal.pone.0261768 . ISSN   1932-6203. PMC   8754324 . PMID   35020727.
  10. 1 2 Kiesel, Johannes; Mestre, Maria; Shukla, Rishabh; Vincent, Emmanuel; Adineh, Payam; Corney, David; Stein, Benno; Potthast, Martin (2019). "SemEval-2019 Task 4: Hyperpartisan News Detection". Proceedings of the 13th International Workshop on Semantic Evaluation. Minneapolis, Minnesota, USA: Association for Computational Linguistics. pp. 829–839. doi:10.18653/v1/S19-2145. S2CID   120224153.
  11. 1 2 3 "Methodology". Media Bias/Fact Check. 7 June 2023. Retrieved 8 June 2023.
  12. Saro, Robert De (28 March 2023). A Crisis like No Other: Understanding and Defeating Global Warming. Bentham Science Publishers. pp. 74–79. ISBN   978-1-68108-962-1.
  13. Baly, Ramy; Karadzhov, Georgi; Alexandrov, Dimitar; Glass, James; Nakov, Preslav (2018). "Predicting Factuality of Reporting and Bias of News Media Sources". Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing. Brussels, Belgium: Association for Computational Linguistics. pp. 3528–3539.
  14. Main, Thomas J. (February 1, 2022). "Both the Right and Left Have Illiberal Factions. Which Is More Dangerous?". The Bulwark. Retrieved February 18, 2022.
  15. "PIEGraph FAQ". University of North Carolina at Chapel Hill.
  16. Christian, Sue Ellen (20 September 2019). Everyday Media Literacy: An Analog Guide for Your Digital Life. Routledge. ISBN   978-1-351-17548-7.
  17. Solender, Andrew (12 June 2018). "How One Website Sets Out to Classify News, Expose 'Fake News'". InsideSources. Retrieved 7 June 2023.
  18. Brown, Lyle; Langenegger, Joyce A.; Garcia, Sonia; Biles, Robert E.; Rynbrandt, Ryan (30 July 2021). Practicing Texas Politics. Cengage Learning. p. 224. ISBN   978-0-357-50532-8.
  19. 1 2 Chołoniewski, Jan; Sienkiewicz, Julian; Dretnik, Naum; Leban, Gregor; Thelwall, Mike; Hołyst, Janusz A. (2020). "A calibrated measure to compare fluctuations of different entities across timescales". Scientific Reports . 10 (1): 20673. doi:10.1038/s41598-020-77660-4. ISSN   2045-2322. PMC   7691371 . PMID   33244096.
  20. 1 2 3 4 Bozarth, Lia; Saraf, Aparajita; Budak, Ceren (26 May 2020). "Higher Ground? How Groundtruth Labeling Impacts Our Understanding of Fake News about the 2016 U.S. Presidential Nominees". Proceedings of the International AAAI Conference on Web and Social Media. 14: 48–59. doi: 10.1609/icwsm.v14i1.7278 . ISSN   2334-0770. Despite the varied labeling and validation procedures used and domains listed by fake news annotators, the groundtruth selection has a limited to modest impact on studies reporting on the behaviors of fake news sites
  21. Allen, Jennifer; Arechar, Antonio A.; Pennycook, Gordon; Rand, David G. (3 September 2021). "Scaling up fact-checking using the wisdom of crowds". Science Advances. 7 (36): eabf4393. Bibcode:2021SciA....7.4393A. doi:10.1126/sciadv.abf4393. ISSN   2375-2548. PMC   8442902 . PMID   34516925.
  22. Rogers, R (2021). "Marginalizing the Mainstream: How Social Media Privilege Political Information". Frontiers in Big Data. 4: 689036. doi: 10.3389/fdata.2021.689036 . PMC   8290493 . PMID   34296078.
  23. Lin, Hause; Lasser, Jana; Lewandowsky, Stephan; Cole, Rocky; Gully, Andrew; Rand, David G; Pennycook, Gordon (2023-09-05). Contractor, Noshir (ed.). "High level of correspondence across different news domain quality rating sets". PNAS Nexus. 2 (9): pgad286. doi:10.1093/pnasnexus/pgad286. ISSN   2752-6542. PMC   10500312 . PMID   37719749.
  24. Volkova, Svitlana; Shaffer, Kyle; Jang, Jin Yea; Hodas, Nathan (July 2017). "Separating Facts from Fiction: Linguistic Models to Classify Suspicious and Trusted News Posts on Twitter". Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers). Association for Computational Linguistics: 647–653. doi: 10.18653/v1/P17-2102 . S2CID   29259081.
  25. Dian Schaffhauser. "U-M Tracker Measures Reliability of News on Facebook, Twitter -- Campus Technology". Campus Technology. Retrieved 2018-12-03.
  26. Paul Resnick; Aviv Ovadya; Garlin Gilchrist. "Iffy Quotient: A Platform Health Metric for Misinformation" (PDF). School of Information - Center for Social Media Responsibility. University of Michigan. p. 5.
  27. "Who Pays For PolitiFact? | PolitiFact". www.politifact.com. Retrieved 14 June 2023.
  28. Albarracin, Dolores; Albarracin, Julia; Chan, Man-pui Sally; Jamieson, Kathleen Hall (2021). Creating Conspiracy Beliefs: How Our Thoughts Are Shaped. Cambridge University Press. p. 130. doi:10.1017/9781108990936. ISBN   978-1-108-84578-6. S2CID   244413957.
  29. Tamar Wilner (January 9, 2018). "We can probably measure media bias. But do we want to?". Columbia Journalism Review.