Source criticism

Last updated

Source criticism (or information evaluation) is the process of evaluating an information source, i.e.: a document, a person, a speech, a fingerprint, a photo, an observation, or anything used in order to obtain knowledge. In relation to a given purpose, a given information source may be more or less valid, reliable or relevant. Broadly, "source criticism" is the interdisciplinary study of how information sources are evaluated for given tasks.

Contents

Meaning

Problems in translation: The Danish word kildekritik, like the Norwegian word kildekritikk and the Swedish word källkritik, derived from the German Quellenkritik and is closely associated with the German historian Leopold von Ranke (17951886). Historian Wolfgang Hardtwig wrote:

His [Ranke's] first work Geschichte der romanischen und germanischen Völker von 14941514 (History of the Latin and Teutonic Nations from 1494 to 1514) (1824) was a great success. It already showed some of the basic characteristics of his conception of Europe, and was of historiographical importance particularly because Ranke made an exemplary critical analysis of his sources in a separate volume, Zur Kritik neuerer Geschichtsschreiber (On the Critical Methods of Recent Historians). In this work he raised the method of textual criticism used in the late eighteenth century, particularly in classical philology to the standard method of scientific historical writing. (Hardtwig, 2001, p. 12739)

Historical theorist Chris Lorenz wrote:

The larger part of the nineteenth and twentieth centuries would be dominated by the research-oriented conception of historical method of the so-called Historical School in Germany, led by historians as Leopold Ranke and Berthold Niebuhr. Their conception of history, long been regarded as the beginning of modern, 'scientific' history, harked back to the 'narrow' conception of historical method, limiting the methodical character of history to source criticism. (Lorenz, 2001)

In the early 21st century, source criticism is a growing field in, among other fields, library and information science. In this context source criticism is studied from a broader perspective than just, for example, history, classical philology, [1] or biblical studies (but there, too, it has more recently received new attention). [2] [3]

Principles

The following principles are from two Scandinavian textbooks on source criticism, written by the historians Olden-Jørgensen (1998) and Thurén (1997):

Two other principles are:

"Because each source teaches you more and more about your subject, you will be able to judge with ever-increasing precision the usefulness and value of any prospective source. In other words, the more you know about the subject, the more precisely you can identify what you must still find out". (Bazerman, 1995, p. 304).

"The empirical case study showed that most people find it difficult to assess questions of cognitive authority and media credibility in a general sense, for example, by comparing the overall credibility of newspapers and the Internet. Thus these assessments tend to be situationally sensitive. Newspapers, television and the Internet were frequently used as sources of orienting information, but their credibility varied depending on the actual topic at hand" (Savolainen, 2007).

The following questions are often good ones to ask about any source according to the American Library Association (1994) and Engeldinger (1988):

  1. How was the source located?
  2. What type of source is it?
  3. Who is the author and what are the qualifications of the author in regard to the topic that is discussed?
  4. When was the information published?
  5. In which country was it published?
  6. What is the reputation of the publisher?
  7. Does the source show a particular cultural or political bias?

For literary sources complementing criteria are:

  1. Does the source contain a bibliography?
  2. Has the material been reviewed by a group of peers, or has it been edited?
  3. How does the article/book compare with similar articles/books?

Levels of generality

Some principles of source criticism are universal, other principles are specific for certain kinds of information sources.

There is today no consensus about the similarities and differences between source criticism in the natural science and humanities. Logical positivism claimed that all fields of knowledge were based on the same principles. Much of the criticism of logical positivism claimed that positivism is the basis of the sciences, whereas hermeneutics is the basis of the humanities. This was, for example, the position of Jürgen Habermas. A newer position, in accordance with, among others, Hans-Georg Gadamer and Thomas Kuhn, understands both science and humanities as determined by researchers' preunderstanding and paradigms. Hermeneutics is thus a universal theory. The difference is, however, that the sources of the humanities are themselves products of human interests and preunderstanding, whereas the sources of the natural sciences are not. Humanities are thus "doubly hermeneutic".

Natural scientists, however, are also using human products (such as scientific papers) which are products of preunderstanding (and can lead to, for example, academic fraud).

Contributing fields

Epistemology

Epistemological theories are the basic theories about how knowledge is obtained and are thus the most general theories about how to evaluate information sources.

The evaluation of knowledge or information sources cannot be more certain than is the construction of knowledge. If one accepts the principle of fallibilism then one also has to accept that source criticism can never 100% verify knowledge claims. As discussed in the next section, source criticism is intimately linked to scientific methods.

The presence of fallacies of argument in sources is another kind of philosophical criterion for evaluating sources. Fallacies are presented by Walton (1998). Among the fallacies are the ad hominem fallacy (the use of personal attack to try to undermine or refute a person's argument) and the straw man fallacy (when one arguer misrepresents another's position to make it appear less plausible than it really is, in order more easily to criticize or refute it.)

Research methodology

Research methods are methods used to produce scholarly knowledge. The methods that are relevant for producing knowledge are also relevant for evaluating knowledge. An example of a book that turns methodology upside-down and uses it to evaluate produced knowledge is Katzer; Cook & Crouch (1998).

Science studies

Studies of quality evaluation processes such as peer review, book reviews and of the normative criteria used in evaluation of scientific and scholarly research. Another field is the study of scientific misconduct.

Harris (1979) provides a case study of how a famous experiment in psychology, Little Albert, has been distorted throughout the history of psychology, starting with the author (Watson) himself, general textbook authors, behavior therapists, and a prominent learning theorist. Harris proposes possible causes for these distortions and analyzes the Albert study as an example of myth making in the history of psychology. Studies of this kind may be regarded a special kind of reception history (how Watson's paper was received). It may also be regarded as a kind of critical history (opposed to ceremonial history of psychology, cf. Harris, 1980). Such studies are important for source criticism in revealing the bias introduced by referring to classical studies.

Textual criticism

Textual criticism (or broader: text philology) is a part of philology, which is not just devoted to the study of texts, but also to edit and produce "scientific editions", "scholarly editions", "standard editions", "historical editions", "reliable editions", "reliable texts", "text editions" or "critical editions", which are editions in which careful scholarship has been employed to ensure that the information contained within is as close to the author's/composer's original intentions as possible (and which allows the user to compare and judge changes in editions published under influence by the author/composer). The relation between these kinds of works and the concept "source criticism" is evident in Danish, where they may be termed "kildekritisk udgave" (directly translated "source critical edition").

In other words, it is assumed that most editions of a given works is filled with noise and errors provided by publishers, why it is important to produce "scholarly editions". The work provided by text philology is an important part of source criticism in the humanities.

Psychology

The study of eyewitness testimony is an important field of study used, among other purposes, to evaluate testimony in courts. The basics of eyewitness fallibility includes factors such as poor viewing conditions, brief exposure, and stress. More subtle factors, such as expectations, biases, and personal stereotypes can intervene to create erroneous reports. Loftus (1996) discuss all such factors and also shows that eyewitness memory is chronically inaccurate in surprising ways. An ingenious series of experiments reveals that memory can be radically altered by the way an eyewitness is questioned after the fact. New memories can be implanted and old ones unconsciously altered under interrogation.

Anderson (1978) and Anderson & Pichert (1977) reported an elegant experiment demonstrating how change in perspective affected people's ability to recall information that was unrecallable from another perspective.

In psychoanalysis the concept of defence mechanism is important and may be considered a contribution to the theory of source criticism because it explains psychological mechanisms, which distort the reliability of human information sources.

Library and information science (LIS)

In schools of library and information science (LIS), source criticism is taught as part of the growing field of information literacy.

Issues such as relevance, quality indicators for documents, kinds of documents and their qualities (e.g. scholarly editions) are studied in LIS and are relevant for source criticism. Bibliometrics is often used to find the most influential journal, authors, countries and institutions. Librarians study book reviews and their function in evaluating books.

In library and information science the checklist approach has often been used. [4] A criticism of this approach is given by Meola (2004): "Chucking the checklist".

Libraries sometimes provide advice on how their users may evaluate sources. [5] [6]

The Library of Congress has a "Teaching with Primary Sources" (TPS) program. [7]

Ethics

Source criticism is also about ethical behavior and culture. It is about a free press and an open society, including the protecting information sources from being persecuted (cf., Whistleblower).

In specific domains

Photos

Photos are often manipulated during wars and for political purposes. One well known example is Joseph Stalin's manipulation of a photograph from May 5, 1920, on which Stalin's predecessor Lenin held a speech for Soviet troops that Leon Trotsky attended. Stalin had later Trotsky retouched out of this photograph. (cf. King, 1997). A recent example is reported by Healy (2008) about North Korean leader Kim Jong Il. [8]

Internet sources

Much interest in evaluating Internet sources (such as Wikipedia) is reflected in the scholarly literature of library and information science and in other fields. Mintz (2002) is an edited volume about this issue. Examples of literature examining Internet sources include Chesney (2006), Fritch & Cromwell (2001), Leth & Thurén (2000) and Wilkinson, Bennett, & Oliver (1997).

Archaeology and history

"In history, the term historical method was first introduced in a systematic way in the sixteenth century by Jean Bodin in his treatise of source criticism, Methodus ad facilem historiarium cognitionem (1566). Characteristically, Bodin's treatise intended to establish the ways by which reliable knowledge of the past could be established by checking sources against one another and by so assessing the reliability of the information conveyed by them, relating them to the interests involved." (Lorenz, 2001, p. 6870).

As written above, modern source criticism in history is closely associated with the German historian Leopold von Ranke (17951886), who influenced historical methods on both sides of the Atlantic Ocean, although in rather different ways. American history developed in a more empirist and antiphilosophical way (cf., Novick, 1988).

Two of the best-known rule books from the 19th century are Bernheim (1889) and Langlois & Seignobos (1898). These books provided a seven-step procedure (here quoted from Howell & Prevenier, 2001, p. 70–71):

  1. If the sources all agree about an event, historians can consider the event proved.
  2. However, majority does not rule; even if most sources relate events in one way, that version will not prevail unless it passes the test of critical textual analysis.
  3. The source whose account can be confirmed by reference to outside authorities in some of its parts can be trusted in its entirety if it is impossible similarly to confirm the entire text.
  4. When two sources disagree on a particular point, the historian will prefer the source with most "authority"—i.e. the source created by the expert or by the eyewitness.
  5. Eyewitnesses are, in general, to be preferred, especially in circumstances where the ordinary observer could have accurately reported what transpired and, more specifically, when they deal with facts known by most contemporaries.
  6. If two independently created sources agree on a matter, the reliability of each is measureably enhanced.
  7. When two sources disagree (and there is no other means of evaluation), then historians take the source which seems to accord best with common sense.

Gudmundsson (2007, p. 38) wrote: "Source criticism should not totally dominate later courses. Other important perspectives, for example, philosophy of history/view of history, should not suffer by being neglected" (Translated by BH). This quote makes a distinction between source criticism on the one hand and historical philosophy on the other hand. However, different views of history and different specific theories about the field being studied may have important consequences for how sources are selected, interpreted and used. Feminist scholars may, for example, select sources made by women and may interpret sources from a feminist perspective. Epistemology should thus be considered a part of source criticism. It is in particular related to "tendency analysis".

In archaeology, radiocarbon dating is an important technique to establish the age of information sources. Methods of this kind were the ideal when history established itself as both a scientific discipline and as a profession based on "scientific" principles in the last part of the 1880s (although radiocarbon dating is a more recent example of such methods). The empiricist movement in history brought along both "source criticism" as a research method and also in many countries large scale publishing efforts to make valid editions of "source materials" such as important letters and official documents (e.g. as facsimiles or transcriptions).

Historiography and historical method include the study of the reliability of the sources used, in terms of, for example, authorship, credibility of the author, and the authenticity or corruption of the text.

Biblical studies

Source criticism, as the term is used in biblical criticism, refers to the attempt to establish the sources used by the author and/or redactor of the final text. The term "literary criticism" is occasionally used as a synonym.

Biblical source criticism originated in the 18th century with the work of Jean Astruc, who adapted the methods already developed for investigating the texts of classical antiquity (Homer's Iliad in particular) to his own investigation into the sources of the Book of Genesis. It was subsequently considerably developed by German scholars in what was known as "the higher criticism", a term no longer in widespread use. The ultimate aim of these scholars was to reconstruct the history of the biblical text, as well as the religious history of ancient Israel.

Related to source criticism is redaction criticism which seeks to determine how and why the redactor (editor) put the sources together the way he did. Also related is form criticism and tradition history which try to reconstruct the oral prehistory behind the identified written sources.

Journalism

Journalists often work with strong time pressure and have access to only a limited number of information sources such as news bureaus, persons which may be interviewed, newspapers, journals and so on (see journalism sourcing). Journalists' possibility for conducting serious source criticism is thus limited compared to, for example, historians' possibilities.

The most important legal sources are created by parliaments, governments, courts, and legal researchers. They may be written or informal and based on established practices. Views concerning the quality of sources differ among legal philosophies: Legal positivism is the view that the text of the law should be considered in isolation, while legal realism, interpretivism (legal), critical legal studies and feminist legal criticism interprets the law on a broader cultural basis.

See also

Notes

  1. C. B. Krebs, “'Making History:' Constructive Wonder (aka Quellenforschung) and the Composition of Caesar’s Gallic War (Thanks to Labienus and Polybius)," in Usages of the Past in Roman Historiography, ed. by Poulsen, A.D. & A. Jönsson, Leiden (Brill) 2021, 91-114.
  2. Hjørland, Birger (2012). Methods for evaluating information sources: An annotated catalogue. Journal of Information Science 38(3), 258–268. doi : 10.1177/0165551512439178
  3. Balin, A. & Grafstein, A. (2010). The critical assessment of research: Traditional and new methods of evaluation. Oxford: Chandos Publishing.
  4. "Checklists for Internet sources". Archived from the original on 2013-02-10. Retrieved 2012-10-30.
  5. General Source Criticism Archived 2007-03-04 at the Wayback Machine
  6. Topicality and Reliability of Printed Documents Archived 2008-12-15 at the Wayback Machine
  7. "About the Program: Teaching with Primary Sources – Teacher Resources – Library of Congress". www.loc.gov.
  8. Healy, Jack (2008-11-07). "Was the Dear Leader Photoshopped In?". The New York Times.

Related Research Articles

In science and history, consilience is the principle that evidence from independent, unrelated sources can "converge" on strong conclusions. That is, when multiple sources of evidence are in agreement, the conclusion can be very strong even when none of the individual sources of evidence is significantly so on its own. Most established scientific knowledge is supported by a convergence of evidence: if not, the evidence is comparatively weak, and there will probably not be a strong scientific consensus.

<span class="mw-page-title-main">Historian</span> Scholar who deals with the exploration and presentation of history

A historian is a person who studies and writes about the past and is regarded as an authority on it. Historians are concerned with the continuous, methodical narrative and research of past events as relating to the human race; as well as the study of all history in time. Some historians are recognized by publications or training and experience. "Historian" became a professional occupation in the late nineteenth century as research universities were emerging in Germany and elsewhere.

<span class="mw-page-title-main">Research</span> Systematic study undertaken to increase knowledge

Research is "creative and systematic work undertaken to increase the stock of knowledge". It involves the collection, organization and analysis of evidence to increase understanding of a topic, characterized by a particular attentiveness to controlling sources of bias and error. These activities are characterized by accounting and controlling for biases. A research project may be an expansion of past work in the field. To test the validity of instruments, procedures, or experiments, research may replicate elements of prior projects or the project as a whole.

In law, a witness is someone who, either voluntarily or under compulsion, provides testimonial evidence, either oral or written, of what they know or claim to know.

Cognitive linguistics is an interdisciplinary branch of linguistics, combining knowledge and research from cognitive science, cognitive psychology, neuropsychology and linguistics. Models and theoretical accounts of cognitive linguistics are considered as psychologically real, and research in cognitive linguistics aims to help understand cognition in general and is seen as a road into the human mind.

<span class="mw-page-title-main">Primary source</span> Original source of information created at the time under study

In the study of history as an academic discipline, a primary source is an artifact, document, diary, manuscript, autobiography, recording, or any other source of information that was created at the time under study. It serves as an original source of information about the topic. Similar definitions can be used in library science and other areas of scholarship, although different fields have somewhat different definitions.

New Criticism was a formalist movement in literary theory that dominated American literary criticism in the middle decades of the 20th century. It emphasized close reading, particularly of poetry, to discover how a work of literature functioned as a self-contained, self-referential aesthetic object. The movement derived its name from John Crowe Ransom's 1941 book The New Criticism.

William Kurtz Wimsatt Jr. was an American professor of English, literary theorist, and critic. Wimsatt is often associated with the concept of the intentional fallacy, which he developed with Monroe Beardsley in order to discuss the importance of an author's intentions for the creation of a work of art.

Anecdotal evidence is evidence based only on personal observation, collected in a casual or non-systematic manner.

<span class="mw-page-title-main">Credibility</span> Believability of a source or message

Credibility comprises the objective and subjective components of the believability of a source or message. Credibility dates back to Aristotle theory of Rhetoric. Aristotle defines rhetoric as the ability to see what is possibly persuasive in every situation. He divided the means of persuasion into three categories, namely Ethos, Pathos, and Logos, which he believed have the capacity to influence the receiver of a message. According to Aristotle, the term "Ethos" deals with the character of the speaker. The intent of the speaker is to appear credible. In fact, the speaker's ethos is a rhetorical strategy employed by an orator whose purpose is to "inspire trust in his audience." Credibility has two key components: trustworthiness and expertise, which both have objective and subjective components. Trustworthiness is based more on subjective factors, but can include objective measurements such as established reliability. Expertise can be similarly subjectively perceived, but also includes relatively objective characteristics of the source or message. Secondary components of credibility include source dynamism (charisma) and physical attractiveness.

"The Death of the Author" is a 1967 essay by the French literary critic and theorist Roland Barthes (1915–1980). Barthes's essay argues against traditional literary criticism's practice of relying on the intentions and biography of an author to definitively explain the "ultimate meaning" of a text. Instead, the essay emphasizes the primacy of each individual reader's interpretation of the work over any "definitive" meaning intended by the author, a process in which subtle or unnoticed characteristics may be drawn out for new insight. The essay's first English-language publication was in the American journal Aspen, no. 5–6 in 1967; the French debut was in the magazine Manteia, no. 5 (1968). The essay later appeared in an anthology of Barthes's essays, Image-Music-Text (1977), a book that also included his "From Work to Text".

<span class="mw-page-title-main">Historical method</span> Techniques used by historians

Historical method is the collection of techniques and guidelines that historians use to research and write histories of the past. Secondary sources, primary sources and material evidence such as that derived from archaeology may all be drawn on, and the historian's skill lies in identifying these sources, evaluating their relative authority, and combining their testimony appropriately in order to construct an accurate and reliable picture of past events and environments.

<span class="mw-page-title-main">Positivism</span> Empiricist philosophical theory

Positivism is a philosophical school that holds that all genuine knowledge is either true by definition or positive—meaning a posteriori facts derived by reason and logic from sensory experience. Other ways of knowing, such as intuition, introspection, or religious faith, are rejected or considered meaningless.

<span class="mw-page-title-main">Recorded history</span> Historical narrative based on a written record

Recorded history or written history describes the historical events that have been recorded in a written form or other documented communication which are subsequently evaluated by historians using the historical method. For broader world history, recorded history begins with the accounts of the ancient world around the 4th millennium BC, and it coincides with the invention of writing.

<span class="mw-page-title-main">History</span> Study of the past

History is the systematic study and documentation of the human past.

<span class="mw-page-title-main">Secondary source</span> Document that discusses information originally presented elsewhere

In scholarship, a secondary source is a document or recording that relates or discusses information originally presented elsewhere. A secondary source contrasts with a primary source, which is an original source of the information being discussed; a primary source can be a person with direct knowledge of a situation or a document created by such a person.

Auxiliarysciences of history are scholarly disciplines which help evaluate and use historical sources and are seen as auxiliary for historical research. Many of these areas of study, classification and analysis were originally developed between the 16th and 19th centuries by antiquaries, and would then have been regarded as falling under the broad heading of antiquarianism. "History" was at that time regarded as a largely literary skill. However, with the spread of the principles of empirical source-based history championed by the Göttingen School of History in the late 18th century and later by Leopold von Ranke from the mid-19th century onwards, they have been increasingly regarded as falling within the skill-set of the trained historian.

The following outline is provided as an overview of and topical guide to social science:

The Göttingen school of history was a group of historians associated with a particular style of historiography located at the University of Göttingen in the late 18th century.

<i>A Field Guide to Lies</i>

A Field Guide to Lies: Critical Thinking in the Information Age is a bestselling book written by Daniel J. Levitin and originally published in 2016 by Dutton. It was published in 2017 in paperback with a revised introduction under the new title Weaponized Lies: How to Think Critically in the Post-truth Era; a new edition was published in 2019 under the title A Field Guide to Lies: Critical Thinking With Statistics and the Scientific Method.

References