CRAAP test

Last updated

The CRAAP test is a test to check the objective reliability of information sources across academic disciplines. CRAAP is an acronym for Currency, Relevance, Authority, Accuracy, and Purpose. [1] Due to a vast number of sources existing online, it can be difficult to tell whether these sources are trustworthy to use as tools for research. The CRAAP test aims to make it easier for educators and students to determine if their sources can be trusted. By employing the test while evaluating sources, a researcher can reduce the likelihood of using unreliable information. The CRAAP test, developed by Sarah Blakeslee [2] and her team of librarians at California State University, Chico (CSU Chico), [1] is used mainly by higher education librarians at universities. It is one of various approaches to source criticism.

Contents

C: Currency

The first step toward knowing if a source is reliable is to check its currency. [1] Currency means that the information found is the most up to date. That being said, students and educators may ask where the information was posted or published. Next, they look to see if the information has been revised or updated and whether the research assignment can rely on multiple sources. A topic may need current news, media, or the latest findings from research, or older sources may be as good. These questions help pinpoint recent trends of the information and also exhibit the constant research changes that are spreading rapidly as technology expands now and in the future. If the source comes from a website, the links to access it must be working. [1]

R: Relevance

When looking at sources, the relevance of the information will impact a well rounded research endeavor. One question in this category to ask is how does the topic relate to the information given in a source? More importantly, the writers of the references should focus on the intended audience. There are a vast number of topics and an increase in access to information. Therefore, the relevance of the information helps the audience know what they are looking for. Also, there is a check-in about whether the data is at an appropriate level of comprehension, that is, the degree must not be too elementary or advanced for the students' or educators' needs. Because of the variety of sources, educators can do their best to keep an open mind about source usage. Moreover, they should decide if they feel comfortable enough to cite the source. [1]

A: Authority

There is, however, not only the currency and relevance of the given source, but also its authority to consider. This is significant because the students and educators will look to see who is the author, publisher, or sponsor before they can trust the information. Their education level and the author's affiliations are important because this can help the readers know if the author is qualified to write on the topic. There should also be contact information for the publisher or author. The authority of the source helps the students or educators know that the information can be used and trusted in a proper manner. [1] Authority in citing a source establishes a trust boundary between the reader and the author of the works.

A: Accuracy

Emphasizing the trustworthiness of sources, the accuracy of the contents in the source must connect back to the origin. Evidence must support the information presented to the audience. Evidence can include findings, observations, or field notes. The report must be reviewed or referred. It must be verifiable from another source or common knowledge. That said, the language used in the sources has to be unbiased or free of emotion, because of its use for fact retrieval. The content in the source should be free of spelling, grammar, or typographical errors. [1]

P: Purpose

The purpose of the sources helps the readers know whether the information they are looking for is right for their research. The questions that arise when looking for the purpose range from informing, teaching, selling, entertaining, research or even self-gaining purposes. Also, the author's intentions should be clear. Certain aspects should be taken into consideration whether the information given is fact, opinion, or propaganda as well as political, personal, religious, or ideological bias. [1] Knowing the purpose of the information helps researching for sources a lot easier.

History

The test was implemented by Sarah Blakeslee [3] [2] during the spring of 2004 when she was creating a first year workshop to first-year instructors. Blakeslee was frustrated that she could not remember the criteria for looking up different sources. After much thought, she came up with the acronym. She wanted to give students an easier way to determine what sources are credible. [2] One of the other tests that came before the CRAAP test is the SAILS test: Standardized Assessment of Information Literacy Skills, created in 2002 by a group of librarians at Kent State University as an assessment for students' information literacy skills. The SAILS test focuses more on the scores as a quantitative measure of how well students look up their sources. [4] While the SAILS test is more specific in its terms of evaluation, it shares the same objectives as the CRAAP test.

Website evaluation

One university has started using the CRAAP test to help teach students about online content evaluation. In a 2017 article, Cara Berg, a reference librarian and co-coordinator of user education at William Paterson University emphasizes website evaluation as a tool for active research. [5] At Berg's university, for example, library instruction is given to roughly 300 different classes, each in different subjects that require some type of research that require students to look up sources. Website evaluation using the CRAAP test was incorporated as part of the first year seminar for students at this university, to help them hone their research skills. [5]

Challenges in the classroom

When the CRAAP test was first implemented at William Paterson University, there were some technical challenges. The workshop for website evaluation felt rushed and in most cases, librarians could not cover all the angles in one class session. As well, as a consequence of rushing the website evaluation portion for reasons of time, student performance on an assessment focused on website evaluation was poor. To address these problems, they developed a "flipped" method in which students watched a video that covered two of three workshop sections on their own time, with in-class instruction limited to website evaluation yet occupying all of a class period. Student performance on assessments of their knowledge of CRAAP for website evaluation improved after the change to instruction. [5]

Pedagogical uses

The CRAAP test is generally used in library instruction as part of a first-year seminar for students. Students were required to participate in this class as a part of the graduation requirement at William Paterson University. [5] Besides using the CRAAP method in English courses, many other courses have been using this method as well, such as science and engineering classes. The test is applied the same way as the website evaluation and is used universally in all courses. Examples of universities that use the CRAAP test include Central Michigan University, [6] Benedictine University, [7] Community College of Baltimore County, [8] among the many examples. There are other schools that use the test as a way for students to do well on their assignments in subjects that require research papers.

Alternatives and criticisms

In 2004, Marc Meola's paper "Chucking the Checklist" critiqued the checklist approach to evaluating information, [9] and librarians and educators have explored alternative approaches.

Mike Caulfield, who has criticized some uses of the CRAAP test in information literacy, [10] has emphasized an alternative approach using step-by-step heuristics that can be summarized by the acronym SIFT: "Stop; Investigate the source; Find better coverage; Trace claims, quotes, and media to the original context". [11] [12]

In a December 2019 article, Jennifer A. Fielding raised the issue that the CRAAP method's focus is on a "deep-dive" into the website being evaluated, but noted that "in recent years the dissemination of mis- and disinformation online has become increasingly sophisticated and prolific, so restricting analysis to a single website's content without understanding how the site relates to a wider scope now has the potential to facilitate the acceptance of misinformation as fact." [13] Fielding contrasted use of the CRAAP method, a "vertical reading" of a single website, with "lateral reading", a fact-checking method to find and compare multiple sources of information on the same topic or event. [13]

In a 2020 working paper, Sam Wineburg, Joel Breakstone, Nadav Ziv and Mark Smith found that using the CRAAP method for information literacy education makes "students susceptible to misinformation". According to these authors the method needs thorough adaptation in order to help students detect fake news and biased or satirical sources in the digital age. [14]

Related Research Articles

<span class="mw-page-title-main">Phonics</span> Method of teaching reading and writing

Phonics is a method for teaching reading and writing to beginners. To use phonics is to teach the relationship between the sounds of the spoken language (phonemes), and the letters (graphemes) or groups of letters or syllables of the written language. Phonics is also known as the alphabetic principle or the alphabetic code. It can be used with any writing system that is alphabetic, such as that of English, Russian, and most other languages. Phonics is also sometimes used as part of the process of teaching Chinese people to read and write Chinese characters, which are not alphabetic, using pinyin, which is.

A teaching method is a set of principles and methods used by teachers to enable student learning. These strategies are determined partly on subject matter to be taught and partly by the nature of the learner. For a particular teaching method to be appropriate and efficient it has take into account the learner, the nature of the subject matter, and the type of learning it is supposed to bring about.

The Association of College and Research Libraries defines information literacy as a "set of integrated abilities encompassing the reflective discovery of information, the understanding of how information is produced and valued and the use of information in creating new knowledge and participating ethically in communities of learning". In the United Kingdom, the Chartered Institute of Library and Information Professionals' definition also makes reference to knowing both "when" and "why" information is needed.

Educational assessment or educational evaluation is the systematic process of documenting and using empirical data on the knowledge, skill, attitudes, aptitude and beliefs to refine programs and improve student learning. Assessment data can be obtained from directly examining student work to assess the achievement of learning outcomes or can be based on data from which one can make inferences about learning. Assessment is often used interchangeably with test, but not limited to tests. Assessment can focus on the individual learner, the learning community, a course, an academic program, the institution, or the educational system as a whole. The word "assessment" came into use in an educational context after the Second World War.

Library collection development is the process of systematically building the collection of a particular library to meet the information needs of the library users in a timely and economical manner using information resources locally held as well as resources from other organizations. "According to is a dynamic self perpetuation cycle or process and consists six definable stages namely,community analysis, selection policies, selection, acquisition, weeding and evaluation.

Accelerated Reader is a website used to assist students with reading skills. It is a digital program aiming to help students and teachers manage and monitor independent reading practice in English and Spanish. Students pick a book at their own level and read it at their own pace. When a student finish their book, they take a short quiz on the computer to check their understanding. As students read and take quizzes, they receive points depending on the book's reading level. The more difficult the book is, the more points the students receive. AR also tracks the students' progress towards their individualized Accelerated Reader goals.

<span class="mw-page-title-main">School library</span> Library within a school

A school library is a library within a school where students, staff, and often, parents of a public or private school have access to a variety of resources. The goal of the school library media center is to ensure that all members of the school community have equitable access "to books and reading, to information, and to information technology." A school library media center "uses all types of media... is automated, and utilizes the Internet [as well as books] for information gathering." School libraries are distinct from public libraries because they serve as "learner-oriented laboratories which support, extend, and individualize the school's curriculum... A school library serves as the center and coordinating agency for all material used in the school."

<span class="mw-page-title-main">Digital literacy</span> Ones fluency in subjects involving digital matters

Digital literacy is an individual's ability to find, evaluate, and communicate information using typing or digital media platforms. It is a combination of both technical and cognitive abilities in using information and communication technologies to create, evaluate, and share information.

Library instruction, also called bibliographic instruction, user education and library orientation, consists of "instructional programs designed to teach library users how to locate the information they need quickly and effectively. [It] usually covers the library's system of organizing materials, the structure of the literature of the field, research methodologies appropriate to the academic discipline, and specific resources and finding tools " It prepares individuals to make immediate and lifelong use of information effectively by teaching the concepts and logic of information access and evaluation, and by fostering information independence and critical thinking. Above all they are aimed at equipping library users with skills to locate library sources and use them effectively to satisfy their information needs.

Inquiry-based learning is a form of active learning that starts by posing questions, problems or scenarios. It contrasts with traditional education, which generally relies on the teacher presenting facts and their knowledge about the subject. Inquiry-based learning is often assisted by a facilitator rather than a lecturer. Inquirers will identify and research issues and questions to develop knowledge or solutions. Inquiry-based learning includes problem-based learning, and is generally used in small-scale investigations and projects, as well as research. The inquiry-based instruction is principally very closely related to the development and practice of thinking and problem-solving skills.

<span class="mw-page-title-main">Pacific Northwest tree octopus</span> Internet hoax

The Pacific Northwest tree octopus is an Internet hoax created in 1998 by a humor writer under the pseudonym Lyle Zapato. Since its creation, the Pacific Northwest tree octopus website has been commonly referenced in Internet literacy classes in schools and has been used in multiple studies demonstrating children's gullibility regarding online sources of information.

Library anxiety refers to the "feeling that one’s research skills are inadequate and that those shortcomings should be hidden". In some students this manifests as an outright fear of libraries and the librarians who work there. The term stems from a 1986 article by Constance Mellon, a professor of library science in the U.S. state of North Carolina, titled "Library anxiety: A grounded theory and its development" in the College & Research Libraries journal.

<span class="mw-page-title-main">Transliteracy</span> Ability to use diverse techniques to collaborate across different social groups

Transliteracy is "a fluidity of movement across a range of technologies, media and contexts". It is an ability to use diverse techniques to collaborate across different social groups.

<span class="mw-page-title-main">Information and media literacy</span> Overview of information and media literacy

Information and media literacy (IML) enables people to show and make informed judgments as users of information and media, as well as to become skillful creators and producers of information and media messages. IML is a combination of information literacy and media literacy. The transformative nature of IML includes creative works and creating new knowledge; to publish and collaborate responsibly requires ethical, cultural and social understanding.

A virtual school library is a PreK-12 library that is a subunit of a virtual school—using the same telecommunications network to provide equitable access to electronic resources and communication designed to support the school's curriculum.

<span class="mw-page-title-main">Evidence-based education</span> Paradigm of the education field

Evidence-based education (EBE) is the principle that education practices should be based on the best available scientific evidence, rather than tradition, personal judgement, or other influences. Evidence-based education is related to evidence-based teaching, evidence-based learning, and school effectiveness research. For example, research has shown that spaced repetition "leads to more robust memory formation than massed training does, which involves short or no intervals".

<span class="mw-page-title-main">International Society for Music Information Retrieval</span>

The International Society for Music Information Retrieval (ISMIR) is an international forum for research on the organization of music-related data. It started as an informal group steered by an ad hoc committee in 2000 which established a yearly symposium - whence "ISMIR", which meant International Symposium on Music Information Retrieval. It was turned into a conference in 2002 while retaining the acronym. ISMIR was incorporated in Canada on July 4, 2008.

The S.U.R.E. Campaign is an information literacy awareness campaign initiated by the National Library Board (NLB) of Singapore. In Singapore, the NLB drives the information literacy awareness for the nation.

Project Information Literacy (PIL) is a research institute that conducts national, ongoing scholarly studies on how early adults find and use information as they progress through, and beyond, their higher education years.

<span class="mw-page-title-main">Instructional materials</span> Materials used to impart knowledge

Instructional material, also known as teaching/learning materials (TLM), are any collection of materials including animate and inanimate objects and human and non-human resources that a teacher may use in teaching and learning situations to help achieve desired learning objectives. Instructional materials may aid a student in concretizing a learning experience so as to make learning more exciting, interesting and interactive. They are tools used in instructional activities, which include active learning and assessment. The term encompasses all the materials and physical means an instructor might use to implement instruction and facilitate students achievement of instructional objectives.

References

  1. 1 2 3 4 5 6 7 8 Korber, Irene. "LibGuides: Literature Reviews: Evaluating Info". libguides.csuchico.edu. Archived from the original on 2018-05-08. Retrieved 2018-05-21.
  2. 1 2 3 Blakeslee, Sarah (2004). "The CRAAP Test". LOEX Quarterly. 31 (3). Archived from the original on 2018-06-12. Retrieved 2018-05-28.
  3. "Library Staff Directory | Meriam Library". library.csuchico.edu. Archived from the original on 2018-09-05. Retrieved 2018-05-27.
  4. "Project SAILS: Standardized Assessment of Information Literacy Skills". Project SAILS. May 29, 2018. Archived from the original on May 28, 2018. Retrieved June 3, 2018.
  5. 1 2 3 4 Berg, Cara (March–April 2017). "Teaching Website Evaluation The CRAAP Test and the Evolution of an Approach". Internet@schools. 24 (2): 8–11. Archived from the original on 10 August 2019. Retrieved 25 July 2019.
  6. Renirie, Rebecca. "Research Guides: Website Research: CRAAP Test". libguides.cmich.edu. Archived from the original on 2017-12-27. Retrieved 2018-06-12.
  7. Hopkins, Joan. "Research Guides: Evaluating Sources: The CRAAP Test". researchguides.ben.edu. Archived from the original on 2018-06-12. Retrieved 2018-06-12.
  8. Casey, Sharon. "Research Guides: Evaluate It! : C.R.A.A.P. Criteria". libraryguides.ccbcmd.edu. Archived from the original on 2018-06-12. Retrieved 2018-06-12.
  9. Lenker, Mark (October 2017). "Developmentalism: Learning as the Basis for Evaluating Information". portal: Libraries and the Academy . 17 (4): 721–737. doi:10.1353/pla.2017.0043. S2CID   148728541. Archived from the original on 2019-01-01. Retrieved 2019-12-19.
  10. Caulfied, Mike (September 14, 2018). "A Short History of CRAAP". hapgood.us. Archived from the original on 2019-04-01. Retrieved 2019-06-14.
  11. Fister, Barbara; MacMillan, Margy (May 31, 2019). "Mike Caulfield: Truth Is in the Network: Smart Talk Interview, no. 31". projectinfolit.org. Project Information Literacy. Archived from the original on 2019-08-06. Retrieved 2019-06-14.
  12. See also: Stellino, Molly (December 12, 2018). "Shortcut roundup: quick guides to become media literate". newscollab.org. News Co/Lab at the Walter Cronkite School of Journalism and Mass Communication, Arizona State University. Archived from the original on 2019-04-06. Retrieved 2019-06-19. Stellino lists Caulfield's four moves (an earlier version of SIFT) alongside other acronyms and heuristics and then summarizes the common factors that she sees in all of them.
  13. 1 2 Fielding, Jennifer A. (December 2019). "Rethinking CRAAP: Getting students thinking like fact-checkers in evaluating web sources". C&RL News. 80 (11): 620–622. doi: 10.5860/crln.80.11.620 . S2CID   214267304. Archived from the original on 2019-12-31. Retrieved 2019-12-31.
  14. Wineburg, Sam; Breakstone, Joel; Ziv, Nadav; Smith, Mark (2020). "Educating for Misunderstanding: How Approaches to Teaching Digital Literacy Make Students Susceptible to Scammers, Rogues, Bad Actors, and Hate Mongers". Stanford History Working Group Working Paper. Working Paper A-21322. Archived from the original on 2021-08-11. Retrieved 2021-08-11.