Expertise reversal effect

Last updated

The expertise reversal effect refers to the reversal of the effectiveness of instructional techniques on learners with differing levels of prior knowledge. [1] [2] The primary recommendation that stems from the expertise reversal effect is that instructional design methods need to be adjusted as learners acquire more knowledge in a specific domain. Expertise is described as "the ability to perform fluently in a specific class of tasks." [2]

Instructional design (ID), also known as instructional systems design (ISD), is the practice of systematically designing, developing and delivering instructional products and experiences, both digital and physical, in a consistent and reliable fashion towards an efficient, effective, appealing, engaging and inspiring acquisition of knowledge. The process consists broadly of determining the state and needs of the learner, defining the end goal of instruction, and creating some "intervention" to assist in the transition. The outcome of this instruction may be directly observable and scientifically measured or completely hidden and assumed. There are many instructional design models but many are based on the ADDIE model with the five phases: analysis, design, development, implementation, and evaluation.

Contents

Instructional techniques that assist learners to create long term memory schema are more effective for novices or low-knowledge individuals, who approach a learning situation or task without these knowledge structures to rely on. In contrast, for higher-knowledge learners or experts, i.e. learners with more prior knowledge of the task, the reverse is true, such that reduced guidance often results in better performance than well-guided instruction. [1] [3] Slava Kalyuga, one of the leading researchers in this area, writes, "instructional guidance, which may be essential for novices, may have negative consequences for more experienced learners." [3]

In psychology and cognitive science, a schema describes a pattern of thought or behavior that organizes categories of information and the relationships among them. It can also be described as a mental structure of preconceived ideas, a framework representing some aspect of the world, or a system of organizing and perceiving new information. Schemata influence attention and the absorption of new knowledge: people are more likely to notice things that fit into their schema, while re-interpreting contradictions to the schema as exceptions or distorting them to fit. Schemata have a tendency to remain unchanged, even in the face of contradictory information. Schemata can help in understanding the world and the rapidly changing environment. People can organize new perceptions into schemata quickly as most situations do not require complex thought when using schema, since automatic thought is all that is required.

The expertise reversal effect is a specific example of an aptitude by treatment interaction (ATI), which is a more general phenomenon in which learning environments that have positive effects for one type of person have neutral or even negative effects for another type of person. [4]

Cognitive load theory

The expertise reversal effect is typically explained within a cognitive load framework. [3] [5] Cognitive load theory assumes that a learner's existing cognitive resources can influence the effectiveness of instructional techniques. [6] The goal of any learning task is to construct integrated mental representations of the relevant information, which requires considerable working memory resources. To accomplish the task without overwhelming working memory, some form of guidance is needed.

In cognitive psychology, cognitive load refers to the used amount of working memory resources. Cognitive load theory differentiates cognitive load into three types: intrinsic, extraneous, and germane.

Working memory is a cognitive system with a limited capacity that is responsible for temporarily holding information available for processing. Working memory is important for reasoning and the guidance of decision-making and behavior. Working memory is often used synonymously with short-term memory, but some theorists consider the two forms of memory distinct, assuming that working memory allows for the manipulation of stored information, whereas short-term memory only refers to the short-term storage of information. Working memory is a theoretical concept central to cognitive psychology, neuropsychology, and neuroscience.

Low-knowledge learners lack schema-based knowledge in the target domain and so this guidance comes from instructional supports, which help reduce the cognitive load associated with novel tasks. If the instruction fails to provide guidance, low-knowledge learners often resort to inefficient problem-solving strategies that overwhelm working memory and increase cognitive load. Thus, low-knowledge learners benefit more from well-guided instruction than from reduced guidance. [1]

In contrast, higher-knowledge learners enter the situation with schema-based knowledge, which provides internal guidance. If additional instructional guidance is provided it can result in the processing of redundant information and increased cognitive load. "Learners would have to relate and reconcile the related components of available long-term memory base and externally provided guidance. Such integration processes may impose an additional working memory load and reduce resources available for learning new knowledge." [1] In this case, the external guidance becomes redundant relative to the learner's internal schemas and is less beneficial than a reduced-guidance technique.

Long-term memory (LTM) is the stage of the Atkinson–Shiffrin memory model where informative knowledge is held indefinitely. It is defined in contrast to short-term and working memory, which persist for only about 18 to 30 seconds. Long-term memory is commonly labelled as explicit memory (declarative), as well as episodic memory, semantic memory, autobiographical memory, and implicit memory.

The differing effect of externally provided instructional guidance on learners with varying levels of prior knowledge Expertise reversal effect diagram.png
The differing effect of externally provided instructional guidance on learners with varying levels of prior knowledge

Although this cognitive load theory-driven explanation for the expertise reversal effect is plausible, there are a few caveats to keep in mind. First, many studies that demonstrate expertise reversal effects rely on subjective measures of cognitive load. [7] [8] For example, one common measure is to have learners rate task difficulty by answering the following question on a scale from 1 (extremely easy) to 7 (extremely difficult): "How easy or difficult was it to complete this task?" [9] [10] [11] Some researchers claim that such ratings are increasingly being used as an effective and valid measure of subjective cognitive load. [9] However, others question the use of subjective measures. For example, some question people's ability to provide accurate self-reports of mental effort. [12] Others suggest that there is no way to know how subjective ratings relate to actual cognitive load. [13] [14] Second, expertise reversal effects have been found in studies outside of the cognitive load paradigm, indicating that alternative explanations remain viable. [1] For example, a number of explanations center on motivational processes. [15] [16]

Examples

The expertise reversal effect has been found in a variety of domains and for a variety of instructional techniques. Listed below are just a small set of examples, all of which are described more thoroughly in Kalyuga, Ayres, Chandler, & Sweller, 2003. [3]

Interactions between levels of knowledge and the worked-example effect: Worked examples provide a problem statement followed by a step-by-step demonstration of how to solve it. Worked examples are often contrasted with open-ended problem solving in which the learner is responsible for providing the step-by-step solution. Low-knowledge learners benefit more from studying structured worked-out examples than from solving problems on their own. However, as knowledge increases, open-ended problem solving becomes the more effective learning activity. [17]

Interactions between levels of knowledge and the imagination effect: The imagination effect occurs when imagining the instructional material is more effective than studying the instructional material. The idea is that imagining the material supports the generation and construction of mental representations. Generally, low-knowledge learners benefit more from studying instructional material than from imagining it. However, as knowledge increases, imagining a procedure or set of relations becomes the more effective learning activity. [18]

Interactions between levels of knowledge and the split attention effect: The split attention effect occurs when two or more related sources of information are presented apart from one another in time or space (e.g., text located separately from a diagram). Mentally integrating the two pieces can require considerable working memory resources. If the sources provide similar information, there are two options to reduce split attention: one is physically to integrate the two sources of the information and the other is simply to eliminate one of them. For low-knowledge learners, physical integration of two or more sources of information is more beneficial than eliminating one of the sources. However, as knowledge increases, eliminating one of the sources becomes the more effective instructional method. [19]

Interactions between levels of knowledge and segmentation in multimedia learning : Segmentation is a strategy used to manage cognitive load, particularly with multimedia learning. By creating breaks in the instructional material (for example, dividing animations into several videos), segmentation reduces cognitive load by giving the learner time to process and reflect on the information. [20] In addition, segments indicate what information is important by chunking information. Research conducted by Spanjers et al. (2011) suggests an expertise reversal effect when using segmentation in animations. While low knowledge learners benefited from learning from animated material that was segmented, high-knowledge learners did not. While there was no difference in performance in this study, participants indicated a difference in mental effort and efficiency between low knowledge learners and high prior knowledge learners. The authors recommend that segmentation of animation be used for low prior knowledge learners, and using continuous animation for high prior knowledge learners. [21]

Addressing

Adaptive fading in worked examples

Studies addressing the expertise reversal effect have found worked examples, particularly those which "tailor fading of worked examples to individual students' growing expertise levels", [22] to be effective in improving learning results (Atkinson et al. 2003; Renkl et al. 2002, 2004; Renkl and Atkinson 2007). [22] Worked examples reduce cognitive load, reducing the "problem-solving demand by providing worked-out solutions." [22]

A key consideration in the success of worked examples is the use of gradual fading of worked-out steps as the learner progresses through the instruction. While fixed fading (previously decided fading points with no individual connection to the learner) provides better results than general problem solving, results from adaptive fading showed even better learner knowledge acquisition. Adaptive fading is the fading of worked-out steps in response to learner demonstration of understanding, allowing for higher knowledge learners to progress in a way that minimizes the expertise reversal effect.

The advent of intelligent instructional software such as Cognitive Tutor, which can trace student learning and assess knowledge acquisition, provides a platform within which adaptive fading can be applied. In response to learner assessments, the software can provide embedded "adaptive individualized example fading mechanism[s]". [22] To ensure that learners do not experience the expertise reversal effect, such software must conduct further, ongoing assessment of learner progress and make adjustments to adapt and provide "optimal example fading" [22] that addresses the individual learner's needs.

Notes

  1. 1 2 3 4 5 Kalyuga, S. (2007). Expertise reversal effect and its implications for learner-tailored instruction. Educational Psychology Review , 19, 509–539.
  2. 1 2 Kalyuga, S., Rikers, R., Pass, F. (2012). Educational implications of expertise reversal effect in learning and performance of complex cognitive and sensorimotor skills. Educational Psychology Review, 24, 313-337.
  3. 1 2 3 4 Kalyuga, S., Ayres, P., Chandler, P., & Sweller, J. (2003). The expertise reversal effect. Educational Psychologist, 38, 23-31.
  4. Cronbach, L. J., & Snow, R. E. (1977). Aptitudes and instructional methods: A handbook for research on interactions. New York: Irvington
  5. Kalyuga, S. (2009). Knowledge elaboration: A cognitive load perspective. Learning and Instruction, 19, 402-410.
  6. Sweller, J., van Merrienboer, J. J. G., & Paas, F. (1998). Cognitive architecture and instructional design. Educational Psychology Review, 10, 251-296.
  7. Ayres, P. (2006). Using subjective measures to detect variations of intrinsic cognitive load within problems. Learning and Instruction, 16, 389-400.
  8. Paas, F., Tuovinen, J. E., Tabbers, H., & van Gerven, P. (2003). Cognitive load measurement as a means to advance cognitive load theory. Educational Psychologist, 38, 63-71.
  9. 1 2 Kalyuga, S., Chandler, P, & Sweller, J. (2004). When redundant on-screen text in multimedia technical instruction can interfere with learning. Human Factors, 46, 567-581.
  10. Kalyuga, S., Chandler, P., & Sweller, J. (2000). Incorporating learner experience into design of multimedia instruction. Journal of Educational Psychology, 92, 126-136.
  11. Mayer, R. E., & Chandler, P. (2001). When learning is just a click away: Does simple user interaction foster deeper understanding of multimedia messages?Journal of Educational Psychology, 93, 390-397.
  12. Schnotz, W., & Kurschner, C. (2007). A reconsideration of cognitive load theory. Educational Psychology Review, 19, 469-508.
  13. Brunken, R., Plaas J. L., & Leutner, D. (2003). Direct measurement of cognitive load in multimedia learning. Educational Psychologist, 38, 53-61.
  14. Kirschner, P. A., Ayres, P., & Chandler, P. (2011). Contemporary cognitive load research: The good, the bad, and the ugly. Computers in Human Behavior, 27, 99-105.
  15. Paas, F., Tuovinen, J. E., van Merrienboer, J. J. G., & Darabi, A. A. (2005). A motivational perspective on the relation between mental effort and performance: Optimizing learner involvement in instruction. Educational Technology Research and Development, 58, 193-198.
  16. Schnotz, W. (2010). Reanalyzing the expertise reversal effect. Instructional Science, 38, 315-323.
  17. Renkl, A., & Atkinson, R. K. (2003). Structuring the transition from example study to problem solving in cognitive skill acquisition: A cognitive load perspective. Educational Psychologist, 38, 15-22.
  18. Cooper, G., Tindall-Ford, S., Chandler, P., & Sweller, J. (2001). Learning by imagining procedures and concepts. Journal of Experimental Psychology: Applied, 7, 68-82.
  19. Kalyuga, S., Chandler, P., & Sweller, J. (1998). Levels of expertise and instructional design. Human Factors, 40, 1-17.
  20. Mayer, R. & Moreno, R (2003). Nine ways to reduce cognitive load in multimedia learning. Educational Psychologist. 38, 43-52.
  21. Spanjers, I.A.E., Wouters, P., van Gog, T., van Merrienboer, J.J.G. (2011). An expertise reversal effect of segmentation in learning from animated worked-out examples. Computers in Human Behaviour. 27, 46-52.
  22. 1 2 3 4 5 Salden, R.J.C.M, Aleven, V., Schwonke, R., & Renkl, A. (2008). The expertise reversal effect and worked examples in tutored problem solving. Instructional Science, 38, 289-307.

Related Research Articles

Educational psychology is the branch of psychology concerned with the scientific study of human learning. The study of learning processes, from both cognitive and behavioral perspectives, allows researchers to understand individual differences in intelligence, cognitive development, affect, motivation, self-regulation, and self-concept, as well as their role in learning. The field of educational psychology relies heavily on quantitative methods, including testing and measurement, to enhance educational activities related to instructional design, classroom management, and assessment, which serve to facilitate learning processes in various educational settings across the lifespan.

Learning is the process of acquiring new, or modifying existing, knowledge, behaviors, skills, values, or preferences. The ability to learn is possessed by humans, animals, and some machines; there is also evidence for some kind of learning in some plants. Some learning is immediate, induced by a single event, but much skill and knowledge accumulates from repeated experiences. The changes induced by learning often last a lifetime, and it is hard to distinguish learned material that seems to be "lost" from that which cannot be retrieved.

Instructional scaffolding is the support given during the learning process which is tailored to the needs of the student with the intention of helping the student achieve his/her learning goals This learning process is designed to promote a deeper level of learning.

In psychology, cognitivism is a theoretical framework for understanding the mind that gained credence in the 1950s. The movement was a response to behaviorism, which cognitivists said neglected to explain cognition. Cognitive psychology derived its name from the Latin cognoscere, referring to knowing and information, thus cognitive psychology is an information-processing psychology derived in part from earlier traditions of the investigation of thought and problem solving.

Problem-based learning student-centered pedagogy in which students learn about a subject through the experience of problem solving

Problem-based learning (PBL) is a student-centered pedagogy in which students learn about a subject through the experience of solving an open-ended problem found in trigger material. The PBL process does not focus on problem solving with a defined solution, but it allows for the development of other desirable skills and attributes. This includes knowledge acquisition, enhanced group collaboration and communication. The PBL process was developed for medical education and has since been broadened in applications for other programs of learning. The process allows for learners to develop skills used for their future practice. It enhances critical appraisal, literature retrieval and encourages ongoing learning within a team environment.

Concept map diagram showing relationships among concepts

A concept map or conceptual diagram is a diagram that depicts suggested relationships between concepts. It is a graphical tool that instructional designers, engineers, technical writers, and others use to organize and structure knowledge.

A cognitive tutor is a particular kind of intelligent tutoring system that utilizes a cognitive model to provide feedback to students as they are working through problems. This feedback will immediately inform students of the correctness, or incorrectness, of their actions in the tutor interface; however, cognitive tutors also have the ability to provide context-sensitive hints and instruction to guide students towards reasonable next steps.

Constructivism (philosophy of education) philosophical viewpoint about the nature of knowledge; theory of knowledge

Constructivism is a philosophical viewpoint about the nature of knowledge. Therefore, it represents an epistemological stance.

Metacognition is "cognition about cognition", "thinking about thinking", "knowing about knowing", becoming "aware of one's awareness" and higher-order thinking skills. The term comes from the root word meta, meaning "beyond", or "on top of". Metacognition can take many forms; it includes knowledge about when and how to use particular strategies for learning or problem-solving. There are generally two components of metacognition: (1) knowledge about cognition and (2) regulation of cognition.

Cognitive apprenticeship is a theory that emphasizes the importance of the process in which a master of a skill teaches that skill to an apprentice.

Educational animations are animations produced for the specific purpose of fostering learning.

Model-centered instruction is a general theory of instructional design developed by Andrew S. Gibbons. This theory can be used to design individual and group instruction for all kinds of learning in any type of learning environment. In addition, this theory may be used to design instruction with a wide variety of technologies and many media delivery systems.

Discovery learning

Discovery learning is a technique of inquiry-based learning and is considered a constructivist based approach to education. It is also referred to as problem-based learning, experiential learning and 21st century learning. It is supported by the work of learning theorists and psychologists Jean Piaget, Jerome Bruner, and Seymour Papert. Although this form of instruction has great popularity, there is some debate in the literature concerning its efficacy.

E-learning theory describes the cognitive science principles of effective multimedia learning using electronic educational technology.

The split-attention effect is a learning effect inherent within some poorly designed instructional materials. It is apparent when the same modality is used for various types of information within the same display. To learn from these materials, learners must split their attention between these materials to understand and use the materials provided.

The worked-example effect is a learning effect predicted by cognitive load theory. Specifically, it refers to the learning effect observed when worked-examples are used as part of instruction, compared to other instructional techniques such as problem-solving and discovery learning. According to Sweller: "The worked example effect is the best known and most widely studied of the cognitive load effects".

Subgoal labeling is giving a name to a group of steps, in a step-by-step description of a process, to explain how the group of steps achieve a related subgoal. This concept is used in the fields of cognitive science and educational psychology.

Seductive details are often used in textbooks, lectures, slideshows, and other forms of educational content to make a course more interesting or interactive. Seductive details can take the form of text, photos, illustrations, sounds or music and are by definition: (1) interesting and (2) not directed toward the learning objectives of a lesson. John Dewey, in 1913, first referred to this as “fictitious inducements to attention.” While illustrated text can enhance comprehension, illustrations that are not relevant can lead to poor learning outcomes. Since the late 1980s, many studies in the field of educational psychology have shown that the addition of seductive details results in poorer retention of information and transfer of learning. Thalheimer conducted a meta-analysis that found, overall, a negative impact for the inclusion of seductive details such as text, photos or illustrations, and sounds or music in learning content. This reduction to learning is called the seductive details effect. Recently, there have been many criticisms of this theory. Critics cite unconvincing and contradictory evidence to argue that seductive details do not always impede understanding and that seductive details can sometimes be motivating for learners.