Modality effect

Last updated

The modality effect is a term used in experimental psychology, most often in the fields dealing with memory and learning, to refer to how learner performance depends on the presentation mode of studied items.

Contents

Description

Modality can refer to a number of characteristics of the presented study material. However, this term is usually used to describe the improved recall of the final items of a list when that list is presented verbally in comparison with a visual representation. The effect is seen in free recall (recall of list items in any given order), serial recall (recall of list items in the order of study), short-term sentence recall (recall specific words from sentences with similar meanings) and paired associate recall (recall of a pair from presentation of one of its members). For paired associates, the effect is limited to an increased probability of recall for the final 2 or 3 pairs studied. [1] In free recall and serial recall, the modality effect is seen as simply an exaggerated recency effect in tests where presentation is auditory. In short-term sentence recall studies, emphasis is placed on words in a distractor-word list when requesting information from the remembered sentence. This demonstrates the modality effect can be more than auditory or visual. [2]

For serial recall, the modality effect is seen in an increased memory span for auditorally presented lists. Memory span is defined as the maximum number of items that participants correctly recall in 50% of trials. Typically, studies find these to be seven digits, six letters and five words. [3] In a study done by Drewnowski and Murdock, a visual list of English words was found to have an immediate recall of 4.82 words while an auditory representation of this same list led to a memory span of 5.36, a statistically significant variance. [4]

Some studies use the term modality to refer to a general difference in performance based upon the mode of presentation. For example, Gibbons demonstrated modality effects in an experiment by making participants count either beeping sounds or visually presented dots. The to-be-remembered number was derived from the number of dots or beeps counted. [5] In memory experiments, the modality effect is an example of source clustering, which refers to the tendency of items presented in the same modality to be grouped together during recall. [6] Within-list manipulations of modality affect recall probability, order of recall, and grouping. [7]

Bennet Murdock used a basic free recall paradigm, with different types of lists, mixing auditorally and visually presented words. The results he obtained showed that modality improved recency but did not affect recall for the pre-recency items. This effect was seen to be slightly larger when the items for study were presented more rapidly. [8] However, with mixed list presentations (lists presented both auditorally and visually in a single study period) the superiority of auditory study is seen in all serial positions, not just in recency. Murdock interprets this as evidence for separate short term stores for visual and auditory memory.

Glenberg [9] showed that the modality effect is also prevalent in long term memory, showing that to-be-remembered word pairs that are separated by distractor activity are better recalled if presented auditorally vs. visually. By using techniques similar to Murdock's free recall paradigm, plus the addition of varied amounts of distraction time (filled with counting backwards), Glenberg showed that the modality effect is not affected by a disruptive task and therefore is theoretically not restricted to short term memory.

In his book about teaching Mathematics, Craig Barton refers to the Modality Effect, arguing that students learn better when images or narrations are presented alongside verbal narration, as opposed to being presented with on screen text. [10] This is because the text would be initially processed as an image, adding to the work already being done by the brain in processing the other image. In contrast, the narration is dealt with by the 'Phonological Loop' while the 'Visuospatial Sketchpad' deals separately with the original image and hence both pieces of information can be processed simultaneously. Teachers can hence seek to avoid overloading students' working memories by not using slides containing many images and text at the same time.

Several terms have been used to refer to the modality effect on recency. Crowder and Morton [11] refer to it as PAS, or precategorical acoustic store. This and other similar terms (echoic memory, phonological loop) are used to explain a specialized short-term memory system store for phonological information. [12]

See also

Related Research Articles

Short-term memory is the capacity for holding, but not manipulating, a small amount of information in mind in an active, readily available state for a short period of time. For example, short-term memory can be used to remember a phone number that has just been recited. The duration of short-term memory is believed to be in the order of seconds. A commonly cited capacity of items to remember is The Magical Number Seven, Plus or Minus Two. Cowan (2001) suggests that a more realistic figure is 4±1 items). In contrast, long-term memory holds information indefinitely.

Recall in memory refers to the mental process of retrieval of information from the past. Along with encoding and storage, it is one of the three core processes of memory. There are three main types of recall: free recall, cued recall and serial recall. Psychologists test these forms of recall as a way to study the memory processes of humans and animals. Two main theories of the process of recall are the two-stage theory and the theory of encoding specificity.

"The Magical Number Seven, Plus or Minus Two: Some Limits on Our Capacity for Processing Information" is one of the most highly cited papers in psychology. It was written by the cognitive psychologist George A. Miller of Harvard University's Department of Psychology and published in 1956 in Psychological Review. It is often interpreted to argue that the number of objects an average human can hold in short-term memory is 7 ± 2. This has occasionally been referred to as Miller's law.

The interference theory is a theory regarding human memory. Interference occurs in learning. The notion is that memories encoded in long-term memory (LTM) are forgotten and cannot be retrieved into short-term memory (STM) because either memory interfers, or hampers, the other. There is an immense number of encoded memories within the storage of LTM. The challenge for memory retrieval is recalling the specific memory and working in the temporary workspace provided in STM. Retaining information regarding the relevant time of encoding memories into LTM influences interference strength. There are two types of interference effects: proactive and retroactive interference.

The Decay theory is a theory that proposes that memory fades due to the mere passage of time. Information is therefore less available for later retrieval as time passes and memory, as well as memory strength, wears away. When an individual learns something new, a neurochemical "memory trace" is created. However, over time this trace slowly disintegrates. Actively rehearsing information is believed to be a major factor counteracting this temporal decline. It is widely believed that neurons die off gradually as we age, yet some older memories can be stronger than most recent memories. Thus, decay theory mostly affects the short-term memory system, meaning that older memories are often more resistant to shocks or physical attacks on the brain. It is also thought that the passage of time alone cannot cause forgetting, and that decay theory must also take into account some processes that occur as more time passes.

The Atkinson–Shiffrin model is a model of memory proposed in 1968 by Richard Atkinson and Richard Shiffrin. The model asserts that human memory has three separate components:

  1. a sensory register, where sensory information enters memory,
  2. a short-term store, also called working memory or short-term memory, which receives and holds input from both the sensory register and the long-term store, and
  3. a long-term store, where information which has been rehearsed in the short-term store is held indefinitely.
Picture superiority effect

The picture superiority effect refers to the phenomenon in which pictures and images are more likely to be remembered than words. This effect has been demonstrated in numerous experiments using different methods. It is based on the notion that "human memory is extremely sensitive to the symbolic modality of presentation of event information". Explanations for the picture superiority effect are not concrete and are still being debated.

The spacing effect demonstrates that learning is more effective when study sessions are spaced out. This effect shows that more information is encoded into long-term memory by spaced study sessions, also known as spaced repetition or spaced presentation, than by massed presentation (“cramming”).

Serial-position effect Tendency of a person to recall the first and last items in a series best, and the middle items worst

Serial-position effect is the tendency of a person to recall the first and last items in a series best, and the middle items worst. The term was coined by Hermann Ebbinghaus through studies he performed on himself, and refers to the finding that recall accuracy varies as a function of an item's position within a study list. When asked to recall a list of items in any order, people tend to begin recall with the end of the list, recalling those items best. Among earlier list items, the first few items are recalled more frequently than the middle items.

In cognitive psychology, chunking is a process by which individual pieces of an information set are broken down and then grouped together in a meaningful whole. The chunks by which the information is grouped is meant to improve short-term retention of the material, thus bypassing the limited capacity of working memory and allowing the working memory to be more efficient. A chunk is a collection of basic familiar units that have been grouped together and stored in a person's memory. These chunks are able to be retrieved more easily due to their coherent familiarity. It is believed that individuals create higher order cognitive representations of the items within the chunk. The items are more easily remembered as a group than as the individual items themselves. These chunks can be highly subjective because they rely on an individual's perceptions and past experiences, that are able to be linked to the information set. The size of the chunks generally ranges anywhere from two to six items, but often differs based on language and culture.

Baddeley's model of working memory is a model of human memory proposed by Alan Baddeley and Graham Hitch in 1974, in an attempt to present a more accurate model of primary memory. Working memory splits primary memory into multiple components, rather than considering it to be a single, unified construct.

The Levels of Processing model, created by Fergus I. M. Craik and Robert S. Lockhart in 1972, describes memory recall of stimuli as a function of the depth of mental processing. Deeper levels of analysis produce more elaborate, longer-lasting, and stronger memory traces than shallow levels of analysis. Depth of processing falls on a shallow to deep continuum. Shallow processing leads to a fragile memory trace that is susceptible to rapid decay. Conversely, deep processing results in a more durable memory trace.

In psychology and neuroscience, memory span is the longest list of items that a person can repeat back in correct order immediately after presentation on 50% of all trials. Items may include words, numbers, or letters. The task is known as digit span when numbers are used. Memory span is a common measure of working memory and short-term memory. It is also a component of cognitive ability tests such as the WAIS. Backward memory span is a more challenging variation which involves recalling items in reverse order.

The generation effect is a phenomenon where information is better remembered if it is generated from one's own mind rather than simply read. Researchers have struggled to account for why generated information is better recalled than read information, but no single explanation has been sufficient.

Free recall is a basic paradigm in the psychological study of memory. In this paradigm, participants study a list of items on each trial, and then are prompted to recall the items in any order. Items are usually presented one at a time for a short duration, and can be any of a number of nameable materials, although traditionally, words from a larger set are chosen. The recall period typically lasts a few minutes, and can involve spoken or written recall. The standard paradigm involves the recall period starting immediately after the final list item; this can be referred to as immediate free recall (IFR) to distinguish it from delayed free recall (DFR). In delayed free recall, a short distraction period is interpolated between the final list item and the start of the recall period. Both immediate free recall and delayed free recall have been used to test certain effects that appear during recall tests, such as the primacy effect and recency effect.

Articulatory suppression is the process of inhibiting memory performance by speaking while being presented with an item to remember. Most research demonstrates articulatory suppression by requiring an individual to repeatedly say an irrelevant speech sound out loud while being presented with a list of words to recall shortly after. The individual experiences four stages when repeating the irrelevant sound: the intention to speak, programming the speech, articulating the sound or word, and receiving auditory feedback.

Nelson Cowan is the Curators' Distinguished Professor of Psychological Sciences at the University of Missouri. He specializes in working memory, the small amount of information held in mind and used for language processing and various kinds of problem solving. To overcome conceptual difficulties that arise for models of information processing in which different functions occur in separate boxes, Cowan proposed a more organically organized "embedded processes" model. Within it, representations held in working memory comprise an activated subset of the representations held in long-term memory, with a smaller subset held in a more integrated form in the current focus of attention. Other work has been on the developmental growth of working memory capacity and the scientific method. His work, funded by the National Institutes of Health since 1984, has been cited over 41,000 times according to Google Scholar. The work has resulted in over 250 peer-reviewed articles, over 60 book chapters, 2 sole-authored books, and 4 edited volumes.

In cognitive psychology, a recall test is a test of memory of mind in which participants are presented with stimuli and then, after a delay, are asked to remember as many of the stimuli as possible. Memory performance can be indicated by measuring the percentage of stimuli the participant was able to recall. An example of this would be studying a list of 10 words and later recalling 5 of them. This is a 50 percent recall. Participants' responses also may be analyzed to determine if there is a pattern in the way items are being recalled from memory. For example, if participants are given a list consisting of types of vegetables and types of fruit, their recall can be assessed to determine whether they grouped vegetables together and fruits together. Recall is also involved when a person is asked to recollect life events, such as graduating high school, or to recall facts they have learned, such as the capital of Florida.

The Deese–Roediger–McDermott (DRM) paradigm is a procedure in cognitive psychology used to study false memory in humans. The procedure was pioneered by James Deese in 1959, but it was not until Henry L. Roediger III and Kathleen McDermott extended the line of research in 1995 that the paradigm became popular. The procedure typically involves the oral presentation of a list of related words and then requires the subject to remember as many words from the list as possible. Typical results show that subjects recall a related but absent word, known as a 'lure', with the same frequency as other presented words. When asked about their experience after the test, about half of all participants report that they are sure that they remember hearing the lure, indicating a false memory – a memory for an event that never occurred.

Ranschburg effect

The Ranschburg effect, sometimes referred to as Ranschburg inhibition, is a psychological theory which refers to the substandard recall of repeated items, or listed items, in a short sequence. According to a 1973 paper in the Journal of Verbal Learning and Verbal Behavior, the Ranschburg effect is interpreted as a result of a restricted guessing strategy that excludes repetitions of remembered items as possible responses. This term is also described as the deterioration in memory performance when items are repeated in a list of items to be remembered. The Ranschburg effect can also be referred to as repetition inhibition, which should not be mistaken for repetition blindness, which refers to the failure or inability to recall repeated items from the short-term memory when sequences are presented rapidly.

References

  1. Murdock, Bennet B. (1972). Short-term Memory. The Psychology of Learning and Motivation: Advances in Research and Theory. Psychology of Learning and Motivation. 5. pp. 67–127. doi:10.1016/s0079-7421(08)60440-5. ISBN   9780125433051.
  2. Goolkasian, Paula; Paul W. Foos; Mirrenda Eaton (2009). "Modality Effects in Sentence Recall". The Journal of General Psychology. 136 (2): 205–224. doi:10.3200/GENP.136.2.205-224. PMID   19350835. S2CID   25834024.
  3. Crannell, C.W.; Parish, J.M. (1957). "A comparison of immediate memory span for digits, letters and words". Journal of Psychology. 44 (2): 319–327. doi:10.1080/00223980.1957.9713089.
  4. Drewnowski, Adam; Murdock, B.B. (1980). "The role of auditory features in memory span for words". Journal of Experimental Psychology: Human Learning and Memory. 6 (3): 319–332. doi:10.1037/0278-7393.6.3.319. PMID   7373250.
  5. Gibbons, Jeffrey A.; Velkey, Andrew K.; Partin, Kathren T. (January 2008). "Influence of recall procedures on the modality effect with numbers and enumerated stimuli". Journal of General Psychology. 135 (1): 84–104. doi:10.3200/genp.135.1.84-104. PMID   18318410. S2CID   957109.
  6. Kahana, Michael J.; Polyn, Sean M.; Norman, Keith A. (2009). "A Context Maintenance and Retrieval Model of Organizational Processes in Free Recall". Psychological Review. 116 (1): 129–156. doi:10.1037/a0014420. PMC   2630591 . PMID   19159151.
  7. Murdock, Benet B.; Walker, Keith D. (1969). "Modality Effects in Free Recall". Journal of Verbal Learning and Verbal Behavior. 8 (5): 665–676. doi:10.1016/s0022-5371(69)80120-9.
  8. Murdock, Bennet B.; Walker, Kenneth D. (1969). "Modality effects in free recall". Journal of Verbal Learning and Verbal Behavior. 8 (5): 665–676. doi:10.1016/s0022-5371(69)80120-9.
  9. Glenberg, Arthur M. (January 1984). "A retrieval account of the long-term modality effect". Journal of Experimental Psychology: Learning, Memory, and Cognition. 10 (1): 16–31. doi:10.1037/0278-7393.10.1.16. PMID   6242733.
  10. Barton, Craig (2018). How I wish I'd taught maths: Lessons learned from research, conversations with experts, and 12 years of mistakes. Melton, Suffolk. ISBN   978-1911382492. OCLC   1007075648.
  11. Crowder, Robert G.; Morton, John (1969). "Precategorical acoustic storage (PAS)". Perception & Psychophysics. 5 (6): 365–373. doi: 10.3758/bf03210660 .
  12. Baddeley, A.D. (1986). Working Memory. Oxford, England: Clarendon Press.