Bloom's 2 sigma problem

Last updated

Bloom's 2 sigma problem refers to an educational phenomenon and associated problem observed by educational psychologist Benjamin Bloom and initially reported in 1984 in the journal Educational Researcher . [1] [2] [3] Bloom's paper analyzed the results of University of Chicago PhD students Joanne Anania and Joseph Arthur Burke who, through their dissertations' research, found that the average student tutored one-to-one using mastery learning techniques performed two standard deviations better than students educated in a classroom environment with one teacher to 30 students, with or without mastery learning. As quoted by Bloom: "the average tutored student was above 98% of the students in the control class". [1] :4 Additionally, the variation of the students' achievement changed: "about 90% of the tutored students ... attained the level of summative achievement reached by only the highest 20%" of the control class. [1] :4

Contents

The phenomenon was described by Bloom as illustrative of the importance of the problem to "find methods of group instruction as effective as one-to-one tutoring". [1] The phenomenon has also been used to illustrate that factors outside of a teachers' control influences student education outcomes, motivating research in alternative teaching methods, [4] in some cases reporting larger standard deviation improvements than those predicted by the phenomenon. [5] [6] The phenomenon has also motivated developments in human-computer interaction for education, including cognitive tutors [6] and learning management systems. [7]

Mastery learning

Mastery learning is an educational philosophy first proposed by Bloom in 1968 [8] based on the premise that students must achieve a level of mastery (e.g., 90% on a knowledge test) in prerequisite knowledge before moving forward to learn subsequent information on a topic. [9] Mastery is determined with regular tests, and students who do not yet achieve mastery on the test are given additional educational support before another test. This cycle continues until the learner accomplishes mastery, and they may then move on to the next stage. Failure for a student to achieve mastery is viewed, differently from conventional educational testing, as due to instruction rather than lack of student ability. Another key element of mastery learning is that it requires attention to individual students as opposed to assessing group performance. There is good evidence to suggest the effectiveness of mastery learning for improving student educational outcomes. [9]

Two of the three groups in the original study by Bloom conducted mastery learning, with one control group that did not. [1]

Correlations

Though Bloom concluded that one-to-one tutoring is "too costly for most societies to bear on a large scale", Bloom conjectured that a combination of two or three altered variables may result in a similar performance improvement. Bloom thus challenged researchers and teachers to "find methods of group instruction as effective as one-to-one tutoring". [1] :15 Bloom's graduate students Joanne Anania and Arthur J. Burke conducted studies of the effect at different grade levels and in different schools, observing students with "great differences in cognitive achievement, attitudes, and academic self-concept". [1] :15

Bloom classified alterable variables that may have, in combination, a 2 sigma effect as the following "objects of change process":

  1. Learner
  2. Instructional material
  3. Home environment or peer group
  4. Teacher

Bloom and his graduate students considered and tested various combinations of these variables, focusing only on those variables that individually had a 0.5 or higher effect size. These included:

Effect of selected alterable variables on student achievement [1] :6 [10]
Object of change processAlterable variable Effect size Percentile equivalent
Teacher Tutorial instruction 2.0098
TeacherReinforcement1.2
LearnerFeedback-corrective (mastery learning)1.0084
TeacherCues and explanations1.00
Teacher, LearnerStudent classroom participation1.00
LearnerStudent time on task1.00
LearnerImproved reading/study skills1.00
Home environment / peer group Cooperative learning 0.8079
Teacher Homework (graded)0.80
TeacherClassroom morale0.6073
LearnerInitial cognitive prerequisites0.60
Home environment / peer groupHome environment intervention0.5069

Related Research Articles

<span class="mw-page-title-main">Educational psychology</span> Branch of psychology concerned with the scientific study of human learning

Educational psychology is the branch of psychology concerned with the scientific study of human learning. The study of learning processes, from both cognitive and behavioral perspectives, allows researchers to understand individual differences in intelligence, cognitive development, affect, motivation, self-regulation, and self-concept, as well as their role in learning. The field of educational psychology relies heavily on quantitative methods, including testing and measurement, to enhance educational activities related to instructional design, classroom management, and assessment, which serve to facilitate learning processes in various educational settings across the lifespan.

Instructional design (ID), also known as instructional systems design (ISD), is the practice of systematically designing, developing and delivering instructional materials and experiences, both digital and physical, in a consistent and reliable fashion toward an efficient, effective, appealing, engaging and inspiring acquisition of knowledge. The process consists broadly of determining the state and needs of the learner, defining the end goal of instruction, and creating some "intervention" to assist in the transition. The outcome of this instruction may be directly observable and scientifically measured or completely hidden and assumed. There are many instructional design models but many are based on the ADDIE model with the five phases: analysis, design, development, implementation, and evaluation.

A teaching method comprises the principles and methods used by teachers to enable student learning. These strategies are determined partly on subject matter to be taught and partly by the nature of the learner. For a particular teaching method to be appropriate and efficient it has take into account the learner, the nature of the subject matter, and the type of learning it is supposed to bring about.

Bloom's taxonomy is a set of three hierarchical models used for classification of educational learning objectives into levels of complexity and specificity. The three lists cover the learning objectives in cognitive, affective and psychomotor domains. The cognitive domain list has been the primary focus of most traditional education and is frequently used to structure curriculum learning objectives, assessments and activities.

Instructional scaffolding is the support given to a student by an instructor throughout the learning process. This support is specifically tailored to each student; this instructional approach allows students to experience student-centered learning, which tends to facilitate more efficient learning than teacher-centered learning. This learning process promotes a deeper level of learning than many other common teaching strategies.

<span class="mw-page-title-main">Tutoring</span> Instructor who gives private lessons

Tutoring is private academic support, usually provided by an expert teacher; someone with deep knowledge or defined expertise in a particular subject or set of subjects.

<span class="mw-page-title-main">Problem-based learning</span> Learner centric pedagogy

Problem-based learning (PBL) is a student-centered pedagogy in which students learn about a subject through the experience of solving an open-ended problem found in trigger material. The PBL process does not focus on problem solving with a defined solution, but it allows for the development of other desirable skills and attributes. This includes knowledge acquisition, enhanced group collaboration and communication.

<span class="mw-page-title-main">Active learning</span> Educational technique

Active learning is "a method of learning in which students are actively or experientially involved in the learning process and where there are different levels of active learning, depending on student involvement." Bonwell & Eison (1991) states that "students participate [in active learning] when they are doing something besides passively listening." According to Hanson and Moser (2003) using active teaching techniques in the classroom can create better academic outcomes for students. Scheyvens, Griffin, Jocoy, Liu, & Bradford (2008) further noted that “by utilizing learning strategies that can include small-group work, role-play and simulations, data collection and analysis, active learning is purported to increase student interest and motivation and to build students ‘critical thinking, problem-solving and social skills”. In a report from the Association for the Study of Higher Education, authors discuss a variety of methodologies for promoting active learning. They cite literature that indicates students must do more than just listen in order to learn. They must read, write, discuss, and be engaged in solving problems. This process relates to the three learning domains referred to as knowledge, skills and attitudes (KSA). This taxonomy of learning behaviors can be thought of as "the goals of the learning process." In particular, students must engage in such higher-order thinking tasks as analysis, synthesis, and evaluation.

Benjamin Samuel Bloom was an American educational psychologist who made contributions to the classification of educational objectives and to the theory of mastery learning. He is particularly noted for leading educational psychologists to develop the comprehensive system of describing and assessing educational outcomes in the mid-1950s. He has influenced the practices and philosophies of educators around the world from the latter part of the twentieth century.

A cognitive tutor is a particular kind of intelligent tutoring system that utilizes a cognitive model to provide feedback to students as they are working through problems. This feedback will immediately inform students of the correctness, or incorrectness, of their actions in the tutor interface; however, cognitive tutors also have the ability to provide context-sensitive hints and instruction to guide students towards reasonable next steps.

Learning styles refer to a range of theories that aim to account for differences in individuals' learning. Although there is ample evidence that individuals express personal preferences for how they prefer to receive information, few studies have found any validity in using learning styles in education. Many theories share the proposition that humans can be classified according to their "style" of learning, but differ in how the proposed styles should be defined, categorized and assessed. A common concept is that individuals differ in how they learn.

<span class="mw-page-title-main">Constructivism (philosophy of education)</span> Philosophical viewpoint about the nature of knowledge; theory of knowledge

Constructivism is a theory in education which posits that individuals or learners do not acquire knowledge and understanding by passively perceiving it within a direct process of knowledge transmission, rather they construct new understandings and knowledge through experience and social discourse, integrating new information with what they already know. For children, this includes knowledge gained prior to entering school. It is associated with various philosophical positions, particularly in epistemology as well as ontology, politics, and ethics. The origin of the theory is also linked to Swiss developmental psychologist Jean Piaget's theory of cognitive development.

Mastery learning is an instructional strategy and educational philosophy, first formally proposed by Benjamin Bloom in 1968. Mastery learning maintains that students must achieve a level of mastery in prerequisite knowledge before moving forward to learn subsequent information. If a student does not achieve mastery on the test, they are given additional support in learning and reviewing the information and then tested again. This cycle continues until the learner accomplishes mastery, and they may then move on to the next stage.

An intelligent tutoring system (ITS) is a computer system that aims to provide immediate and customized instruction or feedback to learners, usually without requiring intervention from a human teacher. ITSs have the common goal of enabling learning in a meaningful and effective manner by using a variety of computing technologies. There are many examples of ITSs being used in both formal education and professional settings in which they have demonstrated their capabilities and limitations. There is a close relationship between intelligent tutoring, cognitive learning theories and design; and there is ongoing research to improve the effectiveness of ITS. An ITS typically aims to replicate the demonstrated benefits of one-to-one, personalized tutoring, in contexts where students would otherwise have access to one-to-many instruction from a single teacher, or no teacher at all. ITSs are often designed with the goal of providing access to high quality education to each and every student.

Formative assessment, formative evaluation, formative feedback, or assessment for learning, including diagnostic testing, is a range of formal and informal assessment procedures conducted by teachers during the learning process in order to modify teaching and learning activities to improve student attainment. The goal of a formative assessment is to monitor student learning to provide ongoing feedback that can help students identify their strengths and weaknesses and target areas that need work. It also helps faculty recognize where students are struggling and address problems immediately. It typically involves qualitative feedback for both student and teacher that focuses on the details of content and performance. It is commonly contrasted with summative assessment, which seeks to monitor educational outcomes, often for purposes of external accountability.

E-learning theory describes the cognitive science principles of effective multimedia learning using electronic educational technology.

The worked-example effect is a learning effect predicted by cognitive load theory. Specifically, it refers to improved learning observed when worked examples are used as part of instruction, compared to other instructional techniques such as problem-solving and discovery learning. According to Sweller: "The worked example effect is the best known and most widely studied of the cognitive load effects".

Online tutoring is the process of tutoring in an online, virtual, or networked, environment, in which teachers and learners participate from separate physical locations. Aside from space, literature also states that participants can be separated by time.

Adaptive learning, also known as adaptive teaching, is an educational method which uses computer algorithms as well as artificial intelligence to orchestrate the interaction with the learner and deliver customized resources and learning activities to address the unique needs of each learner. In professional learning contexts, individuals may "test out" of some training to ensure they engage with novel instruction. Computers adapt the presentation of educational material according to students' learning needs, as indicated by their responses to questions, tasks and experiences. The technology encompasses aspects derived from various fields of study including computer science, AI, psychometrics, education, psychology, and brain science.

The expertise reversal effect refers to the reversal of the effectiveness of instructional techniques on learners with differing levels of prior knowledge. The primary recommendation that stems from the expertise reversal effect is that instructional design methods need to be adjusted as learners acquire more knowledge in a specific domain. Expertise is described as "the ability to perform fluently in a specific class of tasks."

References

  1. 1 2 3 4 5 6 7 8 Bloom, Benjamin S (June–July 1984). "The 2 Sigma Problem: The Search for Methods of Group Instruction as Effective as One-to-One Tutoring" (PDF). Educational Researcher. 13 (6): 4–16. doi:10.3102/0013189x013006004. S2CID   1714225 . Retrieved 9 June 2018.
  2. Guskey, Thomas R (2005), Formative Classroom Assessment and Benjamin S. Bloom: Theory, Research, and Implications, p. 12, ERIC   ED490412
  3. Guskey, Thomas R. (2007), "All Our Children Learning: New Views on the Work of Benjamin S. Bloom", Engaging Every Learner, Thousand Oaks, CA: Corwin Press, pp. 101–118, doi:10.4135/9781483329383.n6, ISBN   9781412938549 , retrieved 2022-04-27
  4. Wood, William B.; Tanner, Kimberly D. (March 2012). "The Role of the Lecturer as Tutor: Doing What Effective Tutors Do in a Large Lecture Class". CBE: Life Sciences Education. 11 (1): 3–9. doi:10.1187/cbe.11-12-0110. ISSN   1931-7913. PMC   3292071 . PMID   22383611.
  5. Deslauriers, Louis; Schelew, Ellen; Wieman, Carl (2011-05-13). "Improved Learning in a Large-Enrollment Physics Class". Science. 332 (6031): 862–864. Bibcode:2011Sci...332..862D. doi:10.1126/science.1201783. ISSN   0036-8075. PMID   21566198. S2CID   42770370.
  6. 1 2 Corbett, Albert (2001), "Cognitive Computer Tutors: Solving the Two-Sigma Problem", User Modeling 2001, Lecture Notes in Computer Science, Berlin, Heidelberg: Springer Berlin Heidelberg, vol. 2109, pp. 137–147, doi:10.1007/3-540-44566-8_14, ISBN   978-3-540-42325-6 , retrieved 2022-04-27
  7. Mott, Jon; Wiley, David (2013-01-03). "Open for Learning: The CMS and the Open Learning Network". In Education. 15 (2). doi: 10.37119/ojs2009.v15i2.53 . ISSN   1927-6117.
  8. Bloom, Benjamin S. (March 1973). "Recent developments in mastery learning". Educational Psychologist. 10 (2): 53–57. doi:10.1080/00461527309529091. ISSN   0046-1520.
  9. 1 2 Winget, Marshall; Persky, Adam M. (2022-01-13). "A Practical Review of Mastery Learning". American Journal of Pharmaceutical Education. 86 (10): 8906. doi: 10.5688/ajpe8906 . ISSN   0002-9459. PMID   35027359. S2CID   245946166.
  10. Walberg, Herbert J (May 1984). "Improving the productivity of America's schools". Educational Leadership. 41 (8): 19–27.

Further reading