Teacher quality assessment

Last updated

Teacher quality assessment commonly includes reviews of qualifications, tests of teacher knowledge, observations of practice, and measurements of student learning gains. [1] [2] Assessments of teacher quality are currently used for policymaking, employment and tenure decisions, teacher evaluations, merit pay awards, and as data to inform the professional growth of teachers.

Contents

Qualifications, credentials, and teacher characteristics

Teacher qualifications include a range of variables affecting teacher quality, including type of teaching certification, undergraduate major or minor, undergraduate institution, advanced degrees or certifications (such as certification through the National Board for Professional Teaching Standards and Centre for Teacher Accreditation (CENTA), type of preparation program (traditional or alternate route), test scores (various subject matter, licensure, or verbal skills tests), and years of teaching experience. [3] In many countries, teaching credentials represent the main measure of teacher quality. [4] In the United States, one goal of the No Child Left Behind law is to ensure that all teachers meet state-defined standards of highly qualified teachers. Demographic characteristics such as a teacher's gender, race, ethnicity, or socioeconomic background may also be characterized as elements of teacher quality as variables impacting student outcomes. [5] These indicators of teacher quality are relatively straightforward to ascertain, as opposed to the student achievement and teacher observation measures described below.

Student achievement measures

Teacher quality with regard to student achievement—also known as "teacher effectiveness"—is measured in terms of student achievement gains. Most extant research on teacher quality pertains to observable attributes, preparation, and credentials (Goldhaber, 2002; McCaffrey et al., 2003; Neild and Ripple, 2008). Probably the most widely studied attributes are experience and education levels, in part because the data can be readily obtained because of their use in salary placement (Goldhaber, 2002). There is mixed evidence, however, that experience and education levels are associated with student learning (Goldhaber, 2002; Goldhaber and Brewer, 1997, 2000; Hanushek, 1997; Wenglinsky, 2002). [3] Student achievement is measured through the use of standardized tests to determine the academic growth of students over time. Recently, a type of analysis of this growth termed "value-added modeling," following the 1971 approach of Eric Hanushek. [6] has sought to isolate the fraction of student achievement gains attributable to individual teachers, or in some cases groups of teachers. [7]

However, it has been argued that student achievement measures do not necessarily correlate entirely with teacher quality, given that there are various factors that influence a student's performance which is not under the control of a teacher.

Teacher practice

Assessments of teacher quality may also draw upon evidence collected from observations of teachers' work that lead to the empowering of effective teachers. This evidence may be collected from in-person or video-recorded observations of teaching, pre- and post-observation conferences with teachers, and samples of teachers' work with students. Assessments of teacher practice may examine teacher quality for a single lesson or over an entire school year. Such assessments may be holistic or narrative in form, but in rubric-based systems of teacher assessment like the Framework for Teaching, [8] and Classroom Assessment Scoring System (CLASS) [9] have become increasingly more common in the United States in order to align with state and federal accountability requirements. Many school districts have developed their own rubrics for this purpose, such as the IMPACT system used in the District of Columbia public schools. [10] Other practice-based assessments of teacher quality require teachers themselves to assemble evidence and self-assess their own indicators of teacher quality according to rubrics as part of the process. Examples include the Performance Assessment for California Teachers (PACT) [11] and its national successor the edTPA, [12] the Oregon-based Teacher Work Sample. [13] and the collection of assessments required by teachers seeking certification from the National Board for Professional Teaching Standards.

Teacher experience

The way that most current teacher compensation systems are set up is to reward teachers with salary increases for every year of additional experience they gain. The research literature on the predictive power of teacher experience for student achievement gains, however, reveals modest effects of experience limited to the first few years of a teacher's career. [14] Research by Hanushek, Kain, O'Brien, and Rivkin (2005), Kane et al. (2006), and Rockoff (2004) suggests that teacher effectiveness grows in the initial four or five years in the classroom and then begins to level off.

Teacher evaluation approaches

Teacher evaluation is a process used to measure teacher effectiveness based on students learning and success. Evaluations of teachers over the years have changed. In earlier years, teacher evaluations were based on personal characteristics of the teacher, however, starting in the early 1950s until the 1980s, teacher evaluations took a shift and started to focus on teachers' teaching, observed through students' outcomes. [15] After the 1980s, teacher evaluations were measured based on increased professional development, accountability, and school improvement. [15]

Teacher evaluation has taken numerous approaches that observed teacher practices. Measures of Effective Teaching (MET), Danielson's Framework Model, Classroom Assessment Scoring System (CLASS), and the Value added Model (VAM) are all evaluation tools that aim to measure student achievement using teacher evaluation. MET evaluates teacher effectiveness through five measures: students' gains in standardized testing, recorded classroom sessions and teacher reflections afterwards, teachers' knowledge in the pedagogical content, students views of the classroom and instruction of the teacher, and the teachers own views on their working conditions and the support of the school. [16]

While the MET approach uses five measures to evaluate teacher effectiveness, the Danielson Framework for Teaching model evaluates teachers using four domains: planning and preparation, classroom environment, instruction, and professional responsibilities. [17] In this framework of evaluation, teachers are evaluated through a rubric that contains these four domains. They can either be ranked or measured as unsatisfactory, basic, proficient, or distinguished. In this rubric, teachers are being evaluated through critical attributes and examples when being observed. Teacher responses to this evaluation system have been positive because the evaluation system presented clear and specific standards. [18] Administrators generally perceive the Danielson Framework as positive because of the rigorous and specific statement of standards. One concern that administrators have about using the Danielson Framework as the sole evaluation model is that teachers may alter their behavior only around observable classroom behaviors, limiting how representative the evaluations truly are. [19] Many schools use Danielson's framework for teaching to assess teachers.

The CLASS approach, by Robert Pianta, evaluates teachers based on their interaction with students. To do this, the CLASS model evaluates teachers' interactions using three domains: emotional support, classroom organization, and instructional support. [20] This approach is much more flexible, as the domains used within the approach vary based on students' grade levels.

On the other hand, the VAM approach uses students' test score gains to reflect teachers' effectiveness. Unlike the other approaches that evaluate particular characteristics or style of teaching for teacher evaluations, VAM does not directly evaluate the teacher. Although many of the approaches for teacher evaluations are debated, VAM is said to be inconsistent in its approach due to variation in classes, years, or test since its effectiveness measures are not based on teachers. [21] However, it said that VAM measures are retroactively effective due to teacher practices that influence learning of students. [21]

Finally, an organization in India called Centre for Teacher Accreditation (CENTA) uses two main steps in teacher certification and evaluation. The first step is an Objective Test which is based on the subject chosen, classroom practice, logical ability, communication etc. The second step is a Practical assessment which consists of an e-portfolio submission and a proctored assessment + interview. This evaluation and certification is based on CENTA standards [22] that have been developed after several years of research and feedback.

See also

Related Research Articles

Educational assessment or educational evaluation is the systematic process of documenting and using empirical data on the knowledge, skill, attitudes, aptitude and beliefs to refine programs and improve student learning. Assessment data can be obtained from directly examining student work to assess the achievement of learning outcomes or can be based on data from which one can make inferences about learning. Assessment is often used interchangeably with test, but not limited to tests. Assessment can focus on the individual learner, the learning community, a course, an academic program, the institution, or the educational system as a whole. The word "assessment" came into use in an educational context after the Second World War.

William L. Sanders was an American statistician, a senior research fellow with the University of North Carolina at Chapel Hill. He developed the Tennessee Value-Added Assessment System (TVAAS), also known as the Educational Value-Added Assessment System (EVAAS), a method for measuring a teacher's effect on student performance by tracking the progress of students against themselves over the course of their school career with their assignment to various teachers' classes.

In the realm of US education, a rubric is a "scoring guide used to evaluate the quality of students' constructed responses" according to James Popham. In simpler terms, it serves as a set of criteria for grading assignments. Typically presented in table format, rubrics contain evaluative criteria, quality definitions for various levels of achievement, and a scoring strategy. They play a dual role for teachers in marking assignments and for students in planning their work.

Evidence-based practice is the idea that occupational practices ought to be based on scientific evidence. While seemingly obviously desirable, the proposal has been controversial, with some arguing that results may not specialize to individuals as well as traditional practices. Evidence-based practices have been gaining ground since the formal introduction of evidence-based medicine in 1992 and have spread to the allied health professions, education, management, law, public policy, architecture, and other fields. In light of studies showing problems in scientific research, there is also a movement to apply evidence-based practices in scientific research itself. Research into the evidence-based practice of science is called metascience.

Mastery learning is an instructional strategy and educational philosophy, first formally proposed by Benjamin Bloom in 1968. Mastery learning maintains that students must achieve a level of mastery in prerequisite knowledge before moving forward to learn subsequent information. If a student does not achieve mastery on the test, they are given additional support in learning and reviewing the information and then tested again. This cycle continues until the learner accomplishes mastery, and they may then move on to the next stage. In a self-paced online learning environment, students study the material and take assessments. If they make mistakes, the system provides insightful explanations and directs them to revisit the relevant sections. They then answer different questions on the same material, and this cycle repeats until they reach the established mastery threshold. Only then can they move on to subsequent learning modules, assessments, or certifications.

<span class="mw-page-title-main">Trends in International Mathematics and Science Study</span> Study of international math and science skills

The IEA's Trends in International Mathematics and Science Study (TIMSS) is a series of international assessments of the mathematics and science knowledge of students around the world. The participating students come from a diverse set of educational systems in terms of economic development, geographical location, and population size. In each of the participating educational systems, a minimum of 4,000 to 5,000 students is evaluated. Contextual data about the conditions in which participating students learn mathematics and science are collected from the students and their teachers, their principals, and their parents via questionnaires.

Holistic grading or holistic scoring, in standards-based education, is an approach to scoring essays using a simple grading structure that bases a grade on a paper's overall quality. This type of grading, which is also described as nonreductionist grading, contrasts with analytic grading, which takes more factors into account when assigning a grade. Holistic grading can also be used to assess classroom-based work. Rather than counting errors, a paper is judged holistically and often compared to an anchor paper to evaluate if it meets a writing standard. It differs from other methods of scoring written discourse in two basic ways. It treats the composition as a whole, not assigning separate values to different parts of the writing. And it uses two or more raters, with the final score derived from their independent scores. Holistic scoring has gone by other names: "non-analytic," "overall quality," "general merit," "general impression," "rapid impression." Although the value and validation of the system are a matter of debate, holistic scoring of writing is still in wide application.

Formative assessment, formative evaluation, formative feedback, or assessment for learning, including diagnostic testing, is a range of formal and informal assessment procedures conducted by teachers during the learning process in order to modify teaching and learning activities to improve student attainment. The goal of a formative assessment is to monitor student learning to provide ongoing feedback that can help students identify their strengths and weaknesses and target areas that need work. It also helps faculty recognize where students are struggling and address problems immediately. It typically involves qualitative feedback for both student and teacher that focuses on the details of content and performance. It is commonly contrasted with summative assessment, which seeks to monitor educational outcomes, often for purposes of external accountability.

Authentic assessment is the measurement of "intellectual accomplishments that are worthwhile, significant, and meaningful" Authentic assessment can be devised by the teacher, or in collaboration with the student by engaging student voice. When applying authentic assessment to student learning and achievement, a teacher applies criteria related to “construction of knowledge, disciplined inquiry, and the value of achievement beyond the school.”

Thomas Joseph Kane is an American education economist who currently holds the position of Walter H. Gale Professor of Education and Economics at the Harvard Graduate School of Education. He has performed research on education policy, labour economics and econometrics. During Bill Clinton's first term as U.S. President, Kane served on the Council of Economic Advisers.

<span class="mw-page-title-main">Eric Hanushek</span> American economist

Eric Alan Hanushek is an economist who has written prolifically on public policy with a special emphasis on the economics of education. Since 2000, he has been a Paul and Jean Hanna Senior Fellow at the Hoover Institution, an American public policy think tank located at Stanford University in California. He was awarded the Yidan Prize for Education Research in 2021.

The National Board for Professional Teaching Standards (NBPTS) is a nonpartisan, nonprofit organization in the United States. Founded in 1987, NBPTS develops and maintains advanced standards for educators and offers a national, voluntary assessment, National Board Certification, based on the NBPTS Standards. As of December 2017, more than 118,000 educators have become National Board Certified Teachers in the United States. Its headquarters is located in Arlington County, Virginia

Value-added modeling is a method of teacher evaluation that measures the teacher's contribution in a given year by comparing the current test scores of their students to the scores of those same students in previous school years, as well as to the scores of other students in the same grade. In this manner, value-added modeling seeks to isolate the contribution, or value added, that each teacher provides in a given year, which can be compared to the performance measures of other teachers. VAMs are considered to be fairer than simply comparing student achievement scores or gain scores without considering potentially confounding context variables like past performance or income. It is also possible to use this approach to estimate the value added by the school principal or the school as a whole.

<span class="mw-page-title-main">Differentiated instruction</span> Framework or philosophy for effective teaching

Differentiated instruction and assessment, also known as differentiated learning or, in education, simply, differentiation, is a framework or philosophy for effective teaching that involves providing all students within their diverse classroom community of learners a range of different avenues for understanding new information in terms of: acquiring content; processing, constructing, or making sense of ideas; and developing teaching materials and assessment measures so that all students within a classroom can learn effectively, regardless of differences in their ability. Differentiated instruction means using different tools, content, and due process in order to successfully reach all individuals. Differentiated instruction, according to Carol Ann Tomlinson, is the process of "ensuring that what a student learns, how he or she learns it, and how the student demonstrates what he or she has learned is a match for that student's readiness level, interests, and preferred mode of learning." According to Boelens et al. (2018), differentiation can be on two different levels: the administration level and the classroom level. The administration level takes the socioeconomic status and gender of students into consideration. At the classroom level, differentiation revolves around content, processing, product, and effects. On the content level, teachers adapt what they are teaching to meet the needs of students. This can mean making content more challenging or simplified for students based on their levels. The process of learning can be differentiated as well. Teachers may choose to teach individually at a time, assign problems to small groups, partners or the whole group depending on the needs of the students. By differentiating product, teachers decide how students will present what they have learned. This may take the form of videos, graphic organizers, photo presentations, writing, and oral presentations. All these take place in a safe classroom environment where students feel respected and valued—effects.

Last in First Out is a policy often used by school districts and other employers to prioritize layoffs by seniority. Under LIFO layoff rules, junior teachers and other employees lose their jobs before senior ones. Laying off junior employees first is not exclusive to the education sector or to the United States, but is perhaps most controversial there. LIFO's proponents claim that it protects teachers with tenure and gives them job stability, and that it is an easily administered way of accomplishing layoffs following a budget cut. LIFO's critics respond that it is bad for students. They prefer that the best teachers remain regardless of how long they have been teaching.

The highly qualified teacher provision is one of the goals of the No Child Left Behind Act (NCLB) of 2001. The term highly qualified teachers (HQT) comes from the original language of Title II of the No Child Left Behind Act. Title II of NCLB designates federal funds to educational agencies for the purpose of improving the student achievement through the professional development of highly qualified teachers and principals. To qualify for this funding, states must comply with a series of conditions stipulated in NCLB, and track their progress toward goals each state sets. Title II was originally known as the Eisenhower Professional Development Program, and has undergone several reauthorizations, though the original intent has remained relatively intact. The main goals of the highly qualified teacher provision is to ensure that every classroom is staffed by a teacher deemed "highly qualified" under conditions set by NCLB. As some point out, this section of NCLB is quite at odds with the general thrust of NCLB because it focuses on school inputs rather than student outcomes. The sections of NCLB designated to HQTs allocates the majority of the funds to the states and does not clearly define at the federal level what is and what is not a highly qualified teacher, allowing for more local definitions of this term. This provision has come under much scrutiny, as it is up to states to decide how to measure highly qualified, and states are not holding their teachers to the same level of rigor across the country. Since its reauthorization in 2001, Title II has yet to reach its stated goal of ensuring that 100% of teachers in public schools in the United States are highly qualified.

Writing assessment refers to an area of study that contains theories and practices that guide the evaluation of a writer's performance or potential through a writing task. Writing assessment can be considered a combination of scholarship from composition studies and measurement theory within educational assessment. Writing assessment can also refer to the technologies and practices used to evaluate student writing and learning. An important consequence of writing assessment is that the type and manner of assessment may impact writing instruction, with consequences for the character and quality of that instruction.

The Framework for Authentic Intellectual Work (AIW) is an evaluative tool used by educators of all subjects at the elementary and secondary levels to assess the quality of classroom instruction, assignments, and student work. The framework was founded by Dr. Dana L. Carmichael, Dr. M. Bruce King, and Dr. Fred M. Newmann. The purpose of the framework is to promote student production of genuine and rigorous work that resembles the complex work of adults, which identifies three main criteria for student learning, and provides standards accompanied by scaled rubrics for classroom instruction, assignments, and student work. The standards and rubrics are meant to support teachers in the promotion of genuine and rigorous work, as well as guide professional development and collaboration.

Educator effectiveness is a United States K-12 school system education policy initiative that measures the quality of an educator performance in terms of improving student learning. It describes a variety of methods, such as observations, student assessments, student work samples and examples of teacher work, that education leaders use to determine the effectiveness of a K-12 educator.

Data-driven instruction is an educational approach that relies on information to inform teaching and learning. The idea refers to a method teachers use to improve instruction by looking at the information they have about their students. It takes place within the classroom, compared to data-driven decision making. Data-driven instruction works on two levels. One, it provides teachers the ability to be more responsive to students’ needs, and two, it allows students to be in charge of their own learning. Data-driven instruction can be understood through examination of its history, how it is used in the classroom, its attributes, and examples from teachers using this process.

References

  1. ↑ Strong, M. (2011). The highly qualified teacher: What is teacher quality and how do we measure it? New York: Teachers College Press.
  2. ↑ Darling-Hammond, L., & Youngs, P. (2004). Defining 'highly qualified teachers.' what does scientifically-based research actually tell us? Educational Researcher, 31, 9.
  3. 1 2 Goe, L. (2007).The link between teacher quality and student outcomes: A research synthesis. Archived 2010-08-06 at the Wayback Machine Washington, DC: National Comprehensive Center for Teacher Quality. Retrieved 21 Feb 2013.
  4. ↑ Sclafani, S., & Organisation for Economic Co-operation and Development. (2009). Evaluating and rewarding the quality of teachers: International practices. Paris: OECD.
  5. ↑ Zumwalt, K., & Craig, E. (2005). Teachers' characteristics: Research on the indicators of quality. In AERA Panel on Research and Teacher Education, M. Cochran-Smith & K. M. Zeichner (Eds.), Studying teacher education: The report of the AERA panel on research and teacher education (pp. 157-260). Mahwah, N.J.
  6. ↑ Eric A. Hanushek, "Teacher characteristics and gains in student achievement: Estimation using micro data." American Economic Review 60, no. 2 (May): 280-288
  7. ↑ Harris, D. N. (2011). Value-added measures in education: What every educator needs to know. Cambridge, Mass.: Harvard Education Press.
  8. ↑ Danielson, Charlotte (2007). Enhancing professional practice: A framework for teaching (2nd ed.). Alexandria, Va.: Association for Supervision and Curriculum Development. ISBN   978-1416605171.
  9. ↑ Teachstone.org. About the CLASS
  10. ↑ District of Columbia Public Schools. "An Overview of IMPACT"
  11. ↑ .pacttpa.org. "What is PACT?"
  12. ↑ American Association of Colleges for Teacher Education. "About edTPA"
  13. ↑ Western Oregon University. Teacher Work Sample Methodology
  14. ↑ Jacob, A. M. (2012) Examining the Relationship between Student Achievement and Observable Teacher Characteristics: Implications for School Leaders. International Journal of Educational Leadership Preparation, 7(3).
  15. 1 2 Ellett, Chad D.; & Teddlie, C (2003). "Teacher Evaluation, Teacher Effectiveness and School Effectiveness : Perspective from the USA". Journal of Personnel Evaluation in Education. 17 (1): 101–128. doi:10.1023/A:1025083214622. S2CID   140333277.
  16. ↑ "Working with Teachers to Develop Fair and Reliable Measures of Effective Teaching". MET Project: 1–12. 2010.
  17. ↑ Danielson, Charlotte (2013). The Framework for Teaching Evaluation Instrument (2013 ed.). Charlotte Danielson. pp. 4–59.
  18. ↑ Robinson, M. A. (2019). Perceptions of the Danielson Framework on student performance & classroom instruction (Order No. 13806847). ProQuest   2197679918
  19. ↑ Robinson, M. A. (2019). Perceptions of the Danielson framework on student performance & classroom instruction (Order No. 13806847). ProQuest   2197679918
  20. ↑ "The CLASS Protocol for Classroom Observations". The MET Project: 1–4. 2010.
  21. 1 2 Darling-Hammond, Linda; Amrein-Beardsley, A.; Haertel, E.; Rothstein, Jesse (2012). "Evaluating Teacher Evaluation". Phi Delta Kappan. 93 (6): 8–15. doi:10.1177/003172171209300603. S2CID   12513263.
  22. ↑ "CENTA". Archived from the original on 2017-07-23. Retrieved 2017-07-05.
This page is based on this Wikipedia article
Text is available under the CC BY-SA 4.0 license; additional terms may apply.
Images, videos and audio are available under their respective licenses.