Joint Committee on Standards for Educational Evaluation

Last updated

The Joint Committee on Standards for Educational Evaluation is an American/Canadian based Standards Developer Organization (SDO). The Joint Committee, created in 1975, represents a coalition of major professional associations formed in 1975 to develop evaluation standards and improve the quality of standardized evaluation. The Committee has thus far published three sets of standards for evaluations. The Personnel Evaluation Standards (2nd edition) was published in 1988 and updated in 2008, The Program Evaluation Standards (2nd edition) was published in 1994 (the third edition of which is in draft form as of 2008), and The Student Evaluation Standards was published in 2003.

Contents

The Joint Committee is a private nonprofit organization. It is accredited by the American National Standards Institute (ANSI). Standards approved by ANSI become American National Standards . In addition to setting standards in evaluation, it also is involved in reviewing and updating its published standards (every five years); training policymakers, evaluators, and educators in the use of the standards; and serving as a clearinghouse on evaluation standards literature.

The Committee performs its work on behalf of its constituents, namely, the people and groups involved in conducting educational evaluations and using the results of educational evaluations. The Joint Committee has three sets of standards published at this time: The Student Evaluation Standards, The Personnel Evaluation Standards and The Program Evaluation Standards.

Each publication presents and elaborates a set of standards for use in a variety of educational settings. The standards provide guidelines for designing, implementing, assessing and improving the identified form of evaluation. Each of the standards has been placed in one of four fundamental categories to promote educational evaluations that are proper, useful, feasible, and accurate.

The Personnel Evaluation Standards

The second edition of the Personnel Evaluation Standards (2008) is based on knowledge about personnel evaluation gained from the professional literature and research/development since 1988. In this edition, six new standards were added to the original 21 of the first edition. The Joint Committee on Standards for Educational Evaluation requires that personnel evaluations be ethical, fair, useful, feasible, and accurate. The standards also provide special consideration to issues of diversity.

It is not the intent of these standards to design or promote specific systems of evaluation, rather to ensure that whatever system is in place provides a sound process most likely to produce the desired results.

The four attributes of sound educational evaluation practices are:

The Program Evaluation Standards

  • Stakeholder Identification: the people involved in the evaluation and those who will be affected by the evaluation must be identified so that their needs can be addressed.
  • Evaluator Credibility: the people conducting the evaluation must be trustworthy and competent to perform the evaluation in order for the evaluation's findings to achieve maximum credibility and acceptance.
  • Information Scope and Selection: the collected information must be broadly selected so that it addresses pertinent questions about the program and is able to be responsive to the needs and interests of clients and other specified stakeholders.
  • Values Identification: the perspectives, procedures and rationale used to interpret the findings of the evaluation should be carefully described so that the bases for value judgments are clear.
  • Report Clarity: an evaluation report must precisely describe the program being evaluated, including its context, purposes, procedures and findings so that the essential information is provided and easy to understand.
  • Report Timelines and Dissemination: evaluation reports and any significant interim findings should be disseminated to intended users so that they may be used in a timely fashion.
  • Evaluation Impact: the way an evaluation is planned, conducted and reported should encourage follow-through by stakeholders in order to increase the likelihood that the evaluation will be used.
  • Practical Procedures: evaluation procedures should be practical in order to keep disruption to a minimum while relevant and needed information is obtained.
  • Political Viability: whilst planning and conducting the evaluation one must anticipate the different positions of various interest groups so that their co-operation may be obtained. This will also allow one to avert or counteract any possible attempts by these groups to obstruct evaluation operations or to bias or misapply the evaluation's results.
  • Cost Effectiveness: a good evaluation should be efficient and produce information of sufficient value to justify the use of available resources.
  • Service Orientation
  • Formal Agreement
  • Rights of Human Subjects
  • Human Interactions
  • Complete and Fair Assessment
  • Disclosure of Findings
  • Conflict of Interest
  • Fiscal Responsibility
  • Program Documentation
  • Context Analysis
  • Described Purposes and Procedures
  • Defensible Information Sources
  • Valid Information
  • Reliable Information
  • Systematic Information
  • Analysis of Quantitative Information
  • Analysis of Qualitative Information
  • Justified Conclusions
  • Impartial Reporting
  • Meta-Evaluation

The Student Evaluation Standards

Sponsoring Organizations

The Joint Committee includes sixteen Sponsoring Organizations that reflect a balance of primarily client practitioner and evaluation technical specialist perspectives. These organizations appoint and sponsor a member of the Joint Committee. Each Sponsoring Organization is kept informed of the work of the Joint Committee and is afforded an opportunity to contribute to the standard-setting process. Sponsoring Organizations include the following:

Executive committee

MemberCurrent TermOrganization
Dr. Donald Yarbrough2009-2012Chair, At-Large Member
Dr. Patricia McDivitt2009-2012Vice-Chair, Association for Assessment in Counseling and Education
Dr. Stephan Henry2007-2010American Educational Research Association
Dr. Flora Caruthers2010-2013National Legislative Program Evaluation Society
Dr. Leslie Lukin2010-2013National Council on Measurement in Education
Dr. Patricia L. Hardre2012-2015National Rural Education Association

Notes

  1. ^ Joint Committee on Standards for Educational Evaluation
  2. ^ Joint Committee on Standards for Educational Evaluation. (1988). The Personnel Evaluation Standards: How to Assess Systems for Evaluating Educators. Newbury Park, CA: Sage Publications.
  3. ^ Joint Committee on Standards for Educational Evaluation. (2011). The Program Evaluation Standards. Newbury Park, CA: Sage Publications.
  4. ^ Joint Committee on Standards for Educational Evaluation. (2003). The Student Evaluation Standards: How to Improve Evaluations of Students. Newbury Park, CA: Corwin Press.
  5. ^ ANSI Membership Diretory. ANSI Member Organizations
  6. ^ ANSI Online Library - JCSEE Directory. Publication Listing

Related Research Articles

American National Standards Institute American non-profit organization that develops standards

The American National Standards Institute is a private non-profit organization that oversees the development of voluntary consensus standards for products, services, processes, systems, and personnel in the United States. The organization also coordinates U.S. standards with international standards so that American products can be used worldwide.

Psychometrics theory and technique of psychological measurement

Psychometrics is a field of study within psychology concerned with the theory and technique of measurement. Psychometrics generally refers to specialized fields within psychology and education devoted to testing, measurement, assessment, and related activities. Psychometrics is concerned with the objective measurement of latent constructs that cannot be directly observed. Examples of latent constructs include intelligence, introversion, mental disorders, and educational achievement. The levels of individuals on nonobservable latent variables are inferred through mathematical modeling based on what is observed from individuals' responses to items on tests and scales.

Configuration management Process for maintaining consistency of a product attributes with its design

Configuration management (CM) is a systems engineering process for establishing and maintaining consistency of a product's performance, functional, and physical attributes with its requirements, design, and operational information throughout its life. The CM process is widely used by military engineering organizations to manage changes throughout the system lifecycle of complex systems, such as weapon systems, military vehicles, and information systems. Outside the military, the CM process is also used with IT service management as defined by ITIL, and with other domain models in the civil engineering and other industrial engineering segments such as roads, bridges, canals, dams, and buildings.

Evaluation is a systematic determination of a subject's merit, worth and significance, using criteria governed by a set of standards. It can assist an organization, program, design, project or any other intervention or initiative to assess any aim, realisable concept/proposal, or any alternative, to help in decision-making; or to ascertain the degree of achievement or value in regard to the aim and objectives and results of any such action that has been completed. The primary purpose of evaluation, in addition to gaining insight into prior or existing initiatives, is to enable reflection and assist in the identification of future change. Evaluation is often used to characterize and appraise subjects of interest in a wide range of human enterprises, including the arts, criminal justice, foundations, non-profit organizations, government, health care, and other human services. It is long term and done at the end of a period of time.

Standardized test Test administered and scored in a predetermined, standard manner

A standardized test is a test that is administered and scored in a consistent, or "standard", manner. Standardized tests are designed in such a way that the questions, conditions for administering, scoring procedures, and interpretations are consistent and are administered and scored in a predetermined, standard manner.

The Association of College & Research Libraries defines information literacy as a "set of integrated abilities encompassing the reflective discovery of information, the understanding of how information is produced and valued and the use of information in creating new knowledge and participating ethically in communities of learning".

Educational assessment or educational evaluation is the systematic process of documenting and using empirical data on the knowledge, skill, attitudes, and beliefs to refine programs and improve student learning. Assessment data can be obtained from directly examining student work to assess the achievement of learning outcomes or can be based on data from which one can make inferences about learning. Assessment is often used interchangeably with test, but not limited to tests. Assessment can focus on the individual learner, the learning community, a course, an academic program, the institution, or the educational system as a whole. The word 'assessment' came into use in an educational context after the Second World War.

The Sporting Arms and Ammunition Manufacturers' Institute is an association of American manufacturers of firearms, ammunition, and components. SAAMI is an accredited standards developer that publishes several American National Standards that provide safety, reliability, and interchangeability standards for commercial manufacturers of firearms, ammunition, and components. In addition, SAAMI publishes information on the safe and responsible transportation, storage, and use of those products.

A feasibility study is an assessment of the practicality of a proposed project or system. A feasibility study aims to objectively and rationally uncover the strengths and weaknesses of an existing business or proposed venture, opportunities and threats present in the natural environment, the resources required to carry through, and ultimately the prospects for success. In its simplest terms, the two criteria to judge feasibility are cost required and value to be attained.

The InterNational Committee for Information Technology Standards (INCITS),, is an ANSI-accredited standards development organization composed of Information technology developers. It was formerly known as the X3 and NCITS.

Educational evaluation is the evaluation process of characterizing and appraising some aspect/s of an educational process.

Accreditation is the independent, third-party evaluation of a conformity assessment body against recognised standards, conveying formal demonstration of its impartiality and competence to carry out specific conformity assessment tasks.

A chief security officer (CSO) is an organization's most senior executive accountable for the development and oversight of policies and programs intended for the mitigation and/or reduction of compliance, operational, strategic, financial and reputational security risk strategies relating to the protection of people, intellectual assets and tangible property.

<i>Standards for Educational and Psychological Testing</i>

The Standards for Educational and Psychological Testing is a set of testing standards developed jointly by the American Educational Research Association (AERA), American Psychological Association (APA), and the National Council on Measurement in Education (NCME).

The Air Movement and Control Association International, Inc. (AMCA) is a long-established American trade body that sets standards for Heating, Ventilation and Air Conditioning (HVAC) equipment. It is best known for its ratings in fan balance and vibration, aerodynamic performance, air density, speed and efficiency.

A test method is a method for a test in science or engineering, such as a physical test, chemical test, or statistical test. It is a definitive procedure that produces a test result. In order to ensure accurate and relevant test results, a test method should be "explicit, unambiguous, and experimentally feasible.", as well as effective and reproducible.

American Society of Safety Professionals (ASSP), formerly known as American Society of Safety Engineers (ASSE) until June 2018, is a global organization of more than 37,000 occupational safety and health (OSH) professional members who manage, supervise, research and consult on work-related OSH concerns in all industries, government and education. The Society's members use risk-based approaches to prevent workplace fatalities, injuries and illnesses.

ISO/IEC 27006 is an information security standard published by the International Organization for Standardization (ISO) and the International Electrotechnical Commission (IEC). Part of the ISO/IEC 27000 series of ISO/IEC Information Security Management System (ISMS) standards, it is titled Information technology - Security techniques - Requirements for bodies providing audit and certification of information security management systems.

A Student Bill Rights or Charter of Student Rights and Freedoms is a document adopted by a student group, university or college or government at a local, state or national level. It outlines a population's basic beliefs regarding student rights. These statements of belief are often the foundation future legislative efforts or collaborative efforts to create joint statements between organizations. The European Students' Union, for example, uses their Student Rights Charter when lobbying for student rights in the European Union Higher Education Area as a document representing the student will. The historic National Student Association in the United States used their Student Bill of Rights to help create dialogue between the American Association of University Professors and to initiate the creation of a joint statement on student rights. This collaborative effort gave credence to the demands of students and helped normalize student rights on campuses across North America. While the United States Student Association does not have a student bill of rights of its own, it upholds the 1947 student bill of rights put forth by the National Student Association.

The American Psychological Association (APA) Ethical Principles of Psychologists and Code of Conduct includes an introduction, preamble, a list of five aspirational principles and a list of ten enforceable standards that psychologists use to guide ethical decisions in practice, research, and education. The principles and standards are written, revised, and enforced by the APA. The code of conduct is applicable to psychologists in a variety of areas across a variety of contexts. In the event of a violation of the code of conduct, the APA may take action ranging from termination of the APA membership to the loss of licensure, depending on the violation. Other professional organizations and licensing boards may adopt and enforce the code.

References

  1. 1 2 3 4 Programme Policy and Procedures Manual: Programme Operations, UNICEF, New York, Revised May 2003, pp.109-120.