CIPP evaluation model

Last updated

CIPP evaluation model is a Program evaluation model which was developed by Daniel Stufflebeam and colleagues in the 1960s. CIPP is an acronym for Context, Input, Process and Product. CIPP is an evaluation model that requires the evaluation of context, input, process and product in judging a programme’s value. CIPP is a decision-focused approach to evaluation and emphasises the systematic provision of information for programme management and operation. [1]

Program evaluation is a systematic method for collecting, analyzing, and using information to answer questions about projects, policies and programs, particularly about their effectiveness and efficiency. In both the public and private sectors, stakeholders often want to know whether the programs they are funding, implementing, voting for, receiving or objecting to are producing the intended effect. While program evaluation first focuses around this definition, important considerations often include how much the program costs per participant, how the program could be improved, whether the program is worthwhile, whether there are better alternatives, if there are unintended outcomes, and whether the program goals are appropriate and useful. Evaluators help to answer these questions, but the best way to answer the questions is for the evaluation to be a joint project between evaluators and stakeholders.

Contents

CIPP model

The CIPP framework was developed as a means of linking evaluation with programme decision-making. It aims to provide an analytic and rational basis for programme decision-making, based on a cycle of planning, structuring, implementing and reviewing and revising decisions, each examined through a different aspect of evaluation –context, input, process and product evaluation. [1]

Decision-making cognitive process resulting in the selection of a belief or a course of action among several alternative possibilities

In psychology, decision-making is regarded as the cognitive process resulting in the selection of a belief or a course of action among several alternative possibilities. Every decision-making process produces a final choice, which may or may not prompt action.

The CIPP model is an attempt to make evaluation directly relevant to the needs of decision-makers during the phases and activities of a programme. [1] Stufflebeam’s context, input, process, and product (CIPP) evaluation model is recommended as a framework to systematically guide the conception, design, implementation, and assessment of service-learning projects, and provide feedback and judgment of the project’s effectiveness for continuous improvement. [1]

Product breakdown structure

In project management under the PRINCE2 methodology, a product breakdown structure (PBS) is a tool for analysing, documenting and communicating the outcomes of a project, and forms part of the product based planning technique.

Implementation is the realization of an application, or execution of a plan, idea, model, design, specification, standard, algorithm, or policy.

Four aspects of CIPP evaluation

These aspects are context, inputs, process, and product. These four aspects of CIPP evaluation assist a decision-maker to answer four basic questions:

This involves collecting and analysing needs assessment data to determine goals, priorities and objectives. For example, a context evaluation of a literacy program might involve an analysis of the existing objectives of the literacy programme, literacy achievement test scores, staff concerns (general and particular), literacy policies and plans and community concerns, perceptions or attitudes and needs. [1]

This involves the steps and resources needed to meet the new goals and objectives and might include identifying successful external programs and materials as well as gathering information. [1]

This provides decision-makers with information about how well the programme is being implemented. By continuously monitoring the program, decision-makers learn such things as how well it is following the plans and guidelines, conflicts arising, staff support and morale, strengths and weaknesses of materials, delivery and budgeting problems. [1]

By measuring the actual outcomes and comparing them to the anticipated outcomes, decision-makers are better able to decide if the program should be continued, modified, or dropped altogether. This is the essence of product evaluation. [1]

Using CIPP in the different stages of the evaluation

The CIPP model is unique as an evaluation guide as it allows evaluators to evaluate the program at different stages, namely: before the program commences by helping evaluators to assess the need and at the end of the program to assess whether or not the program had an effect.

CIPP model allows you to ask formative questions at the beginning of the program, then later gives you a guide of how to evaluate the programs impact by allowing you to ask summative questions on all aspects of the program.

Related Research Articles

Evaluation is a systematic determination of a subject's merit, worth and significance, using criteria governed by a set of standards. It can assist an organization, program, design, project or any other intervention or initiative to assess any aim, realisable concept/proposal, or any alternative, to help in decision-making; or to ascertain the degree of achievement or value in regard to the aim and objectives and results of any such action that has been completed. The primary purpose of evaluation, in addition to gaining insight into prior or existing initiatives, is to enable reflection and assist in the identification of future change.

Transportation planning field

Transportation planning is the process of defining future policies, goals, investments, and designs to prepare for future needs to move people and goods to destinations. As practiced today, it is a collaborative process that incorporates the input of many stakeholders including various government agencies, the public and private businesses. Transportation planners apply a multi-modal and/or comprehensive approach to analyzing the wide range of alternatives and impacts on the transportation system to influence beneficial outcomes.

In the field of management, strategic management involves the formulation and implementation of the major goals and initiatives taken by an organization's top management on behalf of owners, based on consideration of resources and an assessment of the internal and external environments in which the organization operates.

A marketing plan may be part of an overall business plan. Solid marketing strategy is the foundation of a well-written marketing plan. While a marketing plan contains a list of actions, without a sound strategic foundation, it is of little use to a business.

Software development is the process of conceiving, specifying, designing, programming, documenting, testing, and bug fixing involved in creating and maintaining applications, frameworks, or other software components. Software development is a process of writing and maintaining the source code, but in a broader sense, it includes all that is involved between the conception of the desired software through to the final manifestation of the software, sometimes in a planned and structured process. Therefore, software development may include research, new development, prototyping, modification, reuse, re-engineering, maintenance, or any other activities that result in software products.

Systems development life cycle Systems engineering term

The systems development life cycle (SDLC), also referred to as the application development life-cycle, is a term used in systems engineering, information systems and software engineering to describe a process for planning, creating, testing, and deploying an information system. The systems development lifecycle concept applies to a range of hardware and software configurations, as a system can be composed of hardware only, software only, or a combination of both. There are usually six stages in this cycle: analysis, design, development and testing, implementation, documentation, and evaluation.

Feasibility Study is an assessment of the practicality of a proposed project or system.

ADDIE is an instructional systems design (ISD) framework that many instructional designers and training developers use to develop courses. The name is an acronym for the five phases it defines for building training and performance support tools:

A lesson plan is a teacher's detailed description of the course of instruction or "learning trajectory" for a lesson. A daily lesson plan is developed by a teacher to guide class learning. Details will vary depending on the preference of the teacher, subject being covered, and the needs of the students. There may be requirements mandated by the school system regarding the plan. A lesson plan is the teacher's guide for running a particular lesson, and it includes the goal, how the goal will be reached and a way of measuring how well the goal was reached.

The engineering design process is a methodical series of steps that engineers use in creating functional products and processes. The process is highly iterative - parts of the process often need to be repeated many times before another can be entered - though the part(s) that get iterated and the number of such cycles in any given project may vary.

…It is a decision making process in which the basic sciences, mathematics, and engineering sciences are applied to convert resources optimally to meet a stated objective. Among the fundamental elements of the design process are the establishment of objectives and criteria, synthesis, analysis, construction, testing and evaluation.

User experience design is the process of enhancing user satisfaction with a product by improving the usability, accessibility, and pleasure provided in the interaction with the product. User experience design encompasses traditional human–computer interaction (HCI) design, and extends it by addressing all aspects of a product or service as perceived by users.

The rational planning model is a model of the planning process involving a number of rational actions or steps. Taylor (1998) outlines five steps, as follows:

Participatory development communication is the use of mass media and traditional, inter-personal means of communication that empowers communities to visualise aspirations and discover solutions to their development problems and issues.

Youth mainstreaming is a public policy concept. The Commonwealth of Nations describes it in this context:

National youth development is often the sole responsibility of the government ministry or department where the youth portfolio lies, whereas youth issues should be mainstreamed across various sectors and line ministries such as health, finance, economic development, housing, justice, foreign affairs, education, and agriculture.

A phase-gate process, is a project management technique in which an initiative or project is divided into distinct stages or phases, separated by decision points.

The PRECEDE–PROCEED model is a cost–benefit evaluation framework proposed in 1974 by Lawrence W. Green that can help health program planners, policy makers and other evaluators, analyze situations and design health programs efficiently. It provides a comprehensive structure for assessing health and quality of life needs, and for designing, implementing and evaluating health promotion and other public health programs to meet those needs. One purpose and guiding principle of the PRECEDE–PROCEED model is to direct initial attention to outcomes, rather than inputs. It guides planners through a process that starts with desired outcomes and then works backwards in the causal chain to identify a mix of strategies for achieving those objectives. A fundamental assumption of the model is the active participation of its intended audience — that is, that the participants ("consumers") will take an active part in defining their own problems, establishing their goals and developing their solutions.

Participatory evaluation is an approach to program evaluation. It provides for the active involvement of stakeholder in the program: providers, partners, beneficiaries, and any other interested parties. All involved decide how to frame the questions used to evaluate the program, and all decide how to measure outcomes and impact. It is often used in international development.

Strategic environmental assessment (SEA) is a systematic decision support process, aiming to ensure that environmental and possibly other sustainability aspects are considered effectively in policy, plan and program making. In this context, following Fischer (2007) SEA may be seen as:

Marketing engineering is currently definded as "a systematic approach to harness data and knowledge to drive effective marketing decision making an implementation through a technology-enabled and model-supported decision process".

References

  1. 1 2 3 4 5 6 7 8 Robinson, B. (2002). The CIPP has its formation from the earlier stages where there were no paragraphs or any acronyms for any product or stanzas. The CIPP approach to evaluation.Collit project: A background note from Bernadette