Monitoring and evaluation

Last updated

Monitoring and Evaluation (M&E) is a combined term for the processes set up by organizations such as companies, government agencies, international organisations and NGOs, with the goal of improving their management of outputs, outcomes and impact. Monitoring includes the continuous assessment of programmes based on early detailed information on the progress or delay of the ongoing assessed activities. [1] Evaluation involves the examination of the relevance, effectiveness, efficiency and impact of activities in the light of specified objectives. [2]

Contents

Monitoring and evaluation processes can be managed by the donors financing the assessed activities, by an independent branch of the implementing organization, by the project managers or implementing team themselves and/or by a private company. The credibility and objectivity of monitoring and evaluation reports depend very much on the independence of the evaluators. Their expertise and independence is of major importance for the process to be successful.

Many international organizations such as the United Nations, USAID, the World Bank group and the Organization of American States have been utilizing this process for many years. The process is also growing in popularity in the developing countries where the governments have created their own national M&E systems to assess the development projects, the resource management and the government activities or administration. The developed countries are using this process to assess their own development and cooperation agencies.

Evaluation

The M&E is separated into two distinguished categories: evaluation and monitoring. An evaluation is a systematic and objective examination concerning the relevance, effectiveness, efficiency, impact and sustainabilities of activities in the light of specified objectives. [2] The idea in evaluating projects is to isolate errors in order to avoid repeating them and to underline and promote the successful mechanisms for current and future projects.

An important goal of evaluation is to provide recommendations and lessons to the project managers and implementation teams that have worked on the projects and for the ones that will implement and work on similar projects.

Evaluations are also indirectly a means to report to the donor about the activities implemented. It is a means to verify that the donated funds are being well managed and transparently spent. The evaluators are supposed to check and analyze the budget lines and to report the findings in their work. [3] Monitoring and Evaluation is also useful in the Facilities [Hospitals], it enables the donors such as WHO and UNICEF to know whether the funds provided are well utilized in purchasing drugs and also equipment in the Hospitals.

Monitoring

Monitoring is a continuous assessment that aims at providing all stakeholders with early detailed information on the progress or delay of the ongoing assessed activities. [1] It is an oversight of the activity's implementation stage. Its purpose is to determine if the outputs, deliveries and schedules planned have been reached so that action can be taken to correct the deficiencies as quickly as possible.

Good planning, combined with effective monitoring and evaluation, can play a major role in enhancing the effectiveness of development programs and projects. Good planning helps focus on the results that matter, while monitoring and evaluation help us learn from past successes and challenges and inform decision making so that current and future initiatives are better able to improve people's lives and expand their choices. [4]

Differences between monitoring and evaluation

In monitoring, the feedback and recommendation is inevitable to the project manager but in evaluation, this is not the case. The common ground for monitoring and evaluation is that they are both management tools. For monitoring, data and information collection for tracking progress according to the terms of reference is gathered periodically which is not the case in evaluations for which the data and information collection is happening during or in view of the evaluation. The monitoring is a short term assessment and does not take into consideration the outcomes and impact unlike the evaluation process which also assesses the outcomes and sometime longer term impact. This impact assessment occurs sometimes after the end of a project, even though it is rare because of its cost and of the difficulty to determine whether the project is responsible for the observed results. [2] Evaluation is a systematic and objective examination which is conducted on monthly and/or yearly basis, unlike Monitoring, which is a continuous assessment, providing stakeholders with early information. Monitoring checks on all the activities on the last [implementation stage] unlike Evaluation which entails information on whether the donated funds are well managed and that they are transparently spent.

Importance

Although evaluations are often retrospective, their purpose is essentially forward looking. [5] Evaluation applies the lessons and recommendations to decisions about current and future programmes. Evaluations can also be used to promote new projects, get support from governments, raise funds from public or private institutions and inform the general public on the different activities. [2]

The Paris Declaration on Aid Effectiveness in February 2005 and the follow-up meeting in Accra underlined the importance of the evaluation process and of the ownership of its conduct by the projects' hosting countries. Many developing countries now have M&E systems and the tendency is growing. [6]

Performance measurement

The credibility of findings and assessments depends to a large extent on the manner in which monitoring and evaluation is conducted. To assess performance, it is necessary to select, before the implementation of the project, indicators which will permit to rate the targeted outputs and outcomes. According to the United Nations Development Programme (UNDP), an outcome indicator has two components: the baseline which is the situation before the programme or project begins, and the target which is the expected situation at the end of the project. An output indicator that does not have any baseline as the purpose of the output is to introduce something that does not exist yet. [7]

In the United Nations

The most important agencies of the United Nations have a monitoring and evaluation unit. All these agencies are supposed to follow the common standards of the United Nations Evaluation Group (UNEG). These norms concern the Institutional framework and management of the evaluation function, the competencies and ethics, and the way to conduct evaluations and present reports (design, process, team selection, implementation, reporting and follow up). This group also provides guidelines and relevant documentation to all evaluation organs being part of the United Nations or not. [8]

Most agencies implementing projects and programmes, even if following the common UNEG standards, have their own handbook and guidelines on how to conduct M&E. Indeed, the UN agencies have different specialisations and have different needs and ways of approaching M&E. The Joint Inspection Unit of the United Nations periodically conducts system-wide reviews of the evaluation functions of their 28 Participating Organizations. [9]

See also

Reference's

  1. 1 2 United Nations development programme evaluation office - Handbook on Monitoring and Evaluating for Results. http://web.undp.org/evaluation/documents/handbook/me-handbook.pdf
  2. 1 2 3 4 A UNICEF Guide for Monitoring and Evaluation - Making a Difference. http://library.cphs.chula.ac.th/Ebooks/ReproductiveHealth/A%20UNICEF%20Guide%20for%20Monitoring%20and%20Evaluation_Making%20a%20Difference.pdf
  3. Center for Global Development. US Spending in Haiti: The Need for Greater Transparency and Accountability. http://www.cgdev.org/doc/full_text/CGDBriefs/1426965/US-Spending-in-Haiti-The-Need-for-Greater-Transparency-and-Accountability.html
  4. http://web.undp.org/evaluation/handbook/documents/english/pme-handbook.pdf [ bare URL PDF ]
  5. McLellan, Timothy (2020-08-25). "Impact, theory of change, and the horizons of scientific practice". Social Studies of Science. 51 (1): 100–120. doi: 10.1177/0306312720950830 . ISSN   0306-3127. PMID   32842910. S2CID   221326151.
  6. "Why is it important to strengthen Civil Society's evaluation capacity? | MY M&E". mymande.org. Archived from the original on 2014-05-27. Retrieved 2014-05-27.
  7. United Nations Development Programme evaluation office - Handbook on Monitoring and Evaluating for Results. Prince Conway II; a M&E specialist from the Ministry of Health and Social Welfare was one of those who achieved greatly in the health sector moving the Malaria data from 60% below base line to 85% above target. http://web.undp.org/evaluation/documents/handbook/me-handbook.pdf
  8. United Nations Evaluation Group (UNEG). "About". Archived from the original on 2013-11-05. Retrieved 2014-05-27.
  9. United Nations Joint Inspection Unit. https://www.unjiu.org/

Related Research Articles

In common usage, evaluation is a systematic determination and assessment of a subject's merit, worth and significance, using criteria governed by a set of standards. It can assist an organization, program, design, project or any other intervention or initiative to assess any aim, realizable concept/proposal, or any alternative, to help in decision-making; or to generate the degree of achievement or value in regard to the aim and objectives and results of any such action that has been completed.

The United Nations Development Programme (UNDP) is a United Nations agency tasked with helping countries eliminate poverty and achieve sustainable economic growth and human development. The UNDP emphasizes on developing local capacity towards long-term self-sufficiency and prosperity.

Program evaluation is a systematic method for collecting, analyzing, and using information to answer questions about projects, policies and programs, particularly about their effectiveness and efficiency.

The Logical Framework Approach (LFA) is a methodology mainly used for designing, monitoring, and evaluating international development projects. Variations of this tool are known as Goal Oriented Project Planning (GOPP) or Objectives Oriented Project Planning (OOPP).

The Committee of Sponsoring Organizations of the Treadway Commission (COSO) is an organization that develops guidelines for businesses to evaluate internal controls, risk management, and fraud deterrence. In 1992, COSO published the Internal Control – Integrated Framework, commonly used by businesses in the United States to design, implement, and conduct systems of internal control over financial reporting and assessing their effectiveness.

<span class="mw-page-title-main">Environmental impact assessment</span> Assessment of the environmental consequences of a decision before action

Environmental Impact assessment (EIA) is the assessment of the environmental consequences of a plan, policy, program, or actual projects prior to the decision to move forward with the proposed action. In this context, the term "environmental impact assessment" is usually used when applied to actual projects by individuals or companies and the term "strategic environmental assessment" (SEA) applies to policies, plans and programmes most often proposed by organs of state. It is a tool of environmental management forming a part of project approval and decision-making. Environmental assessments may be governed by rules of administrative procedure regarding public participation and documentation of decision making, and may be subject to judicial review.

<span class="mw-page-title-main">African Peer Review Mechanism</span>

The African Peer Review Mechanism (APRM) is a mutually agreed instrument voluntarily acceded to by the member states of the African Union (AU) as a self-monitoring mechanism. It was founded in 2003.

<span class="mw-page-title-main">Capacity building</span> Process by which individuals or organizations improve their capability to produce, perform or deploy

Capacity building is the improvement in an individual's or organization's facility "to produce, perform or deploy". The terms capacity building and capacity development have often been used interchangeably, although a publication by OECD-DAC stated in 2006 that capacity development was the preferable term. Since the 1950s, international organizations, governments, non-governmental organizations (NGOs) and communities use the concept of capacity building as part of "social and economic development" in national and subnational plans. The United Nations Development Programme defines itself by "capacity development" in the sense of "'how UNDP works" to fulfill its mission. The UN system applies it in almost every sector, including several of the Sustainable Development Goals to be achieved by 2030. For example, the Sustainable Development Goal 17 advocates for enhanced international support for capacity building in developing countries to support national plans to implement the 2030 Agenda. 

<span class="mw-page-title-main">Environmental planning</span> Considering environment in developing land

Environmental planning is the process of facilitating decision making to carry out land development with the consideration given to the natural environment, social, political, economic and governance factors and provides a holistic framework to achieve sustainable outcomes. A major goal of environmental planning is to create sustainable communities, which aim to conserve and protect undeveloped land.

Recognition of prior learning (RPL), prior learning assessment (PLA), or prior learning assessment and recognition (PLAR) describes a process used by regulatory bodies, adult learning centres, career development practitioners, military organizations, human resources professionals, employers, training institutions, colleges and universities around the world to evaluate skills and knowledge acquired outside the classroom for the purpose of recognizing competence against a given set of standards, competencies, or learning outcomes. RPL is practiced in many countries for a variety of purposes, for example an individual's standing in a profession, trades qualifications, academic achievement, recruitment, performance management, career and succession planning.

DARA is an independent, international organization based in Madrid, Spain. DARA was established in 2003 by Silvia Hidalgo to assess the impact of humanitarian aid and to make specific recommendations for changes in policies and practices. DARA has carried out evaluations in more than 60 crises countries for a variety of organizations including United Nations agencies, the International Federation of Red Cross and Red Crescent Societies, the European Commission, governments and non-governmental organizations (NGOs).

Youth mainstreaming is a public policy concept. The Commonwealth of Nations describes it in this context:

National youth development is often the sole responsibility of the government ministry or department where the youth portfolio lies, whereas youth issues should be mainstreamed across various sectors and line ministries such as health, finance, economic development, housing, justice, foreign affairs, education, and agriculture.

Impact evaluation assesses the changes that can be attributed to a particular intervention, such as a project, program or policy, both the intended ones, as well as ideally the unintended ones. In contrast to outcome monitoring, which examines whether targets have been achieved, impact evaluation is structured to answer the question: how would outcomes such as participants' well-being have changed if the intervention had not been undertaken? This involves counterfactual analysis, that is, "a comparison between what actually happened and what would have happened in the absence of the intervention." Impact evaluations seek to answer cause-and-effect questions. In other words, they look for the changes in outcome that are directly attributable to a program.

MEASURE Evaluation aims to strengthen the capacity of developing countries to gather, interpret, and use data to improve health. MEASURE Evaluation creates tools and approaches for rigorous evaluations, providing evidence to address health challenges, and strengthening health information systems so countries can make better decisions and sustain good health outcomes over time. MEASURE Evaluation is a cooperative agreement awarded by the U.S. Agency for International Development (USAID) to the Carolina Population Center at the University of North Carolina at Chapel Hill and five partner organizations: ICF International, John Snow Inc., Management Sciences for Health, Palladium, and Tulane University. This MEASURE Evaluation partnership provides technical leadership through collaboration at local, national, and global levels to build the sustainable capacity of developing nations to identify data needs, collect and analyze technically sound data, and use that data for health decision-making.

<span class="mw-page-title-main">IT risk management</span>

IT risk management is the application of risk management methods to information technology in order to manage IT risk, i.e.:

The Emergency Capacity Building Project is a collaborative capacity-building project aimed at improving the speed, effectiveness and delivery of humanitarian response programs. The ECB Project is a partnership between seven non-governmental organizations (NGOs), and implements programs in one region and four countries known as consortia.

Program process monitoring is an assessment of the process of a program or intervention. Process monitoring falls under the overall evaluation of a program. Program evaluation involves answering questions about a social program in a systematic way. Examples of social programs include school feeding programs, job training in a community and out-patient services of a community health care facility. Questions about a social program can be asked by program sponsors, developers, policymakers and even taxpayers who want to determine whether or not a particular program is effective. More specifically, purposes of social programs include identifying a programs’ strengths and weaknesses, assessing the impact of a program, justifying the need for additional resources and responding to attacks on a program, among others.

The United Nations Evaluation Group (UNEG) is a platform for the different United Nations (UN) evaluation offices to discuss evaluation issues and to share evaluation knowledge. It suggests norms and standards for all evaluation offices in the UN and delivers thematic reports concerning monitoring and evaluation. It has 45 members and 3 observers listed below.

Four high level forums on aid effectiveness were held between 2003 and 2011 as part of a "continuous effort towards modernising, deepening and broadening development co-operation and the delivery of aid" coordinated through the OECD. They took place at Rome (2003), Paris (2005), Accra (2008) and Busan (2011).

Monitoring Education for Sustainable Development (ESD) refers to measuring progress in ESD learning compared to policy commitments, provision, institutional support, resources and others. Monitoring and evaluation (M&E) of Education for Sustainable Development is widely discussed in literature on ESD, including debates regarding methodology and strategies for interpreting the data.