Participatory impact pathways analysis (PIPA) is a project management approach in which the participants in a project (project and program are used synonymously from now on), including project staff, key stakeholders, and the ultimate beneficiaries, together co-construct their program theory. [1] [ unreliable source? ]
The PIPA theory describes plausible impact pathways by which project outputs are used by others to achieve a chain of outcomes leading to a contribution to eventual impact on social, environmental or economic conditions. Impact pathways are a type of logic model, that is, they constitute a model that describes the logic of what the project will do, is doing, or what it did.
PIPA helps workshop participants identify, discuss, and write down assumptions and theories about how the project activities and outputs could contribute to project goals. The description of these assumptions and theories is a description of the project’s impact pathways. PIPA has helped workshop participants to:
PIPA was first used in a workshop in January 2006 in Ghana, with seven projects funded by the "Challenge Program on Water and Food". [2] Nine PIPA workshops have been held since then for 46 projects. Researchers from the International Center for Tropical Agriculture, [3] WorldFish Center, [4] and International Potato Center [5] are developing PIPA.
PIPA developed from innovation histories [6] and work carried out by the Institutional Learning and Change Initiative. [7] A paper describing PIPA was accepted for publication in the Canadian Journal of Program Evaluation .
PIPA is useful when two or more projects in the same program wish to better integrate. At least two people for each project should attend, preferably the project leader and someone else who knows the project and has time and inclination to follow up on what comes out of the workshop. PIPA also works well when one project wishes to build up common understanding and commitment from its stakeholders. In this case, two or more representatives from each important stakeholder group should attend.
PIPA can be used at the beginning of a project, in the middle or at the end as way of documenting and learning from the project. PIPA describes project (or program) impact pathways in two ways: (i) causal chains of activities, outputs and outcomes through which a project is expected to achieve its purpose and goal; and (ii) networks of evolving relationships between project implementing organizations, stakeholders and ultimate beneficiaries that are necessary to achieve the goal. The workshop process, shown in the diagram, develops the two perspectives in turn and then integrates them.
The workshop begins with participants developing a problem tree that links the project goal framed in terms of a challenge or problem to what the project is actually going to do. The approach used for developing the problem tree is based on work by Renger and Titcombe (2003). The problem tree helps participants clarify the key problems / opportunities their projects are addressing, and the outputs (things others will use) that their projects need to produce. Participants then carry out a visioning exercise, which borrows from appreciative inquiry, to describe project success two years after the project's conclusion based on the adoption and use of project outputs. These three steps (see diagram) usually take about a day to complete and provide the information needed to describe a causal chain of outcomes needed to achieve success.
The second part of the workshop involves drawing the networks of people and organizations who are already working in the area and then drawing the networks that will be needed to achieve the project vision. Analyzing the differences between the two can help identify an effective communication strategy. The final step is to integrate the causal chain and the network perspectives by drawing a timeline.
Optionally, monitoring and evaluation can be discussed by identifying SMART criteria (specific, measurable, attributable, realistic, and time-bound) to measure expected change, and by identifying "most significant change" to pick up unexpected ones. A key component of any evaluation plan is that project staff periodically revisit their vision, problem trees, and network maps to update them, identify necessary changes to the timeline, and document the changes.
The information from PIPA workshops has been used in a number of ways:
In common usage, evaluation is a systematic determination and assessment of a subject's merit, worth and significance, using criteria governed by a set of standards. It can assist an organization, program, design, project or any other intervention or initiative to assess any aim, realisable concept/proposal, or any alternative, to help in decision-making; or to ascertain the degree of achievement or value in regard to the aim and objectives and results of any such action that has been completed.
Development communication refers to the use of communication to facilitate social development. Development communication engages stakeholders and policy makers, establishes conducive environments, assesses risks and opportunities and promotes information exchange to create positive social change via sustainable development. Development communication techniques include information dissemination and education, behavior change, social marketing, social mobilization, media advocacy, communication for social change, and community participation.
Program evaluation is a systematic method for collecting, analyzing, and using information to answer questions about projects, policies and programs, particularly about their effectiveness and efficiency.
Policy analysis or public policy analysis is a technique used in the public administration sub-field of political science to enable civil servants, nonprofit organizations, and others to examine and evaluate the available options to implement the goals of laws and elected officials. People who regularly use policy analysis skills and techniques on the job, particularly those who use it as a major part of their job duties are generally known by the title Policy Analyst. The process is also used in the administration of large organizations with complex policies. It has been defined as the process of "determining which of various policies will achieve a given set of goals in light of the relations between the policies and the goals."
Social return on investment (SROI) is a principles-based method for measuring extra-financial value. It can be used by any entity to evaluate impact on stakeholders, identify ways to improve performance, and enhance the performance of investments.
Futures techniques used in the multi-disciplinary field of futurology by futurists in Americas and Australasia, and futurology by futurologists in EU, include a diverse range of forecasting methods, including anticipatory thinking, backcasting, simulation, and visioning. Some of the anticipatory methods include, the delphi method, causal layered analysis, environmental scanning, morphological analysis, and scenario planning.
Participatory GIS (PGIS) or public participation geographic information system (PPGIS) is a participatory approach to spatial planning and spatial information and communications management.
Logic models are hypothesized descriptions of the chain of causes and effects leading to an outcome of interest. While they can be in a narrative form, logic model usually take form in a graphical depiction of the "if-then" (causal) relationships between the various elements leading to the outcome. However, the logic model is more than the graphical depiction: it is also the theories, scientific evidences, assumptions and beliefs that support it and the various processes behind it.
Governance is a broader concept than government and also includes the roles played by the community sector and the private sector in managing and planning countries, regions and cities. Collaborative governance involves the government, community and private sectors communicating with each other and working together to achieve more than any one sector could achieve on its own. Ansell and Gash (2008) have explored the conditions required for effective collaborative governance. They say "The ultimate goal is to develop a contingency approach of collaboration that can highlight conditions under which collaborative governance will be more or less effective as an approach to policy making and public management" Collaborative governance covers both the informal and formal relationships in problem solving and decision-making. Conventional government policy processes can be embedded in wider policy processes by facilitating collaboration between the public, private and community sectors. Collaborative Governance requires three things, namely: support; leadership; and a forum. The support identifies the policy problem to be fixed. The leadership gathers the sectors into a forum. Then, the members of the forum collaborate to develop policies, solutions and answers.
Impact evaluation assesses the changes that can be attributed to a particular intervention, such as a project, program or policy, both the intended ones, as well as ideally the unintended ones. In contrast to outcome monitoring, which examines whether targets have been achieved, impact evaluation is structured to answer the question: how would outcomes such as participants' well-being have changed if the intervention had not been undertaken? This involves counterfactual analysis, that is, "a comparison between what actually happened and what would have happened in the absence of the intervention." Impact evaluations seek to answer cause-and-effect questions. In other words, they look for the changes in outcome that are directly attributable to a program.
The net-map toolbox is a social network analysis tool that uses interviews and mapping to help people understand, visualize, discuss, and improve situations in which many different actors influence outcomes. Social network analysis is a research approach used by scholars such as S.D. Berkowitz, Stephen Borgatti, Ronald Burt, Linton Freeman, Mark Granovetter, Nicholas Mullins, Anatol Rapoport, Stanley Wasserman, Barry Wellman, and Harrison White to better understand the implications of the position of individual actors in a social structure.
Policy Impact Assessments (IAs) are formal, evidence-based procedures that assess prospective economic, social, and environmental effects of a public policy proposal. They have been incorporated into policy making in the OECD countries and the European Commission. If the assessment is favourable, and the proposed policy is enacted—after a suitable length of time for the policy to gain traction—it might be followed by an impact evaluation; ideally, assessed impacts before the fact and evaluated impacts after the fact are not wildly divergent. In some cases, impact becomes politicized due to a change in the governing regime between assessment and evaluation, and non-congruence might be amplified for ideological reasons. In other cases, the world is a complex place, and assessment is not a perfect art.
Inclusive management is a pattern of practices by public managers that facilitate the inclusion of public employees, experts, the public, and politicians in collaboratively addressing public problems or concerns of public interest.
Participatory development (PD) seeks to engage local populations in development projects. Participatory development has taken a variety of forms since it emerged in the 1970s, when it was introduced as an important part of the "basic needs approach" to development. Most manifestations of public participation in development seek "to give the poor a part in initiatives designed for their benefit" in the hopes that development projects will be more sustainable and successful if local populations are engaged in the development process. PD has become an increasingly accepted method of development practice and is employed by a variety of organizations. It is often presented as an alternative to mainstream "top-down" development. There is some question about the proper definition of PD as it varies depending on the perspective applied. Two perspectives that can define PD are the "Social Movement Perspective" and the "Institutional Perspective":
Theory of Change (ToC) is a methodology or a criterion for planning, participation, adaptive management, and evaluation that is used in companies, philanthropy, not-for-profit, international development, research, and government sectors to promote social change. Theory of Change defines long-term goals and then maps backward to identify necessary preconditions.
Advocacy evaluation, also called public policy advocacy design, monitoring, and evaluation, evaluates the progress or outcomes of advocacy, such as changes in public policy.
Participatory evaluation is an approach to program evaluation. It provides for the active involvement of stakeholder in the program: providers, partners, beneficiaries, and any other interested parties. All involved decide how to frame the questions used to evaluate the program, and all decide how to measure outcomes and impact. It is often used in international development.
Empowerment evaluation (EE) is an evaluation approach designed to help communities monitor and evaluate their own performance. It is used in comprehensive community initiatives as well as small-scale settings and is designed to help groups accomplish their goals. According to David Fetterman, "Empowerment evaluation is the use of evaluation concepts, techniques, and findings to foster improvement and self-determination". An expanded definition is: "Empowerment evaluation is an evaluation approach that aims to increase the likelihood that programs will achieve results by increasing the capacity of program stakeholders to plan, implement, and evaluate their own programs."
An evaluability assessment (EA) is a qualitative investigation employed before a programme is evaluated.
Community-based program design is a social method for designing programs that enables social service providers, organizers, designers and evaluators to serve specific communities in their own environment. This program design method depends on the participatory approach of community development often associated with community-based social work, and is often employed by community organizations. From this approach, program designers assess the needs and resources existing within a community, and, involving community stakeholders in the process, attempt to create a sustainable and equitable solution to address the community's needs.
 | This article includes a list of general references, but it lacks sufficient corresponding inline citations .(June 2011) |