program design, monitoring and evaluation

Program Design, Program Design, Monitoring and Evaluation Monitoring and Evaluation USAID/Vietnam Informal Training USAID/Vietnam Informal Training January, 2004 January, 2004 2 Overview of Training Overview of Training  Elements of a Program Elements of a Program  Introduction to Needs Assessment Introduction to Needs Assessment  Program Design (The Causal Pathway) Program Design (The Causal Pathway)  Monitoring Program Success Monitoring Program Success  Evaluation Evaluation  Proposal Design Proposal Design – Linking a Program Framework to Proposal Design Linking a Program Framework to Proposal Design 3 Implementation and Monitoring Assessment Program Design Evaluation Elements of a Program 4 Implementation and Monitoring Assessment Program Design Evaluation Elements of a Program 5 Needs Assessment Basics Needs Assessment Basics  Why conduct a needs assessment? Why conduct a needs assessment? – To To learn learn what a group or community sees as the most what a group or community sees as the most important needs important needs – To To understand the environment understand the environment in which you will be in which you will be working working – To To prioritize prioritize what you may be able to do with your what you may be able to do with your group or community group or community 6 Needs Assessment Basics Needs Assessment Basics  What is a needs assessment survey? What is a needs assessment survey? – Some general characteristics: Some general characteristics:  Have pre-set list of questions to be answered Have pre-set list of questions to be answered  Have pre-determined sample size for the number and Have pre-determined sample size for the number and types of people to be surveyed types of people to be surveyed  Should be PARTICPATORY Should be PARTICPATORY 7 Phases of Needs Assessment Phases of Needs Assessment  Phase 1: Phase 1: Brainstorm Brainstorm – Why am I doing this? Why am I doing this? – What are my goals in conducting the survey? What are my goals in conducting the survey? – Am I ready to do this? Am I ready to do this? Brainstorm 8 Phases of Needs Assessment Phases of Needs Assessment  Phase 2: Phase 2: Assess Available Information Assess Available Information – What do I already know about the needs of this target What do I already know about the needs of this target group/community? group/community? – What are the existing resources to assist in informing our What are the existing resources to assist in informing our assessment? assessment? – Am I ready to do this? Am I ready to do this? Brainstorm Assess Available Data 9 Phases of Needs Assessment Phases of Needs Assessment  Phase 3: Phase 3: Develop Questions Develop Questions – What do you want to learn from the target What do you want to learn from the target group/community? group/community? Brainstorm Assess Available Data Develop Questions 10 Phases of Needs Assessment Phases of Needs Assessment  Phase 4: Phase 4: Identify Target Population Identify Target Population – Who in the community has the information to answer your Who in the community has the information to answer your questions? questions? – Consider revising your questions based on the Consider revising your questions based on the groups/individuals you have identified groups/individuals you have identified Brainstorm Assess Available Data Develop Questions Identify Target Population [...]... outputs, effects and impact easily measurable? Q: Are the key beneficiaries and cooperating partners clearly identified? Q: Are there sufficient funds and political support and/ or commitment from relevant parties for this program? 33 Before you consider Implementing…  Crucial Questions: Q: How will the program build capacity among its beneficiaries? Q: What are the program s sustainability and exit strategies?... 29 Where does Evaluation fit? Inputs Activities Outputs Effect Impact 30 A good planning tool can help us  Identify where a problem may exist  link actions and results  decide what resources are needed  make evaluation part of initial plan  learn what works and what doesn’t 31 Program Design: Key Issues USAID/Vietnam Informal Training January, 2004 Before you consider Monitoring and Evaluating…... knowledge or experience A skilled interviewer asks specific and open-ended questions to obtain information about needs Respondents can express their understanding openly and freely – – – Time: Expertise: Cost: Not more than 1 hour per meeting Moderate Low 17 Needs Assessment Tools  Surveys – Generally three kinds: face-to-face, telephone and mailed (emailed) – Time: – Expertise: – Cost: Not more than... inventory_of_resources/section_2/section_a/a10_somalia_capacity_a ssessment_tool.pdf http://www.familiesandwork.org/forums/download/f01/needs.PDF 20 Program Design  Some quick Definitions: – Cause: – Pathway: – The Causal Pathway: A framework for designing a program with clearly defined inputs, activities and outcomes 21 Causal Pathway Framework Impact Impact Change in the health, social, economic status... program s sustainability and exit strategies? Q: What are the risks and what steps will be taken to monitor and minimize risks? 34 Before you consider Implementing…  Additional Factors: – Policy Support Measures – Participation of Local Stakeholders – Gender Issues – Management Capacity – Environmental Issues – Economic and Financial Issues 35 Program Design: Exercise 1: Designing your own Causal Pathway... Inputs Activities Outputs Effect Impact Design direction Causal Hypothesis This set of inputs and activities will result in these products and services (outputs), which will lead to these changes in the population, which will contribute to the desired impact 27 28 Sample Causal Pathway for Service Delivery Program Inputs Staff Activities Activity: Training Outputs Output: Skilled workers Sites Activity:... backgrounds with a skilled moderator and, if possible, a recorder Moderator guides the group into increasing levels of focus on key issues – – – Time: Expertise: Cost: 1.5 – 2 hours each Moderate Low 15 Needs Assessment Tools  Community Forums – A series of public meetings to involve the community in defining and discussing needs They are less formal than focus groups and open to the public – – – Time:... Community Resource Inventories – A means of data collection that usually results from a survey of service providers, which yields a listing or summary of information about activities and services provided by organizations and agencies in a defined geographic area – – – Time: Expertise: Cost: Not more than 1 hour to complete Moderate Moderate 19 Additional Resources for Assessment Tools     http://ctb.ku.edu/tools/en/section_1042.htm... Framework Effect Impact Effect Change in the knowledge, attitudes, skills, behavior of the population of interest 23 Causal Pathway Framework Outputs Effect Impact Outputs Products and services that must be in place for the effects and impact to occur 24 Causal Pathway Framework Activities Outputs Effect Impact Activities Either technical activity or support required to produce the outputs 25 Causal Pathway . Program Design, Program Design, Monitoring and Evaluation Monitoring and Evaluation USAID/Vietnam Informal Training USAID/Vietnam Informal. Design 3 Implementation and Monitoring Assessment Program Design Evaluation Elements of a Program 4 Implementation and Monitoring Assessment Program Design Evaluation Elements of a Program 5 Needs Assessment. Pathway)  Monitoring Program Success Monitoring Program Success  Evaluation Evaluation  Proposal Design Proposal Design – Linking a Program Framework to Proposal Design Linking a Program Framework to Proposal