Transcript M&E System Overview
Overview of M&E System
• Results Framework and KPIs • Program Monitoring • Program Evaluation • Support Activities • Operations and Management
Mirrors the M&E Sub-manual
Outline
Why M&E?
• To know if we were able to achieve our objective:
Communities in target municipalities are empowered to achieve improved access to services and to participate in more inclusive local planning, budgeting, implementation and disaster risk reduction and management.
Monitoring vs. Evaluation
Monitoring
a continuing function that uses systematic collection of data on specified indicators to provide management and the main stakeholders of an on-going development intervention with indications of the extent of progress and achievement of objectives and progress in the use of allocated funds.
Evaluation
Is a periodic, systematic analysis of project or program performance in terms of achievement of higher objectives, and to process the lessons learned for improving design during implementation or applying the lessons to other projects or programs.
“when, where, how much” “why, how”
Program Development Objective:
“Communities in the target municipalities empowered to achieve improved access to basic services and to participate in more inclusive local planning, budgeting, implementation and disaster risk reduction and management”
Results Framework and KPIs
Program Development Objective
• 6 (End-of-Program) Outcome Indicators • 22 (Intermediate) Outcome Indicators 6 indicators for Component 1: Barangay Grants 10 indicators for Component 2: Capacity Building and Implementation Support 6 indicators for Component 3: Program Management and M&E
Results Framework and KPIs
PROGRAM MONITORING
•
Community Monitoring
•
Operations Monitoring
•
Results Monitoring
•
Grievance Monitoring
•
Geo-tagging
Types of Monitoring
Data Gathering, Processing and Reporting
1) NPMO will randomly quality 1) NPMO will feed data and manage information in the server.
1) 2) 3) 1) 2) 3) Thorough quality checking Approval and consolidation Send feedback to SRPMT.
Check submitted data for clearance Send feedback to municipal level Post process data 1) 2) Encoding to office desktop Submit data to KC NCDDP server.
1) Geo-tagging activities, gathering of forms, GRS, etc.
• Opportunity Data Sharing Avoids duplications Venue to clarify guidelines and directives Monitoring of higher level results • Challenge Development of indicators, systems and tools Multiple stakeholders New approach for DSWD High expectations
Convergence
• Comes in the form of… Documents and record reviews Site visits Key informant interviews Focus group discussions • Purpose… Assess the actual forms and procedures used Review data collection and handling Check the sufficiency and timeliness of data Check other concerns which affect data validity, accuracy and integrity
Data Quality Assessment
Types of Evaluation
Internal External Third party
Examples
Municipal Talakayan Impact Evaluation by MCC and MCA-P Thematic Studies by WB and ADB Consultation mechanisms conducted by others such as the CSOs, Academes, future CDD investors, etc.
Types of Evaluation
SUPPORT ACTIVITIES
Program Information Management System and Capability building
• • • • • • • • Desktop Application Web Application Business Intelligence Geo-database/GIS Android Applications Interactive Website Web Forum LGU Dashboard
PIMS
• Staff Capacity Building Trainings TA and Coaching • LGU and Community trainings on M&E
Capacity Building
OPERATIONS & MANAGEMENT
• • • • • NPMO RPMO SRPMT ACT LGU counterpart staff
Roles in M&E
Role of ACTs in Program M&E
Area
Monitoring Evaluation PIMS
Direct
Filling-out of forms Data gathering, review, encoding and submission Geo-tagging Conduct of SET (as member of MSIT) Grievance intake Talakayan Implementation
Indirect
Facilitate volunteers to fill-out forms Facilitate Community Monitoring Coordination and monitoring of SET conduct Grievance resolution Support to conduct of special studies Maintenance of M&E equipment and database Support Activities Training of volunteers Training of LGUs
Forms and Geo-tagging Community Monitoring
CM and AR SET
KPI GRS Operational Results Talakayan External IE and Studies Geo-tagging Third Party
• • • • • • If you do not measure results, you cannot tell success from failure.
If you cannot see success, you cannot reward it.
If you cannot reward success, you are probably rewarding failure.
If you cannot see success, you cannot learn from it.
If you cannot recognize failure, you cannot correct it.
If you can demonstrate results, you can win public support.
Adapted from Osborne & Gaebler, 1992