|
Terms of Reference for Project End Evaluation
Assignment Summary
|
Name of the assignment
|
Project End Evaluation
|
|
Locations
|
Punjab (Talagang, Layyah), Sindh (Rashidabad, Khairpur and Matiari, Karachi), Baluchistan (Quetta)
|
|
Assignment start and end date (tentative)
|
24th November –22nd December 2025
|
|
Assignment Purpose
|
To help determine how well the project achieved its goals and what difference it made and assess the project’s outcomes, efficiency, and overall impact, while also ensuring accountability to donor and stakeholders.
The evaluation will also identify lessons learned, highlight what worked well and what could be improved and provide do able recommendations to partners and CBM
|
|
Commissioning Organisation
|
Brien Holden Foundation
|
|
Assignment Duration
|
28 days
|
1. Introduction
Brien Holden Foundation in partnership with public and private organisations is implementing a project to set up optical services for low-income communities in seven (Talagang, Layyah, Tando Allah Yar, Karachi, Matiari, Khairpur and Quetta) districts of Pakistan. The project is funded by CBM Christoffel-Blindenmission Pakistan. It aims to establish sustainable optical services to provide a variety of subsidised and good-quality spectacles to the local communities.
Project Summary:
The project aims to treat refractive errors related blindness by developing accessible and good-quality optical services leading to a comprehensive continuum of eye care in Pakistan. The specifically objectifies to enhance the access of local communities to good quality optical services in three provinces of Pakistan, Punjab Sindh and Baluchistan. The project makes the existing package of eye health services comprehensive by integrating optical services. Similarly, the project introduces a range of optical products including spectacles, sunglasses and reading glasses for all ages and diverse genders. The project contributes to developing an eye health workforce through training at least nine persons especially those with disabilities to dispense the spectacles and run the optical shops.
Project Results and Activities:
Result 1: Accessible and good quality optical services are established in the project districts
- Situational analysis about the dynamics of the optical market
- Setting up of optical shops - procurement of optical equipment of optical workshops
- Setting up of point of sales including desktop computer, barcode scanner, thermal printer, cash drawer
- Refurbishment of shops - display counter, reception, minor furniture and up keeping
- Disability assessment and making shops accessible
- Training of field staff on dispensing spectacles, safeguarding, disability inclusion, shop management, record keeping and reporting
Result 2: Women, men and children including persons with disabilities are receiving good quality optical services in the project districts
- Procurement of inventory (spectacle frames, lenses, reading glasses, sunglasses)
- Setting up Mechanisms for Uninterrupted Supply Chain, Quality Assurance and Feedback/complaints
Result 3: The project established and maintained quality standards of implementation
- Project Monitoring
- Local travel for monitoring and daily coordination
- Mid Term Review and End Project Evaluation
- Staff and partner organisation training conducted on Safety and safeguarding
Target Groups:
The people benefitting from the services of the optical shops are the patients who were provided with spectacles including, children women, men, persons with disabilities and elderly.
2. The objective of the Project End Evaluation
The project end evaluation aims to:
i- Measure performance: To evaluate whether the project met its planned objectives, targets, and outcomes.
ii- Assess impact: To understand what difference the project made — for example, how it improved people’s lives or strengthened eye health systems.
iii- Ensure accountability: To provide evidence to donors, partners, and beneficiaries on how funds and resources were used.
iv- Identify lessons learned: To capture what worked well and what did not, so future programs can be designed and implemented more effectively.
v- Support decision-making: To guide organisational strategy, resource allocation, and the design of follow-up or scaling-up initiatives.
3. Scope
The project end evaluation is expected to cover the project period from the start of the project (1 July 2022 until 31st December 2025, by creating an accurate and comprehensive picture of the project implementation, project budget, target audience and generating findings on the evaluation criteria and documenting good practices and lessons learned.
Evaluation Matrix:
This evaluation matrix outlines the key criteria, questions, indicators, data sources, and methods for assessing the final performance of the project aimed at establishing and sustaining optical services for underprivileged communities in Pakistan.
|
Evaluation Criteria
|
Key Evaluation Questions
|
Indicators / Means of Verification
(the consultant will adjust these in line with the project LFA)
|
Data Sources
|
Data Collection Methods
|
|
Relevance
|
How well are the optical services aligned with community needs and national eye health priorities? Are the project’s objectives still valid and responsive to the target population? How effectively does the project address barriers faced by low-income and marginalised groups? How does the project promote inclusion and accessibility for women, children, and persons with disabilities?
|
Alignment with national eye health policy Evidence of community needs addressed Inclusion of marginalised groups Feedback from beneficiaries and local authorities
|
Project proposal, National Eye Health Policy, stakeholder interviews, community feedback
|
Document review, key informant interviews (KIIs), focus group discussions (FGDs), beneficiary survey
|
|
Effectiveness
|
To what extent were planned activities completed and intended results achieved? Have beneficiaries experienced measurable improvements in vision and access to services? What factors contributed to or hindered success? How effective were training and capacity-building activities?
|
Percentage of activities completed Number of beneficiaries screened and provided spectacles Improvement in visual outcomes Number and competence of trained personnel
|
Project reports, training records, monitoring data, beneficiary lists
|
Document review, interviews, observation, beneficiary interviews
|
|
Efficiency
|
Were resources used effectively to achieve project outcomes? Were any adaptations made to improve cost-effectiveness? How efficient were logistics and supply chain processes? Are there areas for improvement in resource management?
|
Budget utilisation rate Timeliness of procurement and service delivery
|
Financial reports, partner feedback
|
Financial analysis, interviews, document review
|
|
Impact
|
What significant changes resulted from the project? How did the project affect wellbeing and quality of life? What long-term or systemic benefits are evident?
|
Reduction in vision impairment Increased awareness and service uptake Testimonies of improved quality of life
|
Beneficiary feedback
|
Case studies, FGDs
|
|
Sustainability
|
What mechanisms are in place to sustain optical services post-project? Have local capacities been developed for long-term management? What partnerships support continued service delivery?
|
Local staff trained Financial model viability Partnerships with local health departments or NGOs
|
Partner agreements, training reports
|
Document review, interviews
|
|
Good Practice
|
Which strategies or models were most effective and replicable? How can these practices be scaled or adapted for other regions?
|
Documented successful interventions Stakeholder feedback on replicable models Evidence of improved outcomes due to innovative approaches
|
Evaluation findings, project documentation
|
Stakeholder interviews
|
|
Cross-Cutting Issues
|
How well did the project integrate gender equality, disability inclusion, safeguarding, and environmental considerations? Were staff and partners trained and compliant with safeguarding and inclusion policies?
|
Gender and disability disaggregated data Inclusion in training and outreach Safeguarding mechanisms Environmental sustainability measures
|
Training records, safeguarding reports, monitoring data
|
Document review, observation, staff and beneficiary interviews
|
4. Expected Deliverables
The consultant will be expected to deliver the following;
|
Deliverable
|
Description
|
Timeline
|
Responsible Party
|
|
Inception Report
|
Detailed evaluation plan including methodology, data collection tools, sampling, and work plan. To be reviewed and approved by BHF before fieldwork begins.
|
Within a week of contract signing
|
Consultant
|
|
Data Collection Tools
Stakeholder Consultation Summary
|
Final versions of survey forms, interview and FGD guides, and consent forms aligned with evaluation matrix.
Summary of coordination meetings with BHF, implementing partners, and key stakeholders, highlighting key inputs and agreements.
|
Week 2
|
Consultant
|
|
Draft Evaluation Report
|
Comprehensive draft report analysing findings under all evaluation criteria (Relevance, Effectiveness, Efficiency, Impact, Sustainability, etc.).
|
Week 3
|
Consultant
|
|
Validation Workshop / Presentation
|
Presentation of key findings and recommendations to BHF and partners for review and feedback.
|
Week 4
|
Consultant & BHF
|
|
Final Evaluation Report
|
Finalised report incorporating feedback from validation workshop, including executive summary, findings, lessons learned, and recommendations.
|
Week 4
|
Consultant
|
|
Summary Brief / Factsheet
|
Two-page summary of key findings and recommendations for donor and partner dissemination.
|
Week 4
|
Consultant
|
|
Data and Documentation Package
|
Submission of clean dataset, anonymised transcripts, photos, and supporting documentation.
|
Week 4
|
Consultant
|
5. Proposed methodology
Consultants are expected to propose their own methodology for the project’s end evaluation. The approach should assess relevance, effectiveness, efficiency, impact, and sustainability, using a mix of quantitative and qualitative data. It should engage key stakeholders—including BHF staff, partners, government representatives, and community members—and align with ethical standards. Consultants should outline how they will collect and analyse data, ensure stakeholder participation, and validate findings. The final deliverables will include a comprehensive report and a two-page summary of key lessons and recommendations.
6. Report Format
See Annex 1
- Required Profile of the Consultant(s)
- Possess proven experience (at least 10 years) in monitoring, evaluation and learning work for NGO development projects preferably of public health and eye health
- Strong analytical and documentation skills
- Experience in conducting similar assignments for international NGOs in Pakistan
Proposed Evaluation Team
|
Position
|
Core Role
|
|
Team Leader / Lead Evaluator
|
Overall coordination, analysis, and reporting
|
|
Eye Health / Optometry Specialist
|
Technical assessment of services and outcomes
|
|
MEL Specialist
|
Framework design, data collection, analysis
|
|
Gender, Disability & Safeguarding Specialist
|
Cross-cutting theme assessment
|
|
Field Researchers (2–3 persons)
|
Field data collection and transcription
|
|
Data Analyst / Report Editor (optional)
|
Data cleaning, visuals, report editing
|
Note: the team should include local women with disabilities where possible.
8. Administrative and logistical support:
Brien Holden Foundation will not pay for the consultant’s travel, hotel accommodation, meals and any incidental costs associated with the assessment. All in-country logistical arrangements will be made by the consultant her/himself.
9. Submission and selection of proposals
The proposals can electronically be shared at [email protected].
The proposals in paper form and email can be sent (please mention “Proposal for Project End Evaluation” on top of the envelope) at the following address,
Procurement Committee, Brien Holden Foundation, Plot 5, Basement, Fayyaz Market, Sector G 8/2, Islamabad.
The timeline for submission of proposals is 20th November 2025.
No expression of interest will be accepted after the deadline.
The following documents should be included in the proposal:
- Technical proposal including proposed methodology
- Financial proposal (detailed budget including taxes according to the rules and regulations of the consultants’ local tax authorities)
- CVs (maximum 04 pages) / profiles of the team member and their respective roles
- At least two recent examples of the same/ relevant assignment
- An outline of the understanding of these TORs and the suggested methodology
- Work plan and timeline for the entire assignment
Selection matrix
|
Criteria
|
Score
|
|
Budget
|
30%
|
|
Technical proposal
|
30%
|
|
Experience in the related task
|
20%
|
|
Qualifications of team
|
20%
|
|
Total
|
100%
|
10. Proposed payment schedule:
Brien Holden Foundation proposes to pay 20% of the proposed assignment cost upon presentation of a detailed work plan, the next 50% will be paid upon submission of the first draft of the report and the final 30% will be paid as the final settlement of the contractual obligation.
Annex 1:
Final Project Evaluation Report Template
This template provides a concise structure for preparing the final evaluation report of the project aimed at establishing and sustaining optical services for underprivileged communities in Pakistan. The report should not exceed 15 pages (excluding annexes). Each section includes a brief description of the expected content.
1. Executive Summary (1–2 pages)
Provide a concise overview summarising: project background, purpose of evaluation, key objectives, methodology, major findings by evaluation criteria (relevance, effectiveness, efficiency, impact, sustainability), and key recommendations.
2. Introduction (1 page)
Briefly describe the project’s objectives, duration, target areas, implementing partners, and intended beneficiaries. State the purpose, scope, and audience of the final evaluation.
3. Methodology (1–2 pages)
Outline the evaluation approach, including data collection methods (document review, interviews, FGDs, field visits), sampling strategy, data sources, limitations, and ethical considerations.
4. Key Findings (6–7 pages total)
Organise findings under the following evaluation criteria:
4.1 Relevance
Discuss how the project aligns with national eye health policies, local community needs, and inclusion priorities.
4.2 Effectiveness
Assess progress against objectives, delivery of outputs, quality of services, and capacity-building outcomes.
4.3 Efficiency
Evaluate use of financial and human resources, cost-effectiveness, and adaptive management during implementation.
4.4 Impact
Describe the project’s influence on access to optical services, vision outcomes, and quality of life, including broader systemic effects.
4.5 Sustainability
Explain the measures in place to ensure continuity of services after project completion, local ownership, and partnerships.
4.6 Good Practices and Cross-Cutting Issues
Highlight innovations, inclusion of persons with disabilities, gender equality, safeguarding, and environmental considerations.
5. Conclusions (1 page)
Summarise the overall performance of the project, highlighting achievements, challenges, and alignment between results and objectives.
6. Recommendations (1–2 pages)
Provide clear, actionable, and prioritised recommendations for improving future projects, sustaining outcomes, and enhancing partnerships.
7. Lessons Learned and Good Practices (1 page)
Identify key lessons and effective approaches that can be applied to future eye health or community development initiatives.
8. Annexes (not counted in 15 pages)
Include ToR, evaluation matrix, data collection tools, list of stakeholders, supporting tables/charts, photos, and references.
Page Allocation Summary
|
Section
|
Suggested Length
|
|
Executive Summary
|
1–2 pages
|
|
Introduction
|
1 page
|
|
Methodology
|
1–2 pages
|
|
Key Findings
|
6–7 pages
|
|
Conclusions
|
1 page
|
|
Recommendations
|
1–2 pages
|
|
Lessons Learned and Good Practices
|
1 page
|
|
Total (excluding annexes)
|
13–15 pages
|
| |
|
|
|
|
|