Yearly Third-Party Evaluation of Country Programme, WaterAid Pakistan

(April 2024 to March 2025)

1. Background 

WaterAid is an international not-for-profit organization working in 28 countries including Pakistan.The organisation’s vision is of a world where everyone has access to safe water and sanitation. To attain its vision WaterAid is systematically transforming the lives of the poorest and most marginalised people by improving their access to safe Water, Sanitation and Hygiene (WASH). The organization works with partners and government departments/ institutions in strengthening their capacity to deliver WASH programmes. Furthermore, WaterAid’s policy and advocacy efforts are concentrated on decision-makers to maximise impact of its interventions.

WaterAid has supported the implementation of WASH programmes in Pakistan since 1996 through its implementing partners and opened its country office in Pakistan in 2006.  In its 16 years presence in the country, the organisation, in collaboration with sector stakeholders, has delivered numerous projects on water, sanitation and hygiene and has effectively engaged the government and policy makers on: 

• Developing WASH models across Pakistan for promotion, adoption and scale-up

• Enhancing political ownership of WASH and recognition of human rights to WASH 

• Supporting Improved sector governance to plan and implement safely managed services in Punjab and Sindh

• Prioritization of WASH by the Health Sector & Communities/Households for Improved Public Health

• Adaption of WASH systems to mitigate the effects of climate change and continue to deliver benefits for marginalized climate-vulnerable communities

2. Programme Areas Focused by WaterAid Pakistan 

WaterAid Pakistan’s programmatic work is divided around two priority thematic areas/programmes, which are:

1. WASH & Health Programme

2. WASH & Climate Programme 

Over the past year, WaterAid Pakistan received approval for 12 projects, which are currently at various stages of implementation across Punjab, KPK, Baluchistan and Sindh. 

3. The Purpose of Evaluation

The evaluation aims to assess the impact of WaterAid interventions at local, provincial, and national levels. It will involve a thorough analysis of the effectiveness and outcomes of these interventions, providing insights into their contributions to advancing water, sanitation, and hygiene initiatives and promoting sustainable development goals in targeted areas.

The country programme evaluation (CPE) also aims to assess the results generated through each of the projects and programmes in 2024-25, the way these contributed to achieving Country Programme Strategy (CPS) objectives and how these contributed in governments’ efforts in fulfilling their WASH mandates at various levels. The findings of the evaluation will help the country team to reflect on the continued relevance of the programmes against the backdrop of a changing external environment and assess whether the approaches applied in each programme were appropriate and effective.

The CP evaluation will generate recommendations and lessons learned that will be used to inform the ongoing programmes for their improvement and maintain focus on achieving the organizational goal as delineated in the CPS.

4. Objectives of the Study

• To evaluate the efficiency, effectiveness, relevance and, sustainability of the programme delivery with a focus on projects initiated and completed last year (April 2024 – March 2025).

• To gauge level of impact WaterAid’s programmes has achieved at the local, provincial and national levels 

• To analyse and document issues and challenges in the programme implementation with recommendations for future course correction.

• To assess effectiveness of the support functions i.e. M&E, Finance, HR and Admin/ Security in supplementing the work with partners, government and stakeholders

• To document lessons learnt by WaterAid Pakistan in the implementation of its programmes

• To make recommendations for the next year of the programme

5. Methodology

It is envisaged that this assignment will be performed using qualitative tools and a desk review of documents to assess the WAP programme. 

Considering it qualitative in nature the evaluation, the indicative methodology includes:

1. Review of programme plans and progress reports such as Country Programme Strategy, programme /project plans, periodic progress reports of the projects including financial reports, field visit reports, M&E reports, organisational frameworks on Equity & Inclusion (E&I), and Sustainability framework, Water quality testing protocols/policy and reports. Furthermore, the consultant will also review the anecdotal evidence already collected by WaterAid.

2. Interviews of key staff and stakeholders which may include Heads of different departments of WaterAid, Provincial Managers and Sector Specialist. If required, WaterAid may arrange virtual meetings of the consultants with the staff of implementing partners and other key stakeholders including officials of relevant line departments of the target districts.

However, this is the indicative evaluation methodology, and the consultant is expected to propose detailed methodology in the proposal which may include the aforementioned steps and any other process as deemed necessary. 

Based on the information from relevant documents and insights gained through interviews and discussions, the consultant/consulting firm will finalize a comprehensive report based on the format agreed with WaterAid. This report will include objectives and methodology of the evaluation, challenges and limitation, detailed findings and recommendations. 

6. Deliverables

Following are the expected deliverables of this assignment:

7. Study Report Format

Following is the proposed broader outline of the evaluation report:

• Executive Summary

• Introduction (context, country programme brief)

• Objectives and Methodology

• Key Challenges and Limitations

• Findings and Analysis

• Lessons Learnt

• Recommendations

• References

• Annexes

8. Payment process:

• 1st instalment of 20% payment at the acceptance of inception report 

• 2nd instalment of 40% payment on the submission of draft report 

• 3rd instalment of 40% payment on the acceptance of final report. 

9. Qualifications or specialised knowledge/experience required

The protentional consultant/firm conducting the evaluation should have

• Minimum 10 years of experience in leading third-party evaluations and research. 

• Demonstrable knowledge of evaluation techniques, especially qualitative analysis techniques such as CAT.

• Proven analytical and articulation skills

• Understanding of the water, sanitation and hygiene (WASH) sector in general and WASH programming in school and communities in low-income context in particular. 

• Demonstrable experience and evidence of producing high quality reports for international development organisations. 

10. Intellectual Property Rights

All documentation related to the assignment shall remain the sole and exclusive property of WaterAid Pakistan.

11. Timeframe

This assignment is expected to begin by 5th July ,2025 and shall be accomplished no later than 20th August ,2025.

12. Evaluation criteria

Candidate (firms/individual) shall submit technical and financial proposals in two separate sealed envelopes. Technical offers will first be evaluated according to the “Evaluation criteria” below and the technical qualification threshold point is “70”. Financial offers of ONLY successful candidates will be opened

Technical Evaluation Criteria for Shortlisting Consultancy Firms/Consultants:

Financial offer 

For Financial offer, each deliverable must be included in the financial offer. All deliverables MUST be completed within the assignment duration.