Pak Mission Society
Final Evaluation of the Project
1790 views
Posted date 27th March, 2025 Last date to apply 8th April, 2025
Country Pakistan Locations Khipro
Category Accounting/Auditing
Type Consultancy Position 1
Experience 8 years

TERMS OF REFERENCE (TOR)

Title of Assignment:

Final Evaluation of the Project

Project Title:

Khipro 5C'S Project

Donor:

Humedica International-BMZ

Location:

Khipro, District Sanghar, Province Sindh, Pakistan.

 

1. Introduction/Background                                                                                                                           
The Province of Sindh is rich in natural resources; it is also subject to a host of environmental and development issues. There is a severe water shortage in the province, especially in the arid and desert areas of interior Sindh. The poor and poorest of the poor live in the areas that are most deprived and lack basic resources. The land is afflicted by desertification, waterlogging, and salinity. Water is an increasingly contested issue in Sindh. The province has been facing severe water shortages in recent years, which have exacerbated other cross-sectoral issues. Scant rainfall and the politicization of water distribution to the provinces are leading to both economic and social hardship. District Sanghar has a medium development ranking (0.637) among the districts of Pakistan according to the Human Development Index. The sub-district (Tehsil) Khipro is a neglected region of Sanghar because of its distance from the District Headquarters and little representation in Federal and Provincial Assemblies. Inadequate funding for development activities and little interest from the Government have left many communities with facilities that are inadequate and in urgent need of improvement. Women, in particular, are often compelled to travel long distances to fetch water for drinking and domestic purposes. Open defecation is still widely practiced in these areas, resulting in high diarrhea and vector-borne diseases, particularly among children. According to ECHO, 27% of the population in Sindh is moderately to acutely food insecure. A lack of access to WASH facilities and medical services exacerbates food security and nutrition conditions. Landless agricultural laborers, pastoralists, and sharecroppers are most vulnerable and the worst hit. In light of the above-mentioned observed problems and difficulties, Khipro is one of Pak Mission Society’s three Integrated Development Areas (IDA), along with Rajanpur and Kohistan. The area has been selected because of the innumerable challenges faced by its high percentage of marginalized, indigenous, and minority populations and the authentic need for health, nutrition, WASH, livelihood, education, environment, and disaster preparedness initiatives. The area chosen for the series of proposed interventions is Tehsil Khipro. Through two consecutive interventions, supported by Humedica and BMZ, Pak Mission Society has positively intervened in 35 villages and, in the proposed project, will further engage the said communities and facilitate 125 communities and establish 25 clusters.

    

    Problem Statement:

The economy of Sindh province is primarily driven by irrigated agriculture, with wheat, rice, and cotton being the main crops. However, increasing water shortages are leading to more frequent droughts. The situation regarding agricultural yields and access to food, particularly for the large population of landless people, is deteriorating across the province, with a high proportion of children under five being underweight.

The majority of cultivable land is owned by large landowning families, and the latifundia are managed by tenant farmers. These farmers, often in a weak position, have become continuously indebted, leading to complete dependency on landlords in the form of bonded labor.

Building on the results of project interventions in 125 villages, which primarily focused on improving drinking water supplies, hygiene, and establishing self-help structures at the village level, the project aims to create self-help structures at higher levels that can serve as permanent and competent representatives in dealings with government agencies and landowners. The capacity of self-help groups at three levels – village/hamlet, village cluster, and union council – will be strengthened, enabling them to independently plan and implement development initiatives within their communities. Additionally, representatives from the target groups, as registered entities, will be empowered to establish connections with other actors in the civil society sector, join networks, and gain support for their legitimate concerns.

 

  1. 1.       Project Outcome/Outputs

Impact: The social and economic situation of landless agricultural labourers and small tenants in Khipro sub-county will in the long-term improve.

1.1 Outcome includes:

The population of 125 villages effectively and actively promotes their social, legal, and economic situation, advocates their legitimate rights and cases, and positively influences decisions affecting their situation.

 Outcome indicators:

  • Three target group representations at Union Council level have been officially registered as Community Based Organizations (CBOs) representing 125 village target group representations (VDC: Village Development Committees) and have started their work.
  • In at least 80% of the decisions that have been taken at upper administrative level in relation to the 125 village communities, since the start of the project, target group representatives have been involved.
  • 50 % VDCs have prepared new micro project schemes rated sufficiently feasible by the project engineer. For 40% of these schemes contacts with potential supporters have been established.
  • In 25 village communities, other local development initiatives supported by governmental or non-governmental agencies have been launched, in addition to the micro projects supported by the project.
  • 70% of targeted 125 communities showed "high organisational maturity" score on Maturity Index Calculation (community members representation, gender mainstreaming, VDPs, record keeping, regular meeting etc).
  • 75% of Human Rights issues arising during project period have been addressed and solved in equitable manner.
  • 50% human rights related issues have decreased throughout the project period.

Outputs:

  1. At the Union Council level, three Community Based Organisations are registered as target group representations and represent the interests of 125 target villages to government agencies and potential sponsors.
  2. The targeted communities on village and Union Council level are equipped with development approaches enabling them to identify and implement development initiatives in their area.
  3.  3 UC level representative organizations (CBO) have access to relevant government institutions and   are equipped to lobby for services at government agencies.

Output Indicator-1:

  • Three Union Council representations are registered as CBOs (Community Based Organisations) by the Welfare Department.
  • 90 % of the Village Development Committees (VDC) of 125 villages are represented in these Union Council Committees (CBOs).
  • The Village Development Committees (VDC) and Union Council representations (CBOs) hold regular meetings (monthly to quarterly) and are take meeting protocols.
  • All three CBOs have established contacts with institutions and persons who can support them in asserting their legitimate interests - legally and otherwise - e.g. NGOs, legal advisors, organisational consultants, UN, sponsors, and can provide information about these contacts.

Output Indicator-2:

  • 75 % of the targeted communities have written Village Development Plans.
  • In 100 of 125 micro projects of target communities, community representatives have independently managed and made arrangements for sustaining the results, according to an assessment by the project team.
  • 100% of the communities managing small projects, for that VDCs maintain financial records using procedures that ensure transparency and accountability (Cash books, receipts)

Output Indicator-3:

  • 75 % of the target villages - represented by their VDCs - have used the advisory services of the government agencies, 30 % of them several times.
  • 30 % of representatives at cluster level made at least two additional visits to the relevant authorities in addition to the visits organised by the project.
  • 75 % of 450 randomly selected community members from 15 target villages name responsibilities of government institutions and how to address them.

 

Final Evaluation:

The project was implemented from December 2021 to November 2024. Initially, it was set to end in November 2024, but after a five-month extension, it will now conclude in April 2025. This is a mandatory final project evaluation required by the project donor, Humedica International-BMZ Fund, to assess the effectiveness, relevance, efficiency, coherence, sustainability, and impact of project initiatives.

 

2. Objectives                                                                                                                                                        

 The objectives of the evaluation are summarized below:

  • To evaluate the project in terms of its effectiveness, relevance, efficiency, coherence, sustainability, and impact, with a primary focus on assessing the expected results and outcomes.
  • To identify key lessons learned and potential practices for future learning.
  • To assess challenges encountered, highlight best practices, and document outcomes for future processes.
  • To provide recommendations for similar future interventions as well as for new initiatives in the targeted areas.

 

3. Scope of Work                                                                                                                                                  

The evaluation will cover the entire project duration from December 2021 to November 2024, including the five-month extension until April 2025. During this period, the evaluation will assess project outcomes at all levels, including result-based management, beneficiaries and project stakeholders, timeline, budget, inputs, and resources. The impact assessment will provide a comprehensive evaluation of the project's interventions in the targeted villages, focusing on the overall impact and relevance of the project. It will analyze the effectiveness of project management and activity implementation in terms of budget consumption and efficiency.

The evaluation will closely examine the results achieved, the coordination with local line departments, and the level of involvement of stakeholders and beneficiaries in the project interventions across 125 target villages.

Additionally, the assessment will identify challenges faced and best practices utilized for future engagement. The review will include feedback from the target group or beneficiaries, representing a diverse group that includes males, females, children, vulnerable individuals, minorities, transgender individuals, and the elderly from the target areas.

Overall, the impact assessment will provide valuable insights into the strengths and weaknesses of the project, enabling informed decisions for future interventions and ensuring sustainable positive impacts on the communities in the 125 target villages approx. 19,000 persons in 2,750 households; the VDCs of these villages; and the new committees to be formed: 25 cluster committees; 3 CBOs.

 

4. Timeframe                                                                                                                                                        

(Outline the estimated working days for each activity in a table.)

Activity

Working Days

  1. Proposed work plan and tools

02

  1. Fieldwork

02

  1. Data Collection

10

  1. Presentation of Data (excel sheets)

02

  1. Draft of Evaluation report

04

  1. Final Report

02

Total Working Days

22

 

5. Deliverables                                                                                                                                                     

The following are the expected deliverables:

Sr.#

Deliverables

Detail

Timeline/days

1

Proposed work plan and tools

Proposed work plan and evaluation questionnaires to be submitted within 02 days following the official initiation of the evaluation.

2

2

Fieldwork

Training of enumerators, testing of tools and final validation

2

3

Data Collection

Briefing, deployment of enumerators, data collection and post field work debriefing.

10

4

Presentation of Data (excel sheets)

Lead Consultant to present analysed summary of field data before the writing the first draft report. This will allow for review, questioning and field follow up and cross validation of the data.

2

5

Draft of Evaluation report

The evaluator must submit draft report for review and comments by all parties involved after analysis of the field data. Both the PMS management members and other related stakeholders in the evaluation must review the draft evaluation report to ensure that the evaluation meets the required quality criteria.

4

6

Final Report

Report and database will be submitted 2 days after receiving comments from the PMS management members and other related stakeholders. The content and structure of the final analytical report with findings, recommendations and lessons learnt covering the scope of the evaluation must include the following:

• Executive summary

• Introduction

• Description of the evaluation methodology

• Situational analysis with regard to the outcome, outputs

• Analysis of opportunities to provide guidance for future programming

• Key findings, including best practices and lessons learned

• Conclusions and recommendations

• Appendices: Terms of reference, field visits, people interviewed, documents reviewed.

• After the final report, LFA-based reporting will be required

 

2

 

6. Methodology                                                                                                                                                  

1. Evaluation Methodology:

The proposed methodology for the endline/final evaluation will combine qualitative and quantitative data collection and evaluation techniques. The methodology will be developed by the consultant, as well as all relevant tools and presented in the inception report. The data collection should include the use of a number of approaches to gain a deeper understanding of the outcomes of the project, including,

  • Desk-base review: The evaluation will review relevant project documents and content produced before and during project implementation including the project proposal, work plans, project progress reports, annual project reports and other documents produced by or associated with the project.
  • Survey: Kindly make a sample estimation part of the technical proposal according to the population of 125 villages across four Union Councils (UCs) of District Khipro. The total population of 125 villages as per baseline was 21161.

KII Interviews: In addition to the desk review, the evaluation will also conduct interviews of key project stakeholders using a structured methodology developed by the consultant.

ü  Livestock Department

ü  District Administration

ü  Public Health Department

ü  Social Welfare Department

ü  NGO/INGO

ü  PMS Staff/HO Staff (if required)

  • Focus Group Discussions (FGDs):

Data will also be collected using focus groups discussion with the key project stakeholder. The details of FGDs are below.

ü  10 FGD’s will be conducted with Village Development Committees (VDCs)

ü  5 FGD’s with Female groups

ü  5 FGD’s with Male groups

ü  03 FGD’s will be conducted with (CBO’s) from each union council

1.1   Evaluation Questions

The evaluation will be guided by the following questions by keeping DAC criteria in focus.

Sr.#

Evaluation Criteria

Mandatory Evaluation Questions

1

Relevance

  1. Was the project relevant to the identified needs of the target beneficiaries and the context?
  2. Were the project activity and strategy (including its assumptions and LFA) realistic, appropriate and adequate to achieve the results?
  3. Have there been changes in the planned measures? Were some measures replaced by others or did some measures have to be intensified?
  4. Has the composition or size of the target group changed?
  5. Has the project region been expanded? Reduced? Diversified?
  6. Have the changes in the planned measures had an impact on the achievement of the objectives?
  7. Has it become clear during the course of the project that objectives have to be amended because they cannot be achieved as planned in the application?
  8. Have the measures perhaps been modified based on changed objectives for 125 villages?

2

Effectiveness

  1. How appropriate were the management process in supporting delivery of project expected results?
  2. Were the project activities developed as per the core humanitarian standards and resilience needs?  
  3. How effective were the strategies and tools used in the implementation of the project?
  4. To what extent were the intended project outcomes and outputs achieved and how?
  5. To what extent did the project reach the targeted beneficiaries at the project goal and outcome levels? How many beneficiaries have been reached?
  6. To what extent has this project generated positive (or negative) changes in beneficiaries of targeted villages?

 

These questions will be applied in 125 villages.

 

3

Efficiency

  1. How far the results achieved did justified the cost incurred - were the resources effectively utilized?
  2. Did project activities overlap and duplicate other similar interventions (funded nationally and /or by other donors? Are there more efficient ways and means of delivering more and better results (outputs and outcomes) with the available inputs?
  3. Could a different approach have produced better results? How efficient and timely has this project been implemented and managed in accordance with the project proposal?
  4. How efficient is the record keeping, reporting and data management of the project activities in 125 villages.

These questions will apply in 125 villages.

4

Sustainability

  1. Are there any plans and or strategies to sustain the gains after the project interventions?
  2. How effective were the exit strategies, and approaches to phase out assistance provided by the project?
  3. What are the key factors/areas that will require addition support/attention in order to improve prospects of sustainability of the project outcomes and the potential for replication of this approach?
  4. To what extent are the existence of institutions and their ability to function ensured even after the project has been completed?
  5. How will the acquired knowledge be passed on?
  6. Who will bear the follow-up costs (for example, personnel, repairs and maintenance costs) in 125 villages?

These questions will apply in 125 villages.

5

Impact

  1. What are the unintended consequences as a result of the project activities?
  2. Are there any significant changes in the context as a result of the project intervention?
  3. Is the institution/facility regularly used by the target group?
  4. Are the committee structures (VDCs, O&M committees etc. are well supported and encouraged in their work by their social environment?
  5. If the project aspires to achieve outcomes at the intermediate (meso) and large scale (macro levels), has this already generated additional interest and been emulated by others? What is the reaction of local authorities and other state representatives?

These questions will be applied in 125 villages.

6

Learning and Replicability

  1. What are some of the key lessons learned as a result of this project that can be shared and replicated?
  2. What are the recommendations for similar future interventions?
  3. What are the recommendations for future interventions (for future project)?
  4. Which interventions were particularly popular or unpopular among the target group, and which ones encountered difficulties?
  5. Were there important/less important measures or key impacts for achieving the objectives?

These questions will be applied in 125 villages.

 

7. Selection Criteria                                                                                                                                            

The Evaluator shall have the following expertise and qualifications:

Required Qualifications

  • Education: At least a Master’s degree in Public Policy, International Development, Development Economics/Planning, Economics, International Relations/Diplomacy, or any other relevant field.
  • Expertise in Aid Effectiveness and Management: Extensive expertise, knowledge, and experience in aid effectiveness and aid management processes.
  • Project Evaluation Experience: At least 08 years of experience in project formulation, evaluation, and conducting end-of-project evaluations, particularly in Sindh or similar contexts.
  • Experience with International Organizations: Proven experience working with international organizations, donors, and evaluating projects.
  • Survey and Evaluation Experience: Past experience in conducting surveys, particularly evaluations of German donor-funded projects (Optional).
  • Language Proficiency: Excellent written and verbal communication skills in English. Knowledge of Sindhi and Balochi will be considered an advantage.

Expertise in Localization and Resilience

  • Proven experience (minimum 08 years) in localization and resilience-building initiatives, particularly in mobilization projects within marginalized regions.
  • Demonstrated ability to assess and strengthen local actors' capacities in governance, humanitarian response, and sustainable development.

In-depth Knowledge of Localization within the Framework of the 18th Amendment

  • Excellent understanding of the constitutional, legal, and policy frameworks governing localization in Pakistan, particularly post-18th Amendment.
  • Familiarity with the roles and responsibilities of provincial and local governments in disaster management, governance, and service delivery mechanisms.
  • Successfully completed at least 2–3 similar assignments in the past.

Technical Expertise in Governance, Localization, and Humanitarian Coordination

  • Extensive knowledge of localization principles, governance structures, and humanitarian coordination mechanisms in Pakistan.
  • Experience in evaluating institutional capacities, inter-agency coordination, and multi-stakeholder engagement in local governance and emergency response.

Experience in Developing Implementation Roadmaps and Strategic Frameworks

  • Prior experience in designing and implementing roadmaps, models, and frameworks for localization, resilience, and disaster management.
  • Proven ability to translate research findings into actionable strategies, roadmaps, and policy recommendations for sustainable, locally led development.
  • Successfully completed at least 2–3 assignments in this area.

Evaluation and Analytical Skills

  • Strong background in qualitative and quantitative evaluation methodologies, including data collection, analysis, and reporting.
  • Experience in conducting midterm evaluations, endline/final evaluations, impact assessments, and stakeholder consultations.

Regional and Contextual Understanding

  • In-depth knowledge of Khipro’s socio-economic and governance landscape.
  • Experience working with local government bodies, civil society organizations, and humanitarian agencies in Pakistan.

8. Evaluation Criteria                                                                                                                                

    The Following are the evaluation criteria for the individual consultant/ consulting firm:

Proposed Criteria for Evaluation

Marks

Proven experience in conducting similar studies and share previous work of similar nature at least 2-3 assignment reports.

30

In-depth Knowledge of Localization within the Framework of the 18th Amendment

15

Regional, Contextual Understanding and work plan

15

Report writing and excellent verbal and communication skills

15

Detailed and itemized financial proposal

25

Total

100

 







  • Note: The applicant must adhere to ethical research/evaluations standards, ensuring:
  • Informed Consent: Participants are fully informed about the purpose of the research and consent to participate.
  • Confidentiality: Personal information of participants is protected.
  • Do No Harm: The research study does not adversely affect participants or communities.

9. Desired Competencies, Technical Background, and Experience                                                     

The Evaluator shall have the following expertise and qualifications:

  • At least Master’s degree in Public Policy, International Development, Development Economics/Planning, Economics, International Relations/ Diplomacy or any other relevant university degree.
  • Extensive expertise, knowledge, and experience in the field of aid effectiveness and aid management process related issues.
  • Experience of project formulation and evaluation and practical experience of end of project evaluation in South Punjab/Sindh or in similar context; At least 08 years of experience in working with international organizations, donors and evaluating projects.
  • Past experience in conducting surveys, especially evaluations of German Donors funded projects. (Optional)
  • Strong grasp of the legal, policy, and institutional landscape of localization in Pakistan, particularly in the context of the 18th Amendment.
  • Excellent written and verbal communication skills in English.
  • Experience in Sindhi and Balochi languages will be considered an advantage.
  • Offers will be evaluated on these criteria as well as the quality of the technical offer (proposed methodology, capacity to mobilize qualified personnel in the field, etc.) and the soundness of the financial offer.

10. Technical Proposal                                                                                                                                         

  • Company profile – including the proof of relevant experiences
  • Up to date CV of the lead consultant/evaluator (showing education and expertise).
  • Technical proposition detailing proposed methodology and resources needed (max 8 pages).
  • An example of a previous reports (evaluations) from similar work which demonstrates evidence of the skills and experience required and a list of past evaluation produced by the lead consultant/evaluator.

11. Financial Proposal                                                                                                                                           

  • Proposed financial offer with a complete breakdown of activities.
  • The financial proposal must be submitted in PKR inclusive of all applicable taxes.
  • The Consultant/Firm must be legally registered with the Federal Board of Revenue (FBR).

12. Payment Terms                                                                                                                                               

All payments will be made in the form of a cheque. The disbursement schedule, including the amount and timeline, will be outlined in the agreement. Payments will be subject to the successful completion of agreed-upon deliverables and compliance with contractual obligations and submission of final report and database. Any applicable taxes or deductions will be as per prevailing government regulations.

13. How to Apply                                                                                                                                                   

For any clarification, please write an email at [email protected].

 

Interested applicants should submit their sealed envolopes which (cover letters, profiles, and CVs with technical and financial proposals (PDF, Word, and Excel)) by 08th April, 2025 COB at the following address.

Procurement Manager

House # 333, Street 29 - Sector G-14 / 4 - Islamabad

+92-51-8446166

Related
Programme Policy Officer (Planning & Development) - SSA9

Relevant Experience:   Job Description:....

Provincial M&E/Surveillance Coordinator

MBBS with MPH / Master of Social Sciences with MPH / MBA with MPH from recognized Univers....

Search