TERMS OF REFERENCE FOR THE CONSULTANCY (INDIVIDUAL) FOR FINAL PROJECT EVALUATION OF AREA DEVELOPMENT PROGRAMME BALOCHISTAN (ADPB) PHASE-II
The Government of Balochistan (GOB) and UNDP are currently partnering on a joint initiative, titled Area Development Programme Balochistan phase II, to improve the livelihoods of rural poor in Balochistan. It was an up-scaled phase of a pilot initiative which was implemented through 1999-2005. The current phase of Area Development Programme Balochistan (ADPB II) commenced in July 2006 and currently scheduled to conclude in December 2013. ADPB, is a community driven area development project funded by UNDP, Government of Balochistan (GOB), WFP and local communities. While addressing the needs of early recovery of flood damages in existing project area, ADPB was supported with financial assistance by AusAID during 2011. The Project is being implemented by Planning and Development Department of Government of Balochistan.
The objective of the project is to contribute to poverty reduction in the project target union councils through community based interventions to improve crop and livestock productivity, conserve natural resources, improve communities ‘ access to market and services, support income generation activities, and strengthen women’s role in development. The project’s target area includes the selected union councils 9 district of Balochistan including Musakhail, Loralai, Qila Saifullah, Ziarat, Pishin, Quetta, Mastung, Kalat and Khuzdar.
As ADPB-II in its phasing out stage at present which will be concluded by 31st December 2013, it further will lead towards completing the transition to next phase of launching its new generation project namely Local Economic Development in Balochistan simultaneously. Therefore, project intends to carry out final project evaluation of ongoing phase of ADPB-II covering period July 2006-December 2013.
OBJECTIVES OF THE FINAL PROJECT EVALUATION
The Final Project Evaluation (FPE) will assess the results of the project against the project outputs, as well as identify issues and recommend course corrections. It will also highlight issues and challenges affecting effective and efficient implementation of outputs and their contribution to project outcomes and impact and recommend whether results obtained thus far warrant an extension of the project.
The team of consultants’ will adopt a consultative and participative approach. This will include field visits to project sites and meetings with communities / project direct beneficiaries in nine districts to collect first hand information. The team will also meet with the Project team, relevant government agencies / partners at federal, provincial and district level, if need be, the team may also meet other agencies / projects engaged in similar interventions. The inception of the meeting will take place in head office of ADPB-II Quetta.
KEY FOCUS AREAS
The FPE Team will assess the ADPB-II according to standard evaluation criteria, as elaborated below.
- Assess the contribution of the project towards the achievement of ADPB-II objectives.
- Analyze whether the project’s community based approach addresses the needs and demands of the beneficiaries in a disaggregated manner (for men and women), and the community response.
- Assess the relevance of the tools / instruments / inputs applied by the project for creating assets for the poor, and increasing agricultural production including the technical input.
- Assess the relevance and effect of technical assistance given to the community members.
- Review whether the project has accomplished its outputs. In particular the team should review:
- Area selection criteria and its implementation.
- Targeting strategy for the identification of project beneficiaries including both men and women.
- Any emerging effect of the project on beneficiaries including both men and women. These may include aspects on household income generation / assets formation due to project interventions.
- Assess the performance of the project so far with particular reference to the qualitative and quantitative achievements of outputs and targets as defined in the project documents and annual work plans and with reference to the project baseline.
- Comparative analysis of already conducted mid-term project evaluation 2010 and impact assessment 2012 would also be beneficial to assess the effectiveness.
- Between the project and beneficiary communities
- Between the project and GoB
- Between the project and UNDP
- Between the project and 1 UN
- Between the project and AusAID (early recovery of flood damages in 2011)
- Between the project and WFP / Pakistan Baitul Maal (for the provision of food stamps)
- Assess the effectiveness of the cost sharing arrangements:
- Based on the progress so far and ground situations, suggest / recommend any changes to the above cost-sharing arrangements.
- Analyze the role of the Joint Project Steering Committee (JPSC) and whether this forum is optimally being used for decision making.
- Assess the timeline and quality of the reporting followed by the project
- Analyse the performance of the M & E mechanisms of the project and he use of various M & E tools (MIS, GIS, and any other data collection and analyzing tools)
- Assess the qualitative and quantitative aspects of project management vis-à-vis achievement of outputs and targets.
- Identify factors and constraints which have affected project implementation including technical, managerial, organizational, institutional and socio-economic policy issues in addition to other external factors unforeseen during the project design.
Sustainability and Impact
- Assess preliminary indications of the degree to which the project results are likely to be sustainable beyond the project’s lifetime (both at the community and government level), and provide recommendations for strengthening sustainability.
- Assess the sustainability of the project interventions in terms of their effect on environment
- Analyse the emerging impact on the communities for both men and women in terms of food security, income and asset enhancement.
- Based on the findings (relevance, efficiency, effectiveness, sustainability and impact) as well as taking into account new initiatives emerging, recommend whether continuity in existing project area and replication and/or expansion with focus of new generation project implementation is warranted.
- Evaluate the level, degree and representation by the beneficiaries and stakeholders, (government and donor partners etc.) in the implementation of the project (with particular attention to the development, testing of community based approaches towards assets creation and income diversification, especially for poor and women and accessing technical assistance inputs outside the project).
- Examine the synergies and potential overlap between ADPB and Government departments.
- Assess the alignment of the project and identifying linkages and opportunities for achievement of objectives/targets;
- Assess the project’s knowledge management strategy and outreach and communications to all stakeholders.
Lessons learnt/ Conclusions
- Analyze areas for improved programme planning, especially with respect to setting targets, relevance and capacity of institutions for project decision making and delivery.
- Identify significant lessons or conclusions which can be drawn from the project in terms of
- effectiveness, efficiency, sustainability and networking. Special attention may be given to the security situation and the coping strategies developed by the project to maintain work momentum.
Format of Final Project Evaluation Report (to be provided in English)
- Title Page
- Table of Contents
- Executive Summary
- List of Acronyms and Abbreviations
- Methodology: Description of the way the evaluation was planned and implemented
- Description of the project including any major changes occurring since the proposal’s description of Project’s design, objectives, targets and working methods
- Main findings with the support of SWOT analysis and summarizing strengths and gaps related to the following:
- Implementation Strategies: Key Approaches
- Project Efficiency
- Project Effectiveness
- Lessons learned (including FPE process)
- Recommendations for project improvement
- Recommended Change plan (stating changes, resources, timelines and responsibilities) to implement recommendations
- Annexes (explained in the table)
The findings and recommendations will be thoroughly discussed with the donor. The team will complete and submit a draft final report in both hard and soft copy at the end of the activity. The team leader will finalize the report in the light of comments/suggestions of stakeholders reviews. The key outputs of the FPE are:
- The FPE Draft and Final Reports: The report should be logically structured, contain evidence-based findings, conclusions, lessons and recommendations, and should be free of information that is not relevant to the overall analysis. The report should respond in detail to the key focus areas described above. It should include a set of specific recommendations formulated for the project, and identify the necessary actions required to be undertaken, who should undertake those and possible time-lines (if any). Project stakeholders will provide comments on the Draft Report, and the team will finalize the report in view of these comments.
- A brief paper documenting changes (if any) to be made to the ADPB-II’s Project Document. This may be annexed to the FPE Report.
- Presentation for presenting and discussing the draft final report interactively, the consultants will facilitate a one-day concluding workshop for the project stakeholders.
The duration of the study will be 60 days (two months). The study will commence from the day of signing the contract preferably by 3rd September 2013. The consultant/ firm expected to submit the detailed plan after signing the contract to the National Project Manager, ADPB-II.
The team will consist of a two-member team of consultants, each with at least 12 years of experience related to community based livelihood initiatives and agriculture / Natural Resources Management respectively.
Project Rating Matrix
A Project Rating Matrix will be annexed to the report and will rate the project according to the following criteria:
1. Attainment of objectives and planned results
2. Achievement of outputs and activities
4. Financial Planning
7. Stakeholder participation / public awareness
8. Implementation approach
10. Monitoring and Evaluation
The ratings will be presented in the form of a table. Each of the ten categories shall be rated separately with brief justifications based on the findings of the main analysis. An overall rating for the project should also be given. The following rating system is to be applied:
HS= Highly Satisfactory
S = Satisfactory
MS = Moderately Satisfactory
MU = Moderately Unsatisfactory
HU = Highly Unsatisfactory
Consultants should become fully familiar with the project through a review of relevant documents prior to beginning of country travel / initiation of the assignment.
- Project Document
- Refined Project log-frame
- Minutes of the Steering Committee Meetings
- Baseline survey report
- Project Evaluation Report (mid-term)
- Impact Assessment report
- Annual Progress Review Reports
- Final Progress Report (could be draft)
- Evaluation TORs
- List of persons interviewed
- Summary of field visits
- List of documents reviewed
- Evaluation tools
- Questionnaire used and summary of results
- Comments by stakeholders (only in case of discrepancies with evaluation findings and conclusions)
- A project Rating Matrix will be attached
- Any other annex considered important by the evaluators
- Similarly, they should have experience in monitoring, evaluation and assessment of the development assistance activities, in particular NGO program assessment and performance evaluation.
- They are better equipped with the socio political, economic and physical situation in the project area.
- They should possess qualities such as strong leadership, coordination, work planning and writing skills.
How to Apply
- Individual consultants are invited to submit applications together with their CV for a position / individual consultancy.
- Applications are welcome from anyone who feels they can contribute to the team because they possess three or more of the listed expertise. Obviously, the more qualities that can be demonstrated, the better are the chances of selection.
- Joint proposals from two independent evaluators are welcome. Or, alternatively, proposals will be accepted from recognized consulting firms to field a complete team with the required expertise within the evaluation budget.
- ADPB-II invites eligible firms/individuals/organizations to apply, and submit the following information:
a) General information of the firm/individual/organization experience in the field of the assignment – number of years of professional experience, description of previous assignments/works; and
b) Information on availability for the assignment.
- The applicants will be short listed in accordance with UNDP/ADPB-II procurement/ recruitment procedures, will be interviewed and a contract will be issued to the most suitable applicant.
- Interested individual / firm can apply online at UNDP website www.undp.org.pk or official HR services portal www.brightspyre.com or delivered applications by 3rd July 2013 at the following address:
National Project Manager
Area Development Programme Balochisan (ADPB) Phase-II,
28-A Chaman Housing Scheme, Airport Road Quetta
Phone Numbers: 081-2864075-6
Email Id: firstname.lastname@example.org
Applications received by email would also be accepted.