INDEPENDENT EXTERNAL EVALUATION OF THE ELECTION SUPPORT PROJECT 2010, Tanzania (UNDP) —
English
 

 
Anuncios
Back to Workspace

INDEPENDENT EXTERNAL EVALUATION OF THE ELECTION SUPPORT PROJECT 2010, Tanzania (UNDP)

INDEPENDENT EXTERNAL EVALUATION OF THE ELECTION SUPPORT PROJECT 2010, Tanzania (UNDP)

Manuela Matzinger, November 01. 2010

INDEPENDENT EXTERNAL EVALUATION OF THE ELECTION SUPPORT PROJECT 2010

Location : Dar es Salaam, TANZANIA
Application Deadline : 08-Nov-10
Type of Contract : SSA
Post Level : International Consultant
Languages Required :
English  
Duration of Initial Contract : 30 working days

Background

The Constitution of the United Republic of Tanzania and the Revolutionary Government of Zanzibar provide for the election of the President of the United Republic of Tanzania and Members of Parliament and Local Councils, and on Zanzibar the President of Zanzibar, the members of the House of Representatives and local councils every five years. The country’s fourth multi-party elections will be held in October 2010. The past three elections since the reintroduction of multiparty politics have been generally considered as free and credible on the Mainland but have been much more problematic on Zanzibar where there has been election-related violence (2000/2001) and allegations of registration rigging (2005). Notwithstanding, in the periods between elections, the country has taken notable steps to consolidate democracy including the revision of legislation and introduction of new laws including the Election Expenses Act 2010.
 
Acknowledging the centrality of credible and legitimate elections in democratic consolidation and based on the needs identified by the Government, its key partners and stakeholders, the URT and the Government of Zanzibar (GOZ), through NEC and ZEC, have engaged early in the preparations of the 2010 elections. To complement the national initiative, the Electoral Management Bodies (EMBs) requested the United Nations for support to enhance the relevant national capacities for the preparation, management, conduct and observation during these upcoming elections in 2010. The request was based on the recognition of the importance of effectively addressing the persistent electoral challenges and of responding to the expectations of the electorate for credible elections, and suggsted the need for a rapid augmentation of election management capacity.
 
In response to the request from EMBs, and within the framework of the joint EU-UNDP agreement on electoral assistance, the United Nations fielded a joint electoral Needs Assessment Mission (NAM) from the UN Department of Political Affairs/ Electoral Assistance Division and UNDP to assess the pre-electoral conditions including the political environment and to identify the challenges, constraints and needs of various actors in the electoral process. Among the key actors consulted in terms of their expected roles in the upcoming elections were the EMBs, political parties, civil society organizations, the media, and development partners. The project document is the direct outcome of the needs assessment mission and responds to its recommendations and further reflects additional consultations among programme partners.
The main goal of the Election Support Project 2010, which was formally inaugurated in June 2009, is to further strengthen national capacities for the implementation of free, fair and credible elections, with a focus on strengthening the national leadership of Electoral Management Bodies (EMBs) and engagement and capacities of political parties, media and other civil society, as well as national security management institutions, in contributing to this overall goal.
 
The project is implemented under UNDP Direct Implementation with a dedicated project management team under the leadership and full operational support of the UNDP Country Office. The project has offices in mainland Tanzania and Zanzibar and operates under the overall guidance and leadership of a Steering Committee that has delegated aspects of quality assurance to two stakeholder Technical Committees. Further support, as needed, comes from the UNDP Bureau for Development Policy (BDP) and the UNDP Regional Service Centre based in Johannesburg. The total project budget of USD 28,300,000 is funded through a multi-donor basket funding mechanism which currently receives contributions from the governments of Canada, Denmark, the European Commission, Finland, Norway, Netherlands, Sweden, Switzerland, UNDP and DFID/the United Kingdom. Cost-sharing agreements signed bilaterally between UNDP and individual Development Partners detail the contractual obligations of the parties.  
 
Justification and Timing
 
The Election Support Project will come to a close in June 2011. As per the project document, UNDP Evaluation Policy, and agreement among the partners, an evaluation is to be conducted to independently assess the relative achievement of intended results. While the project comes to an end in June 2011, it is suggested to conduct this evaluation shortly after the electoral events, in order to benefit from the availability of project staff and build on the findings of elections observers and other key informants. This is also a time when a vast majority of project activities will have been completed. The evaluation is expected to also make recommendations that would guide any needed actions in the remaining time of the project up to June 2011. 
 
The evaluation should provide a qualitative, informative and summative assessment of the project components in order to inform stakeholders on the appropriateness of the design, organisation, management, implementation, partnerships, and progress towards achievement of the stated project objectives. 

 

Duties and Responsibilities

Scope and Objectives
The overall aim of the evaluation is to assess the contribution by the Elections Support Project to the conduct of free, fair and credible elections in Tanzania and Zanzibar, by validating the results achieved by the project, their likely impact and their relevance to the overall intended outcome and their overall sustainability.
 
A second objective is to record the overall degree of progress in the development of national elections management capacities, in order to support the Electoral Management Bodies in their ongoing efforts to strengthen their management capacities and systems, and to give some indications to the programme partners on the expected need and focus of any future electoral assistance.
 
Thirdly, the evaluation should inform and provide lessons for future programming in the area of Democratic Governance in the context of the 2011-2015 UN Development Assistance Plan (UNDAP) with regard to assistance to . The Evaluation is expected to provide lessons especially in respect of identifying further capacity development needs in national democratic institutions, including suggestions regarding changes to the legal framework around elections.
 
Fourthly, the evaluation should inform continued implementation in the period of January-June 2011, by making recommendations regarding further capacity development, how lessons learnt and key issues can be followed up in the post-election period, and suggesting immediate steps to be taken towards an improvement in the future electoral environment.
 
The evaluation should cover the period from the signing of the Project Document on June 15th, 2009 until the time of the evaluation. It will examine the ESP’s election support on the Mainland and in Zanzibar, will encompass the entire scope of ESP’s capacity building work with and through NEC and ZEC, civil society organizations, the media and political parties. 
 
Specifically, the evaluation will examine:
 
Relevance – the extent to which the project design and delivery of activities was able to respond to and address:
  • The organizational and programming priorities of the EMBs, participating media and political parties;
  • Recommendations emerging from the 2005 elections, to the extent these had not already been addressed by other initiatives, including the Deepening Democracy in Tanzania Programme (DDTP), a programme that addressed issues resulting from evaluations of the 2005 elections, and any lessons learned that emerged from the implementation of this programme;
  • Pre-election requirements for voter outreach/education;
  • The different situations of women and men and of other segments of the population; that may have been hampered in their participation in elections for reasons of disability, level of literacy or remote location;
  • Relevance to the UNDP goals in the Democratic Governance practice area as expressed in the Strategic Plan (2008-2013);
  • Cultural acceptability and feasibility of activities.
 
Effectiveness – the extent to which project activities yielded expected outputs at the sub-component level and contributed to expected outcomes, e.g. improved:
  • Performance of the EMBs in planning and managing the elections, including: registration, pre-election logistics, election day voting and observer activities; results dissemination; and the handling of security arrangements and processing of complaints; including the effectiveness of the operational plans developed by NEC and ZEC with UNDP’s assistance.
  • Understanding of the elections process among voters;
  • Coverage by the media of the elections;
  • Knowledge of political party functionaries and activists of their rights and responsibilities;
  • Cost-effectiveness: to what extent are the inputs to the project sustainable, for future elections, particularly large procurements and investments?
  • Value for money: Was the cost of project components justified in light of results achieved?
Efficiency/Value for Money – the extent to which project funds, expertise and time were used judiciously to achieve desired project results – i.e. with minimal duplication and redundancy. Were project inputs procured in a timely way and with intended results?
 
Sustainability – the extent to which the legislative and policy innovations, strengthened human capacities, and management systems are likely to benefit the EMBs into the future with a view to the next scheduled elections in 2015. Sustainability should be assessed in particular with regard to the following:
  • Improvements to the Voter’s Register from 2009
  • Skills and expertise development;
  • Capacities for Voter Education;
  • Improvements in the Media environment compared to 2005 elections;
  • Capacities for supporting a peaceful environment, including the Incident Reporting and Response System (IRRS);
  • Future use of other key procurements.
Impact– the evaluation should seek to approximate or estimate the project’s contribution to free, fair and credible elections in 2010.
 
The evaluation should further aim to:
  • Consider project design as well as execution, and examine ESP activities across all the six project components;
  • Assess the degree to which gender, capacity development, and other cross-cutting issues were effectively mainstreamed and addressed in project design and development;
  • Assess the design and implementation of ESP in relation to core aid effectiveness principles such as; national ownership and leadership;
  • Extract the lessons learned and best practices and elaborate specific recommendations to the participating partners and project stakeholders.
 As much as possible, the evaluation should refer to the start of the project period, or the start of project monitoring where applicable, as its baseline for comparative analysis. While many improvements have been recorded in Tanzania’s electoral environment since the 2005 elections, many of them are not attributed to this project;
 
Evaluation Questions
 
The evaluators will develop a work plan and approach that addresses the following key evaluation questions:
  1. Was the ESP project designed in close collaboration with key stakeholders and with the lessons of the 2005 election process in mind?
  2. Were the project objectives achievable? Was the relationship between the objectives and the results logic clear? And were the results stated at the output and outcome levels realistic given the project’s capacity building intent, and given the time and resources available?
  3. Were UNDP, donor and Government inputs mobilized in a timely manner and to the levels anticipated? Was the management arrangement appropriate for this project? Was it implemented according to UNDP DIM standard procedure? Were management arrangements responsive to the requirements of different donors?
  4. How did the funding partners add value to the project, and to what extent were they responsive and harmonized in providing assistance?
  5. Did the project operate with the right number of staff, the appropriate skill sets in place and with a proper distribution of personnel across the various project functions?
  6. Were adequate arrangements put in place for Monitoring against intended results? Were adequate resources attached to monitoring activities? Were the Technical Committees and the Steering Committee adequately informed of project developments? Did these governance bodies perform their roles to expectation and have a composition commensurate with their mandate?
  7. To what extent were stated outputs (sub-component level) achieved? Could they have been achieved to the same extent with the outlay of fewer resources? (Note: the evaluation matrix in Annex D, provides a more specific break down of questions that probe output and outcome results, by component)
  8. What evidence is there of the expected outcomes at the close of the project? (Note: the evaluation matrix in Annex D, provides a more specific break down of questions that probe output and outcome results, by component)
  9. What results did the project achieve with regard to enhancing gender equality, and did the project management effectively integrate gender concerns in implementation of activities?
  10. Across the six components, what key factors hindered and/or helped the performance of the project? Were these factors adequately addressed?
  11. What is the significance of ESP’s results on continuing programming under the UNDP’s Democratic Governance practice area?
  12. Has the project adequately documented its progress, results, challenges and lessons learned?
Methodology
 
The evaluation should use a combination of the following methods for data collection:
  • Document Review – three major categories of documentation will be examined:
  • Documents that constitute formal agreement among project partners and/or record progress; such as the ESP project document, meeting minutes, the monitoring and evaluation framework, the approved project Work Plan, periodic reports, as well as reports prepared by contractors to document the progress of their commissioned work;   
  • Publicly available information such as opinion polls, reports from independent observers that document electoral performance (including some that were funded by the project), including e.g. reports from Media monitoring and international and domestic observer reports, documentation prepared by political parties, the courts and other interested parties during and in the immediate aftermath of the elections;
  • Internal working documents or other documents produced during the course of implementation, such as monitoring reports, training materials, mission reports, consultancy reports, speeches, presentations, etc. (as applicable).
Key Informant Interviews – the evaluation should include interviews with key stakeholders:
  • Senior management and other key focal points in NEC and ZEC;
  • Other national stakeholders with a mandate related to the elections (e.g. political parties, the Police, the RPP, etc.);
  • Representatives of sub-contracted parties of major components;
  • National electoral expert commentators, for example in academia;
  • International long-term observers in Zanzibar;
  • Members of the technical committees and project steering committee, representatives of project donors;
  • UNDP staff and management, including key project personnel;
Structured surveys and semi-structured  telephone interviews – project staff and key informants no longer in the country could be approached by telephone, e-survey or both. The evaluators may also wish to use this tool for other data collection purposes.
 
Stakeholder Consultations – Consultations with groups of stakeholders i.e. media, CSOs Development Partners, Political Parties, National Observers etc.
 
In conducting data analysis and presenting the findings, the evaluation should use a combination of qualitative and quantitative methods. While the evaluation is expected to estimate project impact, it is understood that the evidence of impact may not be available for all components; and further that the methodological rigour usually associated with impact evaluation may not be applicable to this evaluation.
 
In addition to being guided by recognized international standards for free and fair elections as well as the project M&E framework, the evaluators are required to apply substantive expertise to distinguish key indicators of electoral fairness, transparency, and credibility.
 
Outputs and Deliverables
 
Work plan – within two days of the start of the assignment with UNDP. The document will include a review/elaboration of the evaluation matrix drafted by project management, a detailed approach and methodology, schedule, and a draft data collection protocols. The work plan should also include an outline of the evaluation report. 
 
Preliminary findings report – a presentation of findings to key stakeholders orally and in writing will be made prior to completing the in-country mission. The purpose of this session is to provide opportunity for initial validation and elaboration of the evaluator’s observations and analysis. 
 
Draft evaluation report – within two weeks of leaving the project site, the evaluator will submit a draft evaluation report to UNDP.
 
Final evaluation report – within two weeks of receiving comments from stakeholders, the Evaluation Team will submit a final document.  
 
Evaluation Report Outline
 
As a minimum, the Evaluation Report (draft or final) shall include the following components:
  1. Executive Summary
  2. Introduction / Background
  3. Project outline and management
  4. Objectives
  5. Methodology
  6. Analysis
  7. Findings
  8. Lessons Learned
  9. Recommendations
  10. Relevant Annexes, e.g.
  •    List of people interviewed
  •    List of acronyms
  •    Evaluation work plan and TOR
  •    Key reference documents
Evaluation Principles and Ethics
 
The evaluation will be conducted in accordance with the principles laid out in UNDP Evaluation Policy http://www.undp.org/evaluation/ and the principles outlined in the UNEG ‘Ethical Guidelines for Evaluation” ttp://www.uneval.org/search/index.jsp?q=ethical+guidelines.
 
Implementation Arrangement
 
The Team Leader will report directly to UNDP Senior Management, who will provide guidance in the development of the work plan and ensure the monitoring of satisfactory completion of evaluation deliverables. UNDP and/or the Elections Support Project will provide office space and access to office services such as local transport, internet and printing. Evaluators should provide their own computer and communications equipment.
In consultation with the Evaluation Team Leader and as requested, UNDP and ESP personnel will make available all relevant documentation and provide contact information to key project partners and stakeholders, and facilitate contact where needed.
Time Frame for the Evaluation Process
 
The Evaluation is expected to start on 15 November 2010 and have an expected total duration of 30 working days. The final work plan will be confirmed by the Evaluation Team and UNDP upon submission of a draft work plan for discussion.
 
Indicative Work Requirement
Activity and number of days:
 
  • Orientation to the assignment, initial document review, and preparation/discussion of the Evaluation Plan: 2 days
  • Detailed document review at component level and interviews with key project personnel: 7 days
  • Stakeholder consultations, external and internal, including the preparation of surveys etc.: 8 days
  • Analysis and preparation of draft evaluation findings: 6 days
  • Debriefings: 2 days
  • Preparation of Final Evaluation Report, including addressing comments from the stakeholders on the first draft: 5 days
             Total: 30 working days
 
It is expected that the mission will spend 3-4 weeks on in-country work (including domestic travel time), and that remaining time will be allocated for the production of evaluation deliverables.
 

 

Competencies

A team of three independent experts, two international and one national, will be contracted to undertake the evaluation. The Team Leader will lead, organize, and supervise the work of the evaluation team, ensuring a division of labor that is commensurate with the skills profiles of the individual team members.
 
He or she will have overall responsibility for the production of deliverables, in particular the evaluation report, and is ultimately accountable for its quality. The Team Leader is also responsible for ensuring adequate consultations with all stakeholders and for reporting to UNDP on progress.
 
Specifically, the team members will have the following profiles:
Evaluation Team Leader and Senior Electoral Expert:
  • An effective evaluation manager with at least 2-3 years’ experience conducting international development evaluations; and
  • Broad knowledge of technical assistance to elections, with at least 5-10 year’s experience of capacity development in electoral management bodies;
  • Demonstrated strong understanding of international electoral standards and principles required; good knowledge of electoral law preferred;
  • Demonstrated strong knowledge of Monitoring and Evaluation methods for development projects; knowledge of UNDP’s results-based management orientation and practices;
  • Prior experience from Sub-Saharan Africa preferred.
 
International Expert, Democratic governance:
  • At least 5-10 years’ experience in the design, implementation, management, and/or evaluation of democratization programmes in developing countries;
  • Strong knowledge in key areas related to democratic governance such as political parties, the media, civil society, advocacy/education, human rights, women’s empowerment, legal sector, judiciary reform, peace and development;
  • Demonstrated knowledge of capacity development methods;
  • Prior experience in conducting development evaluation;
  • At least 2 years’ experience in Sub-Saharan Africa required;
  • Some experience in analyzing and evaluating Electoral systems preferred;
 
National Expert, Democratic development:
  • Demonstrated experience as a political/governance analyst;
  • Demonstrated knowledge of the democratization process in Tanzania after independence;
  • Knowledge in key areas related to democratic governance including political parties, the media, civil society, advocacy/education, human rights, women’s empowerment, legal sector, judiciary reform, peace and development preferred;
  • Experience in the design, implementation, management, and/or evaluation of democratization programmes in Tanzania or another developing country;
  • Good knowledge of monitoring and evaluation methods;
  • Fluent written and spoken Kiswahili.

 

Required Skills and Experience

  • At least a Masters’s Degree in a Social Science or other relevant area;
  • Min. 10 year’s work experience;
  • Familiarity with project implementation in complex multi donor-funded projects;
  • Fluency in the English language and excellent oral and written communication skills.
 
The consultants must not have had any involvement in the design or implementation of this elections support project and have no present affiliation with UNDP, its funding partners, electoral management bodies in Tanzania, or other key project stakeholder organizations that in any way could jeopardize their objectivity in relation to the assignment.
 
Consultants will be contracted by UNDP and remunerated according to UNDPs standard rates for consultants and in line with the level of their experience and expertise. The contract will be output-based and payment issued only upon delivery of satisfactory outputs.

 

UNDP is committed to achieving workforce diversity in terms of gender, nationality and culture. Individuals from minority groups, indigenous groups and persons with disabilities are equally encouraged to apply. All applications will be treated with the strictest confidence.
Powered by Ploneboard
Document Actions