Evaluation Specialist
Location | Dar es Salaam, Tanzania, United Republic of |
Date Posted | November 13, 2023 |
Category | Management |
Job Type | Full-time |
Currency | TZS |
Description
JOB DETAILS:
Evaluation, strategic planning, and capacity-building services. We work across all development sectors including democracy and governance, health and education, environment, and economic growth. Since 1997 we have worked in over 100 countries for clients such as US government agencies, bilateral donors, multilateral development banks, foundations, and nonprofits.
Introduction:
On January 19, 2023, USAID/Tanzania awarded International Business Initiatives (IBI) and SI a four-year contract for the Tanzania Monitoring, Evaluation, Learning and Adaptation (T-MELA) Activity. This activity is to assist the USAID/Tanzania Mission with strategy- and activity-level performance monitoring, evaluation, and learning. This activity will also provide data gathering and verification, data visualization (including Geographic Information Systems), data quality assessments, impact and performance evaluations, assessments, organizational learning, and collaboration among USAID’s implementing partners and DO teams.
Background of PS3+ Activity
USAID Tanzania is committed to health systems strengthening (HSS) as a cornerstone for the sustainability of health initiatives and the enhancement of health outcomes. This dedication aligns with the USAID Vision for HSS 2030, which transitions from a singular focus on individual health system "building blocks" to an emphasis on holistic health system outcomes. Nevertheless, the vision still acknowledges the undiminished relevance of individual components such as human resources for health, health information systems, and private sector engagement. Specifically, the USAID Tanzania health information systems, governance, and health financing endeavors are encapsulated within the Public Systems Strengthening Plus (PS3+) Activity.
The core goal of the PS3+ Activity is to empower the Tanzanian Government to fortify its public sector systems, ensuring the enhanced quality and delivery of public services across multiple sectors, notably health, education, and agriculture. This initiative is rooted in three primary result areas: the enrichment of evidence-based planning and management, the bolstering of local governance to facilitate deeper citizen participation and ensure social accountability, and the amplification of financial resource efficiency. Each of these areas is instrumental in achieving the overarching objectives of improved service delivery and sustainable development.
Statement of Purpose:
The intent of this evaluation is to conduct activity evaluations of USAID/Tanzania’s PS3+ to help further programming around systems approaches, citizen engagement, mutual accountability with the Government of Tanzania, community system strengthening, and private sector engagement. The evaluation will help the Mission understand if and how the interventions supported in these areas are institutionalized and potential investment opportunities that remain unaddressed. This will provide the HSS Team with the information and learnings that it needs to inform the next round of its HSS-integrated activity designs.
Evaluation Questions:
1. To what extent have PS3+’s supply-side (systems) interventions garnered GoT ownership and been scaled up? What were the factors that contributed to or inhibited both ownership and scale-up?
2. In what ways have PS3+’s demand-side (citizen engagement) interventions been effective at increasing citizen voices and participation in planning and governance? To what degree are PS3+ interventions relevant to the needs of Tanzanian citizens?
3. What challenges remain (e.g. political will, policies and guidelines, staff capacity, monitoring, motivation) in ensuring that the systems and interventions which have been adopted by the GoT continue to function sustainably?
4. How has PS3+ produced tangible and quantifiable benefits for the education and agriculture sectors? To what extent is there an understanding of these benefits on the part of stakeholders from those sectors?
5. To what extent has PS3+’s cross-sectoral approach led to quantifiable cost efficiencies within both the GoT and USAID?
6. Has PS3+ collaborated with and linked private sector entities with government, civil society, and community actors to respond to health, education, and agricultural sector needs? If so, what were the outcomes of those linkages?
7. What potential lessons and investment opportunities are there for USAID to consider in the future that have not already been addressed by PS3+ in the areas of health information systems, governance, citizen engagement, and health finance?
Position Description:
SociaI Impact is seeking an Evaluation Specialist to conduct a Performance Evaluation of the USAID/Tanzania PS3+ Activity alongside the Team Leader and other Senior Technical Advisors. This is a consulting position with an estimated period of performance of December 2023 – May 2024. The estimated level of effort (LOE) for the Specialist will be 47 days with expected travel of up to 2 weeks in Tanzania. The Specialist will report directly to the Senior Assessment and Evaluation Specialist/Deputy Chief of Party.
The Evaluation Specialist will be responsible for contributing to all aspects of the evaluation, including supporting the development of the assessment’s methodology, data collection, qualitative and quantitative data analysis, and writing the draft and final reports.
Responsibilities:
The Evaluation Specialist will provide key support to the evaluation in completing the following duties alongside the TL and Advisor:
• Document key PS3+ interventions and results through a comprehensive desk review and contribute expertise and technical inputs to the work plan.
• Support the design of the evaluation, methodology, development of instruments, data collection, synthesis of data, presentations, and reports.
• Schedule and interview key stakeholders and beneficiaries.
• Travel within selected councils and regions and conduct in-person and remote interviews and/or group discussions.
• In consultation with the Team Leader and Advisor, support the team's ongoing analysis of qualitative and quantitative data.
• Contribute to the consultant team’s collaborative production of the following high-quality deliverables:
• PowerPoint presentations to USAID/Tanzania
• Draft and Final Report
Deliverables:
With support from USAID/T-MELA and team members, the Team Lead will be expected to take overall responsibility for the production and management of the following:
Final Evaluation Design: A detailed, full evaluation design and work plan following an initial consultation with USAID that will include chosen methodologies and data collection tools.
Kick-off meeting/In brief: A PowerPoint/Google Slides presentation summarizing the Inception Report for USAID/T-MELA and key partners prior to the launch of data collection.
Findings Conclusions and Recommendations (FCR) Matrix: An analysis tool through which data is triangulated and findings, conclusions, and recommendations specific to each evaluation question are produced. Two FCR matrixes are expected, a preliminary document after the first full week of data collection, and a final matrix at the end of the data analysis period.
Preliminary Findings PPT: The team will present the key findings to the wider USAID/Tanzania Mission through a PowerPoint/Google Slides presentation. The TL is expected to update this PowerPoint after the final report.
Draft Report: A draft report with fully developed findings, conclusions, and recommendations, no longer than 30 pages excluding annexes, will be submitted to the T-MELA COP who will submit to the USAID COR for T-MELA activity. The format will include an executive summary, table of contents, methodology, findings, and recommendations. USAID/T-MELA and key local stakeholders will provide comments on the draft report.
Final Report: The team will submit a final report that incorporates responses to USAID's/partner's comments and suggestions. The report will be submitted electronically in English. The report will be disseminated within USAID and key stakeholders.
Qualifications and Skills:
The Evaluation Specialist must have/hold:
• Advanced Graduate Degree in a related field.
• Minimum of five years of experience evaluating large health projects, including baseline and mid-term studies of health in Tanzania
• Proven expertise in conducting operational research (both quantitative and qualitative data collection), monitoring and evaluation, and/or health program implementation research.
• Strong background in qualitative data collection methods, including focus group discussions (FGD), key informants/ in-depth interviews (KII/IDI).
• Significant experience in conducting qualitative/quantitative data analysis is recommended, especially for surveys, monitoring data, and HMIS data.
• Familiarity with HMIS (DHIS-2) is recommended.
• Advanced skills in quantitative and Qualitative data analysis with the use of software such as Dedoose, NVivo, Stata, or R.
• Excellent interpersonal skills and ability to work in a team.
• Ability to develop effective working relationships with USAID, local organizations, other program partners, and counterparts.
• Must be fluent (writing and speaking) in English; additional language proficiency in relevant languages (e.g., Kiswahili) would be an asset.