Evaluation Methodology and Tool Development Consultant

Evaluation Methodology and Tool Development Consultant at Resolve to Save Lives

Resolve to Save Lives (RTSL) is a global health organization dedicated to partnering locally and globally to develop and scale solutions addressing the world's deadliest health threats. We aim to close the gap between proven, life-saving solutions and the communities that need them most. Since 2017, we've collaborated with governments and partners in over 60 countries, saving millions of lives and working towards a future of longer, healthier lives, flourishing communities, and thriving economies. This ambitious vision drives our daily progress and inspires our partners.

The Prevent Epidemics (PE) team at RTSL collaborates with governments to fortify essential aspects of their health security systems, enhancing global safety from epidemics.

Location: Global - Remote

Job Structure: Independent Contractor

Background

Resolve to Save Lives has been implementing the Collaborative Surveillance program through its Epidemic Intelligence Team in Zambia, Ethiopia, Mozambique, and Nigeria since late 2023. This program collaborates with national governments to enhance how surveillance data is generated, shared, and utilized to inform timely public health actions. This encompasses improving systems, workforce capabilities, governance, and coordination, ultimately enabling public health actors to more effectively detect risks, assess events, and respond efficiently.

As implementation progresses, there is a critical need to evaluate how these initiatives contribute to stronger surveillance and epidemic intelligence functions. This includes assessing whether enhancements in systems, processes, and collaboration are improving actors' access and use of information, and pinpointing areas requiring further strengthening.

RTSL is currently piloting an impact evaluation to create and test a structured methodology for assessing program contributions across selected pilot countries. This evaluation will employ mixed methods to gather data from key stakeholders and program participants, generating insights to guide ongoing implementation, bolster accountability, and foster broader learning. The primary purpose of this consultancy is to refine and operationalize this evaluation methodology, and to develop standardized data collection tools, protocols, and implementation guidance to ensure consistent and high-quality data collection across various countries.

Purpose

The core objective is to support the impact evaluation pilot by refining the data collection methodology and developing the essential evaluation tools, protocols, and implementation guidance required for high-quality, mixed-methods data collection across diverse country contexts.

The consultant will collaborate closely with RTSL technical staff to:

• Refine and operationalize the evaluation methodology and measurement approach.
• Develop robust quantitative and qualitative data collection instruments.
• Establish protocols and guidance to guarantee consistent and high-quality data collection.
• Prepare comprehensive training and implementation materials for in-country data collectors.

This consultancy will primarily focus on methodology and tool development, thereby empowering in-country consultants and teams to execute standardized data collection effectively.

Scope of Work

The consultant will refine and operationalize the evaluation methodology and develop all necessary tools and protocols for implementation, encompassing the following components:

3.1 Refine evaluation methodology and measurement approach

The consultant will review existing program documentation, the impact framework, and draft indicators, collaborating with RTSL to refine a clear, practical, and implementable evaluation methodology. This will involve:

• Refining the overarching evaluation design and methodological approach.
• Operationalizing the measurement framework and draft indicators into measurable constructs and precise indicators.
• Ensuring methodological rigor and adherence to best practices in mixed-methods evaluation.
• Confirming the feasibility of implementation across diverse country contexts.

3.2 Develop quantitative and qualitative evaluation tools

The consultant will operationalize the measurement framework by developing survey instruments and qualitative interview guides, specifically:

• Developing and refining a survey instrument aligned with evaluation objectives and indicators.
• Developing and refining semi-structured interview guides for key informants, considering various categories of informants (e.g., national, sub-national, validators).
• Ensuring evaluation instruments are theoretically grounded and validated to guarantee data reliability.
• Ensuring precise alignment between evaluation questions, indicators, and data collection tools.
• Ensuring tools are clear, culturally adaptable, and feasible for use across diverse country contexts.

3.3 Develop data collection protocols and data quality assurance guidance

The consultant will create guidance to ensure consistent and high-quality implementation of data collection and analysis, including:

• Developing clear data collection protocols for both quantitative (survey) and qualitative (interview) data collection.
• Developing comprehensive data quality assurance procedures, including guidance on completeness, consistency, and thorough documentation.
• Developing guidance for effectively managing and organizing qualitative data.
• Developing an initial draft codebook for qualitative data analysis, based on the impact framework and the refined evaluation methodology.

3.4 Develop training materials

The consultant will create practical materials to support training and implementation by in-country data collectors, comprising:

• Training materials for data collectors, including slide decks and detailed facilitator notes.
• An implementation guidance note outlining step-by-step procedures for conducting data collection.

These materials should be designed for use by consultants and program teams possessing varying levels of prior evaluation experience.

Contract Deliverables

The consultant will produce the following deliverables:

• Deliverable 1: Refined evaluation methodology and measurement approach.
• Deliverable 2: Fully developed and deployment-ready data collection tools, including a survey instrument and semi-structured interview guide.
• Deliverable 3: Data collection and quality assurance guidance, encompassing data collection protocols, data quality assurance guidance, and a qualitative codebook.
• Deliverable 4: Training materials and comprehensive implementation guidance.

Duration and Level of Effort

Estimated level of effort: Approximately 5 weeks part-time (March-April) with a total effort equivalent to 15 full working days.

Anticipated Distribution of Effort:

• Week 1-2: Deliverable 1
• Week 3: Deliverable 2
• Week 4: Deliverable 3
• Week 5: Deliverable 4

The timeline may be adjusted in coordination with RTSL based on consultant availability and project needs.

Payment Schedule

Payments will be issued upon completion and sign-off of deliverables as follows:

• 40% upon completion of finalized evaluation methodology and data collection tools (Deliverables 1 and 2).
• 30% upon completion of data collection and quality assurance guidance, and qualitative codebook (Deliverable 3).
• 30% upon completion of data collector training materials and implementation guidance note (Deliverable 4).

Required Expertise

• Strong background in social science research and mixed-methods evaluation.
• Demonstrated experience developing robust evaluation methodologies and measurement frameworks.
• Demonstrated experience designing comprehensive surveys and qualitative data collection tools.
• Experience conducting thorough qualitative analysis (NVivo preferred).
• Demonstrated experience producing high-quality evaluation reports.
• Ability to translate complex technical findings into practical program recommendations.
• Experience working in international development or public health is preferred.
• Experience working across multiple country contexts is preferred.

Application Process

Interested candidates should submit their CV and a compelling cover letter detailing their suitability for the role.

RTSL is committed to strengthening its programs through diverse life experiences and inclusive understanding. We encourage applications from all qualified individuals, providing equal employment opportunities without regard to race, color, religion, gender, identity, ancestry, orientation, national origin, age, disability, marital status, organ donor status, or veteran status. Resolve to Save Lives complies with all applicable US EEO laws.

Key skills/competency

• Mixed Methods Evaluation
• Evaluation Methodology
• Measurement Frameworks
• Data Collection Tools
• Qualitative Data Analysis
• Quantitative Data Analysis
• Program Evaluation
• Public Health Surveillance
• International Development
• Stakeholder Engagement