Results Frameworks and Analytic and Technical Support
We strive to assist governments, bilateral and multilateral donors, foundations, and nonprofit partners in all aspects of their evaluation work to assess program impacts and measure results. We often work closely with clients to provide reviews of evaluation designs, craft evaluations and learning and results frameworks, or provide guidance to relevant stakeholders throughout the evaluation process, from design and data collection to analysis and report writing.
In Ukraine, the Ministry of Labor and Social Policy (MLSP) implemented the Social Assistance System Modernization project to better reach the most impoverished Ukrainians. MLSP hired various local and regional consulting firms to evaluate the project and we worked closely with these firms to review and assess their methodological proposals, analytic materials, and reports from local/regional consulting firms. We also provided MLSP staff with training on evaluation methods customized to their monitoring and evaluation challenges and opportunities. Similarly, in Ireland and Northern Ireland, we served as members of expert advisory committees to help grantees ensure that evaluations of their early childhood health and education efforts included sound design, implementation, and analysis techniques.
As the learning partner for the MasterCard Foundation’s Scholars Program, we are designing and implementing a monitoring, evaluation, and learning (MEL) framework, which includes working with the foundation to refine the theory of change, help identify learning questions and conduct relevant evaluation activities, and facilitate convenings to harmonize MEL activities of implementing partners and share lessons learned.
In Chile, Mathematica provided evaluation technical support to the Universidad Diego Portales, a local evaluation partner of the Harvard Graduate School of Education. The technical assistance focused on all phases of evaluation design, implementation, and analysis of a cluster-randomized trial, of the Fundación Educacional Oportunidad’s early childhood education and health program, Un Buen Comienzo. This intervention was a two-year intensive professional development program, based on a coaching model. The goals of the program were to improve three domains of preschool quality—oral language and early literacy development, socio-emotional development, and coordination of early childhood education with health services—through an intensive professional development program for teachers and aides at the prekindergarten and kindergarten levels in municipal schools in Santiago. Mathematica also participated in the dissemination of findings to Chile’s Minister of Education and other education policy stakeholders.