U.S. Agency for International Development (USAID)

Evidence Highlight

Excelling at Criterion 06: Strengthen State and Local Capacity

Historically, the U.S. Agency for International Development (USAID) often partnered with external parties based in the U.S. to conduct evaluations of USAID’s work abroad. However, learning what works, for whom and under what circumstances requires a greater understanding of context.  That’s why USAID has made “localization” a key part of its approach to evaluation. The agency has successfully engaged local institutions in these evaluations based in the countries where USAID was working. But it recognized an unfulfilled remaining need — few were in leadership roles. Most local groups’ involvement was simply collecting data, for example.

USAID created the Local Evaluation and Evidence Support (LEES) mechanism this past year to help realize that opportunity. Awarded in September 2023, with four years of work launched the following month, LEES is building evaluation capacity on the ground in other countries by training local organizations to receive direct USAID funding to lead on USAID evaluation work in the future.  “We want to ensure we are working with experts in the countries,” explained Dr. Winston Allen, Agency Evaluation Officer in the Office of Learning, Evaluation and Research at USAID’s Bureau for Policy, Planning and Learning. LEES will operate in four to six African countries, including Zambia, where 25 firms have already been selected and have completed training as of Summer 2024. LEES has also identified 25 such organizations in Ghana, which started training in October 2024.  Importantly, some organizations have been involved in USAID evaluation work before, but some have never been.

USAID launched LEES through its 2020-2025 Evaluation, Monitoring, and Learning Services IDIQ (Indefinite Delivery, Indefinite Quantity) contract, created in 2010 when USAID established its Office of Learning, Evaluation, and Research. Capped at $655 million, this IDIQ allows USAID missions easy access to a pool of 19 firms engaged in evaluation work, easing the process of tapping evaluation capacity for the work of building evidence that USAID requires. The IDIQ vehicle helps account for the relative speed with which USAID has been able to advance this initiative.

We want to ensure we are working with experts in the countries.

Dr. Winston Allen
Agency Evaluation Officer

The Impact

Local feedback so far has pointed to significant enthusiasm for the initiative. In fact, in both Zambia and Ghana, more organizations sought to participate than were available in the spots. To be responsive to this demand, USAID is already working on making the training materials available through the USAID Learning Lab website so that as many organizations as interested can access training to take on increasing roles in evaluations of work in their own countries.

USAID first featured in the Federal Standard of Excellence in 2013. Its FY 2024 Discretionary Budget was $28.948 billion, the fifth-largest such budget of the 11 agencies in the 2024 Federal Standard of Excellence.

25

Number of local firms in Ghana that have begun USAID training to build evaluation capacity

Leading Example

Results-Driven Contracting

USAID employs a “Pay-for-Results (PFR)” approach to development, in which the agency makes payments when implementing organizations achieve specific milestones or development results. PFR brings all stakeholders together from the beginning of the development activity to set performance metrics, helping to ensure that allocated funds achieve measurable results as cost effectively as possible. USAID has developed a guide offering guidance on setting, pricing and administering performance metrics in PFR programming; a PFR primer is also available here.

USAID also has Notices of Funding Opportunity (NOFOs) that requires procurement contracts to prioritize proposals addressing the needs of people experiencing unfavorable outcomes. An example is the USAID/Ghana NOFO, Teaching and Learning Materials and Classroom Furniture (TLM+) Activity. Its evaluation criteria state that USAID/Ghana will evaluate an applicant’s technical approach and year one work plan outline based on the extent to which they are sound, evidence-based and likely to meet the objectives and purpose set forth in the NOFO, including applying a gender, youth and environmental protection lens; using a behavior-led approach; and incorporating opportunities for learning and adapting.

Promising Examples

01.
Evaluation Leadership
02.
Data Leadership
03.
Investment in Capacity to Learn What Works
04.
Evaluation Policy, Plan and Learning Agenda
06.
Strengthen State and Local Capacity
11.
Community Engagement