U.S. Department of Labor (DOL)

Evidence Highlight

Excelling at Criterion 04: Evaluation Policy, Plan, and Learning Agenda

“We invest a lot of time in generating evidence…. What we don’t do enough of is think upfront about how to design research products with clear messages that stick and make it easy for practitioners and policymakers to apply findings. Too often, we think about sharing evidence once we have completed our research. By then, much of the design work is done and we are either ignoring user needs or hastily retrofitting our research products for dissemination.”Evidence to Action (E2A) Tool Kit

Following the completion of its most recent Capacity Assessment to generate evidence, an assessment required by the Evidence Act, DOL’s Chief Evaluation Office (CEO) recognized the need to better translate findings from research evidence into actionable insights that more easily inform policymaking, program development and other continuous improvement efforts across DOL. The CEO began by considering various practices for effectively communicating complex information, including federal guidelines and insights from behavioral science, journalism and fictional storytelling. Based on this review, the CEO created the E2A Tool Kit, a guide that offers highly practical tips for getting evidence off the shelf and put to use. For example, the Tool Kit notes that people spend seven seconds at most to decide whether to open a product and read it and offers strategies to make the most of that window.

The E2A Tool Kit makes itself accessible as an interactive “binder,” with easy-to-navigate tabs, scannable bullets, and five handy checklists: ones for upfront plans, written products, presentations, infographics and one-pagers and data visualizations.

The Impact

The Tool Kit is already resonating with audiences within and outside of DOL, as documented by hundreds of downloads. Federal agencies and states are beginning to report its use: for example, the U.S. Department of Health & Human Services asked presenters at its May 2024 Research & Evaluation Conference on Self-Sufficiency to follow the Tool Kit’s guidance to improve presentation materials.

CEO is piloting new ways of leveraging insights from the Tool Kit as part of its broader Evidence to Action work. Over the past year, CEO held research roundtables with experts on key priorities like using workforce data as an equity lever; conducted journey mapping to better understand when and where research evidence is needed; and developed “cheat sheets” synthesizing evidence bases into actionable next steps on topics like supportive services and Registered Apprenticeship.

DOL first featured in the Federal Standard of Excellence in 2013.  Its FY 2024 Discretionary Budget was $13.799 billion, the sixth-largest such budget of the 11 agencies in the 2024 Federal Standard of Excellence.

Leading Example

Evaluation Leadership

DOL’s chief evaluation officer oversees the agency’s Chief Evaluation Office (CEO) and coordinates department-wide evaluations, including interpreting research and evaluation findings and identifying implications for programmatic and policy decisions. The agency has created a structure to accomplish important objectives, such as those in the Evidence Act. Its evidence officials closely coordinate through both regular and ad hoc meetings.

DOL continues to leverage current governance structures. For example, the chief evaluation officer plays a role in forming the annual budget requests of DOL’s agencies, recommending the inclusion of evidence in grant competitions, and providing technical assistance to department leadership to ensure that evidence informs policy design. Also, the chief evaluation officer traditionally participates in quarterly performance meetings with DOL leadership and the Performance Management Center (PMC). The chief evaluation officer reviews agency operating plans, works with agencies and the PMC to coordinate performance targets and measures, and evaluates findings. Quarterly meetings are held with agency leadership and staff as part of the learning agenda process, and meetings are held as needed to strategize addressing new priorities or legislative requirements.

Promising Examples

02.
Data Leadership
04.
Evaluation Policy, Plan and Learning Agenda
05.
Data Policies and Practices
06.
Strengthen State and Local Capacity
09.
Performance Management
10.
Results-Driven Contracting
11.
Community Engagement