Excelling at Criterion 03: Investment in Capacity to Learn What Works
Since fall 2023, ED has dedicated more resources to building evidence about programs that support postsecondary students and institutions to help strengthen education and training after high school. This work is made possible by a new authority granted by Congress that allows the department to reserve and pool funding from programs authorized by the Higher Education Act (HEA) and then deploy those funds to support evidence-building activities in high-priority areas.
ED is now leveraging these new funds to help build evidence about what works to increase postsecondary access and success, for whom, and under what circumstances by bolstering existing grant programs and launching new ones. For example, ED supports external partners in evidence-building by providing enhanced technical assistance for grantees under the Postsecondary Student Success Grants program as they design and carry out rigorous evaluations of their strategies to improve postsecondary success. ED’s Institute of Education Sciences will also establish a new Building Evidence of Effectiveness of Strategies to Increase Postsecondary Student Success Network to enable states to drive evidence-building work. It opened the grant application this past summer.
As part of this work, ED has also launched new evaluations to build knowledge about the Student Financial Aid programs. These include research to understand the awareness and impact of income-driven repayment and other borrower benefit programs; an evaluation of Parent PLUS; an evaluation of new provisions extending Pell Grant eligibility to incarcerated students for postsecondary prison education programs; and a study of Satisfactory Academic Progress policies and procedures across institutions.
The HEA funds will also support using grantee data to build knowledge about program implementation and student success strategies under the HEA Titles III and V programs and completing analyses of whether eligibility for short-term Pell Grants led to improved employment and earnings outcomes.
Taken together, these efforts show the promise of an innovative funding authority that allows a leading federal agency to advance evidence-building in alignment with its Learning Agenda. This new HEA authority unlocks new funding for evidence-building and allows ED to use funds in the areas with the greatest possible benefit.
ED first featured in the Federal Standard of Excellence in 2013. Its FY 2024 Discretionary Budget was $79.233 billion, the largest such budget of the 11 agencies in the 2024 Federal Standard of Excellence.
07.
In the months leading up to the passage of the Evidence Act, ED created a new internal office in early 2019 dedicated to “grants policy.” The office has since become a standout example in the federal government of how to use institutionalized leadership roles to advance evidence-based policy. The Grants Policy Office at ED collaborates with colleagues across the agency to ensure alignment with the Secretary’s policy priorities and to support a learning culture. A primary tool for accomplishing these goals is to work collaboratively to design and learn from the department’s competitive grant programs that issue $2 billion in annual funding from ED to organizations throughout the U.S. educational ecosystem.
ED’s ability to excel in this area is bolstered by its foundation policies, including Education Department General Administrative Regulations (EDGAR), which governs ED’s grants and features four tiers of evidence definitions. The evidence definitions in EDGAR also align with those in the Every Student Succeeds Act and the department’s What Works Clearinghouse. Read more on p. 18 of The Power of Evidence to Drive America’s Progress.
These foundational policies are designed to ensure accountability, efficiency and effectiveness in the use of federal education funds. EDGAR defines “evidence-based” as a proposed project supported by one or more of the following types of evidence: strong evidence, moderate evidence, promising evidence and evidence that demonstrates a rationale and provides standard selection criteria to prioritize evidence-based programs in Notices of Funding Opportunity (NOFOs). In September 2024, updates to EDGAR took effect. The new EDGAR guidelines add new features to fund more projects based on evidence of what works, including prioritizing outcomes and requiring evaluations. By strengthening ED’s commitment to prioritizing evidence and data, incorporating greater community engagement in the grantmaking process, and emphasizing the importance of local context and continuous improvement, federal grant dollars can more effectively improve student outcomes.
ED has 33 grant programs that both define and prioritize the use of evidence of effectiveness, totaling $2.2 billion and representing 42.3% of their grant programs. This analysis includes all competitive grant programs and the five largest (in dollar amount) noncompetitive grant programs. These grants direct funds to evidence-based interventions in areas such as postsecondary access and graduation, K-12 reading skills, school-based mental health and career readiness.
Many of the remaining grants encourage or intend to build evidence. Practices that have not yet been documented to be effective can become evidence-based after an impact evaluation is conducted. Adding a definition of evidence and a mechanism to prioritize evidence in the grant can direct funds to those programs. Programs can benefit from a combination of well-established EBPs and innovative programming intentionally designed to meet emerging community needs.
ED’s Commissioner for the National Center for Education Evaluation and Regional Assistance (NCEE) provides leadership as the agency’s evaluation officer. The Institute of Education Sciences, NCEE’s parent agency, is primarily responsible for education research, evaluation and statistics. ED also has an evaluation governance structure led by the Evidence Leadership Group (ELG), which supports program staff that runs evidence-based grant competitions and monitors evidence-based grant projects. The ELG advises ED leadership and staff on how evidence can be used to improve agency programs and provides support to staff in the use of evidence. It is co-chaired by the evaluation officer and the director of grants policy in the Office of Planning, Evaluation and Policy Development. Members meet monthly for the purposes of ensuring ongoing coordination of Evidence Act work.
ED has executive leadership and a governance structure that is responsible for coordinating data governance, collection, sharing and analysis. The Office of the Chief Data Officer (OCDO) is led by the chief data officer (CDO), whose responsibilities include lifecycle data management and developing and enforcing data governance policies. The OCDO has oversight over ED’s information collection approval and associated White House Office of Management and Budget clearance process, except where those functions have been delegated to the statistical official as required by the Evidence Act. The OCDO is responsible for developing and enforcing the agency’s open data plan, including management of a centralized, comprehensive data inventory accounting for all data assets across the department.
The ED Data Governance Board (DGB) sponsors agency-wide actions to develop an open data culture. It works to improve ED’s capacity to leverage data as a strategic asset for evidence-building and operational decisions, including developing the capacity of data professionals in program offices. It is chaired by the CDO, with the statistical officer, evaluation officer, and performance improvement officer as ex-officio members. The evaluation officer, CDO, and statistical officer meet monthly for the purposes of ensuring ongoing coordination of Evidence Act work. Each leader or designee also participates in the performance improvement officer’s Strategic Planning and Review process. Additionally, the tactical Data Coordinator Council, established under the DGB charter with representation from each principal office, facilitates the execution of DGB policies, ED’s Data Strategy, data maturity improvements across principal offices, and the development of solutions to tactical challenges assigned by the DGB.
ED invests program funds in evaluation and uses findings to advance its mission. As of August 2024, the agency had invested $280.9 million in FY 2024 in high-quality evaluations of federal programs, evaluations as part of field-initiated research and development, technical assistance related to evaluation and evidence-building, and capacity-building. This includes work awarded by centers across the Institute of Education Sciences. The $280.9 million investment represents 0.55% of ED’s $51.4 billion FY 2024 discretionary congressional appropriation, net of administrative and other costs.
However, ED has no specific budget for federal program evaluation. Evaluations are supported either by: (a) required or allowable program funds, (b) Elementary and Secondary Education Act (ESEA) Section 8601, which permits the Secretary to reserve up to 0.5% of selected ESEA program funds for rigorous evaluation, or (c) language in recent appropriations bills that permit the ED Secretary to reserve up to 0.5% of appropriated funds from select programs authorized by the Higher Education Act, as amended, for purposes including research and evaluation.
ED’s Evaluation Policy was approved by the Office of the Secretary in August 2020. It reaffirms the department’s commitment to five core principles in program evaluation: (1) independence and objectivity, (2) relevance and utility, (3) rigor and quality, (4) transparency, and (5) ethics. The Annual Evaluation Plan describes its most significant evaluation activities. ED’s Learning Agenda was released as part of the agency’s Strategic Plan in July 2022. It outlines the priority learning questions that the department seeks to answer between FY 2022 and FY 2026, and is organized across six focal areas, including strengthening student learning and postsecondary access and completion.
ED’s Learning Agenda is integral to its evidence-building pipeline, which prioritizes developing, testing and refining evidence-based educational strategies. This pipeline begins by identifying innovative and promising approaches and then adapting these approaches as new evidence emerges. Finally, rigorous evaluations confirm their effectiveness in enhancing student outcomes. Key department offices and programs — like the Grants Policy Office, the Office of Elementary and Secondary Education’s Education Innovation and Research Program, and the Institute of Education Sciences — utilize this pipeline approach, incorporating data from sources like the National Assessment of Education Progress to strengthen evidence-based practices.
Through Notices of Funding Opportunity (NOFOs) and technical assistance, ED seeks to build state and local capacity to evaluate programs. The agency has at least one NOFO explicitly stating that improving the integration of data systems and overall data infrastructure to measure outcomes is a permissible use of grant funds. ED’s State Longitudinal Data Systems grant program is the most notable example of encouraging data integration, including a priority for “infrastructure and interoperability” and “creat[ing] a [data] linkage that did not already exist.”
The agency awards grants to technical assistance centers to improve state data capacity elsewhere. One example is the Individuals with Disabilities Education Act (IDEA) Data Center, which supports state efforts to collect, report, analyze and use high-quality IDEA data. Current ED NOFOs also name project evaluation and improving data and evaluation as allowable; one example is the award for technical assistance on state data collection. The department also provides technical assistance through its State Support Team. ED also provides evaluation capacity building to grantees in several discretionary grant programs, including the Education Innovation and Research Program and the Postsecondary Student Success Grants Program. The agency’s Regional Educational Laboratories have developed a “self-service” curriculum, or toolkit, for states, districts and other education entities to strengthen their program evaluation capacity.
ED uses performance management practices to improve the operational decision-making process and create a culture of accountability to achieve equitable outcomes. The agency’s performance improvement officer (PIO) oversees the performance management system. Each quarter, the PIO issues a data call to solicit updates to performance metrics aligned with agency goals and strategic objectives. An internal system captures metric data, associated narrative data (e.g., examples of activities included in a count), and an indicator of progress toward goals.
Once data are collected, the cross-office team responsible for a given goal meets to review performance data and prepare a quarterly update for the Deputy Secretary and the department-wide performance review team, including plans for accelerating progress toward the stated goal. Reports are then reviewed at quarterly meetings of the ED-wide performance team to identify additional opportunities to support goal-directed work and prioritize action.
In addition to the work done by the PIO and team, ED uses performance data to achieve equitable outcomes. ED’s FY 2025 Performance Plan and 2023 Performance Report include performance management of several related strategic goals, including: (a) to promote equity in student access to educational resources, opportunities and inclusive environments; (b) to support a diverse and talented educator workforce and professional growth to strengthen student learning; and (c) to increase postsecondary value by focusing on equity-conscious strategies to address access to high-quality institutions, affordability, completion, post-enrollment success and support for inclusive institutions.
ED proactively engages and empowers residents and community partners to inform policy development, program design and delivery processes, emphasizing historically underserved communities. The department is pleased to host four White House Initiatives (WHI) for community engagement, each involving ED staff and an external advisory board. The WHIs advance educational equity, excellence and economic opportunity for Black Americans and Historically Black Colleges and Universities, Hispanics and Hispanic-serving institutions, and Native Americans and Tribal colleges and universities.
Separately, ED hosts the Center for Faith-Based and Neighborhood Partnerships. Finally, under the Biden-Harris Administration, ED launched its Office of Strategic Partnerships (OSP). In addition to engaging the communities listed above, OSP is ED’s primary liaison to the philanthropic and business communities. Contemporaneously with the development of the Strategic Plan, the department published a Request for Information in the Federal Register to solicit feedback on the learning agenda’s six focus areas. The department received more than 30 comments, including from individuals, universities, university-based researchers, philanthropies, advocates and advocacy organizations. Those organizations included, but were not limited to, those representing students historically underserved by education systems. Finally, consistent with ED’s Agency Evaluation Policy, its Institute for Education Sciences’ National Center for Education Evaluation, which conducts the agency’s significant evaluations, engages a wide range of stakeholders in evaluation design via study-specific Technical Working Groups that include ED program staff, highly-qualified researchers, subject matter expert, educators, education policymakers and representatives of beneficiary communities.
ED’s current Strategic Plan includes measurable goals to achieve equitable outcomes informed by underserved communities. The agency tracks progress toward key goals in the plan, which also includes strategic objectives, implementation steps and performance objectives.
FY 2024-25 Agency Priority Goals (APGs) were developed based on the priorities of the Administration and the ED’s Secretary and informed by engagement with internal and external stakeholders, including educators, education policymakers, state and local leaders, education researchers and related organizations, advocacy organizations, and students and families. Several of ED’s FY 2024-25 APGs are specifically aligned to meet the needs of underserved communities, including APG1 (eliminating educator shortages, aligned to Objective 2.2, supporting rural and high-poverty districts), APG2 (supporting the mental health needs of all students), and APG4 (expediting academic recovery, emphasizing schools that serve majority high-needs students). The Annual Performance Plan and Report also shows how ED tracks progress toward goals through annual reporting.