Excelling at Criterion 05: Data Policies and Practices
The mission of ACF at the U.S. Department of Health and Human Services is to foster health and well-being for children, youth, families, individuals and communities by providing federal leadership, partnership, and resources for the compassionate and effective delivery of over 60 types of programs and human services. In September 2024, ACF released its inaugural data strategy to advance that mission, a cohesive effort encompassing 12 specific initiatives to make “data deliver for ACF’s mission” instead of just using data for data’s sake.
The Evidence Act required cabinet-level agencies to establish roles such as a Chief Data Officer and encouraged sub-cabinet-level agencies to follow suit. The new strategy includes hiring ACF’s first-ever Chief Data Officer. However, it also goes beyond the legislation’s mandates, launching a first-of-its-kind Data Talent Center, for example. This Center will specialize in helping ACF recruit, hire and mentor top-tier data professionals to sustainably staff out its essential data needs. While some elements of the data strategy represent work that has been underway for a while, such as continuing its Data Surge Support to deploy data whizzes for one-time data issues, most components of the strategy are, in fact, new.
While achieving the full vision of the data strategy will require significant new investment, ACF did not wait for additional funding to begin its work. Instead, it is “reprioritizing data staff, contractor support and budget to align with these data strategy initiatives,” charting a vision for how it can scale these dozen initiatives should additional resources surface.
Refusing to let the ideal for the future prevent the possible today, ACF is reorganizing its existing capacity to put data in the driver’s seat to benefit its nearly 2,000 staff, the grantee partners of ACF, and the Americans both ultimately serve.
This data strategy reminds us of what is possible with existing resources when leadership has the skill and will to elevate the tools that make government work for all.
ACF first featured in the Federal Standard of Excellence in 2013. Its FY 2024 Discretionary Budget was $33.154 billion, the fourth largest such budget of the 11 agencies in the 2024 Federal Standard of Excellence.
12
04.
While ACF is not required by the Evidence Act to develop its own learning agenda, to further its evaluation and evidence-building work, ACF has developed a learning agenda and an evaluation policy and plan aligned with the U.S. Department of Health and Human Services’ (HHS’) policy and practice. ACF contributed research questions and learning activities to HHS’ agency-wide FY 2023-26 evidence-building plan. In 2020, ACF released its own research and evaluation agenda, describing activities and plans in nine ACF program areas with substantial research and evaluation portfolios. ACF will publish updates to the agenda in 2024.
ACF continues to develop program-specific learning agendas through partnerships between the Office of Planning, Research and Evaluation (OPRE) and ACF program offices. Most recently, ACF published the Welfare and Family Self-Sufficiency Learning Agenda to summarize previous learnings, identify questions that might be addressed through future learning, and describe current projects on economic security, stability and self-sufficiency. (Read more on p. 20 of The Power of Evidence to Drive America’s Progress.)
ACF will continue to release annual portfolios that illustrate key findings from past research and evaluation work and how ongoing projects address gaps in the knowledge base to answer critical questions in family self-sufficiency, child and family development, and family strengthening. In addition to describing key questions, methods and data sources for each research and evaluation project, the portfolios provide narratives describing how evaluation and evidence-building activities unfold in specific ACF programs and topical areas over time, and how current research and evaluation initiatives build on past efforts and respond to remaining gaps in knowledge. Likewise, the ACF Evaluation Policy — established in 2012 and updated in 2021 — confirms the agency’s commitment to conducting evaluations and using evidence from evaluations to inform policy and practice. Additionally, ACF contributes to the HHS-wide evaluation plan, and OPRE develops an annual research and evaluation spending plan.
The Deputy Assistant Secretary for Planning, Research and Evaluation in the Office for Planning, Research and Evaluation (OPRE) serves as the agency’s chief evaluation officer. This person oversees ACF’s research and evaluation efforts, including dissemination of findings, among other responsibilities. OPRE works with ACF program offices to develop annual research plans, integrating the development of program-specific learning agendas into this process. In addition, the office holds regular and ad hoc meetings with ACF program offices to discuss research and evaluation findings. Since September 2019, the Deputy Assistant Secretary for Planning, Research and Evaluation has served as the primary ACF representative to the U.S. Department of Health and Human Services’ Leadership Council and Evidence and Evaluation Council. The cross-agency councils meet regularly to discuss agency-specific needs and experiences and to collaboratively develop guidance for department-wide action.
ACF created the Office for Planning, Research and Evaluation’s Division of Data and Improvement (DDI) in 2016 to provide leadership and resources to improve the quality, use and sharing of agency data. The director of DDI, who also currently serves as ACF’s acting chief data officer, provides that leadership. She oversees work assisting ACF programs in responsibly managing and using data to improve the effectiveness, efficiency and equity of human services programs. The director of DDI was designated to act as the primary member to serve on the U.S. Department of Health and Human Services’ (HHS) Data Governance Board and the Data Council.
ACF fosters a data-driven culture to enhance policy, program decisions and service delivery. Its inaugural 2024 Data Strategy advances user-friendly policies for efficient data sharing, linkage and access, with a strong focus on quality, transparency, privacy and security. To support a consistent experience for ACF’s grantees, ACF is building infrastructure and expertise across its offices.
ACF data assets are accessible through archives like the Federal Statistical Research Data Center Network, with access handled by each research institution’s processes. For new requests, external parties may contact data owners listed in ACF’s Public Data Catalog. Certain data sources with specific restrictions, such as the National Directory of New Hires, have dedicated processes and forms, including a guide and research request form. For other programs, ACF provides a standardized Data-Sharing Request form for external research access, along with guidance for ACF staff to evaluate these requests. In collaboration with the U.S. Department of Health and Human Services (HHS), ACF has developed a standard Data Use Agreement (DUA) format with approved clauses for sharing data with third parties, aligned with the HHS DUA policy, which also requires centralized tracking of these agreements.
ACF’s data priorities span organizational domains: leaders foster data-driven decisions, staff are equipped with secure data tools, and engagement systems promote collaboration across ACF to advance equitable data use and evidence-building.
ACF supports building local and state capacity for program evaluation and data integration. First, it allows grant funds to be used for developing data systems and infrastructure to measure outcomes in funding initiatives like interoperability projects and specific grants. For example, Child Care and Development Fund (CCDF) Lead Agency Data and Research Capacity Grants will support partnerships between CCDF Lead Agencies and researchers to develop and improve state, territory and tribal data systems. Another example is the Temporary Assistance for Needy Families (TANF) Data Collaborative Equity Analysis Awards, which are intended to support state, territory or county TANF agencies conducting equity-focused data analyses. Second, many ACF programs authorize grant funds for evaluation and capacity-building, including Fatherhood FIRE grants and Tribal Maternal, Infant and Early Childhood Home Visiting grants. CCDF research set-aside funds also require research, evaluation and demonstrations at various administrative levels. Finally, ACF offers technical assistance to grantees to improve data capacity, integrate data systems to measure outcomes, and improve evaluation capacity. For example, its Child Care Technical Assistance Network conducted a data integration webinar series. The agency works to strengthen the data capacity of grantees through technical assistance with management information systems (e.g., nFORM) and by supporting grantees’ ability to monitor data quality and performance (e.g., PREP). ACF also provides technical assistance on evaluation capacity through the Tribal Home Visiting Evaluation Institute.
ACF has 11 grant programs that both define and prioritize the use of evidence of effectiveness, totaling $180 million and representing 25% of their grant programs. This analysis includes all competitive grant programs and the five largest (in dollar amount) noncompetitive grant programs. These grants direct funds to evidence-based programs in areas such as home visiting and kinship navigator programs.
Many of the remaining grants encourage or intend to build evidence. Practices that have not yet been documented to be effective can become evidence-based after an impact evaluation is conducted. Adding a definition of evidence and a mechanism to prioritize evidence in the grant can direct funds to those programs. Programs can benefit from a combination of well-established EBPs and innovative programming intentionally designed to meet emerging community needs.
ACF’s performance management practices have three main components. First, a dedicated employee collaborates with each program office to annually update performance metrics and enhance decision-making for equitable outcomes. Second, ACF conducts regular performance reviews, aligning with the budget process and providing at least three updates per year. These measures and data are shared with ACF and U.S. Department of Health and Human Services (HHS) leadership and included in key reports, such as the HHS Annual Performance Plan and Report. ACF also offers quarterly updates supporting an Organizational Health Assessment as mandated by Office of Management and Budget Memo 23-15.
Finally, ACF’s strategic goals align with the FY 2022-26 HHS Strategic Plan, with key performance metrics highlighted in Senior Executive Service Performance Plans and contributing to Objective 4.1 of the HHS Strategic Plan: improving program design, delivery and outcomes by emphasizing science, evidence and inclusion.
ACF tracks progress toward key goals to drive equitable outcomes through its Strategic Plan, released in January 2022. The plan includes five strategic goals that support the agency’s mission. ACF was also an active participant in the development of the U.S. Department of Health and Human Services’ (HHS) FY 2022-26 Strategic Plan and is an active participant in the HHS Strategic Review process. In order to know if its programs are working, ACF tracks outcomes, some of which are reported in HHS’ annual performance plan and report. In HHS’ FY 2024 Annual Performance Plan and Report, ACF is the lead agency on 15 performance measures.