HPOG Impact Study

The Health Profession Opportunity Grant (HPOG) Impact study is a random assignment evaluation to determine which specific program components best help low-income adults complete training that leads to family-sustaining careers in health care. HPOG Impact will answer questions about overall HPOG program effectiveness and explore how variations in program services affect program impacts, including identifying which elements of career pathways programs contribute most to advancing the labor market success of participants.

The HPOG Impact Study is a random assignment evaluation including 23 of the 32 HPOG grantees. The Impact Study answers questions about overall HPOG program effectiveness and explores how variations in program services affect program impacts, including identifying which elements of career pathways programs contribute most to advancing the labor market success of participants. The HPOG Impact Study explores what practices are associated with impacts on education, employment, and earnings outcomes.

The Impact Study addresses the following research questions:

  1. What impacts do the HPOG programs as a group have on the outcomes of participants and their families?
  2. To what extent do those impacts vary across selected subpopulations?
  3. Which locally adopted program components influence average impacts?
  4. To what extent does participation in a particular HPOG component (or components) change the impact on trainees?

Given the HPOG Impact Study’s focus on evaluating the impacts of specific program components and designs, an implementation analysis describes the variety of HPOG program components that various HPOG programs adopt, and documents their contrast with control group services. The implementation analysis also describes the administrative structures and baseline characteristics of program participants as well as the range of local demographics, institutional and labor market contexts in which HPOG grantees operate their programs. In addition to describing the HPOG program, how it was delivered, and whether it was delivered as intended, the implementation analysis also answers the following questions:

  1. What services comparable to those available to HPOG participants exist in the local community?
  2. What is the relative supply of, and accessibility to, those counterfactual services?
  3. What services and trainings did control group members use?

Timeline for HPOG Impact

ACF contracted with Abt Associates in 2011 to conduct the Health Profession Opportunity Grants (HPOG) Impact Study.  The study was designed to demonstrate how variations in program services affect program impacts. The HPOG Impact Study will fill a void in the sectoral training and career pathways literature about both program effectiveness and which types of programs or program components are most effective. The study will conclude in 2017 with a final report scheduled to be submitted to ACF in spring 2017.

HPOG Grantees Participating in HPOG Impact Study

  • Alamo Community College District and University Health System
  • Bergen Community College
  • Buffalo and Erie County WDC
  • Central Community College
  • Central Susquehanna Intermediate Unit
  • Eastern Gateway Community College
  • Edmonds Community College
  • Full Employment Council
  • Gateway Community and Technical College (KY)
  • Kansas Department of Commerce
  • Milwaukee Area WIB
  • New Hampshire Office of Minority Health
  • Pensacola State College
  • Research Foundation of CUNY-Hostos Community College
  • Schenectady County Community College
  • South Carolina Department of Social Services
  • Suffolk County Department of Labor
  • The WorkPlace
  • WIB SDA-83 Inc. (LA)
  • Will County WIB

 

HPOG Impact Partners and Sponsors

Primary Evaluation Sponsor

OPREThe PACE evaluation is funded by The Office of Planning, Research and Evaluation (OPRE). OPRE is the principal advisor to the Assistant Secretary for Children and Families, U.S. Department of Health and Human Services, on increasing the effectiveness and efficiency of programs designed to improve the economic and social well-being of children and families.

Lead Evaluator

Abt Associates logoAbt Associates is a mission-driven, global leader in research and program implementation in the fields of health, social and environmental policy, and international development. Known for its rigorous approach to solving complex challenges, Abt Associates is regularly ranked as one of the top 20 global research firms and one of the top 40 international development innovators. The company has multiple offices in the U.S. and program offices in more than 40 countries.

Evaluation Partners

MEF AssociatesMEF Associates works to improve the lives of vulnerable children and youth, adults, and families through evaluation, research, and analysis to support the effectiveness of programs designed to help them.

 

Urban Institute LogoUrban Institute fosters sound public policy and effective government by analyzing policies, evaluating programs, and informing community development to improve social, civic, and economic well-being.

 

Additional Links

Information for HPOG Impact Participants

Contacts

HPOG Impact Project Director
Gretchen Locke
Principal Associate
Abt Associates
evaluationsupport@abtassoc.com

Federal Project Officers
Hilary Forster
HPOG Evaluation Team Lead
Social Science Research Analyst
Administration for Children and Families
Hilary.Forster@ACF.hhs.gov

Nicole Constance
Social Science Research Analyst
Administration for Children and Families
Nicole.Constance@ACF.hhs.gov

Other ACF-Sponsored Studies