Descriptive Evaluation Analysis Plan National and Tribal Evaluation of 2nd Generation HPOG Grants

This document presents an analysis plan for the Descriptive Evaluation which includes three related studies: (i) Implementation, (ii) Outcomes, and (iii) Systems.

The National Evaluation’s Descriptive Evaluation will present descriptive findings only. It will not analyze causal relationships or estimate causal impacts. This report describes the analytic approach to each of the Descriptive Evaluation's component studies including the relevant domains and research questions for each study. This report specifies measures, sample, and data sources, as well as the analytic strategies and presentational approach.

(i) The Implementation Study analyses will use data collected through two rounds of telephone interviews with program staff, program administrative data, and other data sources documenting program implementation to describe the distribution of specific program features and implementation strategies across local HPOG programs. It will also document participant characteristics and program engagement. The Implementation Study questions are:

1. How is HPOG 2.0 designed and implemented, and what innovative and/or promising strategies have programs introduced in the following five focus areas: employer engagement, basic skills training, training in the career pathways framework, work-readiness training, and program sustainability after the grants end?
2. What are the characteristics of HPOG 2.0 participants?
3. At what rates do participants engage in program activities, training courses, and support services?

(ii) The Outcomes Study analyses will use program administrative data, federal administrative data on employment and earnings, and data on enrollment in and graduation from degree-granting institutions. The Outcomes Study will address research questions in two domains: program outputs and participant outcomes. The Outcomes Study question is:

1. What are participants’ education, employment, and earnings outcomes?

(iii) The Systems Study analyses will use interviews with 15 HPOG program operators, the lead organization directly responsible for the administration of an HPOG program, and their partners to better understand how HPOG programs influenced local service delivery systems and how local systems influenced HPOG implementation The Systems Study questions are:

1. What are the local service delivery systems in which HPOG 2.0 programs operate?
2. What was the mutual influence of the HPOG programs and the local service delivery systems?

• Last Updated:
• Created:
• Resource Publication Date: 2020
• Author(s): Werner, A; Koralek. R; Locke, G. (Abt Associates); Loprest, P.; Eyster, L. (The Urban Institute)
• Funding Source: U.S. Department of Health and Human Services
• Resource Availability: Publicly available
• Posted by: Wesley Peterson
• Posted in: Workforce System Strategies