Creating a Data System to Manage and Evaluate Grant Programs: Insights from the PAGES
About
This brief highlights the Health Professionals Opportunity Grant (HPOG 2.0) Next Gen team's creation process and operation of the Participant Accomplishment and Grant Evaluation System (PAGES). It offers recommendations and essential elements for data systems supporting time-limited grants and evaluations like HPOG 2.0. The team's seven-year journey encompassed program needs assessment, vendor selection, system development, launch, maintenance, and user support.
In 2014, the Administration for Children and Families (ACF) engaged in an effort to offer guidance on evaluating the second round of Health Profession Opportunity Grants (HPOG 2.0) awards and to provide support for the grants and national evaluation. A significant initiative within this collaboration involved the creation and management of a federally funded Management Information System (MIS) to underpin HPOG 2.0. This system named the Participant Accomplishment and Grant Evaluation System (PAGES), was built on Microsoft Dynamics 365 US Government, a cloud-based Customer Relationship Management (CRM) platform.
PAGES was purposefully designed to fulfill numerous roles within HPOG 2.0, particularly data collection for evaluations, performance reporting, and case management. The system facilitated HPOG 2.0 grantees in recording participant activities, managing cases, and tracking participant outcomes. Grantees utilized PAGES not only for self-monitoring of organizational progress but also for data analysis to enhance their programs. Beyond the grantees' purview, PAGES empowered ACF to oversee grantees through the generation of comprehensive performance progress and annual reports. Furthermore, PAGES was instrumental in amassing high-quality data for program evaluation and in the random assignment of participants for the experimental Impact Evaluation. The brief's insights stem from interviews and feedback collected from HPOG 2.0 grantee staff, ACF, and contractors. These insights coalesce into a comprehensive guide for organizations embarking on the journey of constructing data systems to bolster federally funded initiatives like HPOG 2.0.
The project identified four fundamental steps for instituting an MIS:
- Gather and Document Needs: The initial phase entails comprehensively understanding program requirements and system prerequisites.
- Platform and Vendor Selection: The subsequent step emphasizes utilizing a competitive selection process, contingent on available time and resources. This phase involves assessing whether Commercial-Off-The-Shelf (COTS) software can cater to the data system's necessities.
- System Development, Launch, and Maintenance: Use a strategic approach to establishing and launching the system and set aside a stabilization period post-launch.
- User Support Delivery: The final phase underscores the significance of providing multifaceted user support with training, documentation, and personalized troubleshooting.
Major Findings and Recommendations
The report's aim is to offer recommendations to agencies in constructing data systems aligned with federally funded, time-limited grants, projects, and evaluations like HPOG 2.0.
Recommendations:
- Defining System Needs and Features: Involve content area experts, draw on past data system experience, and collect user feedback from similar systems. This collaborative approach ensures that the system's design aligns closely with the specific needs of the user community.
- Choosing a System Platform: Employ a competitive selection process, whenever possible, to identify a platform that best aligns with the project's requirements and cost considerations. This approach ensures a thorough evaluation of available options, leading to a better fit between the chosen platform and the project's goals.
- External Support and Resources: Organizations should evaluate available vendor support comprehensively to ensure that it encompasses resources to tackle unexpected challenges. Additional strategies to manage potential resource gaps effectively are to overestimate resources needed for staffing transfers and foster early cross-team collaboration.
- Platform Features and User Experience: Security and monitoring requirements must be met. Consider using FedRAMP-certified system options for added security. Integration capabilities with other tools and systems should also be evaluated to streamline workflows.
- COTS Software Limitations and Customization: Commercial off-the-shelf (COTS) software offers pre-built features that may be able to quickly and easily be updated to meet your system's requirements. However, limitations may necessitate custom code or design adjustments and those could introduce a risk to the system. It is vital to involve team members familiar with the proposed software to assess potential limitations and customization needs.
- Effective System Maintenance: Create a plan for stabilization after the launch and unexpected maintenance that will be necessary over time. The establishment of efficient processes for development allocation and prioritization, along with fostering collaboration between development and user support staff, ensures seamless issue resolution.
- User Training/Support: Provide accessible resources in various formats, tailored training for users, and individualized support for grantees. Striking the right balance between on-demand troubleshooting support and user accessibility is crucial to optimize system usage.
Materials
Comments
Content Details
Methodology:
Topics:
Target Populations:
Programs:
Geographic Locations:
Industry Sectors:
- Last Updated:
- Created:
- Resource Publication Date: 2022
- Author(s): Leiter, A.; Sick, N.
- Resource Availability: Publicly available
- Posted by: Justin Venneri
- Posted in: Workforce System Strategies