|
|
 |
|
|
|
| |
Process Evaluation Research |
|
- Administrative Research: Assessment of the administrative context for the program.
- Implementation Research: Analysis of the effectiveness of program recruitment, intake, service delivery, follow-up, and tracking.
- Customer Research: Analysis of satisfaction, motivation, retention of information, and behavioral changes.
- Nonenergy Benefits Research: Measurement of health and safety, economic, environmental, corporate positioning, and customer benefits.
|
|
Process Evaluation Activities |
Data and Document Review
- Document Review: Review of program history, program goals, and program policy statements.
- Program Budget Review: Analysis of resources devoted to the project, including contract funding and staff time allocation.
- Program Statistics Review: Analysis of production and production rates by target groups, service delivery area, and other variables of interest.
Quality Control Check: Assessment of the quality and reliability of program operations by direct observation or review of quality control inspection documents.
Interviews and Surveys
- Executive Interviews: Guided in-depth interviews with senior program managers regarding program goals, program resource requirements, program oversight, and metrics for success.
- Staff Interviews: Detailed interviews with program staff to document details of outreach, recruitment, eligibility, intake, scheduling, service delivery, information tracking, and follow-up.
- In-Depth Customer Interviews: Guided and open-ended interviews with program participants.
- Customer Surveys: Telephone, mail, or in-person interviews with customers who have received program services.
- Focus Groups: Group discussions with service delivery staff or customers who have received program services.
Observations and Inspections
- On-Site Observation: Observation of all aspects of program implementation including outreach, recruitment, intake, scheduling, service delivery, and follow-up.
- On-site Inspection: Post service inspection of work delivered by the program and interviews with program recipients.
|
Process Evaluation Outputs |
Program Documentation
- Documentation of goals, mandate, and funding for the program
- Documentation of program administration roles and responsibilities
- Documentation of program protocols
Procedures and Context Assessment
- Assessment of the feasibility of program protocols
- Assessment of the barriers to effective program operation
- Assessment of the barriers to program impact
- Assessment of the population served
Implementation Assessment
- Verification of actual program procedures
- Assessment of the effectiveness of each element of program operations in meeting the program objectives
- Assessment of program operations efficiency and quality
- Assessment of individual program experiences
Performance Measurement
- Development of performance measurement indicators
- Analysis and quantification of customer understanding, actions, and satisfaction
- Analysis of program achievements as compared to program goals
- Recommendations for program modification
|
| |
|
|
