APPRISE Process Evaluations –
Low-Income Energy Efficiency Programs
AmerenUE partnered with the Missouri Department of Natural Resources Energy Center and other utilities to provide weatherization services to low-income households through the Low Income Weatherization Program (LIWP). The goal of the program is to provide energy efficient improvements to low-income customers to reduce their utility bills and help them prepare for the heating and cooling seasons. APPRISE conducted a process and impact evaluation of the weatherization program. The goals of this research were to assess the effectiveness of the program and to identify opportunities for program improvement.
APPRISE was a subcontractor to Research Into Action on the California Low-Income Energy Efficiency (LIEE) Program Process Evaluation. The CA LIEE provides no-cost energy services to low-income households including attic insulation, energy efficient refrigerators, energy efficient furnaces, weather stripping, caulking, low-flow showerheads, water heater blankets, and door and building envelope repairs. The Process Evaluation focused on client recruitment and enrollment, program coordination, and efficiency of program delivery and implementation. APPRISE was responsible for in-depth interviews with implementation contractors.
APPRISE conducted an evaluation of California’s Single-Family Affordable Solar Homes and Multi-Family Affordable Solar Homes programs. The programs provide solar incentives to customers of three investor-owned utilities in California. The programs aim to stimulate the adoption of solar power in affordable housing, improve the quality of affordable housing, increase energy affordability for low-income households, and increase awareness and knowledge of the benefits of solar power among affordable housing occupants and developers. As a subcontractor in this research, APPRISE conducted interviews with the program administrators and conducted surveys with participating homeowners, participating building managers, and nonparticipating building managers.
Colorado’s Governor’s Office of Energy Management and Conservation implemented new energy efficiency initiatives in 2006 to improve the energy efficiency of low-income homes. The initiatives include a First Response Program to provide low-cost, cost-effective energy efficiency measures and education and an E$P Plus Initiative to provide heating system and other appliance replacement. APPRISE provided evaluation research on these new programs and additional research on Colorado’s ongoing E$P weatherization services.
The 2004 Colorado REACh grant developed a comprehensive cooling program to assist Colorado’s low-income households. Local agency partners implemented cooling program services, including equipment installation and client education, and the state LIHEAP office furnished community-wide education and notification services. APPRISE conducted a comprehensive Process and Impact Evaluation of this program.
The Cool Homes Program aimed to mitigate heat-related problems of the elderly. This program provided measures to reduce summer temperatures in the home, educated customers on how to keep their homes cool, and established a buddy system that initiated contact with seniors during high-risk periods. APPRISE conducted a Process Evaluation of this program.
FirstEnergy offers a Low-Income Usage Reduction Program (LIURP) and Act 129 Low-Income Programs to assist low-income customers. The programs provide energy efficiency and energy education services, help low-income customers maintain electric service, and protect customers’ health and safety. APPRISE conducted a study to assess recent program changes, and to provide guidance to FirstEnergy on future tracking, reporting, and process improvements. The research included an assessment of what changes should be made to program procedures, whether additional measures should be added, and how projected energy savings for additional energy efficiency measures should be calculated.
First State CAA implemented a heating replacement and energy conservation program for the Delaware Department of Health and Social Services from 2015 to 2020. The Repair Replace Heaters and Conserving Energy (RRHACE) program was designed to assess the needs of low-income households and to deliver a customized set of services, including heating equipment assessment and services, Healthy Homes assessment and services, and energy education. Beginning in 2016, APPRISE completed multiple Process Evaluations to assess program procedures and identify challenges and opportunities as the program developed. APPRISE also conducted an impact evaluation to assess how client energy usage changed after participating in the program. In addition to evaluation activities, APPRISE created a Data Tracking System to allow First State staff to document program activities for performance measurement.
The Illinois REACh project was an innovative pilot program aimed to help low-income households maintain energy service throughout the year and reduce the health and safety risks associated with energy service disruption. The comprehensive program worked with clients to increase resources available for paying energy bills, reduce the amount of energy used through effective energy-saving actions and participation in usage reduction programs, and develop the skills that are needed to maintain energy service through proactive management of their monthly budgets and energy bills. APPRISE conducted an evaluation of this program to assist program managers in assessing whether the program design is appropriate, whether there are any barriers to implementing the program as designed, and whether the program has achieved the intended impacts.
The Minnesota Conservation Improvement Programs (CIP) portfolios include low-income components to assist income-eligible households with energy conservation. APPRISE conducted research through the Conservation Applied Research & Development (CARD) Grant Program to provide a comprehensive review of the low-income efficiency programs, evaluate the program processes, and assess program policies and guidelines. The goal of the research was to facilitate more effective program operations and policymaking.
National Fuel Gas’ (NFG) LIURP provides no-cost energy efficiency services to low-income customers to reduce energy usage, provide health and safety improvements, and increase the affordability of natural gas bills. APPRISE is conducting a process evaluation of this program to help NFG expand the delivery and reach of its LIURP services. The study includes in-depth interviews with NFG managers and staff, in-depth interviews with service providers, a needs assessment, surveys with LIURP participants and nonparticipants, and recommendations to reach NFG’s participation and budget goals.
APPRISE was the lead contractor for the evaluation of the National Low-Income Weatherization Assistance Program (WAP). APPRISE had three key partners for this effort – Blasnik and Associates, Dahloff Associates, and the Energy Center of Wisconsin, and was also supported by technical experts from across the country. The evaluation consisted of data collection from state WAP offices, local agencies, and participating and nonparticipating clients. Utility data was collected and analyzed for a sample of clients from every state and submetering studies were conducted to assess impacts on clients who use bulk fuels and to conduct special technical studies. The evaluation assessed program operations and delivery, energy impacts, and non-energy impacts, and made recommendations for modifications to program design and delivery.
The New Hampshire REACh Furnace Cleaning Program aimed to decrease energy usage and reduce home energy insecurity for low-income households in northern New Hampshire by cleaning furnaces and identifying furnaces in need of repair and replacement. Extensive furnace repairs and furnace replacements were also provided in those homes where the need was identified. APPRISE’s evaluation included interviews with program managers, community agency staff, and furnace cleaners; and analysis of the impact of the program on energy usage, energy insecurity, and furnace safety and efficiency indicators.
The Comfort Partners Program is a statewide collaborative utility residential low-income program, providing joint delivery of services through electric and gas utilities. Participating customers receive direct installation of energy efficiency measures, energy education, and payment plans aimed to reduce arrearages. APPRISE conducted a comprehensive evaluation of this program, including a Process Evaluation and analysis of the program’s data tracking system, the comprehensiveness of service delivery, and the impacts on energy usage and bill payment.
The NJ Comfort Partners Program provides no-cost energy efficiency services to low-income utility customers throughout the state. APPRISE conducted a comprehensive evaluation of this program. The Data Tracking Research assessed the comprehensiveness, sufficiency, and accuracy of the program database. The Process Evaluation included review and assessment of materials and procedures; interviews with utility managers; interviews and on-site observations at service delivery contractors; on-site observation of audits, installations, and third party inspections; and post-completion inspections of program installations. The Affordability Evaluation included a telephone survey with program participants and analysis of the program’s impact on affordability of energy bills and participation in the NJ Universal Service Fund program. The Impact Evaluation included analysis of program data, engineering impact analysis, usage impact analysis, and savings realization analysis. The Energy Savings Protocols Research included review and assessment of protocols currently in use to estimate program savings.
The NJ Comfort Partners Program provides no-cost energy efficiency services to low-income utility customers throughout the state. The 2017 evaluation reviewed program changes that were made since the 2013 evaluation, estimated energy savings with a billing analysis, reviewed and made recommendations for changes to the Energy Saving Protocols, and conducted targeted participant telephone interviews and on-site inspections of completed jobs. The evaluation found improved energy savings and recommended additional program refinements to further increase savings achieved through the program.
The NJ Comfort Partners Program provides no-cost energy efficiency services to low-income utility customers throughout the state. The 2020 evaluation reviewed program changes that were made since the 2017 evaluation, estimated energy savings with a billing analysis, reviewed and recommended changes to the Energy Saving Protocols, and conducted a cost-effectiveness analysis.
Niagara Mohawk’s Low-Income Customer Assistance Program (LICAP) was designed to address the problems of low-income customers who are unable to pay their full energy bills. Payment-troubled customers may receive an affordable payment arrangement, energy use management education, and a variety of energy efficiency services including weatherization and energy efficient appliance replacement. APPRISE conducted Process and Impact Evaluations of this program.
The Ohio Department of Development, Office of Energy Efficiency, has implemented programs funded by the Universal Service Fund. Participating customers receive cost-effective energy efficiency services and education targeted at reducing electric usage. APPRISE conducted a Process Evaluation of this program. The work included review of all program documents; interviews with program managers, staff, and contractors; observation of service delivery; customer surveys; contractor surveys; and economic analysis of the impacts of the program on Ohio’s economy.
Ohio’s Department of Development, Office of Community Services, was awarded a REACh grant to research how to provide additional resources to low-income weatherization services in a way that addresses the more comprehensive needs of low-income households. These funds were used to assess the in-home environmental health risks for vulnerable individuals, prioritize usage reduction measures to meet the energy and health needs of vulnerable individuals, and provide additional measures that enhance the health and safety of the home. The program also established a partnership with vulnerable households to take actions to mitigate the environmental health risks in the home and refer clients to other services that can improve the health of the home and the clients who live there. APPRISE conducted a process and impact evaluation of this project.
PECO’s Low-Income Usage Reduction Program (LIURP) provides energy efficiency services and energy education to PECO’s low-income customers to reduce their energy usage and increase the affordability of their energy bills. The LIURP evaluations estimate the impact of LIURP on participants’ energy usage, energy bills, and payment compliance; and survey customers to analyze the impact of energy education and program satisfaction. Evaluations also include observations of audits on a sample of jobs. This research provides information on potential changes to program services and implementation that may lead to increased program savings.
PPL Electric Utilities (PPL) implemented the Winter Relief Assistance Program (WRAP) in 1984 to help reduce electric bills and improve home comfort for low-income customers. The objectives of the WRAP are to reduce energy usage and bills of low-income customers and to increase low-income customers’ ability to pay their electric bills, resulting in reduced arrearages. The program also aims to increase health, safety, and comfort for low-income occupants; create and maintain partnerships with community based organizations and contractors; and make referrals to other low-income assistance programs. APPRISE conducted a comprehensive Process and Impact evaluation of PPL’s WRAP. The research consisted of administrative interviews, review of program procedures, on-site observation of service delivery, customer interviews, service delivery provider interviews, and usage and payment impact analyses.
PSE&G implemented a low-income multi-family smart thermostat pilot program in their New Jersey service territory in 2018. The program installed Nest, Honeywell, and Ecobee thermostats in 943 units within 16 projects, half of which also received a network solution for connectivity. APPRISE conducted a comprehensive evaluation of this pilot program. This research included market characterization to assess the potential for expanded implementation; interviews with property managers, implementation staff, and building managers; a quantitative survey with program participants; and a usage impact analysis to estimate the impact of the program on electric and gas usage.
Sacramento Municipal Utility District’s (SMUD) Low Income Weatherization Program provides no-cost energy services to qualified low-income residential customers. The goals of the program are to reduce electric bills, improve safety and comfort, provide energy education to reduce usage and lower bills, and partner with contractors and community organizations in providing these services. APPRISE’s comprehensive evaluation included needs assessment, interviews with program administrators and contractors, a participant survey, on-site inspections of completed jobs, and billing analysis to measure the impacts on energy usage.
UGI’s Low-Income Usage Reduction Program (LIURP) provides no-cost energy efficiency services to low-income customers in its service territory. APPRISE conducted a Process and Impact Evaluation of this program. The research included review and assessment of program materials and procedures, on-site interviews with UGI managers and staff, in-depth telephone interviews with a sample of program participants, and analysis of the program’s impact on the energy usage of participating customers.