APPRISE Process Evaluations –
Market Transformation Programs
APPRISE conducted a process evaluation to understand the contributions of Avangrid’s marketing programs to residential and non-residential customer participation in Avangrid’s energy efficiency programs. The research included in-depth interviews and surveys with program participants to assess the success of various marketing approaches.
Columbia Gas implemented a portfolio of Demand Side Management (DSM) programs in 2009 for its residential and small commercial customers. The residential programs include a Residential Home Performance retrofit incentive program and a rebate program for customers who purchase programmable thermostats and energy-efficient showerheads. APPRISE conducted a process evaluation of these programs to help refine the programs and improve program effectiveness. The evaluation research included document review, analysis of program statistics, interviews with Columbia Gas managers and staff, interviews with program implementers, and participant and nonparticipant surveys.
Columbia Gas implemented a portfolio of Demand Side Management (DSM) programs in 2009 for its residential and small commercial customers. The Small Business Energy Solutions program is an energy efficiency improvement rebate program for small general service commercial customers. APPRISE conducted a process evaluation of this program to assess program performance issues and determine whether modifications to program design could result in improved performance. The evaluation research included review of program documents, analysis of market statistics, interviews with Columbia Gas managers and staff, interviews with program implementers, and review of other ratepayer-funded programs for the same customer segment.
The Connecticut Small Business Energy Advantage (SBEA) Program provides energy-saving services for small commercial and industrial customers. APPRISE worked with KEMA on this evaluation research and developed a better understanding of how the program can reach a broader and wider set of customers. The Data Mining Research included analysis of the program database and the eligible customer database. This research assessed which market sectors are highly represented among the SBEA participants over the last five years, which sectors are underrepresented and which are missing; determined how the market sector distribution of program participants compares to those of nonparticipants; characterized the mix of measures installed in the program; and explored predicted savings by sector. The Low-Income and Limited English Study explored how to increase participation by small business owners who are low-income or have limited English fluency. The study contacted organizations in the state who work with these types of small businesses, characterized the businesses and assessed eligibility for the program, and determined whether the organizations were willing to facilitate participation of these businesses in the SBEA.
APPRISE worked with a team to assess the performance of thirteen residential and small business energy efficiency programs offered by the Consolidated Edison and Orange & Rockland utility companies. The evaluation assessed how each energy efficiency program is operating and made recommendations for improvements to the implementation process. Specific information gathered via program participant and non-participant surveys included participant satisfaction, effectiveness of program marketing and delivery, barriers to participation, satisfaction with measures offered, and satisfaction with trade ally training programs.
APPRISE conducted an evaluation of the Illinois Solar for All Program which brings photovoltaic power to low-income and environmental justice communities throughout Illinois and creates a long-term, low-income solar marketplace.
The ILSFA Program has four key components.
- Low-Income Distributed Generation: Single- and multi-family residential properties occupied by low-income households can receive incentives for new solar generation systems.
- Low-Income Community Solar: Low-income owners and renters can buy or lease a share of the solar system and receive credits on their utility bills for the energy produced by their share of the system.
- Incentives for Non-Profits and Public Facilities: Non-profit organizations and public entities within environmental justice communities or low-income communities can receive incentives for new solar generation systems.
- Low-Income Community Solar Pilot Projects: Projects with community partnerships and ownership will be awarded based on a competitive procurement approach.
The evaluation included analysis of community outreach, system cost and production, environmental and economic benefits, impacts on participants’ energy costs and burden, job training, and system reliability.
New Jersey Natural Gas operates energy efficiency programs that are complementary to the New Jersey Clean Energy Programs (NJCEP) as the SAVEGREEN project. The residential program provides grants or on-bill repayment plans to assist with the purchase and installation of furnaces/boilers and water heaters. The commercial program provides NJCEP Direct Install participants with a no-interest on-bill repayment plan for the value of the project not covered by the NJCEP incentive. APPRISE conducted an evaluation of the SAVEGREEN project to assess program management, analyze the incremental impact on energy efficiency activity, determine the extent to which the program influences residential customer implementation of whole house improvements, measure the program’s energy savings, and measure the non-energy impacts of the programs.
New Jersey Natural Gas’ (NJNG) SAVEGREEN Project offers rebates and financing incentives to fund energy efficiency projects for residential and commercial customers. APPRISE is on a contractor team to evaluate NJNG’s operations and ensure that the programs are meeting the energy savings reduction targets outlined in New Jersey’s 2018 Clean Energy Act. APPRISE is responsible for the Home Performance with Energy Star and Moderate Income Weatherization Process and Impact Evaluations. The research will include NJNG and trade ally interviews, participant surveys, and analysis of the natural gas and electric usage reduction that is attributed to these programs.
NYSERDA’s Economic Development Growth Extension (EDGE) program develops partnerships with local businesses and organizations to identify potential energy and economic development projects and to link those projects with available NYSERDA funding opportunities. To support the 2015 process evaluation of the program, APPRISE conducted a survey with EDGE program participants. This survey was designed to identify effective methods to reach potential NYSERDA customers and to collect information about participants’ experience with the program.
NYSERDA is supporting training for building code, design, and construction officials across New York State to help reach State Energy Code compliance goals. The training provides detailed information on current and planned New York State Energy Code requirements, building science principles, and technical guidance on appropriate application of these principles. APPRISE designed the survey, coordinated with multiple training providers to administer the pre- and post-training survey to all training participants, and processed the survey data. The surveys collected information on knowledge and awareness of specific code requirements and feedback on the provided training. This research helped NYSERDA evaluate the impact of training courses and to identify future training opportunities.
PGW’s CIER provides prescriptive rebates to PGW customers who purchase large commercial and industrial natural gas boilers and commercial food service equipment to encourage the purchase of the most energy-efficient units available. APPRISE conducted an impact evaluation and a market study for the program. The impact evaluation estimated the change in energy usage for program participants due to the program, evaluated the application rejection rate, frequency of measure installation, and measure-specific savings. The market study interviewed program participants and nonparticipants, installers, and distributers to understand how participants learned about the program, incremental costs for high-efficiency equipment, availability of high-efficiency equipment, sufficiency of current rebate levels, and how the program could be modified to encourage increased participation.
PGW’s CIRI provides incentives to multi-family residential, commercial, and industrial customers to install comprehensive energy efficiency upgrades. APPRISE conducted a market study and impact evaluation for the program. The market study included interviews with program managers, technical advisors, and program participants and nonparticipants to identify how PGW could improve marketing, participation, measure selection, and financing availability. The impact evaluation assessed installed measures, estimated energy savings, and made recommendations for how greater savings may be achieved.
PGW’s HECI provides incentives to home builders and commercial developers who build properties that save a specified percentage of natural gas. PGW provides offerings for single-family residential properties and for commercial, industrial, and multi-family properties. APPRISE conducted a market study of the program to understand the marketing efforts that have been most successful, the barriers to current program participation, the adequacy of current incentive levels, and opportunities to encourage increased program participation. The market study included in-depth interviews with program administrators and technical advisors, participants and nonparticipants who expressed interest, and architects and design build firms. APPRISE also conducted an impact evaluation to estimate the impact of the program on natural gas usage.
PGW’s Home Rebate Program provides incentives to residential customers and participating Conservation Service Providers (CSPs) who complete comprehensive natural gas energy efficiency retrofits. Financial incentives are designed to encourage customers and CSPs to pursue as many cost-effective energy efficiency measures as possible and achieve at least twenty percent energy savings on average for the program. The market study and impact evaluation included interviews with program administrators and CSPs, in-depth interviews with partial and full program participants, analysis of the measures installed, assessment of the impact of the program on natural gas usage, and estimation of the program’s realization rate and cost-effectiveness.
PGW’s RHER provides rebates to customers who purchase residential-sized natural gas heating equipment to encourage purchase of the most efficient boilers and furnaces available. The program provides prescriptive cash rebates to offset most of the incremental cost of the higher efficiency equipment and installation. APPRISE previously conducted an impact evaluation and a market study for the program soon after the program was implemented. The impact evaluation assessed the impacts of the program on natural gas usage by measure type, efficiency, and pre-treatment usage, and compared estimated savings to deemed savings. The market study included interviews with the program manager, HVAC contractors, and program participants to assess the impact of the program on the market for high efficiency equipment, obstacles faced in program participation, and the level of financial incentives needed to encourage adoption of this equipment. APPRISE also conducted a second impact evaluation to assess the energy savings achieved by the program in the 2014 program year.
South Jersey Gas has been operating energy efficiency programs in coordination with the New Jersey Clean Energy Program (NJCEP) since 2009. The programs provide additional rebates and financing to customers who participate in the NJCEP residential and commercial and industrial programs. APPRISE conducted an evaluation of these programs to assess program design, implementation, and impacts. The research included interviews with program administrators, contractors, and participants; surveys with participants of three different programs; analysis of the impacts of the programs on natural gas usage; and assessment of the non-energy impacts of the programs.