RESEARCH AREAS – Market Transformation Programs 2017-02-01T18:29:22+00:00

Market Transformation Programs

Market Transformation programs promote the manufacture, purchase, and use of energy-efficient technologies through customer, manufacturer, and installer education, incentives, rebates, and tax credits. The goals of these programs are to overcome market barriers to the adoption of energy efficient technologies. APPRISE conducts research and evaluation of market transformation programs, including baseline documentation, implementation evaluation, assessment of the energy usage impacts, and evaluation of free ridership and spillover effects.

 

Market Transformation Program Evaluation Activities

  • Process Evaluation includes reviews of program procedures; interviews with program staff, contractors, and trade allies; evaluation of program materials; and evaluation of training protocols.
  • Impact Evaluation involves estimation of the impact of services and measures on customer usage, utility demand, and the savings-to-investment ratio. The impact evaluation also assesses the impact of the program on market penetration of energy efficient technologies.
  • Survey Research includes program administrator, contractor, and customer surveys. Baseline customer surveys may document pre-program awareness and use of energy efficient technologies. Follow-up customer surveys may document changes in knowledge and use of energy efficient technologies and satisfaction with program services and benefits.
  • Data Tracking includes analysis of data system needs, reviews of existing program data management systems, and recommendations for improvements to existing data systems to facilitate program management, reporting, operations, and evaluation.
  • Needs Assessment includes analysis of utility and public-use data to determine the savings potential from proposed or planned market transformation programs.
  • Performance Measurement includes development and measurement of indices that correspond to program goals and objectives. For example, the indices may include number of program participants, change in awareness and use of particular energy efficient technologies, or percentage reduction in energy usage.
  • Economic Analysis is the measurement of the program’s impact on the economic activity in the state, region, or nation. Energy efficiency investments may have a greater impact on economic activity than other potential investments because they are labor intensive, and a large portion of the expenditures are made within the local area. We use economic multipliers and program expenditures to estimate the economic impact of the program in the geographic area of interest.

APPRISE Market Transformation Program Research and Evaluation

Commercial

APPRISE conducted survey research to support process and impact evaluations of Alliant’s commercial and industrial energy efficiency programs. The programs included Nonresidential Custom, Nonresidential Prescriptive, and Agricultural Prescriptive. The surveys were designed to support program development and improvement.
The Commercial Buildings Energy Consumption Survey (CBECS), a quadrennial survey of commercial buildings and related energy consumption, is conducted for the U.S. Department of Energy. In this project, we designed sample frames for the 1995 and 1999 CBECS. We conducted frame design research activities; designed the area and list frame development (including a targeting sample of newly constructed buildings) and sampling procedures, direct final listing, screening, and sample selection activities; and supervised the sample selection of new buildings included in the survey.
The Commercial Buildings Energy Consumption Survey (CBECS), a quadrennial survey of commercial buildings and related energy consumption, is conducted for the U.S. Department of Energy. In this project, we consulted with Westat on the development of new procedures for the 2003 CBECS sample frame update.
Columbia Gas implemented a portfolio of Demand Side Management (DSM) programs in 2009 for its residential and small commercial customers. The Small Business Energy Solutions program is an energy efficiency improvement rebate program for small general service commercial customers. APPRISE conducted a process evaluation of this program to assess program performance issues and determine whether modifications to program design could result in improved performance. The evaluation research included review of program documents, analysis of market statistics, interviews with Columbia Gas managers and staff, interviews with program implementers, and review of other ratepayer-funded programs for the same customer segment.
APPRISE supported the Connecticut Energy Efficiency Board in research on barriers to commercial and industrial customer participation in energy efficiency programs. The research included a survey with Connecticut businesses that focused on reasons for incomplete program participation, use of financing for energy efficiency investments, and support that utilities can provide to encourage increased program participation. Information from the survey is intended to be used to refine program marketing and potentially provide additional options to reduce barriers to participation.

The Connecticut Small Business Energy Advantage (SBEA) Program provides energy-saving services for small commercial and industrial customers. APPRISE worked with KEMA on this evaluation research and developed a better understanding of how the program can reach a broader and wider set of customers.

The Data Mining Research included analysis of the program database and the eligible customer database. This research assessed which market sectors are highly represented among the SBEA participants over the last five years, which sectors are underrepresented and which are missing; determined how the market sector distribution of program participants compares to those of nonparticipants; characterized the mix of measures installed in the program; and explored predicted savings by sector.

The Low-Income and Limited English Study explored how to increase participation by small business owners who are low-income or have limited English fluency. The study contacted organizations in the state who work with these types of small businesses, characterized the businesses and assessed eligibility for the program, and determined whether the organizations were willing to facilitate participation of these businesses in the SBEA.

APPRISE worked with a team to assess the performance of thirteen residential and small business energy efficiency programs offered by the Consolidated Edison and Orange & Rockland utility companies. The evaluation assessed how each energy efficiency program is operating and made recommendations for improvements to the implementation process. Specific information gathered via program participant and non-participant surveys included participant satisfaction, effectiveness of program marketing and delivery, barriers to participation, satisfaction with measures offered, and satisfaction with trade ally training programs.
Consolidated Edison’s Small Business Direct Install Program offers free energy surveys to evaluate lighting, ballasts, fixtures, HVAC systems, and other equipment and make custom recommendations for improved energy efficiency. The program also provides free installation of low-cost energy-saving devices, including CFLs, low-flow aerators, high pressure rinse sprayers, and water heater thermostat setbacks. Up to 70% of the costs of other upgrades are covered by this program. In support of the Impact Evaluation, APPRISE managed the recruiting and scheduling of participating customer sites for inspections and lighting equipment logging.
The Federal Buildings Supplemental Survey collected building characteristics and energy data about 900 federally-owned buildings for the U.S. Department of Energy’s Energy Information Administration as a follow-up to the 1992 Commercial Buildings Energy Consumption Survey. In this project, we supervised all aspects of the survey including sample design, facility screening, survey implementation, and survey processing. The sample for the project was selected from a database of Federal Buildings. The sampling procedures included the implementation of a multistage PPS design. The interview was a complex mail/phone/mail/phone survey, where a CATI instrument was used in the final phone contact. The survey was managed with an automated project management and sample tracking system.
As part of the Green Lights program, participants agree to submit reports on lighting upgrades so that EPA can estimate the total impact of the program. There was concern by EPA that not all lighting upgrades were being reported and that the reporting system was a burden to program participants. In this project, we conducted research to determine the satisfaction of program participants with program procedures, determine the level of underreporting, make estimates of unreported program accomplishments, and design an alternative reporting system. This research showed that the recognition received by Green Lights program participants was important for some participants. It also showed that detailed reports were overly burdensome for some partners. We developed a simplified data collection system and statistical models to estimate energy savings from the more limited data.
EPA initiated the Green Lights program to reduce pollution by accelerating the adoption of energy-efficient lighting technologies. EPA provided workshops to Green Lights participants to train them on assessing potential energy savings, finding a vendor for the lighting products, and financing the purchases. Interviews with workshop participants provided information on the value of Green Lights services to participating businesses and organizations.
The Commercial and Industrial Evaluation Contract (CIEC) Team has collaborated with the Massachusetts Program Administrators (PAs), Energy Efficiency Advisory Council (EEAC) Consultants and the National Building Institute (NBI) to assess the levels of energy code compliance with various code provisions. The Code Compliance project was intended to perform code compliance assessment on active construction sites and to provide supporting data analysis for the development and implementation of energy code-based efficiency programs. APPRISE participated in the development of the sample design and managed the recruitment efforts for on-site inspections of active construction sites.
APPRISE managed a scoping study for the Supply-Side Market Actors Project. This study assessed the feasibility and efficacy of using Program Administrator (PA) program databases, commercially available business data sources, and targeted in-depth interviews to characterize the population of supply-side market actors, develop market actor sample frames, and implement market actor panels.
The Massachusetts Large Commercial & Industrial Evaluation is a multi-client, statewide project that aims to characterize adoption of energy efficient equipment and design and assess market effects. As part of the evaluation team, APPRISE provided advice, guidance, and expertise on the sample development, data collection, and analysis that was performed in characterization of the large commercial and industrial new construction market.
APPRISE supported the New Jersey Board of Public Utilities (BPU) in research to assess the economic impacts of New Jersey’s Clean Energy Programs. APPRISE’s work included a survey with participants in New Jersey’s Clean Energy program to assess market characteristics, qualify the nature and number of jobs created in New Jersey, and to better understand the State’s clean energy economy. The project also included in-depth interviews with companies that participate in New Jersey’s Clean Energy economy to develop additional information on the perception of these programs and future clean energy plans.
The Business Partners Program is an integration of three prior NYSERDA programs: Motors Systems, Commercial Lighting, and Building Performance and HVAC. The Business Partners program promotes the purchase and installation of energy efficient products and services by working with trade allies including building and systems contractors, distributors, vendors, designers and energy service providers. APPRISE conducted surveys of trade allies and end-use customers to assess market penetration and net program savings.
NYSERDA’s Economic Development Growth Extension (EDGE) program develops partnerships with local businesses and organizations to identify potential energy and economic development projects and to link those projects with available NYSERDA funding opportunities. To support the 2015 process evaluation of the program, APPRISE conducted a survey with EDGE program participants. This survey was designed to identify effective methods to reach potential NYSERDA customers and to collect information about participants’ experience with the program.
NYSERDA’s Emerging Technologies and Accelerated Commercialization (ETAC) Program provides funding and support to building owners and technology developers who implement successful demonstrations of new energy-saving technologies. NYSERDA’s ETAC program is designed to increase adoption of emerging technologies in New York State, including energy efficient lighting and networked lighting controls. APPRISE conducted a survey with lighting end-users and a survey with lighting installation contractors to understand and characterize the adoption of solid-state lighting (SSL) in New York State. Both surveys collected information on awareness and use of new lighting technologies and the impact of several factors on lighting selection decisions. APPRISE developed the sampling approach, conducted the interviews, and prepared the final data for analysis.
APPRISE conducted survey research to support NYSERDA’s process evaluation of their Enhanced Commercial Industrial Performance Program (ECIPP). The ECIPP provides incentives to businesses for energy efficiency projects. APPRISE’s survey research assessed how clients learned about ECIPP, previous client experience with energy efficiency projects, previous client experience with the ECIPP, and client satisfaction with the ECIPP process.
NYSERDA’s Environmental Monitoring, Evaluation, and Protection (EMEP) Program aims to facilitate the communication of scientific and technological information regarding the environmental impacts of energy choices to inform public policy. APPRISE conducted surveys of EMEP’s policy maker, legislative, and environmental group contacts in support of the Process Evaluation. This survey research will aid EMEP in enhancing the efficiency and effectiveness of the program.
The Existing Facilities Program (EFP) is a consolidation of two prior NYSERDA programs — the Peak Load Management Program (PLMP) and the Enhanced Commercial and Industrial Performance Program (ECIPP). The EFP offers prescriptive and performance-based incentives for energy-efficient upgrades to existing buildings. The EFP targets a range of customer sectors including commercial and industrial businesses, healthcare facilities, universities and colleges, state and local governments, and mission critical facilities such as data centers and communications facilities. APPRISE conducted surveys of Energy Service Companies (ESCOs) and end-users that will support estimates of program savings, free ridership, and spillover effects.
NYSERDA’s Flexible Technical Assistance Program (Flex Tech) is a consolidation of what were formerly the Flex Tech, Technical Assistance, and Energy Audit Programs. Flex Tech is designed to provide customers objective and customized energy information that will facilitate the implementation of cost-saving energy-efficient measures. APPRISE conducted survey research to support NYSERDA’s Market Characterization and Assessment, Impact, and Process evaluations of the Program. APPRISE conducted customer and contractor surveys for participating and non-participating market sectors to evaluate the program processes, assess the market climate, and establish estimates of energy savings that can be attributed to the program.
NYSERDA’s Industry and Process Efficiency Program (IPEP) provides incentives to offset the costs of projects focused on increasing productivity, increasing process efficiency, reducing waste, and reducing electricity consumption. The program focuses on key manufacturing sectors in New York. APPRISE surveyed both eligible end-use customers and technical service providers to gather information on customers’ and providers’ decision-making, awareness, and perceptions of energy efficiency opportunities.
NYSERDA’s Innovation Capacity and Business Development Program (ICBD) is designed to provide financial and professional resources to new businesses and entrepreneurs operating in New York State’s clean energy sector.  The ICBD program supports NYSERDA’s clean technology Incubators, special Proof-of-Concept centers, and Entrepreneurs-In-Residence Program, all of which provide business development services to clean energy business start-ups.   APPRISE is conducting surveys with recipients of ICBD services and with other emerging market actors.  Both surveys will study  perceptions of market barriers and drivers, market trends, and market stakeholders.  APPRISE is designing the web instrument, conducting phone interviews, and preparing the final data for analysis.

NYSERDA’s New Construction Program provides non-residential customers with technical assistance services and capital-cost incentives for implementing energy efficiency improvements in new construction or in substantially renovated buildings. The technical assistance provides cost-shared analysis to customers and their design teams (Architecture and Engineering firms) to identify energy efficiency opportunities for their projects. The program is designed to encourage the incorporation of energy efficiency, renewable energy, and green building features in the design, construction, and operation of commercial, industrial, and institutional buildings.

APPRISE conducted survey research to support NYSERDA’s market characterization research for the New Construction Program (NCP) in 2008. This research gathered information from participating and non-participating building owners and participating and non-participating architecture and engineering firms to assess their views, experiences, and perceptions on a variety of topics related to program participation.

APPRISE conducted surveys in 2011 with non-participating building owners and design firms to assess awareness of NYSERDA’s program offerings and energy efficiency measures in the non-residential new construction sector in New York State, to develop baseline data for non-residential new construction in New York State, and to assess non-participant spillover effects of the New Construction Program.

NYSERDA is interested in working with Commercial Property Managers in the NYC region to identify ways to increase adoption of energy efficiency measures by building owners and building tenants in the NYC region. APPRISE conducted structured in-depth interviews with the major Commercial Building Property Managers working in the NYC region to develop a better understanding of their business models, document their current activities with respect to the delivery of energy efficiency services, and explore their interest in partnering with NYSERDA to reach out to their customers. Through this research, APPRISE was able to give NYSERDA a better understanding of the opportunities for and barriers to investment in energy efficiency measures by building owners and tenants, and the role that Property Managers could play in facilitating participation by their owners and tenants in NYSERDA programs.
NYSERDA is interested in working with Demand Response Providers in the NYC region to leverage the provider/customer relationship and increase the adoption of energy efficiency measures. APPRISE conducted structured in-depth interviews with the major Demand Response Providers working in the NYC region to develop a better understanding of their business models, document their current activities with respect to the delivery of energy efficiency services, and explore their interest in partnering with NYSERDA to reach out to their customers. Through this research, APPRISE was able to segment the Demand Response Provider market, identify those provider segments that presented NYSERDA the best access to new customers, and develop a strategy that NYSERDA could use to increase their penetration in the NYC market.
NYSERDA is interested in working with ESCOs (electric commodity suppliers) in the NYC region to leverage the ESCO/customer relationship and increase the adoption of energy efficiency measures. APPRISE conducted structured in-depth interviews with the major ESCOs working in the NYC region to develop a better understanding of their business models, document their current activities with respect to the delivery of energy efficiency services, and explore their interest in partnering with NYSERDA to reach out to their customers. Through this research, APPRISE was able to help NYSERDA segment the ESCO market and identify potential strategies for working with each market segment.
NYSERDA is conducting a review of program spillover effects generated by those not receiving incentives from NYSERDA programs. This cross-program evaluation effort will examine these effects in an attempt to quantify net-to-gross savings estimates. In support of this evaluation, APPRISE conducted surveys of program non-participants in the Commercial and Industrial sectors.
The New York State Energy Research and Development Authority (NYSERDA) supports initiatives to encourage commercial adoption of energy efficient technologies through demonstration and replication (R&D) projects. APPRISE is conducting in-depth telephone interviews with R&D grant recipients to support a process and impact evaluation of the program. The in-depth interviews with Principal Investigators are designed to identify and estimate environmental benefits, cost-effectiveness, and other impacts. The interviews will also collect process evaluation information including participant awareness of NYSERDA programs, effectiveness of program communication, adequacy of assistance provided by program staff, and efficiency of the funding process. The 2016 study is examining projects completed between 2011 and 2013. A previous study conducted in 2013 examined projects completed between 2008 and 2010.
NYSERDA’s Research Development (R&D) Program supports the development and commercialization of innovative energy and environmental products, technologies, and processes. In 2008, APPRISE conducted a survey of firms that reported product sales and made recoupment payments based upon their R&D recoupment contracts with NYSERDA. The purpose of the survey was to obtain information about the products for which NYSERDA provided technical expertise and funding. The survey collected information on product benefits, sales revenue, sources and magnitude of investment capital, impact of NYSERDA funding on product development and commercialization, and total development and commercialization costs. The information will be used to evaluate the impacts and value of NYSERDA funding. In 2010, APPRISE conducted surveys of integrators, vendors and site owners involved in the development of R&D program-funded demonstration projects and worked on a Process Evaluation of the R&D program by conducting surveys of respondents and non-respondents to R&D program solicitations.
NYSERDA’s Transportation Program provides funding to support new transportation technologies and approaches that reduce greenhouse gas emissions, including renewable energy infrastructure, innovative public transportation designs, and traffic demand management approaches.  The Program targets financial support for transportation product development, demonstration, and deployment throughout New York State.  APPRISE is conducting a survey with business participants and transportation companies to understand and characterize the New York State transportation sector.  This survey will collect information on the types of technologies in development, major actors in New York’s transportation market, and experiences with NYSERDA.  APPRISE is designing the web instrument, conducting phone interviews, and preparing the final data for analysis.
PGW’s CIER provides prescriptive rebates to PGW customers who purchase large commercial and industrial natural gas boilers and commercial food service equipment to encourage the purchase of the most energy-efficient units available. APPRISE conducted an impact evaluation and a market study for the program. The impact evaluation estimated the change in energy usage for program participants due to the program, evaluated the application rejection rate, frequency of measure installation, and measure-specific savings. The market study interviewed program participants and nonparticipants, installers, and distributers to understand how participants learned about the program, incremental costs for high-efficiency equipment, availability of high-efficiency equipment, sufficiency of current rebate levels, and how the program could be modified to encourage increased participation.
PGW’s CIRI provides incentives to multi-family residential, commercial, and industrial customers to install comprehensive energy efficiency upgrades. APPRISE conducted a market study and impact evaluation for the program. The market study included interviews with program managers, technical advisors, and program participants and nonparticipants to identify how PGW could improve marketing, participation, measure selection, and financing availability. The impact evaluation assessed installed measures, estimated energy savings, and made recommendations for how greater savings may be achieved.
PGW’s HECI provides incentives to home builders and commercial developers who build properties that save a specified percentage of natural gas. PGW provides offerings for single-family residential properties and for commercial, industrial, and multi-family properties. APPRISE conducted a market study of the program to understand the marketing efforts that have been most successful, the barriers to current program participation, the adequacy of current incentive levels, and opportunities to encourage increased program participation. The market study included in-depth interviews with program administrators and technical advisors, participants and nonparticipants who expressed interest, and architects and design build firms. APPRISE also conducted an impact evaluation to estimate the impact of the program on natural gas usage.
The Rhode Island Commercial Code Compliance Study estimated the statewide energy code compliance rate for commercial buildings, provided information on patterns of compliance and non-compliance, and identified opportunities for Rhode Island to achieve the goal of at least 90 percent compliance with energy codes. Baseline compliance was assessed through on-site visits to buildings built between 2008 and 2011. As part of the evaluation team, APPRISE led the building sample design and development using the F. W. Dodge New Construction Database, and selected a sample of buildings to be visited.
APPRISE conducted research to assist Washington’s Department of Community, Trade, and Economic Development to assess low-income household needs for energy conservation and energy assistance services. The research included an analysis of the fuels used, energy costs, and energy burden for low-income households in WA; documentation of current energy prices and assistance programs offered by utility companies in WA; and recommendations for the types of energy assistance programs that may best meet the needs that are documented in the study.
WE Energies has implemented a set of energy efficiency programs that target different segments of the commercial and industrial market (Prescriptive, Custom, RFP, New Construction, and Multi-Family). APPRISE conducted research to determine whether WE Energies can improve program performance by enhancing program marketing or refining program tools and/or incentives. The scope of work consisted of benchmarking research to determine whether WE Energies was underperforming in any market segments or energy-saving opportunities, program database analysis to document program statistics, and in-depth client and trade ally interviews to understand how well the program was working and whether there were changes in program design and/or implementation that could improve program performance.

Residential

APPRISE conducted survey research to support process and impact evaluations of Alliant’s residential energy efficiency programs. The programs included Appliance Recycling, Direct Load Control, Home Energy Audits, Residential Prescriptive, New Home Construction, and Energy Awareness and Education. The surveys were designed to support program development and improvement.
Columbia Gas implemented a portfolio of Demand Side Management (DSM) programs in 2009 for its residential and small commercial customers. The residential programs include a Residential Home Performance retrofit incentive program and a rebate program for customers who purchase programmable thermostats and energy-efficient showerheads. APPRISE conducted a process evaluation of these programs to help refine the programs and improve program effectiveness. The evaluation research included document review, analysis of program statistics, interviews with Columbia Gas managers and staff, interviews with program implementers, and participant and nonparticipant surveys.
Consolidated Edison’s Appliance Recycling Program provides financial incentives to encourage residential electric customers living in one-to-four unit homes to recycle their freezers, second refrigerators, and room air conditioners. APPRISE supported the Impact Evaluation of this program by facilitating on-site data collection. Data collected included the location of the second refrigerator, how the second refrigerator is used, and metered energy usage for that refrigerator. Data from the site visits was used to analyze the impact of the program on energy use.
APPRISE worked with a team to assess the performance of thirteen residential and small business energy efficiency programs offered by the Consolidated Edison and Orange & Rockland utility companies. The evaluation assessed how each energy efficiency program is operating and made recommendations for improvements to the implementation process. Specific information gathered via program participant and non-participant surveys included participant satisfaction, effectiveness of program marketing and delivery, barriers to participation, satisfaction with measures offered, and satisfaction with trade ally training programs.
Consolidated Edison’s Multi-Family Energy Efficiency Program provides financial incentives for the installation of energy efficiency measures in common areas and within apartments, in multi-family buildings with 5-75 units. Prescriptive rebates are offered for common area measures including HVAC systems and controls, insulation, and lighting. No-cost unit-level measures include compact fluorescent lights, low-flow showerheads, faucet aerators and smart power strips. APPRISE supported the Impact Evaluation of this program by facilitating individual unit on-site data collection. Data collected included the location of the apartment within the building, the number of light fixtures in the apartment, and metered CFL and smart strip usage. Data from the site visits was used to analyze the impact of this program on energy use.
Consolidated Edison’s Residential HVAC Program provides financial incentives to customers to encourage the installation of select high-efficiency equipment and home energy improvements. APPRISE conducted research to assess the impact of this program. This work included recruiting, scheduling, and conducting site visits to meter central air conditioners and ductless heat pumps installed through this program. Resulting usage data will be analyzed to estimate the impact of this program on energy use.
Duquesne Light’s Upstream Lighting program works with residential lighting retailers to offer discounts on CFLs and LEDs at the point of purchase. Duquesne Light is conducting an enhanced net-to-gross analysis of their upstream lighting program. This research includes in-store intercepts with customers, in-depth interviews with lighting manufacturers and retailers, and telephone interviews with Duquesne Light’s residential customers. APPRISE conducted the general population telephone survey of a random sample of Duquesne Light’s residential customers to ascertain the net-to-gross ratio, in service rate, residential versus non-residential installation allocation, and low-income versus non low-income household savings allocation.
Vermont has a number of energy programs that make important contributions to reductions in electricity usage in all sectors and reductions of fossil fuel usage among low-income households. However, Vermont is missing important opportunities for energy savings because there is a program gap with respect to fossil fuel usage by households that are not low-income and fossil fuel usage in the commercial and industrial end-use sectors. This 2006 memo presents the status of energy usage in Vermont, describes existing programs, and discusses opportunities for future programs.
EPA initiated Energy Star programs to reduce pollution by accelerating the adoption of new and underutilized energy-efficient technologies. In this evaluation we conducted surveys with home builders and home buyers. We conducted a home builder mail survey with participating Energy Star builders on their satisfaction with services received through the program. The survey also collected information to assess the impact of the program on the behavior of home builders. In the home buyers survey, we collected baseline and follow-up information from a sample of Energy Star home buyers and a comparison sample of other new home buyers. We obtained energy billing data for responding households and developed estimates of energy savings resulting from the Energy Star Homes Program.
The Energy Star HVAC Program works to overcome barriers associated with the purchase of higher efficiency replacement HVAC equipment in the residential market. EPA works with HVAC equipment manufacturers, distributors, dealers, utilities, and financial institutions to overcome the market barriers. In this evaluation, we conducted in-depth interviews with all participants in the HVAC program, including trade associations, utilities, finance partners, manufacturers, regional distributors, dealers, and consumers.
APPRISE was a subcontractor on the evaluation of the Massachusetts ENERGY STAR Lighting Program. This statewide program provides incentives for residential customers to purchase ENERGY STAR qualified lighting products. APPRISE conducted telephone surveys with comparison residential customers in South Dakota to assess the market effects of the program.
The New Jersey Board of Public Utilities manages a portfolio of energy efficiency programs. These programs include the Residential HVAC, Residential New Construction, Energy Star Products, Commercial and Industrial New Construction, Commercial and Industrial Retrofit, Combined Heat and Power, and Customer On-Site Renewable Energy. As part of a comprehensive evaluation of the portfolio of programs, APPRISE conducted an evaluation of the Residential New Construction Program, known as the NJ Energy Star Homes Program. Under this program, builders receive incentives to develop homes that are at least 15 percent more energy efficient than a standard home. APPRISE conducted research to update how estimates of the program’s energy savings are made and to estimate actual program energy and demand savings from 2001 through 2006. The research included a survey with Energy Star homebuyers and non-participating homeowners and analysis of electric and gas energy usage data for these households.
New Jersey Natural Gas operates energy efficiency programs that are complementary to the New Jersey Clean Energy Programs (NJCEP) as the SAVEGREEN project. The residential program provides grants or on-bill repayment plans to assist with the purchase and installation of furnaces/boilers and water heaters. The commercial program provides NJCEP Direct Install participants with a no-interest on-bill repayment plan for the value of the project not covered by the NJCEP incentive. APPRISE conducted an evaluation of the SAVEGREEN project to assess program management, analyze the incremental impact on energy efficiency activity, determine the extent to which the program influences residential customer implementation of whole house improvements, and measure the program’s energy savings.
Under New Jersey restructuring legislation, all utility DSM programs are implemented through a statewide utility collaborative. The New Jersey RNC Working Group was responsible for designing a statewide RNC program to encourage builders to construct and home buyers to purchase energy-efficient homes. APPRISE staff directed the RNC Baseline Study, including surveys with market actors to assess awareness of and attitudes toward RNC programs, and the development of Residential New Construction statistics and information on the Affordable Housing market.
NYSERDA is supporting training for building code, design, and construction officials across New York State to help reach State Energy Code compliance goals. The training provides detailed information on current and planned New York State Energy Code requirements, building science principles, and technical guidance on appropriate application of these principles. APPRISE is designing the survey, coordinating with multiple training providers to administer the pre- and post-training survey to all training participants, and processing the survey data. The surveys collect information on knowledge and awareness of specific code requirements and feedback on the provided training. This research will help NYSERDA evaluate the impact of training courses and to identify future training opportunities.
The goal of NYSERDA’s ENERGY STAR Homes Program is to implement and promote an enhanced version of the U.S. Environmental Protection Agency’s ENERGY STAR Program in New York State. The program provides technical assistance and targeted financial incentives to residential builders and income-eligible homeowners to encourage the adoption of energy efficient design features and the selection and installation of energy efficient equipment. APPRISE conducted survey research to support NYSERDA’s market characterization research for the ENERGY STAR Homes Program (ESH) in 2008. APPRISE gathered information from homeowners who purchased an Energy Star Home and homeowners who purchased a non-Energy Star Home to examine their views, experiences, and perceptions on a variety of topics related to program participation. APPRISE also surveyed home builders who participated and homebuilders who did not participate in the ESH to assess their views, experiences, and perceptions on a variety of topics related to program participation. APPRISE conducted additional surveys with participating homeowners, non-participating homeowners, participating builders, non-participating builders, and formerly-participating builders to supplement energy savings estimates and provide information on potential program free-ridership and spillover effects.
NYSERDA’s Energy Star Products Program (NYESP) seeks to increase sales of residential energy-efficient appliances, lighting, power management, home electronics, heating, ventilation and air conditioning equipment. The goals of the program are to increase the supply of products through partnerships with retailers, manufacturers and distributors and to create demand for high-efficiency and ENERGY STAR products through increased consumer awareness and understanding of the ENERGY STAR label. APPRISE surveyed recent purchasers and appliance retailers of refrigerators, dishwashers, clothes washers, or room air conditioners and assessed the purchases, sales, availability, attitudes, and awareness of Energy Star products.
NYSERDA’s Green Jobs – Green New York (GJGNY) Program provides New Yorkers with access to energy audits, installation services, low-cost financing, and pathways to training for various green-collar careers. Evaluation activities were designed to assess the effectiveness, progress, and outcomes related to the program and to provide recommendations for program refinement. APPRISE conducted surveys with program participants and non-participants to develop a comprehensive understanding of current and emerging markets and to provide baseline data to enable NYSERDA to define, deliver, and evaluate programs for these target markets.
NYSERDA’s Home Performance with Energy Star (HPwES) Program provides low-cost training to contractors and financial incentives to homeowners to help improve the energy efficiency of the housing stock in New York. APPRISE conducted survey research to support NYSERDA’s market characterization research for the program in 2008. APPRISE’s research gathered information from homeowners who received a Comprehensive Home Assessment from a participating BPI-certified technician to examine homeowner views, experiences, and perceptions on a variety of topics related to program participation. APPRISE also surveyed program participating and non-participating contractors to examine contractor views, experiences, and perceptions on a variety of topics related to program participation. APPRISE also completed the HPwES Impact Evaluation, and conducted surveys of homeowners and contractors to supplement program net-to- gross savings estimates.
APPRISE conducted RDD telephone surveys in NY State, New York City, Ohio, Washington DC, and Houston in 2009 to assess the saturation of CFLs. APPRISE then recruited the RDD survey respondents for in-home audits of lighting fixtures, existing bulbs, and home electronics bundles in the summer of 2009. In the summer of 2010, APPRISE conducted another RDD telephone survey in NY State, New York City, and Houston, and recruited respondents for a follow-up in-home audit. The data are being used by CFL Program staff to identify marketing opportunities and by NYSERDA Evaluation staff to measure program impacts.
NYSERDA conducted a market characterization study of the lighting market in New York to inform a possible Enhanced Lighting Design Program under SBC IV. APPRISE conducted quantitative surveys with retailers, homeowners, and the general population to develop a better understanding of the residential lighting market and identify opportunities for optimizing NYSERDA’s future investments in the lighting market.
PGW’s Home Rebate Program provides incentives to residential customers and participating Conservation Service Providers (CSPs) who complete comprehensive natural gas energy efficiency retrofits.  Financial incentives are designed to encourage customers and CSPs to pursue as many cost-effective energy efficiency measures as possible and achieve at least twenty percent energy savings on average for the program.  The market study and impact evaluation included interviews with program administrators and CSPs, in-depth interviews with partial and full program participants, analysis of the measures installed, assessment of the impact of the program on natural gas usage, and estimation of the program’s realization rate and cost-effectiveness.
PGW’s RHER provides rebates to customers who purchase residential-sized natural gas heating equipment to encourage purchase of the most efficient boilers and furnaces available. The program provides prescriptive cash rebates to offset most of the incremental cost of the higher efficiency equipment and installation. APPRISE previously conducted an impact evaluation and a market study for the program soon after the program was implemented. The impact evaluation assessed the impacts of the program on natural gas usage by measure type, efficiency, and pre-treatment usage, and compared estimated savings to deemed savings. The market study included interviews with the program manager, HVAC contractors, and program participants to assess the impact of the program on the market for high efficiency equipment, obstacles faced in program participation, and the level of financial incentives needed to encourage adoption of this equipment. APPRISE also conducted a second impact evaluation to assess the energy savings achieved by the program in the 2014 program year.
Puget Sound Energy (PSE) began mailing Opower Home Energy Reports (HERs) to approximately 40,000 customers in November 2008. These reports deliver customized, household-level data on energy usage in the home, and encourage energy-efficient behaviors and measures. Savings for participants in the HER Program may be a direct result of the HER report or may result from other energy efficiency programs, such as CFL buy downs. To identify potential double-counting of energy savings, APPRISE conducted survey research as part of a three-year Home Energy Report (HER) Impact Evaluation. Fifteen hundred interviews were completed with current HER recipients, past recipients, and a comparison group of customers who never received a report. The survey collected data on purchases made and energy usage behaviors adopted by respondents across all three groups to enable estimation of the impact of other energy programs and avoid double counting of these savings.
The Residential Energy Consumption Survey (RECS) is a national in-person survey of energy use in residential housing units conducted by the U.S Department of Energy’s Energy Information Administration (EIA). In this project, we updated the national area probability sample frame, selected the sample, recruited and trained interviewers, collected data, processed the data, analyzed the data, and conducted an energy supplier follow-up survey. In 2005, APPRISE was a part of a sample redesign project for the RECS, which involved evaluating the performance of the 1993 design, developing design alternatives, and implementing the listing and sample selection procedures selected by EIA. As part of this effort, we also designed procedures to incorporate a supplemental sample of LIHEAP recipient households.
APPRISE was a subcontractor on the evaluation of the Rhode Island ENERGY STAR Lighting Program. This statewide program sponsored by National Grid provides discounts for residential customers to purchase ENERGY STAR-qualified lighting products. APPRISE conducted telephone surveys with residential customers in Rhode Island to assess the market effects of the program.
APPRISE partnered with two natural gas utilities in the Northeast to study current thermostat technology, setback behavior, and opportunities for smart thermostats.  A survey was conducted with a random sample of 385 residential customers to develop a better understanding of which households may benefit from smart thermostats and assess the opportunities for energy savings.  The survey found that there is a great opportunity for smart thermostats, as only four percent of respondents had a Wi-Fi connected thermostat, but 74 percent had the technology needed for a smart thermostat.  Lower income households may present the greatest opportunity for savings with smart thermostat technology.  Over half of these customers had the needed technology, but they were less likely to have programmable thermostats.  Households show opportunities for benefitting from smart thermostats that adjust to their usage preferences, as about half of the respondents reported frequent manual adjustment of programmable thermostats.  Many reported that they would make extensive use of smart thermostat features if they were available.  Programs and incentives could potentially have a large impact on the adoption of smart thermostats.
South Jersey Gas has been operating energy efficiency programs in coordination with the New Jersey Clean Energy Program (NJCEP) since 2009. The programs provide additional rebates and financing to customers who participate in the NJCEP residential and commercial and industrial programs. APPRISE conducted an evaluation of these programs to assess program design, implementation, and impacts. The research included interviews with program administrators, contractors, and participants; surveys with participants of three different programs; analysis of the impacts of the programs on natural gas usage; and assessment of the non-energy impacts of the programs.
Sustainable Princeton introduced the EnergySmart Homes Campaign to help Princeton residents reduce their energy usage. Through this program, Sustainable Princeton partnered with a BPI-certified contractor to provide low-cost home energy audits and encourage the installation of energy saving measures. APPRISE conducted a survey with EnergySmart Homes participants to explore the quality of energy education and services delivered by the auditor, why customers did or did not install measures, and what actions could be taken to help customers overcome barriers to measure installation.