Electricity Systems

''This page is about the intersection of electricity systems and machine learning (ML) in the context of climate change mitigation. For an overview of electricity systems as a whole, please see the Wikipedia page on this topic.''The energy supply sector contributes about 35% of human-caused greenhouse gas emissions, within which decarbonizing electricity supply plays an important role. In addition, many climate change strategies in sectors such as buildings, transportation, and industry rely on low-carbon electricity. To reduce greenhouse gas emissions from electricity systems, it will be necessary to both transition quickly to low-carbon electricity sources (e.g., solar, wind, and nuclear) and to reduce emissions from existing electricity system operations in the meantime.

AI and machine learning are often discussed in the electricity sector in the context of smart grids,  which broadly refer to the concept of "intelligent" electric grids managed automatically in a data-driven manner. In particular, ML has been used to forecast electricity supply and demand, to improve power system optimization, and to improve system efficiency through applications such as predictive maintenance. In addition, ML has also been used to accelerate scientific discovery of clean energy technologies, and to gather electricity infrastructure data that may be useful for system planners and policymakers.

Enabling low-carbon electricity

 * Supply, demand and price forecasting: The supply and demand of power must both be forecast ahead of time to inform electricity planning and scheduling. In more volatile energy systems, also forecasting of prices becomes relevant to utilize flexibility effectively. ML can help make these forecasts more accurate, improve temporal and spatial resolution, and quantify uncertainty.
 * Improving power system optimization: Scheduling algorithms on the power grid have trouble handling large quantities of solar, wind, and other time-varying electricity sources. ML can help improve electricity scheduling algorithms, control storage and flexible demand, and design real-time electricity prices that reduce CO2 emissions.
 * Improving system planning: Algorithms for planning new low-carbon energy infrastructure are often large and slow. ML can help speed up or provide proxies for these algorithms.
 * Informing maximum power point tracking: Maximum power point tracking refers to a variety of techniques that aim to maximize the power output of weather-dependent renewable energy generators, such as solar panels and wind turbines. ML can help model attributes of renewable energy systems or actively control these systems (e.g., by modulating wind turbine rotation speed) in order to improve power output.
 * Accelerated science for clean energy technologies: Designing new materials is important for many applications, including energy storage via batteries or solar/chemical fuels. ML can help suggest promising materials to try, thereby speeding up the materials discovery process.
 * Informing nuclear fusion research: Nuclear fusion has the potential to produce safe, carbon-free electricity, but such reactors continue to consume more energy than they produce. While basic science and engineering are still needed, ML can help inform nuclear fusion research in a variety of ways, e.g., by suggesting parameters for physical experiments or modeling the behavior of plasma inside reactors.

Reducing current-system impacts

 * Methane leak detection: In addition to the unavoidable climate impacts of burning fossil fuels, natural gas extraction sites, pipelines, and compressor stations leak methane, a powerful greenhouse gas. ML can help detect and prevent these leaks.
 * Power grid emissions modeling: Reducing the emissions associated with electricity use requires understanding what the emissions on the electric grid actually are at any given moment. ML can help estimate and forecast emissions, and potentially model the uncertainty in these estimates.

General-purpose applications

 * Energy infrastructure mapping: There are many cases in which decision-relevant information about energy infrastructure -- such as the locations and sizes of solar panels, or the location of power transmission and distribution infrastructure -- is not readily available. ML can help map some of this energy infrastructure using satellite imagery.
 * Predictive maintenance and fault detection: Quickly detecting power system faults can help reduce power system waste or improve the utilization of low-carbon energy resources. ML can help detect faults in real time from sensor data, or even forecast them ahead of time to enable preemptive maintenance.
 * State estimation: Many power distribution systems have few sensors, but are increasingly necessary to monitor due to the increase in rooftop solar power. ML can provide algorithms for understanding the state of distribution systems in "low-observability" scenarios where traditional state estimation algorithms may not suffice.
 * Greenhouse gas emissions mapping: While some electricity system operators release publicly-available data on the emissions associated with fossil fuel generators, this data is not available in many cases. ML can help map greenhouse gas emissions using a combination of remote sensing and on-the-ground data.
 * Non-Intrusive Load Monitoring (NILM): ML can be used to disaggregate the net-load measurements into their individual components. It finds application in disaggregating native load and PV generation measurements from the net-load measurements obtained at the feeder-lever or at the residential-level. Another aspect of energy disaggregation is non intrusive load monitoring, wherein the load measurement is disaggregated into different components representing the consumption of different household electric appliances.

Primers

 * Chapter 7: "Energy Systems" in the IPCC Fifth Assessment Report (2014) : An overview of "issues related to the mitigation of greenhouse gas emissions (GHG) from the energy supply sector." Available here.
 * "Energy Primer: A Handbook for Energy Market Basics" by the U.S. Federal Energy Regulatory Commission (2020) : A primer on wholesale electricity, natural gas, and oil/petroleum markets, as well as energy-related financial markets, in the United States. Available here.

Textbooks

 * "Electric Power Systems: A Conceptual Introduction" (2006) : A textbook "intended to bridge the gap between formal engineering texts and more popularly accessible descriptions of electric power technology."
 * "Power Generation, Operation, and Control" (2013) : A canonical reference on the engineering and economics of electric power systems.
 * "Fundamentals of Power System Economics" (2018) : An introduction to electricity markets.

Other

 * Greening the Grid toolkit: A collection of readings, trainings, and other resources on power grids, renewable energy, energy storage, and electric vehicles. Available here.

Online Courses and Course Materials

 * "Computational Methods for the Smart Grid": "[A]n introduction to recent advances in computational methods applied to sustainable energy and the smart grid... provid[ing] students with a broad background in state-of-the-art computational methods that repeatedly arise in these domains, such as machine learning, optimization, and control." Lecture slides, videos, and assignments available here.
 * "Electric Power Systems" on Coursera: A course covering the "standards and policies of the electric utility industry," including "basic vocabulary used in the business" and an introduction of "the electric power system, from generation of the electricity all the way to the wall plug." Enroll here.

Major conferences

 * ACM e-Energy: "The International Conference on Future Energy Systems (ACM e-Energy) aims to be the premier venue for researchers working in the broad areas of computing and communication for smart energy systems (including the smart grid), and in energy-efficient computing and communication systems". Website here.
 * IEEE Power & Energy Society General Meeting: One of the IEEE Power & Energy Society's flagship annual conferences, held in North America. Website here.
 * Power Systems Computation Conference: A biennial conference held in Europe, focused on computational power system methods. Website here.
 * PowerTech: The IEEE Power & Energy Society's anchor conference in Europe, held biennially. Website for the 2019 iteration here.
 * Also see additional conferences by IEEE and the IEEE Power & Energy Society

Major journals

 * IEEE Transactions on Power Systems: Covers the "requirements, planning, analysis, reliability, operation, and economics of electric generating, transmission, and distribution systems for general industrial, commercial, public, and domestic consumption." Journal website here.
 * IEEE Transactions on Smart Grid: "[A] cross disciplinary and internationally archival journal aimed at disseminating results of research on smart grid that relates to, arises from, or deliberately influences energy generation, transmission, distribution and delivery." Journal website here.
 * IEEE Transactions on Sustainable Energy: This journal is aimed at disseminating results of research on the design, implementation, grid-integration, and control of sustainable energy technologies and systems that can be integrated into the power transmission and/or distribution grid. Journal website here.

Major professional organizations

 * IEEE Power & Energy Society: "[T]he world's largest forum for sharing the latest in technological developments in the electric power industry, for developing standards that guide the development and construction of equipment and systems, and for educating members of the industry and the general public." Website here.
 * ACM Special Interest Group on Energy Systems and Informatics: "ACM SIGEnergy is a professional forum for scientists, engineers, educators, and professionals for discussing energy systems and energy informatics. It brings together an inter-disciplinary group of computer scientists with diverse backgrounds [...] to discuss and address key challenges in future energy systems, and their impact on society." Website here.

Libraries and Tools

 * PowerTAC: A power system simulation environment, available here.
 * Energy Policy Simulator: A tool to simulate the greenhouse gas emissions effects of various climate and energy policies, available here.
 * Optimal Power Flow (OPF) Sampler Package: A Julia package to generate power grid data samples via optimal power flow methods, available here.
 * Pyiso: A Python client library for data from power grid balancing authorities in the United States, Canada, and Europe. Documentation here.
 * List of Resources by ACM SIG Energy': A list of models, libraries, software and datasets curated by the ACM Special Interest Group on Energy Systems and Informatics, available here.
 * OPFLEarn.jl: A Julia package for creating datasets for machine learning approaches to solving AC optimal power flow (AC OPF).

Data
See the subpages listed above for application-specific datasets.

United States

 * Public Utility Data Liberation (PUDL) Project: A project integrating a variety of United States federal electricity data sources, available here via GitHub.
 * United States ISO/RTO data: Electricity market data (e.g., prices, supply, and demand) are available online for a number of US independent system operator/regional transmission organization regions, namely CAISO, ERCOT, ISO-NE, MISO, NYISO, PJM, and SPP. (These data can also be accessed via the pyiso Python library.)
 * Pecan Street: Disaggregated energy and water data, available here (requires login)
 * United States Environmental Protection Agency's Air Markets Program data: Datasets from the US EPA's emissions trading programs. For instance, the Continuous Emissions Monitoring System dataset (also available via the EPA's FTP site) provides hourly emissions and generation for many fossil fuel generators in the United States. Available here.
 * Utility Transition Hub™ Data: Datasets on US-based utility finances, investments, operations, emissions and the utilities' alignment and commitments for the 1.5°C goals. Available here.

Europe

 * European electricity market data from electricityMap: Links to (and parsers for) European power system data, available here via GitHub.
 * European electricity market data via Pyiso: The pyiso Python library provides data from European power grid control areas.

India

 * Rural Electricity Demand in India (REDI) Dataset: "The dataset contains detailed information on electricity demand in rural India. The dataset covers 10,000 households and 2,000 rural enterprises across 200 villages in Bihar, Uttar Pradesh, Odisha, and Rajasthan." Available here.

Other

 * Project Sunroof by Google: Detailed estimates of rooftop solar potential based on sunlight and roof space, available here.
 * EDP Open Data: EDP, a multinational utility company, publishes open data on solar and wind power assets (including clean datasets put together for previous competitions). Available here.
 * Ausgrid Data': Ausgrid, a DSO in NSW, Australia, provides several datasets, among them 300 households, 225 substations and data about outages.

Relevant Groups and Organizations

 * Electric Power Research Institute (EPRI): A non-profit organization that conducts research, development, and demonstration projects focused on electricity generation and delivery, and with over 1,000 member organizations around the world. Website here.
 * The Global Power System Transformation Consortium (G-PST): An international consortium of the leading electricity system operators "to identify common, cutting-edge research questions that can inform large- scale national research and development investments." Website here and inaugural research agenda here.