Electricity Systems: Difference between revisions

Added a link to the python package open-mastr that provides acces to the official dataset "MaStR" of the german electricity system.
(Added a link to the python package open-mastr that provides acces to the official dataset "MaStR" of the german electricity system.)
 
(22 intermediate revisions by 5 users not shown)
Line 1:
''This page is about the intersection of electricity systems and machine learning (ML) in the context of climate change mitigation. For an overview of electricity systems as a whole, please see the [https://en.wikipedia.org/wiki/Electric_power_system Wikipedia page] on this topic.''[[File:ElectricitySystems.png|thumb|A schematic of selected opportunities to reduce greenhouse emissions from electricity systems using machine learning. From "Tackling Climate Change with Machine Learning."<ref name=":0">{{Cite journal|last=Rolnick|first=David|last2=Donti|first2=Priya L.|last3=Kaack|first3=Lynn H.|last4=Kochanski|first4=Kelly|last5=Lacoste|first5=Alexandre|last6=Sankaran|first6=Kris|last7=Ross|first7=Andrew Slavin|last8=Milojevic-Dupont|first8=Nikola|last9=Jaques|first9=Natasha|last10=Waldman-Brown|first10=Anna|last11=Luccioni|first11=Alexandra|date=2019-11-05|title=Tackling Climate Change with Machine Learning|url=http://arxiv.org/abs/1906.05433|journal=arXiv:1906.05433 [cs, stat]}}</ref>]]As described in the paper "Tackling Climate Change with Machine Learning"<ref name=":0" />:<blockquote>AI has been called the new electricity, given its potential to transform entire industries.<ref>{{Cite web|title=Andrew Ng: Artificial Intelligence is the New Electricity - YouTube|url=https://www.youtube.com/watch?v=21EiKfQYZXc|website=www.youtube.com}}</ref> Interestingly, electricity itself is one of the industries that AI is poised to transform. Many electricity systems are awash in data, and the industry has begun to envision next-generation systems (smart grids) driven by AI and ML.<ref>{{Cite journal|last=Ramchurn|first=Sarvapali D.|last2=Vytelingum|first2=Perukrishnen|last3=Rogers|first3=Alex|last4=Jennings|first4=Nicholas R.|date=2012|title=Putting the 'smarts' into the smart grid|url=http://dx.doi.org/10.1145/2133806.2133825|journal=Communications of the ACM|volume=55|issue=4|pages=86–97|doi=10.1145/2133806.2133825|issn=0001-0782|via=}}</ref><ref>{{Citation|title=Machine Learning Techniques for Supporting Renewable Energy Generation and Integration: A Survey|url=http://dx.doi.org/10.1007/978-3-319-13290-7_7|publisher=Springer International Publishing}}</ref><ref>{{Cite web|title=How artificial intelligence will affect the future of energy and climate|url=https://www.brookings.edu/research/how-artificial-intelligence-will-affect-the-future-of-energy-and-climate/|website=Brookings|date=2019-01-10|language=en-US}}</ref>
 
ElectricityThe systemsenergy aresupply responsiblesector forcontributes about a quarter35% of human-caused greenhouse gas emissions each year.,<ref>IPCCBruckner T., ClimateI.A. ChangeBashmakov, Y. Mulugetta, H. Chum, A. de la Vega Navarro, J. Edmonds, A. Faaij, B. Fungtammasan, A. Garg, E. Hertwich, D. Honnery, D. Infield, M. Kainuma, S. Khennas, S. Kim, H.B. Nimir, K. Riahi, N. Strachan, R. Wiser, and X. Zhang, 2014: Energy Systems. In: ''Climate Change 2014: Mitigation of Climate Change. Contribution of Working Group III to the Fifth Assessment Report of the Intergovernmental Panel on Climate Change'' [Edenhofer, O. Edenhofer, R. Pichs-Madruga, Y. Sokona, E. Farahani, S. Kadner, K. Seyboth, A. Adler, I. Baum, S. Brunner, P. Eickemeier, B. Kriemann, J. Savolainen, S. SchlomerSchlömer, C. von Stechow, T. Zwickel, and J.C. Minx, (eds.)]. 2014Cambridge University Press, Cambridge, United Kingdom and New York, NY, USA.</ref> Moreoverwithin which decarbonizing electricity supply plays an important role. In addition, many climate change strategies in sectors such as [[Buildings and Cities|buildings]], [[transportation]], and other[[industry]] sectorsrely seekon tolow-carbon replaceelectricity. GHG-emittingTo fuelsreduce greenhouse gas emissions from electricity systems, demandit forwill be necessary to both transition quickly to low-carbon electricity willsources grow(e.g., Tosolar, wind, and nuclear) and to reduce emissions from existing electricity systems,system societyoperations mustin the meantime.
 
AI and machine learning are often discussed in the electricity sector in the context of smart grids,<ref>{{Cite journal|last=Ramchurn|first=Sarvapali D.|last2=Vytelingum|first2=Perukrishnen|last3=Rogers|first3=Alex|last4=Jennings|first4=Nicholas R.|date=2012|title=Putting the 'smarts' into the smart grid|url=http://dx.doi.org/10.1145/2133806.2133825|journal=Communications of the ACM|volume=55|issue=4|pages=86–97|doi=10.1145/2133806.2133825|issn=0001-0782|via=}}</ref><ref>{{Citation|title=Machine Learning Techniques for Supporting Renewable Energy Generation and Integration: A Survey|url=http://dx.doi.org/10.1007/978-3-319-13290-7_7|publisher=Springer International Publishing}}</ref><ref>{{Cite web|title=How artificial intelligence will affect the future of energy and climate|url=https://www.brookings.edu/research/how-artificial-intelligence-will-affect-the-future-of-energy-and-climate/|website=Brookings|date=2019-01-10|language=en-US}}</ref> which broadly refer to the concept of "intelligent" electric grids managed automatically in a data-driven manner. In particular, ML has been used to forecast electricity supply and demand, to improve power system optimization, and to improve system efficiency through applications such as predictive maintenance. In addition, ML has also been used to accelerate scientific discovery of clean energy technologies, and to gather electricity infrastructure data that may be useful for system planners and policymakers.<ref name=":0" />
* Rapidly transition to low-carbon electricity sources (such as solar, wind, hydro, and nuclear) and phase out carbon-emitting sources (such as coal, natural gas, and other fossil fuels).
* Reduce emissions from existing CO<sub>2</sub>-emitting power plants, since the transition to low-carbon power will not happen overnight.
* Implement these changes across all countries and contexts, as electricity systems are everywhere.
 
ML can contribute on all fronts by informing the research, deployment, and operation of electricity system technologies. Such contributions include accelerating the development of clean energy technologies, improving forecasts of demand and clean energy, improving electricity system optimization and management, and enhancing system monitoring. These contributions require a variety of ML paradigms and techniques, as well as close collaborations with the electricity industry and other experts to integrate insights from operations research, electrical engineering, physics, chemistry, the social sciences, and other fields.</blockquote>
 
== Machine Learning Application Areas ==
Line 13 ⟶ 9:
=== Enabling low-carbon electricity ===
 
*'''[[Electricity Supply Forecasting|Supply]] and, [[Energy Demand Forecasting|demand]] and [[Energy Price Forecasting|price]] forecasting''': The supply and demand of power must both be forecast ahead of time to inform electricity planning and scheduling. In more volatile energy systems, also forecasting of prices becomes relevant to utilize flexibility effectively. ML can help make these forecasts more accurate, improve temporal and spatial resolution, and quantify uncertainty.
*'''Improving [[Power System Optimization|power system optimization]]''': Scheduling algorithms on the power grid have trouble handling large quantities of solar, wind, and other time-varying electricity sources. ML can help improve electricity scheduling algorithms, control storage and flexible demand, and design real-time electricity prices that reduce CO<sub>2</sub> emissions.
*'''Improving [[Power System Planning|system planning]]''': Algorithms for planning new low-carbon energy infrastructure are often large and slow. ML can help speed up or provide proxies for these algorithms.
Line 31 ⟶ 27:
*[[Power System State Estimation|'''State estimation''']]: Many power distribution systems have few sensors, but are increasingly necessary to monitor due to the increase in rooftop solar power. ML can provide algorithms for understanding the state of distribution systems in "low-observability" scenarios where traditional state estimation algorithms may not suffice.
*'''[[Greenhouse Gas Emissions Detection|Greenhouse gas emissions mapping]]''': While some electricity system operators release publicly-available data on the emissions associated with fossil fuel generators, this data is not available in many cases. ML can help map greenhouse gas emissions using a combination of remote sensing and on-the-ground data.
*'''[[Non-Intrusive Load Monitoring|Non-Intrusive Load Monitoring (NILM)]]''': ML can be used to disaggregate the net-load measurements into their individual components. It finds application in disaggregating native load and PV generation measurements from the net-load measurements obtained at the feeder-lever or at the residential-level. Another aspect of energy disaggregation is non intrusive load monitoring, wherein the load measurement is disaggregated into different components representing the consumption of different household electric appliances.
 
== Background Readings ==
Line 58 ⟶ 55:
=== Major conferences ===
 
 
 
*'''ACM e-Energy''': "The International Conference on Future Energy Systems (ACM e-Energy) aims to be the premier venue for researchers working in the broad areas of computing and communication for smart energy systems (including the smart grid), and in energy-efficient computing and communication systems". Website [https://energy.acm.org/eenergy-conference/ here].
*'''IEEE Power & Energy Society General Meeting''': One of the [https://www.ieee-pes.org/meetings-and-conferences IEEE Power & Energy Society's] flagship annual conferences, held in North America. Website [https://pes-gm.org/ here].
*'''Power Systems Computation Conference''': A biennial conference held in Europe, focused on computational power system methods. Website [https://pscc-central.epfl.ch/ here].
Line 67:
*'''IEEE Transactions on Power Systems''': Covers the "requirements, planning, analysis, reliability, operation, and economics of electric generating, transmission, and distribution systems for general industrial, commercial, public, and domestic consumption." Journal website [https://ieeexplore.ieee.org/xpl/RecentIssue.jsp?punumber=59 here].
*'''IEEE Transactions on Smart Grid''': "[A] cross disciplinary and internationally archival journal aimed at disseminating results of research on smart grid that relates to, arises from, or deliberately influences energy generation, transmission, distribution and delivery." Journal website [https://ieeexplore.ieee.org/xpl/RecentIssue.jsp?punumber=5165411 here].
*'''IEEE Transactions on Sustainable Energy:''' This journal is aimed at disseminating results of research on the design, implementation, grid-integration, and control of sustainable energy technologies and systems that can be integrated into the power transmission and/or distribution grid. Journal website [https://www.ieee-pes.org/ieee-transactions-on-sustainable-energy here].
 
=== Major professional organizations ===
 
*'''IEEE Power & Energy Society''': "[T]he world's largest forum for sharing the latest in technological developments in the electric power industry, for developing standards that guide the development and construction of equipment and systems, and for educating members of the industry and the general public." Website [https://www.ieee-pes.org/ here].
*'''ACM Special Interest Group on Energy Systems and Informatics''': "ACM SIGEnergy is a professional forum for scientists, engineers, educators, and professionals for discussing energy systems and energy informatics. It brings together an inter-disciplinary group of computer scientists with diverse backgrounds [...] to discuss and address key challenges in future energy systems, and their impact on society." Website [https://energy.acm.org/ here].
 
== Libraries and Tools ==
 
*'''PowerTAC''': A power system simulation environment, available [https://powertac.org/ here].
*'''Energy Policy Simulator''': A tool to simulate the greenhouse gas emissions effects of various climate and energy policies, available [https://us.energypolicy.solutions/docs/ here].
*'''Optimal Power Flow (OPF) Sampler Package''': A Julia package to generate power grid data samples via optimal power flow methods, available [https://github.com/invenia/OPFSampler.jl/ here].
*'''Pyiso''': A Python client library for data from power grid balancing authorities in the United States, Canada, and Europe. Documentation [https://pyiso.readthedocs.io/en/latest here].
*'''List of Resources by ACM SIG Energy'''': A list of models, libraries, software and datasets curated by the [https://energy.acm.org/ ACM Special Interest Group on Energy Systems and Informatics], available [https://energy.acm.org/resources/ here].
* '''OPFLEarn.jl''': A [https://github.com/NREL/OPFLearn.jl Julia package] for creating datasets for machine learning approaches to solving AC optimal power flow (AC OPF).
 
== Data ==
Line 88 ⟶ 91:
*'''Pecan Street:''' Disaggregated energy and water data, available [https://www.pecanstreet.org/dataport/about/ here] (requires login)
*'''United States Environmental Protection Agency's Air Markets Program data''': Datasets from the US EPA's emissions trading programs. For instance, the Continuous Emissions Monitoring System dataset (also available via the EPA's [ftp://newftp.epa.gov/DMDnLoad/emissions/ FTP site]) provides hourly emissions and generation for many fossil fuel generators in the United States. Available [https://ampd.epa.gov/ampd/ here].
* '''Utility Transition Hub™ Data''': Datasets on US-based utility finances, investments, operations, emissions and the utilities' alignment and commitments for the 1.5°C goals. Available [https://utilitytransitionhub.rmi.org/data-download/ here].
 
=== Europe ===
Line 93 ⟶ 97:
*'''European electricity market data from electricityMap''': Links to (and parsers for) European power system data, available [https://github.com/tmrowco/electricitymap-contrib#data-sources here] via GitHub.
*'''European electricity market data via Pyiso''': The [https://pyiso.readthedocs.io/en/latest pyiso Python library] provides data from European power grid control areas.
*'''German core energy data set:''' The python library [https://pypi.org/project/open-mastr/ open-mastr] provides data of all electricity and gas producers in Germany.
 
=== India ===
Line 101 ⟶ 106:
 
*'''Project Sunroof by Google''': Detailed estimates of rooftop solar potential based on sunlight and roof space, available [https://www.google.com/get/sunroof/data-explorer/ here].
*'''EDP Open Data''': EDP, a multinational utility company, publishes open data on solar and wind power assets (including clean datasets put together for previous competitions). Available [https://opendata.edp.com/pages/homepage/ here].
*'''Ausgrid Data'''': Ausgrid, a DSO in NSW, Australia, [https://www.ausgrid.com.au/Industry/Our-Research/Data-to-share provides several datasets], among them 300 households, 225 substations and data about outages.
*'''Transmission H-frame Dataset 1.0'''': The [https://www.kaggle.com/competitions/electric-transmission-imagery/overview Dataset] contains 12,158 drone collected images collected and shard by EPRI.
 
== Relevant Groups and Organizations ==
 
* '''Electric Power Research Institute (EPRI)''': A non-profit organization that conducts research, development, and demonstration projects focused on electricity generation and delivery, and with over 1,000 member organizations around the world. Website [https://www.epri.com/ here].
*'''The Global Power System Transformation Consortium (G-PST)''': An international consortium of the leading electricity system operators "to identify common, cutting-edge research questions that can inform large- scale national research and development investments." Website [https://globalpst.org/ here] and inaugural research agenda [https://globalpst.org/resources/ here].
 
== References ==
1

edit