Active projects and challenges as of 04.12.2024 08:22.
Hide full text Print CSV Data Package
Real-Time Grid Load Visualization and Consumer Impact Analysis
We aim to bridge the gap between end-users and the operational data of distribution grids by providing real-time, accessible visualizations of grid loads. We bring a hands-on challenge that leverages a hardware setup featuring a Janitza power meter, commonly used within distribution grids, alongside a local server infrastructure to read and store data in InfluxDB.
https://youtu.be/vhdChUOw8x4?t=919
Challenge
Our challenge is to create a user-friendly web interface that visualizes the load measured by the Janitza power meter. This visualization could be represented in a form such as a traffic light system, signaling the maximum load levels. Additionally, we aim to incorporate sample household consumption data and explore how this individual data correlates with the overall grid pattern. The goal is to provide end-users with insights into their contribution to grid peaks (which can lead to higher costs) or their ability to consume anti-cyclically to help reduce peak costs.
Data
The hardware setup includes a Janitza power meter that will be connected to a local server, capturing data via Modbus and storing it in InfluxDB. We will also provide sample household consumption data for analysis and correlation with the grid load patterns.
Contact
NCCR und EW Walenstadt/ASGAL, Benjamin Sawicki & Thomas Gall
Watts & Bots: Energizing Swiss Tariff Transparency with AI
- lukas_mona
- angelos_selviaridis
- ggcaponetto
- shushi_luo
- michael_mazourik
- maurice_sifrig
- stefano_spadaccia
- tom_strosslin
- marina_gonzlez_vay
- mathias_niffeler
- davidsuter
- patrick_ploesser
Develop a GenAI solution using the OpenAI API, which can provide the end user with the correct detailed electricity tariffs of all individual products of each electricity provider (including the break-down of prices into the different components) for every municipality in Switzerland.
https://youtu.be/vhdChUOw8x4?t=1342
Challenge
There are more than 600 local electricity providers in Switzerland, each one of which has different electricity prices for different unique products, according to different customer types. As a result, at least a thousand of different electricity tariffs exist in Switzerland, a detailed overview of which does not exist. Elcom hosts a website, where the end customers can compare their tariffs to similar tariffs at other municipalities in Switzerland, however this comparison is a rather rough one, relying on average prices for high and low tariffs and on very specific (and rather unrealistic) assumptions about the electricity consumption of each customer type (Strompreise Schweiz (admin.ch)). Thus, the end customers cannot have an exact comparison of their electricity bill with other locations and energy companies do not have the exact data to test new products and services (electric mobility, battery storage etc.) and to perform the exact financial modelling needed for them to decide on where it is more profitable to operate and what to charge.
Here's a list of possible benefits of precise electricity tariffs per energy provider in Switzerland:
Electromobility:
- Cost savings: Allows EV users to charge during cheaper periods.
- Promotes EV adoption: Attractive tariffs for off-peak charging.
Energy Efficiency:
- Optimized consumption: Encourages shifting energy use to lower-cost periods.
- Supports efficient appliances: Incentivizes using energy-efficient devices.
Renewable Energy:
- Boosts self-consumption: Favors users with solar panels to maximize self-produced energy.
- Better integration: Optimizes use of solar/wind power.
Grid Stability:
- Demand shifting: Reduces peak demand, enhancing grid stability.
- Demand response: Enables participation in grid relief programs.
Customer Satisfaction:
- Personalized tariffs: Tailored to individual consumption, increasing satisfaction.
- Transparency: Offers better control over energy costs.
Competitive Advantage:
- Market differentiation: Innovative tariffs set providers apart.
- Customer acquisition: Attracts new customers with clear, attractive tariffs.
Environmental Impact:
- CO2 reduction: Encourages renewable energy use and reduces peak consumption.
- Sustainable practices: Incentivizes eco-friendly behavior.
Flexible Pricing:
- Time-based tariffs: Aligns consumption with lower-cost periods.
Dynamic pricing:
- Reflects real-time market conditions.
How
- Data: The different tariffs can be found in PDF format on the Elcom website and are openly available on the Elcom website. Feel free to use your imagination to access further potentially valuable information online via web-scrapping
- Solution: Use openAI models (or do you have a better idea?) to get the correct information (we can start with the x biggest utilitites in Switzerland and build it up from there).
- Frontend (optionally): Provide a frontend for easy comparison of electricity prices in different regions and across different years in Switzerland
Benefits
- Gain hands-on experience with the openAI API and test the LLM technology – worth it or hype debunked?
- Learn about the different electricity tariffs and provide a fresh look into tariff differences across regions
Requirements
- Coding skills (Python and/or Javascript preferred, others welcomed)
- First experiences with GenAI and writing prompts
- Creative thinking – let’s prototype
Links
- Repository: https://github.com/geoimpact/electricity-tariffs
- Key (encrypted): U2FsdGVkX1/e3dQHsSUfAtb1NqrtQfxriv5mT+UVXm808t4b3d2S/g+sMIYSj0hmRcv6byYw/N8tU938I12RYDWWxFuP/EIVuPxThADCw6X8IRaVce8EG4/N0dGPHtDhqNO/NIuQIeEfYzy3Z/GylhM2mgraoh5Ok77Dvro+od1RWe92mnD5sH9jbpcgGiLyjXQtMe1ifAEzqFA6BVGV03MCkOGfe1SRTYSygOUU20TkFxuyVK0TOhL4dyxH9sfB
- Project Coordination: https://docs.google.com/document/d/1kzSg2NGnhJ7JnRw92oTBIT9yq9eGEWVUAH4OQuudQIs/edit
Contact
EKZ und GeoImpact, Angelos Selviaridis (EKZ) and David Suter (GeoImpact)
Predicting Control Energy Volumes for Grid Stability
- brice_repond
- remo_steiner
- rob_mills
- raphael_vogt
- lea_bchlin
- jill_huber
- fabian_gottschlich
- solt_kovacs
Develop a predictive model to forecast control energy activations for grid stability. Specifically, participants are tasked with estimating the daily activation volumes (in MWh) of automatic Frequency Restoration Reserve (aFRR) activations in Switzerland. This includes distinguishing between positive and negative activations. Additionally, participants should consider how future scenarios - such as the expansion of renewable energy, climate change, and the reduction of fossil fuels - might impact these activation volumes.
https://youtu.be/vhdChUOw8x4?t=1680
Challenge
Ensuring a stable electricity grid requires maintaining a perfect balance between electricity generation and consumption. As the energy landscape evolves rapidly with increasing renewable energy sources, predicting and ensuring grid stability becomes more challenging. Renewables like wind and solar power are variable and less predictable compared to traditional power plants, and the electrification of sectors like transport and heating further complicates power flow predictability. To manage grid stability, ancillary services such as aFRR are crucial, as they provide quick adjustments to electricity supply or demand. By predicting aFRR activations, we can better manage and schedule assets, identify potential market opportunities, and ensure grid reliability in the face of an evolving energy landscape. Predicting aFRR activation calls is particularly challenging, especially when simulating scenarios for the future up to 2050. This challenge aims to determine if the fundamental input and output data of a typical electricity price forecasting model can also be used to predict daily aFRR activation volumes.
How
Participants will
- Data Access: Receive curated datasets containing historical records of aFRR activation calls (both positive and negative) in Switzerland for the years 2018 to 2023 and files containing potential input features. The datasets will be pre-processed and include key contextual factors relevant to the challenge.
- Model Development: Develop predictive models using statistical and machine learning algorithms to predict daily aFRR activation volumes. Emphasize model simplicity and interpretability. Ideally, the model should provide not only a point estimate for daily aFRR call-off quantities but also a probability distribution for these quantities. Models will be evaluated on a test dataset from the year 2024.
- Scenario Evaluation: Consider how future trends, such as increased renewable energy adoption, climate change, and reduced fossil fuel usage, might influence aFRR activation volumes. Visualize assumptions and findings.
Benefits
- By participating in this challenge, you will gain hands-on experience in predictive modelling, data analysis, and the practical application of their work to real-world energy grid stability issues within a short timeframe.
- You support grid operators and energy companies in forecasting future grid stability. In this way, you will help to better quantify the costs of expanding renewables and, at the same time, identify potential market opportunities for flexible power plants or storage systems (e.g. utility-scale batteries).
- Establish contacts with BKW's flexibility and market analysis teams.
Contact
Jill Huber, Fabian Gottschlich, Tom Felder (BKW AG)
Mr. & Mrs. Refrigerator's Data Duel
Rewarding Households for Saving Energy with an Open Data Approach
- diana_petrovic
- petra_schär
- nicole_khni
- nair_pujagic
- manuel_artero
- frederic_nachbauer
- andreas_schuth
- timo_kropp
In many households, the potential for energy efficiency often goes unrealized. Old and inefficient appliances, like outdated refrigerators, are kept for years, leading to unnecessary energy consumption and higher electricity bills. Households lack the tools and knowledge needed to identify these inefficiencies and the potential benefits of upgrading to more energy-efficient alternatives.
https://youtu.be/vhdChUOw8x4?t=2063
Presentation in PowerPoint öffnen
Challenge
What
Our goal is to create an open data foundation that allows to identify the specific, old appliances from households and quantify the potential energy savings that can be achieved through the replacement with an energy efficient alternative. By providing detailed insights and actionable recommendations, we aim to enable households to make informed decisions, rewarding their efforts in the energy transition with lower energy bills and transparency in terms of consumption.
How
- Build an open data appliance catalogue with energy efficiency data
- Develop a workflow to identify old appliances using load disaggregation from user energy data.
- Implement image-to-text extraction from product manuals for appliance identification.
- Create a questionnaire-based tool to help users identify appliances ready for replacement.
- Visualize energy savings and cost reductions from upgrading to efficient appliances.
Where to start
We already have a prototype in place, which is currently running on Databricks. This prototype includes fully set-up user accounts and a complete full-stack environment. The environment is equipped with integrated data storage, connections to external data sources, pretrained machine learning models, and user-friendly web interfaces (using Gradio). Additionally, Databricks personnel are available on-site to assist with any technical needs or further development. This foundation allows you to immediately begin refining steps, integrating additional data sources, and enhancing the user experience, paving the way for a scalable solution that can be rapidly deployed and expanded.
Contact
Primeo Energie , Andreas Schuth and Timo Kropp
Impact of logistic truck electrification on electrical infrastructure
A research project between Coop, AEW and HSLU investigates the impacts of fleet electrification of logistic trucks on the local electrical infrastructure as well as the upstream power grid. A key aspect driving the needs for electrical infrastructure is a better understanding of the charging needs of a e-truck fleet, which reveals the energy required to maintain the operations of the fleet, required grid capacity, the battery sizes required for different routes etc. Moreover, it shall be analyzed if e-trucks can provide demand side flexibility for grid services and maximize use of local renewable production.
https://youtu.be/vhdChUOw8x4?t=2430
Challenge
Assess the operating schedule of a logistic truck fleet. What is the daily energy profile? What charging capacities are required to maintain the logistic operation. Can the charging processes be shifted or optimized? What is the potential flexibility that the e-truck fleet can provide?
Data
Weekly operating schedule of 160 vehicles serving north-eastern part of Coop super markets with exact departure and arrival times and locations, approximate vehicle load, etc.
Contact
Coop & HSLU, Severin Nowak (HSLU), Jamina Häseli (Coop)
Applying graph theory to clean energy districts
Flow optimisation across heat networks
- jonathan_chambers
- yuequn_zhang
- tristan_montalbetti
- kilian_werder
- tyler_anderson
- leiv_andresen
- armin_begic
- mathias_steilen
- lukas_ringlage
- sari_issa
District heating networks provide heat to buildings through a network of underground pipes. Currently 80% of buildings in Switzerland still use oil and gas for heating, so we need new district networks to replace this with clean energy coming from renewable sources like heat pumps or waste heat from data centers.
https://youtu.be/vhdChUOw8x4?t=3066
Presentation in Google Drive öffnen
Challenge
Optimising the layout and routing through this network is an interesting graph theory challenge. While Minimum Spanning Tree algorithms allow us to get the overall shortest network, in reality district heat networks carry hot water flows and we want to minimse the overall flow to reduce energy loss, while also being able to add new network nodes. In this challenge we will provide data for thermal networks represented as graphs, that participants can try different algorithms and solutions, and visualise the resulting heat flows.
Contact
Planeto, Jonathan Chambers and Stefano Cozza
https://kdrive.infomaniak.com/app/share/745832/19ad001e-e849-4652-8132-f81f12ce5a3f
Data folder
https://kdrive.infomaniak.com/app/share/745832/90ca4574-d096-4672-bf44-db07a58fb955
Data and file drop box https://kdrive.infomaniak.com/app/collaborate/745832/aa3f0bad-3645-485a-8c27-1a5376fc09c6
Google Sheets slideshow to collect ideas and results
Load Profile Clustering
The primary goal of this challenge is to develop an innovative solution that leverages public smart meter data to generate clusters of load profiles, highlighting patterns into energy consumption. Participants will be tasked with creating an innovative approach that not only identifies and categorizes these clusters but also provides actionable insights for optimizing energy use.
https://youtu.be/vhdChUOw8x4?t=3447
Challenge
Objectives
- Main Objective: Develop a solution to generate load profile clusters based on public smart meter data.
- Follow-up Objectives: Determine the sizes of clusters, visualize changes over time, identify key features of clusters, forecast cluster changes, and propose solutions to shift consumers between clusters.
Tasks
- Cluster analysis: Determine the optimal sizes and boundaries of these clusters.
- Temporal Visualization: Visualize how these clusters evolve over time to understand dynamic consumption patterns.
- Feature Identification: Identify the key characteristics that define each cluster.
- Forecasting: Predict future changes in cluster composition and behaviour.
- Consumer Shift Strategy: Propose actionable strategies to help consumers transition between clusters, optimizing energy consumption and efficiency.
Contact
Axpo/CKW, Maksim Kapustsin, Ilaria Mastromarino and Roman Sonder (CKW)
Prediction of PV installation angles
- ad_rupp
- dominique_luder
- céline_dupuis
- patrick_schrmann
- lstiefelm
- andrej_bernhard
- omar_55
- fabwu
- chiwenela
- peter_robineau
https://youtu.be/vhdChUOw8x4?t=3870
SwissgridChallenge PV Installation Angles.pdf
Challenge
Problem/current situation
- Pronovo AG issues certificates of origin to photovoltaic (PV) plant owners.
- They have a database of mostPV plants (location, tilt, orientation, capacity, …) in Switzerland.
- But: Data oninstallation angles (orientation & tilt) is incomplete and not public.
We don´t know
- Which PV plant belongs to which building?
- On which roof(s) are the panels likely installed?
- How many roofs are covered to which extent?
- Estimate the installation angles (tilt & orientation) for each PV plant.
Why
- We want to generate forecasts for all ~233.700 PV plants in the Pronovo database to improve our forecast
- We need to know more about the installation angles.
- The sonnendach.chdatabase holds data on roofs (tilt, orientation, suitability for PV). Panel Orientation, Panel Tilt
Challenge
- Can you predict PV installation angles (orientation & tilt) based on sonnendach.ch’sdata on roofs?
https://adb-3356527705169483.3.azuredatabricks.net
Contact
Swissgrid , Xiying Liu, Giulio Ferraris, Christoph Glanzer and Thomas Lanz
Week-ahead Load Forecasting
This challenge invites you to predict the load on the Swiss transmission grid, for the next week, in hourly resolution. The load forecast is used to support some of the core operational tasks in Swissgrid, for example, from weekly planning to near-real-time operation. Load can be influenced by many factors on the grid, including historical load, weather, generations, seasonality, etc. You will get hands on the actual historical load data and other important inputs data to generate week-ahead load forecast. The improvement introduced in this forecast will be examined and applied to our operations when the performance is confirmed to be better – so this is a great chance to make the real impact to the energy industry.
https://youtu.be/vhdChUOw8x4?t=4349
Contact
Swissgrid AG, Liu Xiying, Thiago Raiz, Malte Rohden and Tim Brietenbach
Determining the signature of a solar system
The production of a solar system (photovoltaic system, PVA) depends on many factors. However, under ideal conditions, every solar system has a characteristic output curve that depends on the characteristics of the system, such as orientation and shading.
https://youtu.be/vhdChUOw8x4?t=4742
Challenge
Data
For this challenge, anonymised data from real PV systems is provided. This data can be crossed with weather data on solar radiation and cloud cover to analyse the production patterns of the systems.
Aim
The aim of this challenge is to develop an (AI-) supported model that determines the characteristic signature of a solar plant. This signature ‘S’ depends on factors such as orientation, shading and other characteristics of the system.
Applications
The developed model can then be used with the following applications: - Comparison of effective and expected production for performance review - Forecast of plant production for timetables in the control energy sector, portfolio optimisation, etc. - The model can be used in simulations of any kind at Solarify.
Contact
Solarify: Raimund Neubauer, Roger Langenegger
Characterisation of demand side flexibility
In a collaboration between SAK and HSLU, heat pumps and electric boilers in a pilot area were retrofitted with sophisticated metering and control hardware. Aim of the project is to monetise demand side flexibility through a local flexibility market platform. Demand side flexibility shall be used in a coordinated way for DSO peak shaving, BRP portfolio optimization, as well as TSO balancing services.
https://youtu.be/vhdChUOw8x4?t=5191
Challenge
Assess the suitability of the various devices to provide flexibility. How well do they react to the external control signal? How accurately can the energy consumption be predicted and shaped in practice? How much could this flexibility be worth?
Data
Anonymized consumption data from heat pumps and boilers in 30 second resolution over multiple weeks, including historical activation signals.
Contact
SAK und HSLU, André Egli (HSLU) and Lukas Zigerlig (SAK)
When do Balance Energy Prices Skyrocket?
https://youtu.be/vhdChUOw8x4?t=5610
The original challenge is here. See also details of a Data Expedition for continual improvements to data availability.
https://hack.energy.opendata.ch/project/15
Contact
Bundesamt für Energie, Lucas Tochtermann
When do Balance Energy Prices Skyrocket?
Presented at Energy Data Hackdays 2024. Fachhochschule Nordwestschweiz, September 12 - 13, 2024. The original slides can be found in CHALLENGE.md
Results
Working in an open source data science environment, we used Jupyter Notebooks to dive into the challenge of understanding and modelling national energy balancing with Python. In our presentation you can see the key outputs, or browse our notebooks and other sources shared on GitHub.
The goal is better understanding of the subject matter through clear presentation of the data. Our data sources, as well as further literature and links that were referenced can be found in a section further on.
An initial Energy Overview was done by combining outputs from five energy sources with data available for this year:
Comparison of Share and Price of Tertiary Energy
Comparison of Amount and Price of Tertiary Energy
Energy Overview
We started mocking up a basic dashboard using Marimo, which could include further read-outs and interactive graphs.
Prediction of load levels was done with Chronos forecasting running in a Runpod, as shown here:
We also ran tests in the SARIMAX and Nixtla forecasting libraries.
Finally, a Timeline of April 22 events was started by collecting key developments in a spreadsheet.
We thank all the participants of the Hackdays, and hope that we provoke further data exploration in the future!
Data
Dataset | File | Source |
---|---|---|
Day-ahead prices, hourly | auction_spot_prices_switzerland_2024.csv | EPEX |
Day-ahead traded volumes, hourly | auction_spot_volumes_switzerland_2024.csv | EPEX |
Balancing prices for BGs short/long, 15min | balancing_prices_2024.csv | Swissgrid |
Day-ahead prices, hourly | day_ahead_prices_CH_2024.csv | ENTSO-E |
Swiss power generation per type, hourly | generation_per_type.csv | ENTSO-E |
Swiss power generation per type (staging), hourly | generation_per_type_staging.csv | ENTSO-E |
Yearly calendar of events | kalender_2024_ch.csv | - |
Legend of Meteoschweiz columns | legende meteoschweiz.csv | Meteoschweiz |
Consumption schedule, hourly | load.csv | ENTSO-E |
Consumption Schedule (staging), hourly | load_staging.csv | ENTSO-E |
Weather data | staging_ms_6120.csv | Meteoschweiz |
Weather data (unprocessed) | staging_ms_6121.csv | Meteoschweiz |
Problems reported in power supply | unavailability_of_generation_units.csv | ENTSO-E |
Join our Data Expedition to help efforts to catalog and support open data for projects like this one. Further links can be found in the Resources section of the Hackdays.
Notes
Since it is not possible for the market participants to have all the information we have, we have to reconstruct the probable situation from the available sources - and if we recognize patterns, find out in which combination the variables become important. To learn about pricing models for power trading, see this With The Grid blog post.
Swissgrid has to pay the current balancing price, and there is little to counter speculation and mispredictions. Few understand the background about the schedules and how Swissgrid organizes the grid operation. The Swissgrid website has various documents that illustrate the matter.
For a brief intro to statistical forecasting with Python, see SARIMAX at Statsmodels.org
In the Media
These articles on the events in April were mentioned in the Challenge presentation:
Projects
We found these prior Hackday and other projects inspirational:
- Visistrom (2019)
- Electricity Maps (2020)
- Trends in tertiary energy prices (2021)
- Experimental Statistics ML_SoSi BFS (2023)
- Füllungsgrad der Speicherseen BFE (2024)
- DataHub - Brent and WTI Spot Prices
- UK Energy Dashboard (Source, Data)
- Visualization of the European transmission network with Plotly and the PyPSA-Eur package
Simulation as Game
Inspired by Koboldgames, who supported previous Energy Hackdays and have developed serious games involving environmental and economics models, we researched whether games are being used to simulate and teach power systems.
- Barrios-O’Neill, Hook (2016)
- Fate of the World (2011)
- Green with Energy (2024)
- How video games prepared me for energy modelling (LinkedIn)
We used Etherpad (hosted at OKFN DE) to collaborate on these notes.
Challenges
Orchestrating energy system simulations from different models
What is the challenge?
This is a coding challenge. The goal is to design a library in Python to interact with energy system models data. It will involve identifying the needs from the modelers and the limitations a library like this will inevitably have. The idea is to provide the different models with a common interface that can read data from different sources and formats.
Why?
Our software, Nexus-e, currently orchestrates five different models to solve energy system optimizations problem. It does so by tightly coupling the different models together with very specific solutions to exchange data between the models. We want to develop this library in order to decouple our current models and to welcome new models in our ecosystem.
Background
Nexus-e enters a new development phase where we want to make it truly modular by implementing a plug-in architecture. By doing so we want to enable different energy system models to easily become a Nexus-e plugin. The library developed during this challenge will be the first step of this process.
Data
We will provide a scenario (set of input data) from a Nexus-e simulation and a scenario from another model along with these two models respective codebase.
Contact
ESC/ETH, Jonas Savelsberg and Matthieu Boubat