Edited
Regional Energy Information in High Resolution
Collecting, analyzing and visualizing energy policy data from Swiss communities
National energy policy goals are known and monitored, but how is the progress of the Swiss energy transition on regional level?
Working on our challenges will contributing to the current, highly relevant discussion on security of energy supply in Switzerland. You will support us to develop cutting-edge energy policy design.
Step 1: Web scraping energy policy goals
Find and gather information about energy policy goals and activities of municipalities. Identify ambitious and less ambitious municipalities Optional: Cluster municipalities that follow same/close goals and benchmark
Step 2: regionalize renewable energy production
How much production in Swiss municipalities? Data wrangling and fusion
🧑🏽🏫 GeoImpact/BfE Digital Office
Project Team
Who has which skills and is in which team - policy (P), data (D), scraping (S)
![Project Team](https://bucketeer-036aa605-c047-4623-8610-f1764b90cf98.s3.amazonaws.com/public/374/JWE5NZEJLU6CNH79KPZW8J28/2022-09-16 Energy Data Hackdays Project Team.jpg)
- Emilie Boillat
- Guiseppe Caponetto
- Peter Janes («Piet»)
- Baptiste Jordan
- Manuel Meyer
- Lukas Oberholzer
- Matthias Pauli
- Peter Robineau
- Jan-Philipp Sasse
- Alexander Thommen
- Lucas Tochtermann
- Thilo Weber
![Challenge Team](https://bucketeer-036aa605-c047-4623-8610-f1764b90cf98.s3.amazonaws.com/public/374/9OA788YGXYHIJYZQVNIO5C8B/2022-09-16 Energy Data Hackdays Team md.jpg)
Team 1 - Policy and Data
Which energy policy keywords and categories are relevant?
Step 1 - Brainstorming Keywords
![Relevant Keywords](https://bucketeer-036aa605-c047-4623-8610-f1764b90cf98.s3.amazonaws.com/public/374/XDSYWGKE9S9N66C3U8RWIYPU/2022-09-16 Energy Data Hackdays Mindmap.jpg)
Step 2 - Structuring Keywords
Clustering brainstorming results mind map and converting to a structured table
![Structured Keywords Table](https://bucketeer-036aa605-c047-4623-8610-f1764b90cf98.s3.amazonaws.com/public/374/9KJJ8POR58OL2613UX6XYHW9/2022-09-16 Energy Data Hackdays Keywords.png)
Team 2 - Web Scraping
Finding energy policy information on Swiss municipality websites.
## Step 1 - Manual Samples
Manually retrieving text data from few sample municipalities
![Community Text](https://bucketeer-036aa605-c047-4623-8610-f1764b90cf98.s3.amazonaws.com/public/374/KUPAD64O2DOAO0C2OK4P57YU/2022-09-16 Energy Data Hackdays Community Text.png)
Step 2 - Building a Scraper
As some research revealed, there is no service or implementation which could be used out of the box, so it was decided to go for a simple prototype implementation:
Semi automatic information gathering:
- Loop over 64 municipalities as test set
- For every municipality initiate a google search with municipality name and keywords «Energie Umwelt»
- Take top 3 google results
- Pick sentences where keywords from team 1 appear
- Run sentiment analysis over retrieved sentences
![Screen Scraper](https://bucketeer-036aa605-c047-4623-8610-f1764b90cf98.s3.amazonaws.com/public/374/B20JDP3PAZROP8I8T8NO757E/2022-09-16 Energy Data Hackdays Scraper md.png)
Scraper result set
![Scraper Result Set](https://bucketeer-036aa605-c047-4623-8610-f1764b90cf98.s3.amazonaws.com/public/374/QYCIGBLQG1UDSXRKBYDZV58X/2022-09-16 Energy Data Hackdays Results Table.png)
Scraper result set - sentences and sentiment analysis detail
![Scraper Results Sentences](https://bucketeer-036aa605-c047-4623-8610-f1764b90cf98.s3.amazonaws.com/public/374/B92EYSHNC78HMXT2VPJ9RESZ/2022-09-17 Energy Data Hackdays Results Sentences.png)
Reconciliation and Validation
Bringing the pieces together, checking if it makes sense...
Results Visualization
Visualize results on map (interactive map)
![Result Visualisation on Map](https://bucketeer-036aa605-c047-4623-8610-f1764b90cf98.s3.amazonaws.com/public/374/4ES9VE9LI5TAJQEDEKEZWCZ8/2022-09-17 Energy Data Hackdays Results Map md.png)
Showing municipalities by keywords on map (interactive)
![Keywords on Map](https://bucketeer-036aa605-c047-4623-8610-f1764b90cf98.s3.amazonaws.com/public/374/T42K7EUENIP02V32TF9XN4TU/2022-09-17 Energy Data Hackdays Map Keyword md.png)
Sample Municipality Aadorf
Validating Sentences
Sentences analysis
![Aadorf sentences analysis](https://bucketeer-036aa605-c047-4623-8610-f1764b90cf98.s3.amazonaws.com/public/374/JLU91WG3JAJ6H5BDJYWMP4LN/2022-09-17 Energy Data Hackdays Results Sentences clean md.png)
Map Visualization
Analyzing details (interactive map)
- Thermal network - green
- High solar capacity (kW/cap) - red
- Energy city - blue
![Details Aadorf](https://bucketeer-036aa605-c047-4623-8610-f1764b90cf98.s3.amazonaws.com/public/374/3CXITAYXXEXRKEBMAJIA1DX6/2022-09-17 Energy Data Hackdays Results Validagtion.png)
Final Pitch
By Jan-Philipp Sasse (with assistance of Thilo Weber)
![Final Pitch](https://bucketeer-036aa605-c047-4623-8610-f1764b90cf98.s3.amazonaws.com/public/374/AU6BRKTEFCULDGTH9FZM8WU0/2022-09-17 Energy Data Hackdays Pitching md.jpg)
Challenge Data and Code
See links below for Github repository (click on «Source» icon).
Energy Hackdays 2022 - Regional Energy Information
Code and project files of challenge 15 about Regional Energy Information.
Information about the challenge and documentation: https://hack.opendata.ch/project/848
Event finish
Documentation mostly completed - hack portal, pitch deck
Working plan for day 2 coordinated - approach for findings and documentation
Collaboration space set up, first cut project documentation completed
Two teams - web scraping (to collect data), analysis (verify first examples manually)
Joined the team
2 teams - web scraping, data analysis - first PoCs being developed
Joined the team
Start
Previous
Energy Data Hackdays 2022
Next project