{"contributors":[],"created":"2026-09-07T20:25","description":"The Open Energy Data Hackdays 2020 took place on the 28th and 29th of August in the Hightech Zentrum in Brugg.","homepage":"https://opendata.ch/projects/energy-data-hackdays-2020/","keywords":[["dribdat","hackathon","co-creation"]],"licenses":[{"name":"ODC-PDDL-1.0","path":"http://opendatacommons.org/licenses/pddl/","title":"Open Data Commons Public Domain Dedication & License 1.0"}],"name":"event-5","resources":[{"data":[{"aftersubmit":"","boilerplate":"So you picked a challenge (or decided to go for the Open challenge) - and you've found some team members (ideally 3 - 6 people)? You've discussed in our [Slack channels](https://join.slack.com/t/openenergydat-ehr6560/shared_invite/zt-c4lkd7it-Sv7iHvRBcEsOTn75hIboWA), done some research, [collected some notes](https://md.schoolofdata.ch), made some progress? Fantastic! Let's tell the Internet about your brilliant idea using our hackathon hive. Use the form below to:\r\n\r\n1. Pick a **Title** for your project. You can change this later.\r\n2. Write your basic goal in tweet form. We call this a **Short summary**.\r\n3. Tell the world what you plan to accomplish in the **Description**. (Note: keep it short, try to use a README on GitHub or the [CodiMD service](https://md.schoolofdata.ch) we have provided for you for longer documentation)\r\n4. Add links to your notebook into the **Project home link** and check **Embed this**\r\n5. Use any of the other fields to connect your source code, images, contacts.\r\n\r\nClick **Save changes**. That's it. You're started! Go hack. _Release early, release often._ You might get advice and help from unexpected places.  \r\n\r\n# &#x1f680;\r\n\r\nAnother way to do all of the above in one step is to use the **Sync** field to connect your supported open source community site: a <a href=\"https://github.com\" target=\"_blank\">GitHub</a>, <a href=\"https://gitlab.com\" target=\"_blank\">GitLab</a>, <a href=\"https://bitbucket.org\" target=\"_blank\">Bitbucket</a> projects are supported. You will then find a <a href=\"#\" class=\"btn btn-warning disabled btn-sm\">Sync</a> button on your project page for quickly pulling in changes.\r\n\r\nAfter creating a project, you can come back any time to change content and your team status. By updating your <b>Progress</b>, you can communicate how far along you are in development. Your team members can click the <a href=\"#\" class=\"btn btn-primary disabled btn-sm\">Join</a> button at the top of your project page to link their profile and make changes.\r\n\r\n<p><i>Need more help? Get in touch with the organisers using the <b>Community</b> link in the top.</i></p>","certificate_path":"","community_embed":"<div class=\"codeofconduct\">All attendees, sponsors, partners, volunteers and staff at our hackathon are required to agree with the <a href=\"https://hackcodeofconduct.org/\" target=\"_blank\">Hack Code of Conduct</a>. Organisers will enforce this code throughout the event. We expect cooperation from all participants to ensure a safe environment for everybody. For more details on how the event is run, see the <a href=\"http://make.opendata.ch/wiki/information:rules\" target=\"_blank\">Guidelines</a> on our wiki.</div>\r\n\r\n<br><p><a rel=\"license\" href=\"http://creativecommons.org/licenses/by/4.0/\" target=\"_blank\"><img align=\"left\" style=\"margin-right:1em\" alt=\"Creative Commons Licence\" style=\"border-width:0\" src=\"https://i.creativecommons.org/l/by/4.0/88x31.png\" /></a>The contents of this website, unless otherwise stated, are licensed under a <a rel=\"license\" href=\"http://creativecommons.org/licenses/by/4.0/\" target=\"_blank\">Creative Commons Attribution 4.0 International License</a>.</p>\r\n","community_url":"https://twitter.com/hashtag/energyhack2020","custom_css":"body.dashboard-page {\r\n    background: url(https://blog.datalets.ch/content/images/2020/03/IMG_20200306_130350_C.jpg);\r\n    background-size: fill;\r\n}\r\n.project-page .project-info a.btn-large {\r\n    color:white; \r\n    text-shadow: 1px 1px 2px black; \r\n}\r\n.with-event .honeycomb {\r\n/* too gaudy - can barely read the challenges now... \r\n    background: url(https://opendata.ch/wordpress/files/2019/11/Energy-Data-Hackdays-2020.jpg) no-repeat;\r\n    background-size: cover;\r\n    background-position: center; \r\n*/\r\n}\r\n.challenge.hexagon::before,\r\n.challenge.hexagon::after {\r\n    opacity: 1;\r\n}\r\n.challenge.hexagon {\r\n    font-size: 9.4pt;\r\n    background-image: url(https://opendata.ch/wordpress/files/2020/03/200828-29_Flyer_energyHackdays-1536x1081.png) !important;\r\n    background-size: 482%;\r\n}\r\n.challenge.hexagon .hexagontent {\r\n    font-size: 10pt;\r\n}\r\n.bam-container {\r\n    font-size: 135%; margin: 2em;\r\n}\r\na.bam {\r\n    font-size: 150%; font-weight: bold; text-decoration: none;\r\n}\r\n#ideas-list .list-group-item {\r\n    width: 100%; height: 2em;\r\n}\r\n.project-info .project-longtext .btn-lg {\r\n    color: white;\r\n}","description":"The Open Energy Data Hackdays 2020 took place on the 28th and 29th of August in the Hightech Zentrum in Brugg. We ran a virtual workshop in March to celebrate [Open Data Day](https://opendataday.org/) - find a [blog post here](https://blog.datalets.ch/066/) with a recap - postponing the initial date due to the onset of COVID-19. In August we ran the event with social distancing and multiple other measures to keep our participants safe. This [challenge platform](https://hack.opendata.ch/event/31), a [chat workspace](https://openenergydat-ehr6560.slack.com/home), [online forums](https://forum.opendata.ch/t/6-7-03-energy-data-hackdays/611/1) and [social media](https://twitter.com/hashtag/energyhack2020) enabled virtual participation and audience.","ends_at":"2020-08-29T13:00","gallery_url":"","has_finished":true,"has_started":false,"hashtags":"","hostname":"","id":5,"instruction":"<img src=\"https://upload.wikimedia.org/wikipedia/commons/thumb/5/52/YouTube_social_white_circle_%282017%29.svg/240px-YouTube_social_white_circle_%282017%29.svg.png\" align=\"left\" style=\"margin-right:1em;width:4em\">\r\n\r\n- [Challenge presentations](https://youtu.be/auUMzK257c8)\r\n- [Team presentations, part I](https://youtu.be/WytZIBLyw_M)\r\n- [Team presentations, part II](https://youtu.be/hfu5MbZUnCg)\r\n\r\n<h2>Offene Daten</h2>\r\n\r\nHier findest du die diversen offenen Energiedatens\u00e4tze, die wir f\u00fcr die Hackdays befreit, gesammelt und aufbereitet haben. <b>Weitere Vorschl\u00e4ge</b> und W\u00fcnsche k\u00f6nnen <a href=\"https://airtable.com/shrykWVriVLuRzZ9I\" target=\"_blank\">mit diesem Formular</a> oder <a href=\"https://github.com/schoolofdata-ch/energy-data-ch/issues\" target=\"_blank\">auf GitHub</a> eingereicht werden. Auf Datenportale wie <a href=\"https://opendata.swiss/de/group/energy\" target=\"_blank\">opendata.swiss</a> gibt es weitere offene Datens\u00e4tze zu entdecken. <b>Bitte achten</b> auf die Einhaltung der <a href=\"https://opendata.swiss/de/terms-of-use/\" target=\"_blank\">Nutzungsbedingungen</a> und die korrekte Angabe allen Datenquellen.\r\n\r\n<!--<div class=\"bam-container\">\u00dcber <a class=\"bam\" target=\"_blank\" href=\"https://opendata.swiss/de/group/energy\">200 Datens\u00e4tze</a> zu Energiethemen sind zu finden im offenen Datenportal der Schweiz auf <a href=\"https://opendata.swiss/en/group/energy\" target=\"_blank\"><img src=\"https://opendata.swiss/content/themes/wp-ogdch-theme/assets/images/logo_horizontal.svg\" width=\"220\"></a>  Von diesen haben <a class=\"bam\" target=\"_blank\" href=\"https://opendata.swiss/en/group/energy?res_rights=NonCommercialAllowed-CommercialAllowed-ReferenceNotRequired\"><img src=\"https://opendata.swiss/content/themes/wp-ogdch-theme/assets/images/terms/terms_open.svg\" style=\"height:1.6em\">14</a> vollst\u00e4ndig offene Nutzungsbedingungen, und bei <a class=\"bam\" target=\"_blank\" href=\"https://opendata.swiss/en/group/energy?res_rights=NonCommercialAllowed-CommercialAllowed-ReferenceRequired\"><img src=\"https://opendata.swiss/content/themes/wp-ogdch-theme/assets/images/terms/terms_by.svg\" style=\"height:1.6em\">160</a> ist nur die Quellenangabe verpflichtend. Unter den verf\u00fcgbaren Formaten gibt es <a class=\"bam\" target=\"_blank\" href=\"https://opendata.swiss/en/group/energy?res_format=CSV\">10 CSV</a> und <a class=\"bam\" target=\"_blank\" href=\"https://opendata.swiss/en/group/energy?res_format=JSON\">4 JSON</a> -Dateien.</div>-->\r\n\r\n<h2>Open Data</h2>\r\n\r\nHere are diverse open energy datasets that we have researched and prepared for the Hackdays. <b>Additional suggestions</b> and requests can be <a href=\"https://airtable.com/shrykWVriVLuRzZ9I\" target=\"_blank\">submitted here</a> or <a href=\"https://github.com/schoolofdata-ch/energy-data/issues\" target=\"_blank\">via GitHub</a>. On data portals like <a href=\"https://opendata.swiss\" target=\"_blank\">opendata.swiss</a> you can discover more open datasets such as these. <b>Make sure</b> to follow the <a href=\"https://opendata.swiss/en/terms-of-use/\" target=\"_blank\">Terms of Use</a> and correctly attribute your open data sources.\r\n\r\n<!--<div class=\"bam-container\">Over <a class=\"bam\" target=\"_blank\" href=\"https://opendata.swiss/en/group/energy\">200 datasets</a> on energy topics can be found in Switzerland's open government portal <a href=\"https://opendata.swiss/en/group/energy\" target=\"_blank\"><img src=\"https://opendata.swiss/content/themes/wp-ogdch-theme/assets/images/logo_horizontal.svg\" width=\"220\"></a> Of these, <a class=\"bam\" target=\"_blank\" href=\"https://opendata.swiss/en/group/energy?res_rights=NonCommercialAllowed-CommercialAllowed-ReferenceNotRequired\"><img src=\"https://opendata.swiss/content/themes/wp-ogdch-theme/assets/images/terms/terms_open.svg\" style=\"height:1.6em\">14</a> have fully open terms of use, and <a class=\"bam\" target=\"_blank\" href=\"https://opendata.swiss/en/group/energy?res_rights=NonCommercialAllowed-CommercialAllowed-ReferenceRequired\"><img src=\"https://opendata.swiss/content/themes/wp-ogdch-theme/assets/images/terms/terms_by.svg\" style=\"height:1.6em\">160</a> only require attribution. Among the formats available, there are <a class=\"bam\" target=\"_blank\" href=\"https://opendata.swiss/en/group/energy?res_format=CSV\">10 CSV</a> and <a class=\"bam\" target=\"_blank\" href=\"https://opendata.swiss/en/group/energy?res_format=JSON\">4 JSON</a> files.</div>-->\r\n\r\n<h2>Further resources</h2>\r\n\r\n<iframe class=\"airtable-embed\" src=\"https://airtable.com/embed/shrBxOOXVj0bm7fkW?backgroundColor=greenLight&viewControls=on\" frameborder=\"0\" onmousewheel=\"\" width=\"100%\" height=\"533\" style=\"margin-top:1em; margin-bottom:1em; background: transparent; border: 1px solid #ccc;\"></iframe>\r\n\r\n<center><a href=\"https://airtable.com/shrykWVriVLuRzZ9I\" class=\"btn btn-lg btn-success\" target=\"_blank\">Suggest a dataset</a></center>\r\n\r\n<h2>Data Packages</h2>\r\n\r\nVisit  <a class=\"bam\" href=\"https://energy.schoolofdata.ch\" target=\"_blank\"> \ud83d\udcfaenergy.schoolofdata.ch</a> to explore our prototype community data portal, where you can browse Data Packages that we are working on. What is this good for? Check out an example <a href=\"https://gist.github.com/loleg/2ba345b9a1cabf46c33b0e30b6d71696\">data science notebook</a> or visit <a href=\"https://frictionlessdata.io/\">frictionlessdata.io</a> to find out about some of the advantages of packaging your open data. Here are the latest <a href=\"https://github.com/schoolofdata-ch/energy-data-ch/issues\" target=\"_blank\">open issues</a> with our progress:\r\n\r\n<div id=\"ideas-list\" class=\"list-group list-data\"><i>Loading ...</i></div>\r\n<!--  <div id=\"ckan-embed-1\"></div><script src=\"https://cdn.jsdelivr.net/gh/opendata-swiss/ckan-embed/dist/ckan-embed.bundle.js\"></script><script>CKANembed.datasets('#ckan-embed-1', 'https://opendata.swiss/',{ fq: \"groups:energy\", rows: 5, lang: \"en\" })</script> -->\r\n<script>\r\nvar userName = 'schoolofdata-ch', repoName = 'energy-data-ch';\r\nvar url = 'https://api.github.com/repos/' + userName + '/' + repoName + '/issues' + '?per_page=5';\r\nwindow.onload = function() { $.getJSON(url, function(data) { var elem = $('#ideas-list'); elem.empty(); $.each(data, function() { elem.append('<a href=\"' + this.html_url + '\" class=\"list-group-item\" target=\"_blank\"><img src=\"' + this.user.avatar_url + '\">&nbsp;' + this.title + '</a>'); }); }); };</script>\r\n<br clear=\"all\"/>","location":"Hightech Zentrum in Brugg","location_lat":0.0,"location_lon":0.0,"logo_url":"https://energy.opendata.ch/files/2014/01/oed.png","name":"Energy Data Hackdays 2020","starts_at":"2020-08-28T07:00","summary":"The Open Energy Data Hackdays 2020 took place on the 28th and 29th of August in the Hightech Zentrum in Brugg.","webpage_url":"https://opendata.ch/projects/energy-data-hackdays-2020/"}],"name":"events"},{"data":[{"autotext":"# CII Read Your Smart Meter\r\nRead your own smart meter and visualize your electricity consumption.\r\nCreate dashboards with valuable information and share it!\r\n\r\n# Goal\r\n\r\nRead your Smart Meter through the local Customer Information Interface (CII)\r\nand visualize your consumption.\r\nDesign a dashboard with the most useful information.\r\n\r\n# Idea\r\n\r\nTwo Smart Meters ([Landis+Gyr E450](https://www.landisgyr.ch/product/landisgyr-e450/))\r\nwill be installed on-site and will be measuring the consumption of different devices.\r\nThe live consumption is to be displayed on a web-based dashboard.\r\nIdeally, live measurements are to be combined with historical data.\r\nAt the end, the dashboard will be able to display the most important information to an individual about their electricity consumption.\r\n![Hardware](https://raw.githubusercontent.com/aselviar/cii_read_your_sm/master/img/smartmeter_hardware.jpg).\r\n\r\n# Why\r\n\r\nIn Switzerland, it is prescribed by law that all electricity Smart Meters\r\ninstalled by utilities must have a local interface (CII),\r\nso that customers can have access to their own data.\r\nTransparency is increased as individuals can manage their own data.\r\nInnovation is promoted, as precise data is available for free in real time.\r\n\r\n# Data\r\n\r\nLive measurements from Smart Meters Historical data of an EKZ test site\r\n\r\n# Architecture Diagram\r\n![Architecture Diagram](https://raw.githubusercontent.com/aselviar/cii_read_your_sm/master/img/20200828_HK_HackDays_ReadMySmartMeter.jpg)\r\n\r\n# Setup Procedure\r\nThe setup basically follows the approach outlined in two\r\nDIY IoT blog posts ([Connect Raspberry Pi to MQTT](https://diyi0t.com/microcontroller-to-raspberry-pi-wifi-mqtt-communication/)\r\nand\r\n[Display using InfluxDB and Grafana](https://diyi0t.com/visualize-mqtt-data-with-influxdb-and-grafana/))\r\n\r\n## Raspberry Pi\r\nConnecting to the Raspberry Pi requires knowing its IP address.\r\nThis was provided access the existing Team-Viewer installation. \r\nAccess to a **bash** session on the Pi can then be obtained\r\nwith **ssh** or [Putty](https://putty.org/).\r\nFor example:\r\n\r\n```\r\nssh pi@172.28.255.239\r\n```\r\n\r\n### Mosquitto\r\n**MQTT broker and client software.**\r\n\r\nInstall the [MQTT](https://en.wikipedia.org/wiki/MQTT) (Message Queuing Telemetry Transport)\r\nbroker and client on the Raspberry Pi:\r\n\r\n```\r\nsudo apt-get install mosquitto mosquitto-clients\r\n```\r\n\r\n### MQTT publish \r\n**Bash script file change notification tool.**\r\n\r\nRather than write a program that would replace the proprietary jar file,\r\na simpler bash script approach was used.\r\nThis requires a way to trigger commands when the \r\ncontents of the CSV file being written by the proprietary jar file changes.\r\nAlthough there are many solutions, the **inotify** approach was used.\r\n\r\n```\r\nsudo apt-get install inotify-tools\r\n```\r\nThen run the bash script [monitor_csv](monitor_csv) on the Raspberry Pi:\r\n\r\n```\r\n./monitor_csv\r\n```\r\n\r\n## Client Computer\r\n### InfluxDB\r\n**Time series database.**\r\n\r\nThe smart meter measurement events are stored in an InfluxDB database.\r\n\r\n```\r\nsudo apt-get install influxdb influxdb-client\r\n```\r\n\r\nRun the [MQTTInfluxDBBridge.py](MQTTInfluxDBBridge.py)\r\npython script to start moving the MQTT messages into the InfluxDB:\r\n\r\n```\r\npython3 MQTTInfluxDBBridge.py\r\n```\r\n\r\nAfter a few messages are processed,\r\nthe database can be exercised with the influx command line tool:\r\n\r\n```\r\n$ influx\r\n> use smartmeter\r\n> show measurements\r\nname: measurements\r\nname\r\n----\r\npf\r\npower\r\nvoltage\r\n> select * from voltage;\r\nname: voltage\r\ntime                timestamp           voltage\r\n----                ---------           -------\r\n1598634419180514187 28.08.2020 19:06:59 229\r\n1598634424287928040 28.08.2020 19:07:04 231\r\n...\r\n> select * from pf;\r\nname: pf\r\ntime                pf    timestamp\r\n----                --    ---------\r\n1598634419180514187 0.912 28.08.2020 19:06:59\r\n1598634424287928040 0.91  28.08.2020 19:07:04\r\n...\r\n> select * from power;\r\nname: power\r\ntime                power timestamp\r\n----                ----- ---------\r\n1598634419180514187 10    28.08.2020 19:06:59\r\n1598634424287928040 11    28.08.2020 19:07:04\r\n...\r\n```\r\n\r\n### Grafana\r\n**Time series visualization software.**\r\n\r\nFollow the [instructions](https://grafana.com/grafana/download):\r\n\r\n```\r\nsudo apt-get install -y adduser libfontconfig1\r\nwget https://dl.grafana.com/oss/release/grafana_7.1.5_amd64.deb\r\nsudo dpkg -i grafana_7.1.5_amd64.deb\r\nsudo service grafana-server start\r\n```\r\n\r\nThen browse to [Grafana](http://localhost:3000/)\r\nand login (username: **admin**, password: **admin**).\r\nThe Explorer tab lets you make ad-hoc queries,\r\nand the Dashboards tab lets you create a dashboard using a nice GUI.\r\n\r\n# UI\r\n![Dashboard](https://raw.githubusercontent.com/aselviar/cii_read_your_sm/master/img/dashboard.png)\r\n","autotext_url":"https://github.com/aselviar/cii_read_your_sm","category_id":"","category_name":"","contact_url":"https://github.com/aselviar/cii_read_your_sm/issues","created_at":"2020-02-05T11:08","download_url":"","event_name":"Energy Data Hackdays 2020","event_url":"https://new-hack.energy.opendata.ch/event/5","excerpt":"(English below)\r\n#Eigenen Smart Meter auslesen (#3)\r\n## Ziel\r\nEigenen Smart Meter durch die lokale Customer Information Interface (CII) Schnittstelle auslesen und Stromverbrauch visualisieren. Dashboard mit den wichtigsten Informationen gestalten.\r\n\r\n## Idee\r\nZwei Smart Meter werden vor Ort installiert und werden den Verbrauch von unterschiedlichen Ger\u00e4ten messen. Der Live-Verbrauch wird auf einem web-basierten Dashboard visualisiert. Live-Werte werden mit historischen Daten kombiniert. Am Ende ...","hashtag":"","id":55,"ident":null,"image_url":"https://raw.githubusercontent.com/derrickoswald/cii_read_your_sm/master/img/dashboard.png","is_challenge":false,"is_webembed":false,"logo_color":"","logo_icon":"","longtext":"(English below)\r\n#Eigenen Smart Meter auslesen (#3)\r\n## Ziel\r\nEigenen Smart Meter durch die lokale Customer Information Interface (CII) Schnittstelle auslesen und Stromverbrauch visualisieren. Dashboard mit den wichtigsten Informationen gestalten.\r\n\r\n## Idee\r\nZwei Smart Meter werden vor Ort installiert und werden den Verbrauch von unterschiedlichen Ger\u00e4ten messen. Der Live-Verbrauch wird auf einem web-basierten Dashboard visualisiert. Live-Werte werden mit historischen Daten kombiniert. Am Ende kann das Dashboard einer Person klare Auskunft \u00fcber die wichtigsten Informationen bez\u00fcglich des Stromverbrauchs geben.\r\n\r\n##Warum:\r\nIn der Schweiz ist es gesetzlich vorgeschrieben, dass alle Smart Meter, die von Energieversorgern installiert werden, eine lokale Schnittstelle (CII) haben, so dass die Kunden Zugriff auf die eigenen Daten haben k\u00f6nnen. Das schafft mehr Transparenz, da die Kunden ihre eigenen Daten managen k\u00f6nnen. Innovation wird erm\u00f6glicht, weil genaue Daten neu gratis in Echtzeit verf\u00fcgbar sind.\r\n\r\n##Data:\r\n- Live-Messungen mit Hilfe von Smart Metern\r\n- Historische Daten Testanlage EKZ\r\n- Eine kurze Einf\u00fchrung zu den Kommunikationsprotokollen der Smart Meters findet man hier: https://icube.ch/DLMSSurvivalKit/dsk1.html\r\n\r\n\r\n\r\n\r\n#Read your own Smart Meter\r\n\r\n##Goal:\r\nRead your Smart Meter through the local Customer Information Interface (CII) and visualize your consumption. Design a dashboard with the most useful information.\r\n\r\n## Idea:\r\nTwo Smart Meters will be installed on-site and will be measuring the consumption of different devices. The live consumption is to be displayed on a web-based dashboard. Live measurements are to be combined with historical data. At the end, the dashboard will be able to display the most important information to an individual about their electricity consumption. \r\n\r\n##Why:\r\nIn Switzerland, it is prescribed by law that all electricity Smart Meters installed by utilities must have a local interface (CII), so that customers can have access to their own data. Transparency is increased as individuals can manage their own data. Innovation is promoted, as precise data is available for free in real time.\r\n\r\nSee also Challenge 582: \"Unleashing the Swiss Smartmeter's CII\" \r\nhttps://hack.opendata.ch/project/582 \r\n\r\n##Data:\r\n- Live measurements from Smart Meters\r\n- Historical data of an EKZ test site\r\n- Short introduction to Smart Meter communication protocols can be found here: https://icube.ch/DLMSSurvivalKit/dsk1.html\r\n\r\n\r\nMembers of the team:\r\nMoritz Bolli\r\nPeter Zbinden\r\nDerrick Oswald\r\nHubert Kirrmann\r\nHermann Hueni\r\nAngelos Selviaridis\r\nChristos Konstantinopoulos\r\n\r\n---\r\n`28.08.2020 14:34` \r\n\r\nThe team will focus on moving data from the metering system and visualizing the data graphically.\r\nIt will not rewrite the existing proprietary components.\r\n\r\n---\r\n`28.08.2020 14:38` \r\n\r\nA quick prototype system has been constructed.\r\nThere is a MQTT broker installed on the Raspberry Pi.\r\nIt is fed by a bash script that monitors the log file of the proprietary software and publishes on four topics at roughly 5 second intervals:\r\n- smart_meter_events/raw sends messages containing the text of each new line in the proprietary software CSV file\r\n- smart_meter_events/voltage sends a time stamp and the voltage\r\n- smart_meter_events/pf sends a time stamp and the power factor\r\n- smart_meter_events/power sends a time stamp and the power\r\nMQTT clients, for example on members laptops, subscribe to the above topics and reports the messages as they are received.\r\nGraphing software has been prototypes to display the time series (sample data).\r\n\r\n---\r\n`28.08.2020 14:42` \r\n\r\nOpenHUB 2 has been installed, and still being worked on, but as yet not successful.\r\n\r\n---\r\n`28.08.2020 14:53` \r\n\r\nInitial success in reading the data and transferring it to a PC has been demonstrated.\r\n\r\n---\r\n`28.08.2020 14:55` \r\n\r\nSmart meter readings are saved to the InfluxDB database by a MQTT <=> InfluxDB bridge python script.\r\n\r\n---\r\n`28.08.2020 17:35` \r\n\r\nThe first successful dashboard has been created with Grafana.\r\n\r\n---\r\n`28.08.2020 18:18` \n\nPresented at Open Energy Data Hack Days - Saturday, 29 August, 2020\r\n\r\n---\r\n`01.09.2020 05:58` \n\nSource code is available, per the Source link.\r\n\r\n---\r\n`01.09.2020 06:00` ","maintainer":"nikki_bhler","name":"Read your own Smart Meter","phase":"Share","progress":50,"score":122,"source_url":"https://github.com/aselviar/cii_read_your_sm","stats":{"commits":0,"during":6,"people":1,"sizepitch":4272,"sizetotal":9143,"total":6,"updates":5},"summary":"Lokale Schnittstelle zu Smart Meter inkl. Darstellung auf Web Oberfl\u00e4che","team":"nikki_bhler, HubertKirrmann","team_count":1,"updated_at":"2020-09-01T06:00","url":"https://new-hack.energy.opendata.ch/project/55","webpage_url":""},{"autotext":"# Energy Hackdays 2020 Group 05 e-mobility behavior analysis\r\nErica Lastufka, physics @ www.fhnw.ch | Florence Meier, Full Stack Developmant (focus on frontend) | Benedikt Ramsauer, Data Scientist @ www.swiss-sdi.ch | Xavier Bays, Data Scientist @ www.swiss-sdi.ch | Tim Breitenbach, Analytics & Data Architect @ www.axpo.ch | Pradip Ravichandran, Computer Science @ www.fhnw.ch | Thilo Weber, Data Scientist @ www.geoimpact.ch | David Suter, Sustainable Energy Specialist @ www.geoimpact.ch \r\n\r\n## Dashboard Sreenshots\r\n\r\n![sreenshot1](https://raw.githubusercontent.com/magnetilo/energy_hackdays_2020_05_emob_behavior_analysis/master/imgs/Screenshot1.png)\r\n\r\n\r\n![sreenshot2](https://raw.githubusercontent.com/magnetilo/energy_hackdays_2020_05_emob_behavior_analysis/master/imgs/Screenshot2.png)\r\n\r\n![sreenshot3](https://raw.githubusercontent.com/magnetilo/energy_hackdays_2020_05_emob_behavior_analysis/master/imgs/Screenshot3.png)\r\n\r\n![sreenshot4](https://raw.githubusercontent.com/magnetilo/energy_hackdays_2020_05_emob_behavior_analysis/master/imgs/Screenshot4.png)\r\n\r\n![sreenshot5](https://raw.githubusercontent.com/magnetilo/energy_hackdays_2020_05_emob_behavior_analysis/master/imgs/Screenshot5.png)\r\n\r\n![sreenshot6](https://raw.githubusercontent.com/magnetilo/energy_hackdays_2020_05_emob_behavior_analysis/master/imgs/Screenshot6.png)\r\n\r\n\r\n## findings\r\n\r\n### public ev charging station\r\n\r\n- Typology of municipalities is an important feature for occupied ratio\r\n- highest occupied ratio in big centers and peri-urban rural communes\r\n- no correlation between population density and occupied ratio\r\n- different patterns on weekdays and weekends\r\n\r\n### private ev charging station\r\nDifferent charging patterns of private customers:\r\n- Charging needs\r\n- Hours of charging\r\n- Week days of charging\r\n\r\nThis provide good hints for a further automated customer segmentation.\r\n\r\n### comparison of privat & public charging behavior\r\n- different time-profile on weekdays and weekend in public, but not in private\r\n\r\n## possible next steps\r\n\r\n### public ev charging station\r\n- occupation forecast for every charging station (hourly based day profile as a new feature for the website www.ich-tanke-strom.ch ) --> for the customers\r\n- clustering with more location-based data (socio-economic, roads, traffic etc.), understanding of different charging patterns --> for the provider\r\n- compare clusters of charging behavior with pv potential and production profiles, possibility of own consumption of charging stations --> for the grid\r\n\r\n### private ev charging station\r\n- automated customer segmentation based on linked information (building data, socio-economoic data, location) --> for the provider\r\n- cost estimation tool for customer --> for the customer\r\n- prediction of behavior changes for the load-curve --> for the grid\r\n\r\n\r\n## faced challenges\r\n- parsing and structuring provided raw data --> long running tasks\r\n- handling data errors and missing data\r\n\r\n## things to do\r\n- run everything on database server\r\n- productionalize frontend to shoot queries onto database and parse them to json \r\n\r\n        \r\n## Data Engineering\r\n\r\n### Architecture Overview\r\n\r\n![Overview](https://raw.githubusercontent.com/magnetilo/energy_hackdays_2020_05_emob_behavior_analysis/master//data_engineering_diemo/data_eng_architecture.png)\r\ndata_engineering_diemo/data_eng_architecture.png\r\n\r\n### Data Structure of diemo jsons\r\n\r\n- EVSEStatuses\r\n    - OperatorID \r\n    - Operatorname\r\n    - EVSEStatusRecord\r\n        - EVSEID\r\n        - EVSEStatus\r\n        \r\n### Python and SQL part\r\nFor parsing the 48'000 json files in 5 minutes resolution for 6 months we used python scripts.\r\nWe had to implement various exceptions because of empty jsons.\r\n\r\nFirst we tried looping everything into csv, which did not perform as fast as we would like.\r\nWe then tried Apache Feather as a data transfer format but the data storage speed wasn't the problem.\r\nThe next try was a sqlite database which works fine and was an okay solution for the hackathon.\r\nIf the project would go live, we would recommend a database server preferably in the cloud, to get the inital data loading done quick.\r\nThe dataload still takes over 10 hours and is not very efficient.\r\n\r\n### SQL Queries\r\nThe first query is about getting an overlook over all the EV-Charging points, the different operators.\r\n\r\n## Visualisation ideas  \r\n\r\n### public ev charging stations\r\n- snapshot for specific time (occupied, available) on a map\r\n- top 3 utilised stations for each canton on a map\r\n- occupation ratio per station on a map\r\n- time-profile clusters --> which stations have the same time-profile\r\n- time-profile in city centers, countryside and touristic regions\r\n- aggregated occupation over time of a day/week for all stations\r\n- occupation over time of a day/week for a selected station\r\n- typically duration of a charging process on a map\r\n\r\n\r\n## Analyses\r\n\r\n### Charging points utilization\r\n\r\nFeatures analysis:\r\n\r\n![extraTreesRegressor](https://raw.githubusercontent.com/magnetilo/energy_hackdays_2020_05_emob_behavior_analysis/master//public_metrics_features_analysis/ExtraTreesRegressor.png)\r\n\r\n\r\nLegend:\r\n\r\n1 | Grosszentren\r\n\r\n2 | Nebenzentren der Grosszentren\r\n\r\n3 | G\u00fcrtel der Grosszentren\r\n\r\n4 | Mittelzentren\r\n\r\n5 | G\u00fcrtel der Mittelzentren\r\n\r\n6 | Kleinzentren\r\n\r\n7 | Periurbane l\u00e4ndliche Gemeinden\r\n\r\n8 | Agrargemeinden\r\n\r\n9 | Touristische Gemeinden\r\n\r\n\r\nOccupied ration distribution:\r\n\r\n![occupied_ratio_distribution](https://raw.githubusercontent.com/magnetilo/energy_hackdays_2020_05_emob_behavior_analysis/master/imgs/occupied_ratio_distribution.png)\r\n\r\nWeekend VS weekdays behaviour for private customers: hourly consumption:\r\n\r\n![hourly_consumption](https://raw.githubusercontent.com/magnetilo/energy_hackdays_2020_05_emob_behavior_analysis/master/imgs/hourly_consumption.png)\r\n\r\nExample of behaviour differences between two private customers: Distribution of the percentage of the whole battery that is charged.\r\n\r\n![percentage_of_max_charge_1](https://raw.githubusercontent.com/magnetilo/energy_hackdays_2020_05_emob_behavior_analysis/master/imgs/percentage_of_max_charge_1.png)\r\n\r\n![percentage_of_max_charge_2](https://raw.githubusercontent.com/magnetilo/energy_hackdays_2020_05_emob_behavior_analysis/master/imgs/percentage_of_max_charge_2.png)\r\n\r\nLoad curve for private customers:\r\n\r\n![ecars_load_curve](https://raw.githubusercontent.com/magnetilo/energy_hackdays_2020_05_emob_behavior_analysis/master/imgs/ecars_load_curve.png)\r\n\r\nOverall energy consumption by private e-cars. This also show the adoption curve. The red zone corresponds to COVID time.\r\n\r\n![total_consumption](https://raw.githubusercontent.com/magnetilo/energy_hackdays_2020_05_emob_behavior_analysis/master/imgs/total_consumption.png)\r\n\r\n","autotext_url":"https://github.com/magnetilo/energy_hackdays_2020_05_emob_behavior_analysis","category_id":"","category_name":"","contact_url":"https://github.com/magnetilo/energy_hackdays_2020_05_emob_behavior_analysis/issues","created_at":"2020-02-26T13:04","download_url":"","event_name":"Energy Data Hackdays 2020","event_url":"https://new-hack.energy.opendata.ch/event/5","excerpt":"(English below)\r\n#Analyse E-Mobilit\u00e4tsverhalten (#5)\r\n##Ziel:\r\nAntworten auf Fragen bez\u00fcglich Mobilit\u00e4ts- und Ladeverhalten in der neuen \u00c4ra der Elektromobilit\u00e4t.\r\n##Idee:\r\n\u00d6ffentliche und historische Daten analysieren, um Klarheit bez\u00fcglich des Themas Elektroautos zu schaffen und Fragen beantworten, wie:\r\n- Wie und wann bewegen sich Menschen heute?\r\n- Wie, wann und wo laden Elektroautofahrer ihre Autos?\r\n- Wie vergleicht sich eine \u00f6ffentliche mit einer privaten Ladestation bez\u00fcglich Nutzung, Nu...","hashtag":"","id":56,"ident":null,"image_url":"https://avatars3.githubusercontent.com/u/10993772?v=4","is_challenge":false,"is_webembed":false,"logo_color":"","logo_icon":"","longtext":"(English below)\r\n#Analyse E-Mobilit\u00e4tsverhalten (#5)\r\n##Ziel:\r\nAntworten auf Fragen bez\u00fcglich Mobilit\u00e4ts- und Ladeverhalten in der neuen \u00c4ra der Elektromobilit\u00e4t.\r\n##Idee:\r\n\u00d6ffentliche und historische Daten analysieren, um Klarheit bez\u00fcglich des Themas Elektroautos zu schaffen und Fragen beantworten, wie:\r\n- Wie und wann bewegen sich Menschen heute?\r\n- Wie, wann und wo laden Elektroautofahrer ihre Autos?\r\n- Wie vergleicht sich eine \u00f6ffentliche mit einer privaten Ladestation bez\u00fcglich Nutzung, Nutzungszeit, Nutzungsdauer usw.?\r\n- \u2026?\r\n##Warum?\r\nDie heutige Situation der Elektromobilit\u00e4t verstehen, so dass man sich die Zukunft vorstellen kann und den ben\u00f6tigten Infrastrukturausbau (Verteilnetz, private Ladeinfrastruktur zu Hause) planen kann.\r\n##Daten:\r\n- Anonymisierte Profile von privaten Ladestationen in Mehrfamilienh\u00e4usern\r\n- Historische Daten von \u00f6ffentlichen Ladestationen aus ich-tanke-strom.ch (10GB Daten Feb. - Aug. 2020)\r\n- \u00d6ffentliche Daten aus anderen Quellen\r\n\r\n#E-Mobility behavior analysis\r\n##Goal:\r\nFind answers to questions regarding mobility and charging behavior in the new era of electric mobility.\r\n##Idea:\r\nAnalyze open and historical data to get a clear understanding of the situation regarding electric cars by answering questions like the following:\r\n- How and when do people move?\r\n- How, when and where do people charge their electric cars?\r\n- How does a public charging station compare to a private one in terms of utilization, time of use etc.?\r\n- \u2026?\r\n\r\n##Big Picture:\r\nUnderstand the present situation regarding electric mobility in order to be able to imagine how the future will look like and plan the infrastructure development needed (electrical distribution grid, charging infrastructure at home) accordingly.\r\n\r\n##Data:\r\n- Anonymized profiles of private charging stations in multi-family homes\r\n- Historical data of public charging stations from ich-tanke-strom.ch (10GB of data from Feb. to Aug. 2020)\r\n- Open data from other sources\r\n\r\n\r\n\r\n---\r\n`28.08.2020 13:24` \r\n\r\n---\r\n`28.08.2020 17:34` mockup for our emobility behaviour dashboard done.\r\n\r\n---\r\n`29.08.2020 13:11` presentation & live demo of our amazing dashboard","maintainer":"nikki_bhler","name":"E-Mobility Behavior Analysis","phase":"Publish","progress":40,"score":105,"source_url":"https://github.com/magnetilo/energy_hackdays_2020_05_emob_behavior_analysis","stats":{"commits":0,"during":10,"people":1,"sizepitch":2166,"sizetotal":8936,"total":10,"updates":9},"summary":"","team":"nikki_bhler, Pradip","team_count":1,"updated_at":"2020-08-31T08:10","url":"https://new-hack.energy.opendata.ch/project/56","webpage_url":"https://github.com/magnetilo/energy_hackdays_2020_05_emob_behavior_analysis/blob/master/README.md#energy-hackdays-2020-group-05-e-mobility-behavior-analysis"},{"autotext":"# Cheapest-Charging-Around-Open-Energy-Data-Hackdays\r\n\r\n# Challenge goal\r\nFurther development of the GIS platform of the Swiss Federal Office of Energy (SFOE): Add price information to the charging stations and find the cheapest option around for electric car drivers.\r\n\r\n# Compile the price information: not so easy at it may seem\r\n## Finding the prices\r\nWhat we needed was of course the list of the prices for every provider coherently compiled and available for comparison.\r\nAt the very beginning we toyed a little with the idea of scraping the provider's websites to harvest the price information. This approach was quickly proved as unfeasible since for many providers the price structure is not even clearly published and, even when it is, each provider present it in its own way or only through their proprietary mobile app.\r\nPublic APIs are not available and we had to scrap that approach too.\r\n\r\nAt the end, we resorted to manually look for and extract the pricing information from the various websites. For time reasons we limited ourselves to three of the biggest providers.\r\n## Price structure consolidation\r\nKWh, per minute, per hour, monthly abo, yearly abo, one-time fee per plug-in, flatrates, roaming... and many permutations of all that. The pricing landscape is obscure and confusing. We thus spent quite a lot of time looking for a way to model this variety and compile it in a single table.\r\n\r\nWe settled for the concept of \"tariff plan\" as our object. Discriminating parameters are the tariff provider, the roaming partner, time of the day, power type and KW at the plug. With such a structure we are able to filter for the chosen plug paramenters and present the user the tariff plans available for that particular plug.\r\nAs far as pricing information goes, we could not really consolidate it to a single measurement unit (ex: chf per KWh) because of the diversity in the pricing structures. Therefore, for each tariff plan we show the price in the same measurement units given by the provider. Because of this, it was also not possible to give the final charge price to the user to fill the battery. In addition, this would require a lot of information about the vehicle that are here out of scope.\r\n\r\n# Main problems\r\nAs already stated, we faced several problems during our data collection and consolidation process.\r\n* The pricing data is not publicly available, or very hard to find.\r\n* Some pricing information is available only to registered customers.\r\n* There is no common denominator across the tariff plans across different providers. And even within the same provider we found often huge differences in price calculations. Comparing the various tariff plans is therefore almost impossible.\r\n* We did not manage to harvest the price structures programmatically and had to resort to manual work.\r\n* The price also depends on the car type (max. kW input, battery volume etc.)\r\n\r\n# Our solution\r\nTo allow a user to compare the available tariff plans for a given charging station we combined the following elements:\r\n* A leaflet webmap. The map uses the publicly available geoJSON from the Federal Spatial Data Infrastructure (FSDI) to visualize the charging stations.\r\n* The freely accessible FSDI API at api.geo.admin.ch to retrieve the full station and plug informations\r\n* Our static table (filled as a google sheet then transformed to JSON for the webapp) with the tariff plans information.\r\n\r\nWhen the user picks a charging station, the application retrieves the ID from the geoJSON and then uses it to make an API call to api.geo.admin.ch. This retrieves all the needed information about the available plugs at the station. The app then filters the tariff table to present the valid plans and the pricing information.\r\n\r\nFilter parameters are:\r\n<table>\r\n  <tr>\r\n    <th></th>\r\n    <th>API result attribute</th>\r\n    <th>Tariff table attribute</th>\r\n  </tr>\r\n  <tr>\r\n    <th>Provider<br>This looks for al the tariff plans valid for the selected station's operator</th>\r\n    <td>OperatorName</td>\r\n    <td>tariff_provier</td>\r\n  </tr>\r\n  <tr>\r\n    <th>KW<br>Some tariff plans depend on the available power at the plug.</th>\r\n    <td>QueryChargingFacilities</td>\r\n    <td>valid_kw</td>\r\n  </tr>\r\n  <tr>\r\n    <th>Time of the day<br>Some tariff plans depend on the time of the day.</th>\r\n    <td>-</td>\r\n    <td>start<br>end</td>\r\n  </tr>\r\n  <tr>\r\n    <th>Power time<br>Some tariff plans depend on power type (AC or DC).</th>\r\n    <td>QueryChargingFacilities</td>\r\n    <td>powertype</td>\r\n  </tr>\r\n</table>\r\n\r\n# Data model of the tariff table\r\nYou can find the table [here](https://docs.google.com/spreadsheets/d/1dw7tkYa0nSNKVkIfXEMOxA0CAAqR0nYDYwAuvXVgSB0/edit#gid=0)\r\n<table>\r\n  <tr>\r\n    <th>Variable name</th>\r\n    <th>Description</th>\r\n  </tr>\r\n  <tr>\r\n    <td>tariff_provier</td>\r\n    <td>String<br>Name of the provider offering this tariff</td>\r\n  </tr>\r\n  <tr>\r\n    <td>roaming_partner</td>\r\n    <td>String<br>Name of the roaming partner for this tariff. Is the same as tariff_provider if not a roaming tariff</td>\r\n  </tr>\r\n  <tr>\r\n    <td>tariff_name</td>\r\n    <td>String<br>Name of the tariff</td>\r\n  </tr>\r\n  <tr>\r\n    <td>valid_kw</td>\r\n    <td>String<br>Comma-separated list of the plug powers using this tariff</td>\r\n  </tr>\r\n  <tr>\r\n    <td>start</td>\r\n    <td>hh:mm:ss<br>Validity start for this tariff plan</td>\r\n  </tr>\r\n  <tr>\r\n    <td>end</td>\r\n    <td>hh:mm:ss<br>Validity end for this tariff plan</td>\r\n  </tr>\r\n  <tr>\r\n    <td>powertype</td>\r\n    <td>String<br>\"AC\", \"DC\" or \"AC, DC\" where the info is not available</td>\r\n  </tr><tr>\r\n    <td>flatrate</td>\r\n    <td>Boolaen<br>Informs if the tariff is a flatrate one (pay once, charge unlimited without additional costs)</td>\r\n  </tr>\r\n  <tr>\r\n    <td>chf_plug-in</td>\r\n    <td>Float<br>Base fee just to plug-in the car, in Swiss Francs for this tariff</td>\r\n  </tr>\r\n  <tr>\r\n    <td>chf_minute</td>\r\n    <td>Float<br>Fee in Swiss Francs per minute plugged in</td>\r\n  </tr>\r\n  <tr>\r\n    <td>chf_kwh</td>\r\n    <td>Float<br>Fee in Swiss Francs per KWh delivered by the plug</td>\r\n  </tr>\r\n  <tr>\r\n    <td>chf_month</td>\r\n    <td>Integer<br>Cost in Swiss Francs of the monthly subscription</td>\r\n  </tr>\r\n  <tr>\r\n    <td>chf_year</td>\r\n    <td>Integer<br>Cost in Swiss Francs of the yearly subscription</td>\r\n  </tr>\r\n</table>\r\n\r\n# Known problems and possible ameliorations\r\nOurs is a rudimentary solution that must be considered as an early-stage POC.\r\n\r\n## The main issues are:\r\n* A static and still rudimentary tariff \"database\"\r\n* Incomplete tariff data\r\n* Data model has to be optimized\r\n* Filter to be revised\r\n* Not integrated with ich-tanke-strom.ch\r\n* Impossible to calculate the total cost of a charge\r\n* Still almost impossible for a user to make meaningful comparisons because of the different price calculations\r\n* Car parking costs are not considered\r\n\r\n## Outlook and needed ameliorations\r\n* Include more operators\r\n* Automatic fetching of updated tariff information\r\n* Integration of the data into ich-tanke-strom.ch\r\n* Integration user data such as car type, battery status, ...\r\n* Integration of parking costs\r\n* Develop a real webapp :smile:\r\n\r\n# Lessons learned\r\n* The data needs to be open, easily and freely accessible in order to develop such an applications\r\n* There is a need for a standard way to describe the costs ot make a meaningful comparison possible\r\n* It is a pleasure to work with the freely available DIEMO data (both the static JSON than via the FSDI API)\r\n* Open Data is nice!\r\n","autotext_url":"https://github.com/BaseCrusher/Cheapest-Charging-Around-Open-Energy-Data-Hackdays","category_id":"","category_name":"","contact_url":"https://github.com/BaseCrusher/Cheapest-Charging-Around-Open-Energy-Data-Hackdays/issues","created_at":"2020-02-05T11:14","download_url":"","event_name":"Energy Data Hackdays 2020","event_url":"https://new-hack.energy.opendata.ch/event/5","excerpt":"Github repo:\r\nhttps://github.com/OpenEnergyData/Cheapest-Charging-Around\r\n\r\n(English below)\r\n#G\u00fcnstigste Ladem\u00f6glichkeit in der Umgebung (#4)\r\n## Ziel\r\nWeiterentwicklung der GIS-Plattform vom Bundesamt f\u00fcr Energie (BFE): Preisinformationen integrieren und die g\u00fcnstigste Ladem\u00f6glichkeit in der N\u00e4he f\u00fcr Elektroautofahrer finden.\r\n\r\n## Idee:\r\nEin Charge Point Operator (CPO) ist eine Firma, die einen Ladestationen-Pool betreibt. Der CPO stellt smarte Ladestationen den E-Mobility Service Providern zu...","hashtag":"","id":57,"ident":null,"image_url":"https://avatars2.githubusercontent.com/u/12885003?v=4","is_challenge":false,"is_webembed":false,"logo_color":"#ffffff","logo_icon":"","longtext":"Github repo:\r\nhttps://github.com/OpenEnergyData/Cheapest-Charging-Around\r\n\r\n(English below)\r\n#G\u00fcnstigste Ladem\u00f6glichkeit in der Umgebung (#4)\r\n## Ziel\r\nWeiterentwicklung der GIS-Plattform vom Bundesamt f\u00fcr Energie (BFE): Preisinformationen integrieren und die g\u00fcnstigste Ladem\u00f6glichkeit in der N\u00e4he f\u00fcr Elektroautofahrer finden.\r\n\r\n## Idee:\r\nEin Charge Point Operator (CPO) ist eine Firma, die einen Ladestationen-Pool betreibt. Der CPO stellt smarte Ladestationen den E-Mobility Service Providern zur Verf\u00fcgung (EMPs). Ein EMP ist eine Firma, die Ladeleistungen den Elektroautofahrern anbietet, z. B. mit einer Zugangskarte zur Identifizierung und Aktivierung des Ladenvorgangs und entsprechenden Ladeabonnements. Der EMP erm\u00f6glicht dem User den Zugang zu einer Auswahl von Ladestationen in einer bestimmten Region. Eine Firma kann beides CPO und EMP sein.\r\nUnterschiedliche EMPs haben unterschiedliche Preise f\u00fcr das Laden an der gleichen Ladestation. Die Idee ist, die g\u00fcnstigste Ladem\u00f6glichkeit f\u00fcr den Kunden eines bestimmten oder mehrerer EMPs zu finden. \r\n\r\n##Warum:\r\nGrosse Preisunterschiede existieren heute zwischen den unterschiedlichen EMP Preisen f\u00fcr das Laden an der gleichen Ladestation. Diese L\u00f6sung soll die Kunden besser informieren und ihnen helfen, die beste Preisoption auszuw\u00e4hlen. Die Transparenz ist erh\u00f6ht und die Market Performance ist verbessert. \r\n\r\n##Data\r\n- Ich-tanke-strom.ch auslesen\r\n- Preisinformationen von EMP/CPO Webseiten auslesen\r\n-  Statistical and availability information available in .json format: https://opendata.swiss/dataset/ladestationen-fuer-elektroautos.\r\n\r\n#Cheapest charging around\r\nE-Mobility - further development of ich-tanke-strom.ch\r\n\r\n## Goal:\r\nFurther development of the GIS platform of the Swiss Federal Office of Energy (SFOE): Add price information to the charging stations and find the cheapest option around for electric car drivers.\r\n\r\n##Idea:\r\nA Charge Point Operator (CPO) is a company operating a pool of charging points. A CPO provides value by connecting smart charging devices to E-Mobility Service Providers (EMPs). An EMP is a company offering an EV charging service to EV drivers. EMPs provide value by enabling access to a variety of charging points around a geographic area. One company can be CPO and EMP at the same time.\r\n\r\nAs a result, at each charging station of a certain CPO pool, different EMPs have different prices. The idea is to find the cheapest charging station around a user according to their EMP subscription(s).\r\n\r\n## Big picture:\r\nBig differences in EMP prices exist at certain charging stations. This solution should help users to choose the best pricing options. Transparency and market performance is increased and the user/consumer is better informed.\r\n\r\n## Data:\r\n- Get information from Ich-tanke-strom.ch\r\n- Get information from EMP/CPO websites\r\n-  Statistical and availability information available in .json format: https://opendata.swiss/dataset/ladestationen-fuer-elektroautos.\r\n\r\nUpdate: Removed old not continued documentation: https://md.schoolofdata.ch/7wV5czYKSb2R6_zJiD8PyA#\r\n\r\n---\r\n`28.08.2020 19:11` ","maintainer":"nikki_bhler","name":"Cheapest Charging Around","phase":"Training","progress":20,"score":93,"source_url":"https://github.com/BaseCrusher/Cheapest-Charging-Around-Open-Energy-Data-Hackdays","stats":{"commits":0,"during":4,"people":0,"sizepitch":3112,"sizetotal":10723,"total":4,"updates":4},"summary":"Weiterentwicklung der BfE-Info-Plattform; \u00abIch tanke Strom.ch\u00bb; Verbesserung der Transparenz","team":"nikki_bhler","team_count":0,"updated_at":"2020-08-31T08:10","url":"https://new-hack.energy.opendata.ch/project/57","webpage_url":"https://md.schoolofdata.ch/7wV5czYKSb2R6_zJiD8PyA#"},{"autotext":"# Analysis and Design of Battery Storage for PV Systems\nChallenge No. 2 @ Energy Data Hackdays 2020\n\nThis repo contain some additional analysis scripts that use the original data files (CSV) provided for the challenge.\n\n# Data\nData on power generation, grid feed, grid supply and overall consumption of three power plants by AEW Energie AG. First time published for the Challenge 3 of Energy Data Hackdays 2020 in Brugg.\nA.csv\nB.csv\nC.csv\n\nFor questions on the data, reach out at https://github.com/zuzfil/PV-optimisation/issues.\n\nThe data were created during the operation of AEW-owned PV plants in 2019. The plants are all located in Aargau, Switzerland. The power values in kW refer to the average over the 15min period.\n\n# License\n\nThis Data Package is made available by its maintainers under the [Public Domain Dedication and License v1.0](http://www.opendatacommons.org/licenses/pddl/1.0/), a copy of the full text of which is in [LICENSE.md](LICENSE.md).\n","autotext_url":"https://github.com/ehackdays/PV-Optimisation","category_id":"","category_name":"","contact_url":"https://app.slack.com/client/TU06FHE4F/C019AS2Q4GM/thread/C019JD0QJJY-1598610327.009400","created_at":"2020-08-28T18:04","download_url":"","event_name":"Energy Data Hackdays 2020","event_url":"https://new-hack.energy.opendata.ch/event/5","excerpt":"With the AEW data of a 60 kWp PV installation, we optimized the solar energy self-consumption by a battery system. For this, we calculated different parameters such as battery load, new self-consumption and new grid supply and estimated the optimal battery capacity with further values such as energy and battery prices, life span, contract duration, minimal charge, maximum load power in Google sheet and as well with Python.\r\n\r\nFinally, our customer can select, whether he wants the most economical...","hashtag":"","id":58,"ident":null,"image_url":"https://avatars0.githubusercontent.com/u/70436568?v=4","is_challenge":false,"is_webembed":false,"logo_color":"","logo_icon":"","longtext":"With the AEW data of a 60 kWp PV installation, we optimized the solar energy self-consumption by a battery system. For this, we calculated different parameters such as battery load, new self-consumption and new grid supply and estimated the optimal battery capacity with further values such as energy and battery prices, life span, contract duration, minimal charge, maximum load power in Google sheet and as well with Python.\r\n\r\nFinally, our customer can select, whether he wants the most economical battery solution or maximise his autarky. Our tools calculate the maximized economic benefit over lifetime.\r\n\r\n## Google Sheet Prototyp\r\n[Create a copy](https://docs.google.com/spreadsheets/d/1do9f6oVBUL3lv-VN8X_TGXpjbetuY68Oa-nTt8-lW0M/copy)\r\n\r\n## Github\r\nhttps://github.com/ehackdays/PV-Optimisation\r\nContains initial Python implementation and some exploratory analysis, see also README below.\r\n\r\n---\r\n`29.08.2020 12:02` ","maintainer":"jonas_huber","name":"PV self-consumption optimization","phase":"Prototype","progress":30,"score":92,"source_url":"https://github.com/ehackdays/PV-Optimisation","stats":{"commits":0,"during":30,"people":2,"sizepitch":923,"sizetotal":1965,"total":30,"updates":28},"summary":"Evaluate and optimize trade-offs in the design of battery storage for PV systems","team":"jonas_huber, Roger, Andreas","team_count":2,"updated_at":"2020-08-29T12:23","url":"https://new-hack.energy.opendata.ch/project/58","webpage_url":"https://docs.google.com/spreadsheets/d/1do9f6oVBUL3lv-VN8X_TGXpjbetuY68Oa-nTt8-lW0M/copy"},{"autotext":"# meterOS - Smart Meter Anomaly Detection\n\nChallenge [#14](https://hack.opendata.ch/project/579): \"Anomaly Detection for Smart Meter Devices\" from the open energy hackdays 2020 (Clemap)\n\nEnergy consumption in buildings and industry is often wasted due to user behaviour, human error, and poorly performing equipment. In this context, identifying abnormal consumption power behavior can be an important part of reducing peak energy consumption and changing undesirable user behavior. With the widespread rollouts of smart meters, normal operating consumption can be learned over time and used to identify or flag abnormal consumption. Such information can help indicate to users when their equipment is not operating as normal and can help to change user behavior or to even indicate what the problem appliances may be to implement lasting changes.\n\nThis challenge is looking for data scientists to apply their skills to an anomaly detection problem using smart meter data. Ideally, such an algorithm should begin to operate after as little as 3 months and should improve over time. A platform to visualise the anomalies would also be useful. Users can select any type of machine learning algorithms that they wish to in order to detect the anomalies from the data.\n\n## Group Members\n\n- Raimund Neubauer\n- Vikram Bhatnagar\n- David Giger\n- Marius Giger\n\nIn Collaboration with \n\n- Manuel Baez\n- Konstantin Golubev\n- Xue Wang\n\nThe pitch can be found `./20200829_meterOS_Energy_Data_Hackdays_2020_Pitch.pptx`.\n\n## \u00a0Data\n\nA sample including smart meter [data](https://www.kaggle.com/portiamurray/anomaly-detection-smart-meter-data-sample) can be found on kaggle. Participants are encouraged to find other smart meter data to work with in order to test their algorithms.\n\nDuring the course of the Hackathon, we have created multiple other anonymised datasets (kindly provided by [Solarify](https://solarify.ch/?lang=en)) that can be found under `./anomaly-detection-model/data`.\n\n## Approach\n\n- Create a basic model to detect anomalies\n- Create a visualization layer to present anomalies\n- Get more data of smart meters and possibly publish the datasets on opendata\n- Implement a flexible architecture to allow the online processing of new data points\n  - Simulate incoming data with the newly acquired datasets\n  - Implement online prediction of anomalies\n  - Implement online learning\n\n![Approach Draft](https://raw.githubusercontent.com/nidDrBiglr/energy-hackdays-anomaly-detection/master/approach.jpg \"Approach Draft\")\n\n## Implementation\n\n![Architecture](https://raw.githubusercontent.com/nidDrBiglr/energy-hackdays-anomaly-detection/master/MeterOS.png \"Architecture\")\n\nWe have implemented a scalable architecture, based on the following components:\n- Smart Meter Simulator based on Iotify\n- Meter-Service: Microservice that receives, processes, stores and exposes meter data\n- Meter-UI (meterOS): UI to display meter data and anomalies\n- Anomaly-Detector: Running App with deployed Anomaly Detector model (Thanks to Konstantin Golubev, Manuel Baez, Xue Wang)\n- Kafka Data Stream for real time processing\n\n## Model Selection\n\nOur approach is to combine expert knowhow and statistical models to detect anomalies. Further, for us to understand if our model has produced useful outputs, anomalies should be labelled based on a predefined set of characteristics (e.g. peak energy consumption, high baseload etc.).\n\n### Expert Model\n\nTo find out what a human would consider as an anomaly, we did an extensive analysis on a smart meter dataset: `./anomaly-detection-model/Manual_Anomaly_Detection_V3.docx`.\n\nVery simple cases of anomalies should actually be detected using expert knowhow. For this, we defined a standardised expert model based on historic data:\n\n1) Structure load curve on weekly basis\n\nPossible Features:\n\n- Baseload (especially during weekends)\n  - total baseload\n  - delta baseload\n- Fast Fourier Transform (Frequency Analysis)\n  - small variance in amplitude is good for energy producer\n- Gradient might be interesting, because it might indicate unusual increases in energy consumption\n- Negative values\n- Zero values\n\n### Stats/ML-based \n\nA more sophisticated ML/Stats-based model should be used to find unusual patterns, that are hard to detect by static rules and therefore might not be easily quantifiable by experts.\n\n**Models**\n\nWe have tried the following models:\n\n- **Isolation Forest**: Isolation Forest detects anomalies purely based on the fact that anomalies are data points that are few and different.\n\n![IsolationForest.png](https://raw.githubusercontent.com/nidDrBiglr/energy-hackdays-anomaly-detection/master/IsolationForest.png \"IsolationForest.png\")\n\n- **One Class SVM**: Unsupervised Outlier Detection based on a Support Vector Machine. It is known to be sensitive to outliers.\n\n![OneClassSVM.png](https://raw.githubusercontent.com/nidDrBiglr/energy-hackdays-anomaly-detection/master/OneClassSVM.png \"OneClassSVM.png\")\n\n- **ARIMA Model**: Time-series forecasting model and analysis of the prediction deviation. Also possible to spot patterns accross time. \n\n![ARIMA.png](https://raw.githubusercontent.com/nidDrBiglr/energy-hackdays-anomaly-detection/master/ARIMA.png \"ARIMA.png\")\n![ARIMA1.png](https://raw.githubusercontent.com/nidDrBiglr/energy-hackdays-anomaly-detection/master/ARIMA1.png \"ARIMA1.png\")\n\n- **Monte Carlo Model**: Frequency analysis of kWh values. Monte Carlo Approach -- call single reading of a meter anomalous if it hasn't appeared often in the past. Blazingly Fast (can run on Raspberry Pi), Adaptive, Easy to tune. Not able to detect patterns that span accross time.\n\nA possible way forward could be to implement different models for different temporal patterns:\n\n- Minutely/Hourly Model (Online) --> Predictive Model\n- Daily Model (Historic)\n- Weekly Model (Historic)","autotext_url":"https://github.com/nidDrBiglr/energy-hackdays-anomaly-detection","category_id":"","category_name":"","contact_url":"https://github.com/nidDrBiglr/energy-hackdays-anomaly-detection/issues","created_at":"2020-08-28T12:52","download_url":"","event_name":"Energy Data Hackdays 2020","event_url":"https://new-hack.energy.opendata.ch/event/5","excerpt":"**Demo:** https://meteros.staging.akenza.io/\r\n\r\n---\r\n`28.08.2020 12:54` \r\nProject scope has been defined and work has been started\r\n\r\n---\r\n`28.08.2020 19:54` \r\nWe have deployed a very first version to a k8s cluster which can be viewed here: https://meteros.staging.akenza.io/\r\n\r\nThe backend still needs some work though, the frontend does not query the data from the backend yet\r\n\r\n---\r\n`28.08.2020 23:25` \r\nWe drafted definitions of anomalies (human definitions) and meter data is sent to the cloud ...","hashtag":"","id":59,"ident":null,"image_url":"https://raw.githubusercontent.com/nidDrBiglr/energy-hackdays-anomaly-detection/master/meter-ui/src/assets/logo.png","is_challenge":false,"is_webembed":true,"logo_color":"","logo_icon":"","longtext":"**Demo:** https://meteros.staging.akenza.io/\r\n\r\n---\r\n`28.08.2020 12:54` \r\nProject scope has been defined and work has been started\r\n\r\n---\r\n`28.08.2020 19:54` \r\nWe have deployed a very first version to a k8s cluster which can be viewed here: https://meteros.staging.akenza.io/\r\n\r\nThe backend still needs some work though, the frontend does not query the data from the backend yet\r\n\r\n---\r\n`28.08.2020 23:25` \r\nWe drafted definitions of anomalies (human definitions) and meter data is sent to the cloud where it is processed and stored along with various improvements to the UI. The current state can be checked at the project link.\r\n \r\nThe API and online processing of the data (live detection of anomalies) is still to be implemented.\r\n\r\n---\r\n`29.08.2020 12:38` \r\nThe last finishing touches are being applied. Forecasts have been removed from scope due to time restrictions.","maintainer":"nidDrBiglr","name":"Smart Meter Anomaly Detection","phase":"Prototype","progress":30,"score":88,"source_url":"https://github.com/nidDrBiglr/energy-hackdays-anomaly-detection","stats":{"commits":0,"during":4,"people":0,"sizepitch":873,"sizetotal":6787,"total":4,"updates":4},"summary":"Challenge #14: \"Anomaly Detection for Smart Meter Devices\" from the open energy hackdays 2020","team":"nidDrBiglr","team_count":0,"updated_at":"2020-08-31T08:19","url":"https://new-hack.energy.opendata.ch/project/59","webpage_url":"https://www.youtube.com/embed/tHPd631CEBU"},{"autotext":"","autotext_url":"https://www.figma.com/proto/b0tYMzO51sRp4McNm7A8qF/Open-Energy-Hackdays?node-id=16%3A46&scaling=min-zoom","category_id":"","category_name":"","contact_url":"https://openenergydat-ehr6560.slack.com/archives/C019AS8NQP7","created_at":"2020-08-29T08:10","download_url":"","event_name":"Energy Data Hackdays 2020","event_url":"https://new-hack.energy.opendata.ch/event/5","excerpt":"(Challenge #7)\r\n\r\nNovel energy certificate assesses where and how strongly building / user behaviour causes deviation from theoretical/optimum behaviour.\r\n\r\n\ud83d\udcad _What problem are you solving?_\r\n\r\nEmpowering people to understand what they can do to take action against climate change.\r\n\r\n\ud83d\udca1 _How are you solving that problem?_\r\n\r\nMonitoring of people\u2019s energy consumption, with the implementation of a rating system to understand how good they and the building they are living in are. Personalized inform...","hashtag":"","id":60,"ident":null,"image_url":"","is_challenge":false,"is_webembed":true,"logo_color":"","logo_icon":"","longtext":"(Challenge #7)\r\n\r\nNovel energy certificate assesses where and how strongly building / user behaviour causes deviation from theoretical/optimum behaviour.\r\n\r\n\ud83d\udcad _What problem are you solving?_\r\n\r\nEmpowering people to understand what they can do to take action against climate change.\r\n\r\n\ud83d\udca1 _How are you solving that problem?_\r\n\r\nMonitoring of people\u2019s energy consumption, with the implementation of a rating system to understand how good they and the building they are living in are. Personalized information about what they can do to improve themselves is then presented. For example: for additional x Fr./month, get 100% electricity from renewable sources and move to category A.\r\n\r\n\ud83d\uddfd _What have you achieved during the Hackdays?_\r\n\r\nA new business concept for smart meter data.\r\n\r\n\ud83d\udcee _Include links to source code or prototypes._\r\n\r\nhttps://www.figma.com/proto/b0tYMzO51sRp4McNm7A8qF/Open-Energy-Hackdays?node-id=16%3A46&scaling=min-zoom\r\n\r\n\ud83d\udcce _Indicate any relevant terms or licenses on your work._\r\n\r\nLive or frequently updated and historic smart meter data.\r\n\r\n\ud83c\udfa2 _What issues have you encountered, for example in regards to the data you wanted to use?_\r\n\r\nChoosing the most impactful customer, addressing the exact issue which is tackled by our solution. \r\nData will most probably not come from one unique source, but from a variety of sources. \r\nThe users should authorize data hosters to use their data.\r\n\r\n\ud83d\udcb9 _Which data have you used? Format\u2026? Permissions?_\r\n\r\nFinding business partners, implementing the new certificate, and build a solid user base.- Federal office of energy/statistics (public data), \r\n\r\n- VSE Homepage (public data)\r\n- Customer segmentation data from City Energy Provider of St. Gallen (confidential)\r\n- Smart meters data (from public utilities)\r\n- Building characteristics (from Building and Dwelling register)\r\n- Weather data\r\n\r\n\ud83d\uddfb _What are the next steps?_\r\n\r\nFinding business partners, implementing the new certificate, and build a solid user base.\r\n\r\n\ud83d\udc81 _Who are you and your team mates, and how can you best be contacted?_\r\n\r\nClara Esteve, Jeremias Rehn, Philipp Sch\u00fctz, Wim Ton, Holger Wache\r\n\r\n---\r\n`29.08.2020 12:36` Initial project release","maintainer":"Eclara","name":"Empower the People with Smart Meter Data","phase":"Publish","progress":40,"score":81,"source_url":"https://www.figma.com/proto/b0tYMzO51sRp4McNm7A8qF/Open-Energy-Hackdays?node-id=16%3A46&scaling=min-zoom","stats":{"commits":0,"during":14,"people":3,"sizepitch":2172,"sizetotal":2172,"total":14,"updates":10},"summary":"","team":"Eclara, holger.wache, schutz","team_count":3,"updated_at":"2020-08-31T08:10","url":"https://new-hack.energy.opendata.ch/project/60","webpage_url":"https://speakerdeck.com/player/0cacae97d6ca448198462d89af0ae68a?title=false&skipResize=true"},{"autotext":"# Optimierung von Fernw\u00e4rmeverb\u00fcnden\n\n## Herausforderung - Challenge\n\n[DE]\n\nHeizen macht \u00fcber 40% des schweizerischen Energie-Endverbrauchs aus. Fernw\u00e4rmeverb\u00fcnde erm\u00f6glichen das Ausrollen von W\u00e4rme auf Basis erneuerbarer Energien; sie sind ein wesentlicher Bestandteil der Energiestrategie 2050. \n\nDie AEW als Betreiber von mehr als 80 Fernw\u00e4rmeverb\u00fcnden sieht durch diese Challenge eine sehr gute M\u00f6glichkeit der Replizierbarkeit.\n\n**Ziele**\n\n1. Energieverbrauch von Fernw\u00e4rme-Zentralen allgemein minimieren (Prim\u00e4renergieeinsatz). \n2. Einsatz von Spitzenlast-Kesseln minimieren. Typischerweise verwenden diese Kessel fossilen Brennstoffen, w\u00e4hrend der Haupt-Kessel erneuerbare Energien verwendet.  \n\n**L\u00f6sungsansatz** \n\n- Lastprognosen auf Basis von historischen Verbrauchsdaten, Wetterdaten, etc projizieren.\n- Leistungs-Scheduling innerhalb des Verbundes unter Ausnutzung der thermischen Masse der belieferten Objekte oder Einsatz von verteilten kleineren Zwischenspeichern.\n\n\n[EN] \n\nHeating accounts for more than 40% of Switzerland\u2019s final energy consumption. District heating networks facilitate deploying renewable heating on scale and are an essential part of Switzerland's Energy Strategy 2050. \n\nAEW as operator of more than 80 district heating networks sees a very good opportunity for replicability for this challenge.\n\n**Goals**\n\n1. Minimize the energy consumption of disctrict heating plants (primary energy use) \n2. Minimize the use of peak load boilers. These boilers typically use fossil fuels, while the main boiler uses an renewable energy source.\n\n**Solution** \n\n- Load forecasts based on historical consumption data, weather data, etc.\n- Performance scheduling within the network by exploiting the thermal mass of the supplied objects or using distributed smaller intermediate storage facilities.\n\n\n## Prototyp \n\n#### Anforderungen\n\nAllgemein: \n\n- **F\u00fcr wen**: Steuerungssystem einer Fernw\u00e4rmeanlage, die von einem erneuerbaren Energiequelle (z.B. Holzkessel) betrieben wird, sowie zus\u00e4tzlich bei Bedarf einen oder mehrere fossile Kessel (z.B. Gas). \n- **Was**: Eine Prognose der ben\u00f6tigten Gesamtleistung (in kW) f\u00fcr jede Stunde der n\u00e4chsten 24h, abh\u00e4ngig von der meteoroligischer Prognose f\u00fcr die Aussentemperatur\nund weiteren relevanten Parametern\". \n- **Wieso**: Damit das Steuerungssystem 1) m\u00f6glichst wenig Energie insgesamt verbraucht, und 2) auf den Einsatz der fossilen Quellen verzichten kann. Das Ziel ist, dass m\u00f6glichst nur das Zusammenspiel des Holzkessels und des Speichers (eine Art grosser Boiler) ben\u00f6tigt werden, um die W\u00e4rmebed\u00fcrfnisse zu decken\n\nDetailliert: \n\n*1. Als AEW m\u00f6chten wir wissen, wieviel kW/h an Gaskessel-produzierte W\u00e4rme wir pro Jahr durch die Leistungsprognose h\u00e4tten sparen k\u00f6nnen, um zu entscheiden ob es einen bedeutenden Einfluss auf die Klimaziele h\u00e4tte.*\n\n--> TO DO\n\n*2. Als Betriebsingenieur brauche ich eine Prognose der ben\u00f6tigten Gesamtleistung (in kW) f\u00fcr jede Stunde der n\u00e4chsten 24h, damit ich sie visualisieren kann.* \n\n--> IN PROGRESS: Ans\u00e4tze und erste Prognosen DONE, Optimierung und Komplettierung relevante Input-Variablen TO DO\n\n*3. Als Data Scientist will ich wissen, welche Wetter-Faktoren aufgrund der historischen Daten die ben\u00f6tigte Gesamtleistung (in kW) beteutend beinflussen (z.B. neben der Aussentemperatur auch die globale Strahlung, Windst\u00e4rke, Luftfeuchtigkeit,...), damit ich die richtigen Input-Daten f\u00fcr die Prognose w\u00e4hle*\n\n--> IN PROGRESS\n\n*4. Als Data Scientist will ich die fixe Betriebszeiten von Kunden-Boilers aus Verbrauchsdaten erkennen, damit ich diesen Input der Leistungs-Prognose hinzuf\u00fcgen kann*\n\n--> DONE:  Included in load forecast\n\n\n#### Results\n\nDownload the [final presentation (pptx)](https://github.com/district-heating-2020/data_analysis/blob/master/pitch/01%20pitch%20rev01.pdf?raw=true) for an overview of the results achieved.  \n\n\n#### Datenquellen - Data sources\n\n[DE]\n\n- [Verbrauchs- und Erzeugungsdaten eines Dorf-Fernw\u00e4rmenetzes mit 9 Abnehmern](https://github.com/district-heating-2020/data_analysis/tree/master/data/energy): 2 Jahren (2018-2019), alle 5 Minuten\n- [Historische Wetterdaten f\u00fcr die Region](https://github.com/district-heating-2020/data_analysis/tree/master/data/weather)\n\n[EN] \n\n- [Production and usage data of an existing distric heating network for 9 client buildings](https://github.com/district-heating-2020/data_analysis/tree/master/data/energy): 2 years (2018-2019), every 5 minutes \n- [Historical weather data for the area](https://github.com/district-heating-2020/data_analysis/tree/master/data/weather)\n\n#### Team\n\n- Toni Wietlisbach, AEW --> Fernw\u00e4rme\n- [Andy Gubser](https://github.com/andygubser) --> Data science\n- [Martin Horeni](https://github.com/Martin1877) --> Data Science\n- [Marvin Grass](https://github.com/anywherealocal) --> Data Science\n- Wolfram Willuhn\n- [Emilie Boillat](https://github.com/boillat) --> Dokumentation\n\n[Energy Hack Days 2020](https://hack.opendata.ch/event/31)\n\n\n## Weitere Schritte - Next Steps\n\n#### Integration ins Leitsystem\n\n- Recommender: Speicher jetzt entladen oder f\u00fcllen?\n- Recommender: Wie viel W\u00e4rme soll der Holzkessel jetzt produzieren? \n- Recommender: Soll der \u00d6lkessel (Nr. 6) \"abgeworfen\" werden? \n\n\n#### Weitere potentielle Datenquellen\n- Kalenderdaten (Feiertage, Ferienzeit, \u2026)\n- Kenndaten/Modelldaten Fernw\u00e4rmesysteme\n- Geodaten (Fernw\u00e4rmenetz, W\u00e4rmebedarf, W\u00e4rmequelle, \u2026)\n- [HSLU Programm \"Thermische Netze\"](https://www.energieschweiz.ch/page/de-ch/thermische-netze): seems relevant, but is out of date\n- [Statistics from Germany](https://de.statista.com/statistik/daten/studie/166824/umfrage/verbrauch-von-fernwaerme-in-deutschland/)\n\n\n## Beschreibung Beispiel-Fernw\u00e4rmeverbund\n\nEin Fernw\u00e4rmeerzeuger kann an wenige bis zu 1000 Geb\u00e4ude W\u00e4rme verteilen, je nach Gr\u00f6sse der Anlage. Die W\u00e4rmequelle kann z.B. eine W\u00e4rmepumpe, Kehrrichtverbrennungsanlage, oder ein Holzkessel sein. \n\nIn unserem Data Sample geht es um ein Dorf-Fernw\u00e4rmeverbund mit 9 Kunden (darunter Gewerbe, Schulhaus, Gemeindehaus).\n\n![Fernleitungs-Plan](https://github.com/district-heating-2020/data_analysis/blob/master/doc/pictures/Fernleitungsplan-Auszug.png?raw=true)\n\n#### Heizzentrale\n\n![Heizzentrale](https://github.com/district-heating-2020/data_analysis/blob/master/doc/pictures/Heat-station.png?raw=true)\n\n* Der Holzkessel produziert in der Regel die W\u00e4rme (kann auf ca 30%-100% seiner Kapazit\u00e4t laufen oder ausgeschaltet sein)\n* Die zwei Gaskessel werden bei Bedarf eingeschlatet um eine Spitzenlast zu decken. Sie dienen auch als Redundanz, sollte der Holzkessel ausfallen. \n* Der Speicher bekommt unten abgek\u00fchltes Wasser zur\u00fcck aus dem Netz, oben warmes Wasser aus den W\u00e4rmeerzeugern. Er kann je nach Bedarf W\u00e4rme speichern oder abgeben. Er hat allerdings keine unbegrenzte Kapazit\u00e4t (also z.B muss der Holzkessel runterfahren, bevor der Speicher voll wird). \n\n**Daten:**\n\n* Gelb markiert = W\u00e4rmez\u00e4hlerdaten (reine Messdaten)\n* Weiss markiert = Leitsystemdaten (zur Steuerung)\n* Grau markiert = Soll-daten vom Leistsystem (zur Steuerung)\n\nDie Zieltemperraturen (Soll Gesamtzentrale z.B. 85.0\u00b0C, Soll W\u00e4rmekessel z.B. 93.1\u00b0C) werden gerechnet anhand der momentanen Aussentemperatur. \nW\u00e4rmekessel: auch gerechnet anhand der Aussentemperatur\n\n**Systemsteuerung:**\n\nZur Zeit steuert das Leitsystem die Kessel und den Speicher aufgrund der momentanen Aussentemperaturen. Er \"weiss\" sozusagen nicht, was in einigen Stunden passiert. \n\nBeispielsweise kann es in der \u00dcbergangszeit zu suboptimalen Spitzen kommen: am Nachmittag scheint die Sonne und der Holzkessel ist ausgeschaltet; der Speicher reicht nicht mehr um die kalte Nacht zu decken. Der Gaskessel wird eingeschlatet, obwohl der Holzkessel alleine h\u00e4tte locker reichen k\u00f6nnen, wenn nachmittags mehr gespeichert worden w\u00e4re. \n\n\n![Holzkessel](https://github.com/district-heating-2020/data_analysis/blob/master/doc/pictures/Holzkessel_400px.JPG?raw=true)\n![Speicher](https://github.com/district-heating-2020/data_analysis/blob/master/doc/pictures/Speicher_400px.JPG?raw=true)\n![W\u00e4rme\u00fcbergabestation (gross)](https://github.com/district-heating-2020/data_analysis/blob/master/doc/pictures/W%C3%A4rme%C3%BCbergabestation_gross_400px.jpg?raw=true)\n![W\u00e4rme\u00fcbergabestation (klein)](https://github.com/district-heating-2020/data_analysis/blob/master/doc/pictures/W%C3%A4rme%C3%BCbergabestation_klein_400px.jpg?raw=true)\n\nVon links nach rechts: Holzkessel, Speicher, grosse W\u00e4rme\u00fcbergabestation, kleine W\u00e4rme\u00fcbergabestation\n\n#### Kunden\n\n![W\u00e4rmeverbund-Netzplan](https://github.com/district-heating-2020/data_analysis/blob/master/doc/pictures/W%C3%A4rmeverbund-Netzplan.png?raw=true)\n\nAuf dem Netzplan wird pro Kunde die maximale Leistung (in kW) angegeben.\n\nIm Mittelland bedeutet diese maximale Leistung: wieviel Energie braucht es, um die Raumtemperatur auf 20\u00b0C zu heizen wenn die Aussentemperatur 8\u00b0C betr\u00e4gt.\n\n- Kunde Nr 1: Gewerbe\n- Kunde Nr 2: Schulhaus\n- Kunde Nr 3: Schulhaus\n- Kunde Nr 4: Gemeindehaus\n- Kunde Nr 5: Turnhalle / Mehrzweckhalle\n- Kunde Nr 6: Gewerbe (Betrieb)\n- Kunde Nr 7: Gewerbe (B\u00fcro)\n- Kunde Nr 8: Gewerbe\n- Kunde Nr 9: Gewerbe\n\n**Faktoren hinter den W\u00e4rme-Bedarf**\n\n* Aussentemperatur\n* Zeiten, an denen die individuellen Boiler der Kunden angestellt werden. Normalerweise regelm\u00e4ssig. Kann man bedingt beinflussen mit Fernsteuerung. \n* Globale Strahlung (Erw\u00e4rmung durch Fenster)\n* Wind (k\u00fchlt ab) \n* Luftfeuchtigkeit \n* Industrie-Geb\u00e4ude abkoppeln: Bei einer St\u00f6rung kann der Kunde Nr. 6 abgekoppelt werden (eigene \u00d6lheizung vorhanden). Von der \u00d6kobilanz her sind die Gaskessel aber klar besser als die individuelle \u00d6lheizung. \n \n","autotext_url":"https://github.com/district-heating-2020/data_analysis","category_id":"","category_name":"","contact_url":"https://github.com/district-heating-2020/data_analysis/issues","created_at":"2020-01-14T13:20","download_url":"","event_name":"Energy Data Hackdays 2020","event_url":"https://new-hack.energy.opendata.ch/event/5","excerpt":"Challenge  #1","hashtag":"","id":61,"ident":null,"image_url":"https://github.com/district-heating-2020/data_analysis/blob/master/doc/pictures/Speicher.JPG?raw=true","is_challenge":false,"is_webembed":false,"logo_color":"#0068b5","logo_icon":"","longtext":"Challenge  #1","maintainer":"nikki_bhler","name":"Optimization of District Heating","phase":"Training","progress":20,"score":77,"source_url":"https://github.com/district-heating-2020/data_analysis","stats":{"commits":0,"during":22,"people":1,"sizepitch":13,"sizetotal":9723,"total":22,"updates":21},"summary":"Energieverbrauch von Fernw\u00e4rmeanlagen minimieren, insb. der Einsatz von Spitzenlast-Kesseln (fossile Brennstoffen)","team":"nikki_bhler, Toni W","team_count":1,"updated_at":"2020-09-02T13:19","url":"https://new-hack.energy.opendata.ch/project/61","webpage_url":"https://github.com/district-heating-2020/data_analysis/blob/master/pitch/01%20pitch%20rev01.pdf"},{"autotext":"","autotext_url":"","category_id":"","category_name":"","contact_url":"","created_at":"2020-02-05T11:33","download_url":"","event_name":"Energy Data Hackdays 2020","event_url":"https://new-hack.energy.opendata.ch/event/5","excerpt":"## Big picture: (Challenge #6)\r\nIntegrated Energy System models produce a large amount of results, with a wealth of information. There need to be interactive tools to explore this data by drilling down the data sets. \r\n\r\n## Idea:\r\nBased on databases containing the results, a concept for the visualisation (including data plots/charts) as well as the actual implementation with modern and open-source web publishing and programming tools has to be implemented. It might also be used to display input ...","hashtag":"","id":62,"ident":null,"image_url":"","is_challenge":false,"is_webembed":true,"logo_color":"","logo_icon":"","longtext":"## Big picture: (Challenge #6)\r\nIntegrated Energy System models produce a large amount of results, with a wealth of information. There need to be interactive tools to explore this data by drilling down the data sets. \r\n\r\n## Idea:\r\nBased on databases containing the results, a concept for the visualisation (including data plots/charts) as well as the actual implementation with modern and open-source web publishing and programming tools has to be implemented. It might also be used to display input parameters.\r\n\r\n## We provide:\r\n- Our knowledge and help\r\n- Flexibility to choose a focus\r\n- Clearly defined questions\r\n- Cleaned and structured data \r\n- Established Python-based framework\r\n- Opportunity to see your idea in production soon\r\n## We expect:\r\nYour creativity!\r\n\r\n## Current framework:\r\n(not restrictive):\r\n- Python\r\n- Plotly\r\n- CSV\r\n\r\n\r\n---\r\n`29.08.2020 09:07` \r\nNew landing Page with Scenario overview\r\nUI Improvements:\r\n- Dynamic triggered graphs.\r\n- Immediate trigger of Graph plot on change of parameters or scenario\r\n- Moving Scenario Tabs to center page\r\n\r\n---\r\n`29.08.2020 12:42` \r\nPrototype finished - ready for presentation.","maintainer":"nikki_bhler","name":"Energy data visualization","phase":"Prototype","progress":30,"score":70,"source_url":"","stats":{"commits":0,"during":10,"people":1,"sizepitch":1145,"sizetotal":1225,"total":10,"updates":9},"summary":"Energy data are diverse. How do we present them interactively and informatively?","team":"nikki_bhler, samuele.allegranza","team_count":1,"updated_at":"2020-08-31T08:09","url":"https://new-hack.energy.opendata.ch/project/62","webpage_url":"https://demo.codimd.org/s/SJ2pyTD7D#"},{"autotext":"","autotext_url":"","category_id":"","category_name":"","contact_url":"https://openenergydat-ehr6560.slack.com/archives/C01A232S53J","created_at":"2020-02-05T12:14","download_url":"","event_name":"Energy Data Hackdays 2020","event_url":"https://new-hack.energy.opendata.ch/event/5","excerpt":"<a href=\"https://youtu.be/WytZIBLyw_M?t=10775\" class=\"btn btn-lg btn-danger\">Recording</a>\r\n<a href=\"https://slack-files.com/TU06FHE4F-F01A3Q3U5H7-a56c77bd18\" class=\"btn btn-lg btn-warning\">Slides</a>\r\n<a href=\"#english\" class=\"btn btn-lg btn-dark\">In English</a>\r\n\r\n## Ziel: (Challenge #8)\r\n\r\n- Entwicklung von Machine Learning-Algorithmen (oder Tools/Apps) f\u00fcr verbesserte standortspezifische Leistungsprognosen von Windenergieanlagen. \r\n- Entwicklung von alternativen Algorithmen z.B. Artificial N...","hashtag":"","id":63,"ident":null,"image_url":"","is_challenge":false,"is_webembed":false,"logo_color":"","logo_icon":"","longtext":"<a href=\"https://youtu.be/WytZIBLyw_M?t=10775\" class=\"btn btn-lg btn-danger\">Recording</a>\r\n<a href=\"https://slack-files.com/TU06FHE4F-F01A3Q3U5H7-a56c77bd18\" class=\"btn btn-lg btn-warning\">Slides</a>\r\n<a href=\"#english\" class=\"btn btn-lg btn-dark\">In English</a>\r\n\r\n## Ziel: (Challenge #8)\r\n\r\n- Entwicklung von Machine Learning-Algorithmen (oder Tools/Apps) f\u00fcr verbesserte standortspezifische Leistungsprognosen von Windenergieanlagen. \r\n- Entwicklung von alternativen Algorithmen z.B. Artificial Neural Networks\r\n\r\n##Idee:\r\nDie genaue Vorhersage der Stromproduktion einer Windkraftanlage an einem bestimmten Standort ist sowohl in der Planungs- als auch in der Betriebsphase wichtig, aber die standardm\u00e4\u00dfige Methode zur Speicherung von Leistungskurven ist nicht spezifisch f\u00fcr die atmosph\u00e4rischen Bedingungen am Standort und kann daher ungenau sein. Das Ziel dieser Herausforderung ist die Entwicklung eines Algorithmus f\u00fcr maschinelles Lernen, um die Genauigkeit der standortspezifischen Leistungskurvenvorhersage zu verbessern. Dazu wird Ihnen ein Datensatz von 8'000 simulierten Leistungen der NREL 5MW-Referenzwindturbine aus dem Simulationswerkzeug ASHES bei verschiedenen atmosph\u00e4rischen Bedingungen zur Verf\u00fcgung gestellt. Dieser neue Algorithmus k\u00f6nnte in einem zuk\u00fcnftigen Innovationsprojekt zu einem Werkzeug f\u00fcr Windparkbetreiber entwickelt werden.\r\n\r\n##Daten:\r\n\r\n- Ein Datensatz von 8'000 simulierten Leistungen der NREL 5MW-Referenzwindturbine aus dem Simulationswerkzeug ASHES bei verschiedenen atmosph\u00e4rischen Bedingungen  wird zur Verf\u00fcgung gestellt. \r\n\r\n<a name=\"english\"></a>\r\n\r\n#Machine Learning Wind Turbine Power Curve Prediction\r\n## Goal:\r\n- Development of machine learning algorithms (or tools/aps) for improved site-specific performance prediction of wind turbines.\r\n- Development of alternative algorithms e.g. Artificial Neural Networks\r\n\r\n## Idea:\r\nThe accurate prediction of the power production of a wind turbine at a particular site is important in both the planning and operation phases, but the standard power curve binning method is not specific to the atmospheric conditions at the site and can therefore be inaccurate. The goal of this challenge is to develop a machine learning algorithm in order to improve site-specific power curve prediction accuracy. \r\n\r\nThis new algorithm could be developed into a tool for wind farm operators in a future innovation project.\r\n\r\n##Data\r\nFor this challenge, you will be provided with a dataset of 8'000 simulated powers of the NREL 5MW reference wind turbine from the simulation tool ASHES at a range of different atmospheric conditions.\r\n\r\nDownload data here: https://github.com/sarah-barber/powercurve/tree/master\r\n\r\n---\r\n`29.08.2020 10:54`  Project updated","maintainer":"nikki_bhler","name":"ML Wind Power-Prediction ","phase":"Prototype","progress":30,"score":63,"source_url":"https://md.schoolofdata.ch/kecN4QN2RdWcDVQaqkH5wA?view","stats":{"commits":0,"during":2,"people":0,"sizepitch":2736,"sizetotal":2736,"total":2,"updates":2},"summary":"","team":"nikki_bhler","team_count":0,"updated_at":"2020-08-31T10:48","url":"https://new-hack.energy.opendata.ch/project/63","webpage_url":""},{"autotext":"","autotext_url":"","category_id":"","category_name":"","contact_url":"https://openenergydat-ehr6560.slack.com/archives/CUZCQRP6U","created_at":"2020-03-07T16:52","download_url":"","event_name":"Energy Data Hackdays 2020","event_url":"https://new-hack.energy.opendata.ch/event/5","excerpt":"<a class=\"btn btn-large btn-success\" href=\"https://speakerdeck.com/loleg/know-the-neighbourhood-of-your-customer\">Slides</a>\r\n<a class=\"btn btn-large btn-warning\" href=\"http://bit.ly/swiss-hack-2020\">Demo</a>\r\n<a class=\"btn btn-large btn-danger\" href=\"https://youtu.be/QgXOQBmFKPs?t=2788\">\u25baPitch</a>\r\n\r\n<div class=\"alert alert-primary\" role=\"alert\"><i>This project was worked on during the <a href=\"https://blog.datalets.ch/066/\">virtual Hackdays in March</a>. / An diesem Projekt wurde w\u00e4hrend der <...","hashtag":"","id":64,"ident":null,"image_url":"","is_challenge":false,"is_webembed":true,"logo_color":"","logo_icon":"","longtext":"<a class=\"btn btn-large btn-success\" href=\"https://speakerdeck.com/loleg/know-the-neighbourhood-of-your-customer\">Slides</a>\r\n<a class=\"btn btn-large btn-warning\" href=\"http://bit.ly/swiss-hack-2020\">Demo</a>\r\n<a class=\"btn btn-large btn-danger\" href=\"https://youtu.be/QgXOQBmFKPs?t=2788\">\u25baPitch</a>\r\n\r\n<div class=\"alert alert-primary\" role=\"alert\"><i>This project was worked on during the <a href=\"https://blog.datalets.ch/066/\">virtual Hackdays in March</a>. / An diesem Projekt wurde w\u00e4hrend der <a href=\"https://blog.datalets.ch/066/\">virtuellen Ausgabe im M\u00e4rz</a> gearbeitet.</i></div>\r\n\r\nNote: demo works however only for the Germany Nord Rhein Westfallia (Cologne, Dusseldorf, Munster and so on)\r\n\r\n# Challenge\r\n\r\n**Kundensegmentierung/-Analyse auf Basis offener Daten vs Daten eines Energieversorgungsunternehmens**. Beispiele haben bereits gezeigt, dass eine Kundenanalyse/Kundensegmentierung auf Basis offener Daten bereits m\u00f6glich ist und es keine Kundendaten mehr ben\u00f6tigt. Ist dem so und wenn ja, wie sieht es aus?\r\n\r\n","maintainer":"oleg","name":"LocationAI","phase":"Prototype","progress":30,"score":58,"source_url":"","stats":{"commits":0,"during":0,"people":0,"sizepitch":1028,"sizetotal":1067,"total":0,"updates":0},"summary":"Know the neighbourhood of your customer","team":"oleg","team_count":0,"updated_at":"2020-08-24T15:36","url":"https://new-hack.energy.opendata.ch/project/64","webpage_url":"https://speakerdeck.com/player/f1690cba5b484d3585aa0ddc19f25b7e?title=false&skipResize=true"},{"autotext":"","autotext_url":"","category_id":"","category_name":"","contact_url":"https://openenergydat-ehr6560.slack.com/archives/CUN1RB0N7","created_at":"2020-02-09T12:22","download_url":"","event_name":"Energy Data Hackdays 2020","event_url":"https://new-hack.energy.opendata.ch/event/5","excerpt":"<a class=\"btn btn-large btn-success\" href=\"https://github.com/xiaoshir/Photovoltaic-Where-is-it-Best-/blob/master/local%20electricity%20mix%20in%20Switzerland/Obtain%20local%20electricity%20mix%20from%20Stromkennzeichnung.ipynb\">Notebook</a>\r\n<a class=\"btn btn-large btn-danger\" href=\"https://youtu.be/QgXOQBmFKPs?t=881\">\u25baPitch</a>\r\n<a name=\"challenge\"></a>\r\n\r\n<div class=\"alert alert-primary\" role=\"alert\"><i>This project was worked on during the <a href=\"https://blog.datalets.ch/066/\">virtual Hack...","hashtag":"","id":65,"ident":null,"image_url":"","is_challenge":false,"is_webembed":false,"logo_color":"","logo_icon":"","longtext":"<a class=\"btn btn-large btn-success\" href=\"https://github.com/xiaoshir/Photovoltaic-Where-is-it-Best-/blob/master/local%20electricity%20mix%20in%20Switzerland/Obtain%20local%20electricity%20mix%20from%20Stromkennzeichnung.ipynb\">Notebook</a>\r\n<a class=\"btn btn-large btn-danger\" href=\"https://youtu.be/QgXOQBmFKPs?t=881\">\u25baPitch</a>\r\n<a name=\"challenge\"></a>\r\n\r\n<div class=\"alert alert-primary\" role=\"alert\"><i>This project was worked on during the <a href=\"https://blog.datalets.ch/066/\">virtual Hackdays in March</a>. / An diesem Projekt wurde w\u00e4hrend der <a href=\"https://blog.datalets.ch/066/\">virtuellen Ausgabe im M\u00e4rz</a> gearbeitet.</i></div>\r\n\r\n# Challenge #10 \r\n\r\n([english below](#english))\r\n\r\n## Warum:\r\n\r\nDie Verbreitung der Solar-Photovoltaik in der Schweiz ist nur in grossem Umfang m\u00f6glich, wenn sie wirtschaftlich sinnvoll ist und gleichzeitig die Treibhausgasemissionen reduziert. \r\n\r\n##Idee:\r\nDiese beiden Faktoren k\u00f6nnen durch einen Vergleich der Lebenszykluskosten (LCC) und der Lebenszyklustreibhausgasemissionen (LCE) mit ihrem lokalen Stromtarif und dem LCE des Strom-mixes der Versorgungsunternehmen bewertet werden. Die LCC und die LCE variieren f\u00fcr jedes einzelne PV-System, abh\u00e4ngig von ihrer Gr\u00f6sse, den erneuerbaren Ressourcen und anderen technischen Faktoren. \r\n\r\nAngesichts der bisherigen Erfahrungen des PSI \u00fcber das [PV-Erzeugungs-potenzial und -kosten](https://www.bfe.admin.ch/bfe/de/home/news-und-medien/publikationen/_jcr_content/par/externalcontent.external.exturl.pdf/aHR0cHM6Ly9wdWJkYi5iZmUuYWRtaW4uY2gvZGUvcHVibGljYX/Rpb24vZG93bmxvYWQvOTgyNi5wZGY=.pdf) kann diese Analyse durchgef\u00fchrt werden, um mehr Erkenntnisse dar\u00fcber zu gewinnen, wo der Einsatz von Solarphotovoltaik in der Schweiz am sinnvollsten ist.\r\n\r\n<a name=\"english\"></a>\r\n# Where solar photovoltaics make the most sense\r\n\r\n##The big picture:\r\n\r\nThe rollout of solar photovoltaics to a great extent in Switzerland is only possible when they make economic sense and at the same time reduce greenhouse gas emissions.\r\n\r\n## Idea:\r\n\r\nThese two factors can be assessed by comparing the Life Cycle Cost (LCC) and Life Cycle greenhouse gas Emissions (LCE), with their local electricity tariff and the LCE of electricity mix supplied by utility providers. The LCC and LCE varies for each individual PV system, depending on their size, renewable resources, and other technical factors.\r\n\r\nGiven the previous experience on [PV costs and generation potential](https://www.bfe.admin.ch/bfe/de/home/news-und-medien/publikationen/_jcr_content/par/externalcontent.external.exturl.pdf/aHR0cHM6Ly9wdWJkYi5iZmUuYWRtaW4uY2gvZGUvcHVibGljYX/Rpb24vZG93bmxvYWQvOTgyNi5wZGY=.pdf), this analysis can be undertaken to give more insights on where it makes the most sense to deploy solar photovoltaics in Switzerland.\r\n\r\n# Call for expertise\r\n\r\n1. GIS expert\r\n2. Application/UI developer\r\n3. Energy consultant/scientist\r\n4. Expert from government/utilities working on PV system rollout/implementation\r\n\r\n# Questions to answer in two perspectives:\r\n\r\n1. Country-wide (mainly analysis): \r\nhow much potential do we have for Switzerland considering LCC and LCE in a realistic sense\r\n\r\n2. Individual resident (requires UI): \r\n       - Does it make sense to install PV on top of my roof\r\n       - How can I find residents around me with similar conditions/interest to reduce system investment cost (economy of scale)\r\n\r\n# Data\r\n\r\n1. levelized cost of electricity for each roof in Switzerland from [this analysis](https://www.bfe.admin.ch/bfe/de/home/news-und-medien/publikationen/_jcr_content/par/externalcontent.external.exturl.pdf/aHR0cHM6Ly9wdWJkYi5iZmUuYWRtaW4uY2gvZGUvcHVibGljYX/Rpb24vZG93bmxvYWQvOTgyNi5wZGY=.pdf) by [Technology Assessment Group, Laboratory for Energy Systems Anlaysis, PSI](https://www.psi.ch/en/ta)\r\n2. local electricity mix by  electricity generation technology for municipalities and entities in 2018, obtained from [Stromkennzeichnung](https://www.strom.ch/de/service/stromkennzeichnung)\r\n3. 2 sources for PV potential in Switzerland\r\n  - data from [Sonnendach](https://www.uvek-gis.admin.ch/BFE/sonnendach/)\r\n  - data from [Walch, A. 2020](https://zenodo.org/record/3609833#.XmFSEvlKiUl)\r\n4. life cycle greenhouse gas emissions (LCE) per kWh for different electricity generation technologies based on [ecoinvent version 3.6](https://www.ecoinvent.org/home.html)\r\n5. electricity tariffs in Switzerland from [ElCom](https://www.strompreis.elcom.admin.ch/Start.aspx)\r\n6. simulating the performance of photovoltaic energy systems (pvlib-python)\r\n    * is a community supported tool that provides a set of functions and classes for simulating the performance of photovoltaic energy systems. It was originally ported from the PVLIB MATLAB toolbox developed at Sandia National Laboratories.\r\n    * see more on project gibhub page https://github.com/pvlib/pvlib-python\r\n7. remuneration from electricity providers\r\n    * an official portal providing numbers on compensating the electricity production using PV in households - pvtarif.ch\r\n    * https://www.vese.ch/wp-content/uploads/pvtarif/pvtarif2/appPvMapExpert/pvtarif-map-expert-de.html\r\n    * there is an API but the data license forbids any use of this data in digital form in research\r\n\r\n# Thinking process\r\n\r\n> In this project we did additional study and compiled research notes, sample data and suggestions, expanding on the [original challenge](#challenge)\r\n\r\n1. Limitations of the solardach.ch calculator\r\n\r\n  * 1.1 Number of factors: it considers factors like solar irradiance, angle of roof area, shading. The new study also considers additional factors like temperature (which affects the module efficiency), obstacle structure on roof (based on machine learning) = more realistic estimate --> use data from new study\r\n  * 1.2 Calculation not based on current technology/efficiency factor: Someone planning to build a new PV installation would (reasonably) use the latest technology, while most calculations by tools are based on averages (which consist of a mix of old and new technology). Estimates for kWh potential might be 1/3 to 1/2 too pessimistic. --> use better data based on new technologies?\r\n  * 1.3 Grid network restrictions (maximum power which can be fed into the network): depending on location (more rural = usually worse), maximum capacity which can be fed into the network is much lower, dependent on three factors: connecting cable ampacities, voltage range limitation, and transformer power rating. Data on these three factors is proprietary information of the electricity companies. Might be in a range between 0 and 90% restriction on potential \r\n--> data is not openly available. Is there any way we can find a proxy? (especially for CH-wide potential estimate) --> for individuals data might be retrievable from their energy provider for inclusion in calculators (e.g BKW online portal offers the information for individuals for their own place)\r\n\r\n2. Calculate potential (economical)\r\n  * 2.1 Consider energy usage in network: network limitations might be less extreme because numbers given are based on no consumption --> unclear how this can be estimated\r\n  * 2.2 effects of everyone having PV installed: excess energy supply at peak times in an area = limitation of the network\r\n3. Calculate potential (environmental) \r\n  * 3.1 data on energy mix by city is available\r\n\r\n[Link to Drawing of data structure](https://drive.google.com/file/d/1hdXWuEQ3qG2gAY1OlJggGDt9uaNiOndE/view?usp=sharing)\r\n![](https://drive.switch.ch/index.php/apps/files/?dir=/&fileid=1542339069#/files_mediaviewer/refined%20PV%20concept.png)\r\n\r\n## Network Limitations\r\n\r\nThe past generation potential estimates don't seem to take into account the limitations of the network infrastructure.\r\nThere are three limiting factors related to adding PV to the existing network: connecting cable ampacities, voltage range limitation, and transformer power rating:\r\n\r\n* the voltage increase due to feeding in from a new PV cannot exceed +3% threshold allowed by law\r\n* the current increase due to feeding in from a new PV cannot cause the current to exceed a cable rating (on the entire chain from house to transformer)\r\n* the power fed in by a new PV cannot exceed the transformer rating; the ones connected to the medium voltage grid or others connecting any intermediate subtransmission (1000V intermediate voltage system) network\r\n\r\nThe available public data does not include any of this (cable ratings, network topology, transformer ratings) since it is all proprietary to the power company (Elektrizit\u00e4tsversorgungsunternehmen or EVU).\r\n\r\nUsing proprietary data and comparing the Sonnendach available roof area capacity (sum of all roof sections identified, i.e. good, marginal and bad, using the maximum area) with the calculated maximum feed in values for the electrical connection of the utility, shows a large overestimate of the energy capacity for rural and industrial sites.\r\n\r\n| Location  | Type       | Sonnendach | Network Max | % Over |\r\n| --------- | ---------- | ---------- | ----------- | ------ |\r\n| Uerzlikon | house      | 75500      | 59000       | 28     |\r\n| Uerzlikon | house      | 61700      | 71000       | 0      |\r\n| Uerzlikon | apt 2\u00bd     | 56800      | 48000       | 18     |\r\n| Uerzlikon | farm       | 128300     | 29750       | 331    |\r\n| Uerzlikon | farm       | 505400     | 33850       | 1393   |\r\n| Biel      | industrial | 235400     | 183000      | 29     |\r\n| Biel      | industrial | 244300     | 140000      | 75     |\r\n\r\nThe network maximum is calculated under the worst case assumption that all PV (proposed and installed) are generating at the maximum (peak) value and no consumption is occuring. By and large, the majority of these limitations are based on an over-voltage situation (>3% above nominal). This engineering limit would not normally apply when the PV owner self-consumes or the energy is shared with neighboring consumers.\r\n\r\nThese network maximums are also calculated when only one additional PV is installed (at the indicated site). So this brings up the additional issue that, should everyone in an transformer service area have a PV installation, these maximum values would be replaced by other limitations, for example overloading of shared cables, overloading of supplying transformers or general over-voltage conditions from multiple injection points. A more detailed analysis is needed on a per transformer service area basis with perhaps PV installations at only the most opportune locations (large area, south facing roofs).\r\n\r\nThus, the \u201cLife Cycle Cost\u201d, LCC, would need to include upgrades to the network infrastructure with the addition of large amounts of PV, or the maximum potential for PV installation would need to be adjusted downwards under the assumption of no network upgrades.\r\n\r\nRegarding the proprietary data needed for the engineering analysis:\r\n\r\n* the data is owned separately by each of the over two hundred EVU in Switzerland\r\n* these EVU are very unlikely to be able to provide this network data due to privacy restrictions and competitive considerations\r\n* only a small fraction of the German speaking EVU are doing this maximum feed in analysis on a broad scale\r\n* for these few, the best approach may be to provide a list of candidate sites with kW suggested and ask if their network can support this size of installation at those sites","maintainer":"nikki_bhler","name":"Photovoltaic: Where is it Best?","phase":"Research","progress":10,"score":56,"source_url":"https://github.com/xiaoshir/Photovoltaic-Where-is-it-Best-","stats":{"commits":0,"during":0,"people":0,"sizepitch":11379,"sizetotal":11424,"total":0,"updates":0},"summary":"Where solar photovoltaics make the most sense","team":"nikki_bhler","team_count":0,"updated_at":"2020-08-31T08:15","url":"https://new-hack.energy.opendata.ch/project/65","webpage_url":"https://md.schoolofdata.ch/uxm9hAUMQECO5beIHCG99g?view"},{"autotext":"","autotext_url":"TBA","category_id":"","category_name":"","contact_url":"http://Gantrisch-Energie.ch/","created_at":"2020-07-30T08:59","download_url":"","event_name":"Energy Data Hackdays 2020","event_url":"https://new-hack.energy.opendata.ch/event/5","excerpt":"<h2> Introduction </h2>\r\n\r\nSwiss law (StromVV Art 8a) requires all installed smartmeters to offer a local \"consumer information interface\" (CII) to provide all measured data at the moment of its recording. Despite 2+ years since this has become mandatory by the end of 2017 it is still very hard to obtain sufficient information from the DSO (distribution system operator) on the particular CII put in place on the installed smartmeter.\r\n\r\nDifferent technical interfaces (CII) are in use on various s...","hashtag":"","id":66,"ident":null,"image_url":"","is_challenge":false,"is_webembed":false,"logo_color":"","logo_icon":"","longtext":"<h2> Introduction </h2>\r\n\r\nSwiss law (StromVV Art 8a) requires all installed smartmeters to offer a local \"consumer information interface\" (CII) to provide all measured data at the moment of its recording. Despite 2+ years since this has become mandatory by the end of 2017 it is still very hard to obtain sufficient information from the DSO (distribution system operator) on the particular CII put in place on the installed smartmeter.\r\n\r\nDifferent technical interfaces (CII) are in use on various smartmeters in Switzerland which inhibits interoperability for innovative solutions. It is almost impossible to find publicly available information on what kind of CII is offered by the 600+ different DSO of Switzerland.\r\n\r\nWhere as in the netherlands, the energy sector organisation (netbeheernederland.nl similar to VSE in Switzerland) has required all smartmeters installed during the past years already to offer the same well designed CII called DSMR P1 (also adopted by Belgium and Luxembourg), the swiss authorities or the market participants have regrettably not decided on a mandatory standard to be required. This unfortunate situation has inhibited the market in Switzerland for innvovative applications. And a large amount of money and ressources is currently spent (and are finally wasted) by installing additional private energy meters behind the DSO's smartmeter. \r\n\r\nSee also [D]: https://forume.ch/t/kundenschnittstelle-der-intelligenten-messsysteme/938/4\r\n\r\nLet's try to improve on that.\r\n<hr>\r\n<h4> Motivation </h4>\r\nOne motivation to use the CII beyond visualisation might come from the following problem definition: \r\n<p><br>\r\nPhotovoltaic systems (PVS) with an output of 5-15 kW are increasingly being installed on roofs of swiss houses. Often there is a 300 L electric boiler connected on 3 phases of 400 V with a power of 6 kW for the hot water demand, which is charged during the night via a ripple control of the DSO. Because Art 8c of the StromVV has obliged the DSOs since 2018 to remunerate the customer for such flexibility useful to the grid, some DSOs remove the ripple control when connecting a new PVS to the grid and at the same time installing a smartmeter.\r\n<br><br>\r\nIf energy is permanently supplied to the electric boiler, around 30-50% of the annually required heating energy of approx. 3.8 MWh/a [1] can already be used from the PVS production. By means of an electronic control system, an additional max. of 40% of the grid supply could be substituted trough PVS production. With a tariff difference between the feed-in tariff and grid procurement of approx. 100 Fr/MWh, savings of only 150 Fr per year would result.\r\n<br><br>\r\nFor an economic solution, the costs for the necessary power control (including installation) should not exceed a few 100 Fr. However, many products available today [2] quickly require investment costs of 1'000 - 3'000 Fr which is far beyond any efficient and economically justifiable solution.\r\n<br><br>\r\n[1] https://www.energie-lexikon.info/warmwasser.html\r\n<br>\r\n[2] Example: (a) Energy4me units 1'083 Fr [ control unit 377 Fr, switching power supply 39 Fr, AC meter 248 Fr, thyristor controller 280 Fr, mains filter 139 Fr ] Q:https://www.energy4me.ch/energiemanagement/ (b) Expenses for electricians for installations: 500-1'000 Fr.\r\n</p>\r\n<hr>\r\n\r\n<h2> Goals & tasks </h2>\r\nTogether we shall discuss and demonstrate how easy and cost-efficient a simple solution to this scenario can be put in place using DSMR-P1 with an ESP Microcontroller and a piece of open-source software coupled with a very affordable wifi-enabled powerswitch-actor. Attaching any of the various visualisation- or energymanagement-sytems (EMS) for home automation over MQTT might then be relatively straight-forward.\r\n\r\nBut the key challenge is how to deal with the diversity of CII such that all citizens may get easy and efficient access to their own owned energy data. Many additional questions still have to be worked on. We hope that we may tackle some of these together with the expertise of those supporting this challenge.\n\n---\r\n`29.08.2020 07:19` \r\nWe developed a concept and PoC roadmap to provide a \"universal\" adapter from smart meters to home IoT platforms, see \"Source\" for details.","maintainer":"GEAG","name":"Unleashing the Swiss Smartmeter's CII","phase":"Training","progress":20,"score":54,"source_url":"https://github.com/tamberg/makeopendata-smart-meter-interop","stats":{"commits":0,"during":0,"people":0,"sizepitch":4242,"sizetotal":4360,"total":0,"updates":0},"summary":"Empower citizens to use their energy data. Using the smartmeter's CII beyond visualisation to steer local consumption.","team":"GEAG","team_count":0,"updated_at":"2020-08-31T07:21","url":"https://new-hack.energy.opendata.ch/project/66","webpage_url":""},{"autotext":"","autotext_url":"","category_id":"","category_name":"","contact_url":"https://openenergydat-ehr6560.slack.com/archives/CUZDUCFA9","created_at":"2020-03-06T09:55","download_url":"","event_name":"Energy Data Hackdays 2020","event_url":"https://new-hack.energy.opendata.ch/event/5","excerpt":"Help meet the Paris Convention goals to achieve net 0 by 2050, less than 2 tonnes CO^2 per person! We want to raise awareness around energy use and consumption by putting Switzerland on the map at [electricitymap.org](https://www.electricitymap.org/) and put its open data API to use.  (Challenge #11)\r\n\r\n---\r\n`28.08.2020 15:04`  First solution ideas have been explored and discussed. Beer has been deployed.\r\n`28.08.2020 23:00`  Despite some hurdles we got everything ready for our idea but realised...","hashtag":"","id":67,"ident":null,"image_url":"","is_challenge":false,"is_webembed":true,"logo_color":"","logo_icon":"","longtext":"Help meet the Paris Convention goals to achieve net 0 by 2050, less than 2 tonnes CO^2 per person! We want to raise awareness around energy use and consumption by putting Switzerland on the map at [electricitymap.org](https://www.electricitymap.org/) and put its open data API to use.  (Challenge #11)\r\n\r\n---\r\n`28.08.2020 15:04`  First solution ideas have been explored and discussed. Beer has been deployed.\r\n`28.08.2020 23:00`  Despite some hurdles we got everything ready for our idea but realised that it won't be accepted by electricity maps.\r\n`29.08.2020 11:00`  Complete restart to a much simpler model that will hopefully be accepted by electricity maps and still be better a gray spot on tha map.\r\n\r\n---\r\n`29.08.2020 13:40` Ideas are tested and documented. However, it's not running live.","maintainer":"oleg","name":"Put CH on Electricity Map","phase":"Training","progress":20,"score":53,"source_url":"","stats":{"commits":0,"during":3,"people":1,"sizepitch":797,"sizetotal":845,"total":4,"updates":2},"summary":"Raise awareness and support global climate goals","team":"oleg, Raphaela","team_count":1,"updated_at":"2022-09-29T12:23","url":"https://new-hack.energy.opendata.ch/project/67","webpage_url":"https://app.electricitymaps.com/zone/CH"},{"autotext":"","autotext_url":"","category_id":"","category_name":"","contact_url":"","created_at":"2020-07-20T11:24","download_url":"","event_name":"Energy Data Hackdays 2020","event_url":"https://new-hack.energy.opendata.ch/event/5","excerpt":"(Challenge #13) \r\n\r\nThis task will create a decision support tool for asset managers. The utility asset manager will be able to put results of transformer inspections into the tool and receive:\r\n\r\n1. A health value for the transformer (\"condition-based rating\")\r\n2. A comparison of the transformer's health with other transformers from all over the world\r\n3. Possible faults, based in particular on gas levels\r\n4. A prediction on how the transformer's health will degrade in the next 1-2 years, based...","hashtag":"","id":68,"ident":null,"image_url":"","is_challenge":false,"is_webembed":false,"logo_color":"","logo_icon":"","longtext":"(Challenge #13) \r\n\r\nThis task will create a decision support tool for asset managers. The utility asset manager will be able to put results of transformer inspections into the tool and receive:\r\n\r\n1. A health value for the transformer (\"condition-based rating\")\r\n2. A comparison of the transformer's health with other transformers from all over the world\r\n3. Possible faults, based in particular on gas levels\r\n4. A prediction on how the transformer's health will degrade in the next 1-2 years, based on how similar transformers have behaved\r\n5. Advice on what gas levels to monitor, and how to watch them\r\n\r\nA central part of the task is to conduct the analysis *without* a centralised dataset, and *without* being able to see the asset information of other transformers. The analyst is working blind to protect the privacy of the transformer owners! This is achieved using TAC, a system provided by the challenge sponsor, VIA. \r\n \r\nThe steps we are taking in the hackathon are:\r\n\r\n1. To identify typical condition curves\r\n2. To match these curves to the test transformer\r\n3. To map the changes in health over time for the matching transformer, in particular looking at gas levels\r\n4. To predict how the test transformer will change with time by generating a heatmap and plotting the test transformer to the heatmap\r\n5. Visualisation and business value!\r\n\r\nWe have four datasets that we can use:\r\n\r\n1. A global repository of transformers that we access using VIA's privacy-preserving TAC system (including fault information)\r\n2. An anonoymised database of Swiss transformers\r\n3. A list of faulty transformer readings, from the IEC60590 standard\r\n4. A list of normal transformer readings, from the IEC60950 standard\r\n\r\nThe decision support tool will be combined with online and offline asset management approaches. It will be combined with load and geospatial data to create an exploitable tool.\n\n---\r\n`31.08.2020 12:37` \n\nPrototyping has been completed and now the project will be taken forward for funding\r\n\r\n---\r\n`31.08.2020 12:38` ","maintainer":"","name":"Distributed analytics for asset management","phase":"Prototype","progress":30,"score":50,"source_url":"","stats":{"commits":0,"during":0,"people":0,"sizepitch":2034,"sizetotal":2113,"total":0,"updates":0},"summary":"Using AI to predict how power transformers will fail, and what to watch out for","team":"","team_count":0,"updated_at":"2020-08-31T12:38","url":"https://new-hack.energy.opendata.ch/project/68","webpage_url":""},{"autotext":"","autotext_url":"","category_id":"","category_name":"","contact_url":"https://openenergydat-ehr6560.slack.com/archives/CUZCQRP6U","created_at":"2020-01-14T14:19","download_url":"","event_name":"Energy Data Hackdays 2020","event_url":"https://new-hack.energy.opendata.ch/event/5","excerpt":"<a class=\"btn btn-large btn-success\" href=\"https://speakerdeck.com/loleg/what-the-hack-happened-to-the-data\">Slides</a>\r\n<a class=\"btn btn-large btn-warning\" href=\"https://md.schoolofdata.ch/vaFFe8_ZR_SZYs2SspunjQ?view\">Notebook</a>\r\n<a class=\"btn btn-large btn-danger\" href=\"https://youtu.be/QgXOQBmFKPs?t=1743\">\u25baPitch</a>\r\n\r\n<div class=\"alert alert-primary\" role=\"alert\"><i>This project was worked on during the <a href=\"https://blog.datalets.ch/066/\">virtual Hackdays in March</a>. / An diesem Pro...","hashtag":"","id":69,"ident":null,"image_url":"","is_challenge":false,"is_webembed":true,"logo_color":"","logo_icon":"","longtext":"<a class=\"btn btn-large btn-success\" href=\"https://speakerdeck.com/loleg/what-the-hack-happened-to-the-data\">Slides</a>\r\n<a class=\"btn btn-large btn-warning\" href=\"https://md.schoolofdata.ch/vaFFe8_ZR_SZYs2SspunjQ?view\">Notebook</a>\r\n<a class=\"btn btn-large btn-danger\" href=\"https://youtu.be/QgXOQBmFKPs?t=1743\">\u25baPitch</a>\r\n\r\n<div class=\"alert alert-primary\" role=\"alert\"><i>This project was worked on during the <a href=\"https://blog.datalets.ch/066/\">virtual Hackdays in March</a>. / An diesem Projekt wurde w\u00e4hrend der <a href=\"https://blog.datalets.ch/066/\">virtuellen Ausgabe im M\u00e4rz</a> gearbeitet.</i></div>\r\n\r\n# Challenge\r\n\r\n**Kundensegmentierung/-Analyse auf Basis offener Daten vs Daten eines Energieversorgungsunternehmens**. Beispiele haben bereits gezeigt, dass eine Kundenanalyse/Kundensegmentierung auf Basis offener Daten bereits m\u00f6glich ist und es keine Kundendaten mehr ben\u00f6tigt. Ist dem so und wenn ja, wie sieht es aus?\r\n\r\n","maintainer":"nikki_bhler","name":"Client-Analysis 2.0 ","phase":"Research","progress":10,"score":42,"source_url":"","stats":{"commits":0,"during":0,"people":0,"sizepitch":940,"sizetotal":966,"total":0,"updates":0},"summary":"and the power of open data","team":"nikki_bhler","team_count":0,"updated_at":"2020-08-24T15:36","url":"https://new-hack.energy.opendata.ch/project/69","webpage_url":"https://speakerdeck.com/player/630b676236e04830bd3802865dfee042?title=false&skipResize=true"}],"name":"projects"}],"sources":[{"path":"https://new-hack.energy.opendata.ch/","title":"dribdat"}],"title":"Energy Data Hackdays 2020","version":"0.9.3"}
