Skip to content

magellanic-clouds17/etl_renewables_weather

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

57 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

ETL Pipeline and Machine Learning Analysis to forecast Renewable Energy Generation in Germany using Weather Data

Status: Ongoing 🚧

This project is a work in progress.

Project Overview

This portfolio project aims to explore the integration and analysis of renewable energy generation and consumption data alongside weather data for Germany, focusing on the timeframe after 2010. Utilizing both SQL (MySQL) and NoSQL (MongoDB) databases, the project seeks to uncover insights into how weather impacts energy dynamics, identify energy consumption patterns, and evaluate renewable energy sources' efficiency.

Data Sources

  • Renewable Energy Data: From ENTSO-E Transparency Platform. Data retrieved through the websites API.
  • Weather Data: Detailed records of over a hundred weather stations throughout Germany from the Deutscher Wetterdienst (DWD) Climate Data Center, including temperature, solar radiation, and wind speed metrics. Data retrieved through webscraping.

Technologies Used

  • Databases: MongoDB for unstructured data; MySQL for structured data.
  • Programming: Python, with libraries such as pandas for data processing. SQL to interact with the databases.

Locations of Weather Station Sample

image

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published