Examples of Flink on Azure
-
Updated
Oct 30, 2023 - Java
Examples of Flink on Azure
Local SQL Database ---> Azure ---> Power BI
Project Y is a straightforward Landing Zones automated deployment tool dedicated to data processing.
Everything you need to know about cloning, importing and using the Profisee Azure Data Factory templates.
This solution performs analytics and outlier detections on Apache compliant web server logs. This is based on Microsoft Azure technologies & PowerBI.
Code samples as published on blog
A Re-do of Perth City Properties project using Azure Data Engineering technologies such as Azure Data Factory (ADF), Azure Data Lake Storage Gen2, Azure Blob Storage, Azure Databricks.
This repository is designed for a data science project aimed to education, wich uses a public database from brazilian educational research institute about the nationam highschool exam and applies ETL and datamining association rules to this dataset.
This project extracts data having 800k records from CSV in the data factory and convert it to parquet based data and finally create a PowerBI report of that parquet based data.
Springboard Open Ended Capstone
Practice with Azure Synapse Analytics/Databricks Pipeline
This project exemplifies a robust Azure streaming data solution tailored for fitness data analysis, leveraging Azure's powerful ecosystem to deliver actionable insights and drive informed decisions in health and wellness management.
Covid ETL Project using Azure Data Engineering Stack
This Azure Data Factory (ADF) pipeline will be automatically triggered whenever a CSV file is dropped in a specific location within the Storage Account Container. The pipeline reads the contents of the CSV file, converts it into an HTML table, and then sends a notification containing the newly created table to the designated Microsoft Teams channel
Ingested Tokyo Olympic data into Azure Data Lake using Azure Data Factory. Enhanced data quality with Apache Spark on Azure Databricks. Optimized SQL queries on Synapse Analytics, reducing execution time. Developed engaging Power BI dashboards, boosting user engagement creating KPI's with DAX.
Everything you need to know about cloning, importing and using the Profisee Azure Data Factory templates.
This repository is connected to the Azure data factory to store all the pipelines built.
The data engineering project aims to migrate a company's on-premises database to Azure, leveraging Azure Data Factory for data ingestion, transformation, and storage. The project will implement a three-stage storage strategy, consisting of bronze, silver, and gold data layers (Medalion architecture). Documentation of the project is in PDF file.
Azure-based solution for ingesting and analyzing Formula 1 data using Azure Data Lake Storage Gen2 and Databricks
Transform data from on-premises SQL Server to Azure Delta Lake Storage for Analytics and Visualization
Add a description, image, and links to the azuredatafactory topic page so that developers can more easily learn about it.
To associate your repository with the azuredatafactory topic, visit your repo's landing page and select "manage topics."