Real World Project on Formula1 Racing using Azure Databricks, Delta Lake and Azure Data Factory

In this project, we used the Azure cloud services to get done data engineering operations (Ingestion, Transformation, Analysis, Load) on Formula-1 Racing Dataset Available from 'eargst developer API' which includes both 'CSV' and 'JSON' (single and also split) files. we also manage the incremental load and full load approach to dealing with some of that files and the notebook workflow via Azure Data Factory pipelines and  Azure Databricks Itself. we schedule that pipelines with tumbling window trigger to get execute that pipeline in a wise manner.

This is a End-to-End Azure Data Engineering Project | Analysis on the entire ETL Pipeline - Azure Factory, Azure Lake Gen 2, Databricks, Azure Synapse Analytics & Dashboards

Databricks and Azure projects for experimenting, learning and demonstrating knowledge

Data Engineering Project on Covid19 Reporting – Using Azure Data Factory, Databricks, HDInsight, Azure Data Factory – An End to End ETL pipeline in addition to a Power BI report dashboard.

F1 Data Engineering Project on Azure Databricks!

This Capstone Project includes an End to End Data Engineering Pipeline right from Ingesting the data from HTTPs server to cleaning and transforming the data in Azure Databricks and finally reporting the data on Power BI Desktop

Data Engineering Project on Formula1 Racing – Using Azure Data Factory and Databricks.

This repository showcases a complete cloud‑native data engineering solution built on Azure Databricks, Data Lake, and Synapse Analytics. It demonstrates how to design scalable ETL pipelines, transform raw racing datasets, and deliver actionable insights into Formula 1 performance.

An end to end Azure data Engineering Project on Covid 19 data : Azure Data Factory, Azure Databricks, Azure Data Lake Gen2, Azure Synapse Analytics, Power BI.

Project on Formula1 Racing to practice real world Data Engineering concepts using Azure Databricks, Delta Lake, Azure Data Factory

Data Engineering Project on Covid19 - Using Azure Data Factory and other Azure services like Databricks, HDInsight - End to End ETL along with PowerBI report dashboard

This project is a End-to-end Data Engineering pipeline on Azure implementing the Medallion Architecture using Databricks, Data Factory, and Delta Lake.

Azure Data Engineering Project using Azure Data Factory, Databricks, PySpark and Delta Lake with Medallion Architecture. A complete data pipeline implementation on Azure cloud using NYC Taxi data following best practices in data ingestion, transformation and storage.

A full-stack, cloud-native, real-time streaming data engineering project powered by Azure Databricks, Azure Functions, Azure Event Hub, Azure Data Explorer (ADX/Kusto), Microsoft Fabric, and Power BI. This project streams, processes, stores, visualizes, and triggers alerts on live weather data.

This project focuses on executing a data engineering workflow of Olympic data on the Azure Cloud. The main tasks include extracting data from an API using Azure Data Factory, transforming the data with Azure Databricks, loading the transformed data into Azure Data Lake Storage, and performing data analysis using Azure Synapse Analytics

This project explores 2021 Medicare enrollment data to analyze enrollment metrics and normalize data. Built on Azure Databricks, it showcases scalable data engineering and healthcare analytics using real CMS data.

This project is based on azure data engineering. Main goal is to first ingest the data in azure data lake gen2, Transform that data using spark and databricks and finally loading that data into presentation layer for visualization using PowerBI

Data Engineering final project which transforms data from a CSV file to a data pipeline on Azure using databricks. All technologies used can be found in the provided image within the main branch.

DEPI-Final-Data Engineering-Task is an end-to-end project utilizing Azure cloud services to build data pipelines. The project focuses on data ingestion, transformation, and storage, leveraging Azure Data Factory, Databricks, and Synapse Analytics to deliver secure, scalable, and efficient data solutions.

Explore Olympic data with Azure in an end-to-end data engineering project. Extract data using Azure Data Factory, transform with Databricks, store in Data Lake Storage, and analyze with Synapse Analytics. Dive into athletes, medals, and teams insights. Ideal for those keen on cloud analytics.

Master Azure Data Engineering with this Basic to Advance guide! Covers SQL, PySpark, Kafka, Databricks, Snowflake & Airflow. Build 15+ industrial projects using Azure (ADF, Synapse, Event Hubs), GCP & modern table formats (Delta Lake, Iceberg, Hudi). Learn real-time streaming, Medallion architecture, and cloud data warehousing with hands-on labs.

An end-to-end data engineering pipeline built on Azure Databricks to process airline datasets including bookings, flights, airports, and passenger records. The project demonstrates scalable ingestion, transformation, Delta Lake optimization, workflow automation, and multi-layered data architecture following industry-standard practices.

This project is an end-to-end data engineering solution on Azure using the AdventureWorks dataset. It builds an automated pipeline with Data Factory, Databricks, and Synapse to process raw data and establish a "Single Source of Truth," enabling reliable analytics and reporting in Power BI.

Hybrid Data Ingestion and Analytics Pipeline using Azure Data Factory, Data Lake, Databricks, Synapse, and Power BI. This project demonstrates a complete data engineering pipeline that automates the ingestion, transformation, and reporting of data from on-premises shared folders into Azure Data Lake Storage (ADLS) and downstream analytical systems.

End-to-end Azure data engineering project built on Azure and Databricks services

Data Engineering Project on Covid19 Reporting – Using Azure Data Factory and Databricks – An ETL pipeline.

End-to-end data engineering project using Azure Databricks and Spark on Formula 1 data

This is a project on azure data engineering which uses ADF,databricks,hdinsights on Europen Covid Data

Hands-on data engineering project using Azure Databricks & Spark, extended with data quality and governance checks