Data Engineering Nano Degree Programm of Udacity - Project 5 - Data Pipelines with Apache Airflow

Data Pipelines with Apache Airflow

PROJECTS IN UDACITY NANODEGREE IN DATA ENGINEERING.1 Data Modelling wit PostegreSQL. 2 ETL in Cloud Data Warehouses. 3 Data Lakes with Spark.4 Data Pipelines with Airflow.5 Data Engineering Final Capstone Project.US Migration data ETL pipeline with Spark

No description available

Udacity Data Engineering Nanodegree project 5 - Data pipelines with Airflow

Data Pipeline with Airflow - Data Engineering ND project 5

Udacity Data Engineering Nanodegree - Project 5 - Data Pipelines with Apache Airflow

Udacity Data Engineering Nano Degree Project 5: Data Pipelines with Airflow

Udacity Data Engineering Nanodegree Project 5 of 6 - Data Pipelines with Airflow

### 1. Data Modelling with PostegreSQL. ### 2. ETL in Cloud Data Warehouses. ### 3. Data Lakes with Spark. ### 4. Data Pipelines with Airflow. ### 5. Data Engineering Final Capstone Project: US Migration data ETL pipeline with Spark.

This repository contains code for Project 5 of Udacity's Data Engineering nanodegree and involves creating and automating data pipelines with Airflow as well as monitoring and debugging production pipelines.

Data Engineer with 5+ years of experience in ETL, Data Pipelines, Big Data, and Cloud. Proficient in Python, SQL, Spark, AWS, Azure, Snowflake. This repo showcases ETL workflows, data modeling, streaming with Kafka, and automation with Airflow. Explore projects demonstrating real-world data engineering solutions.