This project showcases how to integrate the world of DevOps, focusing on Continuous Integration (CI) and Continuous Deployment (CD) with the realm of modern data engineering using Terraform and Azure as the case study

No description available

Master the AWS Data Stack! 🚀 This repository features 15+ Industrial Data Engineering Projects covering Serverless ETL, Real-Time Streaming, & Data Warehousing. Hands-on labs for S3, Lambda, Spark, Airflow, Snowflake, Redshift, Kinesis, & Glue. Includes production-grade CICD pipelines. A complete roadmap to becoming a top Data Professional.

This repo is use to maintain Infra as code for data engineering , we will use GitHub actions to setup infra automatically , we will see how to update infra into different environments through CICD using GitHub actions

The goal of this project is to try a full CICD pipeline with GitHub Actions and pre-commit hooks for a simple NLP Project to practice what I learned from Software engineering for Data Scientists Book by Catherine Nelson

CI/CD Terraform_Azure

Lab for Data engineering class for cicd pipeline with aws glue.

Data ENgineering Project for ETL Glue job in CICD with GTerraform andd GitHub Actions

A 2-week sprint project demonstrating automated version roll-ups, tagging, and branch management in a CICD environment. Designed to reduce manual release management overhead for small data-engineering or analytics teams.