Service for bulk-loading data to databases with automatic schema management (Redshift, Snowflake, BigQuery, ClickHouse, Postgres, MySQL)

A Python API for Asynchronously Loading Data into Snowflake DB -

Sample ELT project using Dagster, data load tool and Snowflake

To create the base infrastructure for storage only pipelines that load data from S3 to Snowflake.

Sample Airflow DAGs to load data from the CovidTracking API to Snowflake via an AWS S3 intermediary.

No description available

A Python Snowpark CLI for loading the TPC-DI dataset into Snowflake. Additional dbt models for building the data warehouse.

An ETL Data Pipelines Project that uses AirFlow DAGs to extract employees' data from PostgreSQL Schemas, load it in AWS Data Lake, Transform it with Python script, and Finally load it into SnowFlake Data warehouse using SCD type 2.

A Streamlit App for loading data into Snowflake for grandmas

An automated ETL (Extract, Transform, Load) solution designed to extract company information from Y Combinator's website, transform the data into a structured format, and load it into a Snowflake data warehouse for analysis and reporting.

In this project I develop a data lakehouse on the Snowflake and Databricks platforms, performing data transformations with DBT and using Airbyte for data loading.

In this article, we explored a comprehensive supply chain analytics project, encompassing data extraction, ETL using Python, loading data into Snowflake, and creating an interactive dashboard with Power BI. By harnessing the power of ETL, Snowflake, and Power BI, businesses can unlock valuable insights from their supply chain data.

This repository include the snowflake content relaetd to intro to snowflake & loading data from UI, CLI & Cloud Provider in an hands on way

This ETL (Extract, Transform, Load) project aims to extract human resources data, clean it using PL/SQL and SQL, integrate it into a Snowflake data warehouse on Azure Cloud using Informatica, and visualize the insights in Power BI.

A production‑grade, modular data pipeline that automates the ingestion, transformation, and loading of retailer data into Snowflake using Python, Airflow, Terraform, and Docker. Ideal for data engineers, DevOps engineers, and DataOps workflows.

This project showcases an end-to-end ELT (Extract, Load, Transform) pipeline leveraging the TPCH orders table from Snowflake's sample database. The primary goal is to demonstrate modern data engineering practices using Snowflake, dbt (Data Build Tool), and Apache Airflow.

Learn how to load data, create data models, add data quality tests and documentation using dbt Core with Snowflake

Data extraction from the Spotify API, loads raw data into AWS S3 using AWS Lambda, and transforms it for analysis. A data warehouse is created on Snowflake, and Snowpipe is used to automatically ingest the transformed data, enabling efficient and scalable data analysis.

Automated pipeline for downloading, processing, and visualizing ECMWF tropical cyclone ensemble forecasts. Downloads TC track BUFR files, extracts ensemble data, combines with wind forecasts, and loads to Snowflake. Includes interactive Dash dashboard for visualization.

No description available

No description available

Extracting, Loading and Transforming Data using python, databricks and Snowflake

This project covers all the scripts, steps and methodologies used in extracting data from youtube, transforming it and then loading it into a Snowflake Warehouse.

This repo shows how to Externally Stage files from AWS S3 and load data from staged files in Snowsight/Snowflake

The project focuses on the development and deployment of an ELT (Extract, Load, Transform) pipeline utilizing industry-standard tools such as dbt (data build tool), Snowflake, and Airflow. The pipeline is designed to handle the transformation and loading of data from source tables to final data marts, ensuring efficient data processing.

In this project using lambda function we gonna collect data from spotify web api and put it into s3 stage. After that we collect those stage data and using another lambda function transformed data, then load it into snowflake tables to create further data processing.

This repository provides a configurable, production-ready ETL pipeline in Python. It extracts data from a CSV file, performs flexible transformations, and loads it into a Snowflake data warehouse with structured logging and a CLI interface.

In this project, I designed a Data Warehouse in Snowflake for business analysis of the dealership NovaDrive Motors. I used Apache Airflow to extract raw data from PostgreSQL and load it into the Staging layer of the DWH. Then, I transformed the raw data with DBT into insights to build the BI dashboard for sales analysis

Snowpark with Python to download data from webhost, apply data engineering, load to Snowflake and visualize using Streamlit

Transform and load data from csv for snowflake