ClickHouse Kafka Connector

kafka connector 插件，支持输入 mysql binlog 和 json 格式写入ClickHouse。持续更新

This project sets up a real-time data pipeline utilizing Change Data Capture (CDC) to stream changes from a PostgreSQL database to a ClickHouse database through Apache Kafka. Using Debezium to capture and stream database changes, and Kafka Connect to sink the data into ClickHouse, this pipeline allows for efficient data synchronization.

Easy-to-run demo of a CDC pipeline using Debezium (Kafka Connect), PostgreSQL, Redpanda, and ClickHouse.

Kafka to ClickHouse sink connector for streaming event data into ClickHouse from Kafka topics.

Replicate data from MySQL to ClickHouse®

No description available

Project is in active development and has been moved to https://repository.datamart.ru/datamarts/kafka-clickhouse-connector

Kafka sink connector for clickhouse

Confluent Kafka and Kafka Connect Sink to ClickHouse Cloud using Docker.

Copies data from PostgreSQL to Clickhouse with Kafka Connect

outbox + Kafka + ClickHouse Kafka Connect Sink + ClickHouse

No description available

No description available

No description available

Kafka to ClickHouse sink connector for streaming event data into ClickHouse from Kafka topics.

Kafka to ClickHouse sink connector for streaming event data into ClickHouse from Kafka topics.

Docker and all files for Kafka, clickhouse, quesma, Kibana and Elasticsearch with clickhouse kafka connector

Connector from kafka log data to clickhouse storage

connect MySQL DB to CLickhouse, using debezium connector with kafka.

Example of usage of Redpanda Connect with Kafka and ClickHouse

Real-time data pipeline from MySQL to ClickHouse using Kafka Connect

Change data capture project for MySQL and ClickHouse using Kafka Connect

CDC Monitoring of Cassandra Database using Debezium connector. CDC Events are sent to Kafka from Cassandra and then from Kafka to Clickhouse.

RisingWave Sink Connector Pipeline: Transform streaming data and deliver to external systems (PostgreSQL, Elasticsearch, Redis, ClickHouse, Kafka, MySQL)

🚀 Streamline real-time data integration from Kafka to ClickHouse with this high-performance Debezium connector for efficient database communication.

🚀 Streamline real-time data integration from Kafka to ClickHouse with this efficient sink connector built for high performance and seamless use with Debezium.

A high-throughput event streaming pipeline using Apache Kafka with multi-topic partition management, Debezium CDC connectors, Schema Registry integration, and Kafka Connect sinks to ClickHouse, Elasticsearch, Redis, and S3 Delta Lake.

generate messages to kafka topic, connect it to clickhouse as the real-time db, do a light transformation, and have superset read the table from clickhouse and display charts

A real-time data synchronization pipeline that captures changes from MySQL using Debezium CDC and streams them to ClickHouse via Kafka. This implementation uses a standalone sink connector approach for production-grade flexibility and control.