GitHub - SayantikaGhosh/realtime-data-pipeline: Real-time e-commerce data pipeline using Kafka, Spark, and Delta Lake with a Bronze–Silver–Gold architecture. Dockerized ETL syncs analytics to Supabase and includes a GenAI feature that converts natural language into SQL for interactive querying.

Branches Tags

Name		Name	Last commit message	Last commit date
Latest commit History 1 Commit
.vscode		.vscode
consumer		consumer
deltalake		deltalake
gold_to_sb		gold_to_sb
producer		producer
spark-jars		spark-jars
spark		spark
docker-compose.yml		docker-compose.yml
temp.txt		temp.txt
test.py		test.py

About

Real-time e-commerce data pipeline using Kafka, Spark, and Delta Lake with a Bronze–Silver–Gold architecture. Dockerized ETL syncs analytics to Supabase and includes a GenAI feature that converts natural language into SQL for interactive querying.