Enterprise-grade, production-hardened, serverless data lake on AWS
-
Updated
Oct 1, 2025 - Python
#
lake-formation
Here are 10 public repositories matching this topic...
📄 Pipeline de ingestão e análise com AWS Glue, Athena e S3, utilizando arquivos Parquet e catalogação automatizada via Crawler. Permite consultas SQL rápidas e eficientes sobre dados armazenados na nuvem.
-
Updated
Jun 18, 2025 - Python
Hands-on AWS data lake and pipeline workshops for engineering teams. Glue, Redshift, Lake Formation, Databricks, LLMOps.
aws workshops workshop terraform pyspark data-engineering data-lake databricks amazon-redshift data-pipeline amazon-athena aws-glue lake-formation glue-etl aws-workshops hands-on-labs llmops cloud-training aws-data-lake cloud-workshop
-
Updated
Jul 17, 2026 - HTML
📄 Projeto educacional de pipeline de ingestão de dados utilizando AWS S3 e Lake Formation, estruturando a camada bronze de um Data Lake com Python.
python aws data-science csv pipeline s3 pandas data-engineering data-lake parquet academic-project boto lake-formation
-
Updated
Jun 18, 2025 - Jupyter Notebook
A HIPAA-compliant healthcare data lake built on AWS using Medallion Architecture (Bronze/Silver/Gold). Features PySpark ETL pipelines via AWS Glue, column-level security through Lake Formation, serverless SQL with Athena, and a live Tableau dashboard — simulating a real hospital's cloud migration with full governance and monitoring.
python aws etl pyspark healthcare data-lake tableau hipaa aws-athena amazon-s3 aws-glue lake-formation data-engi cloudwa medallion-architecture
-
Updated
Apr 2, 2026 - Python
Event-driven serverless lakehouse on AWS (Lambda x6 patterns, Step Functions, Glue PySpark, Iceberg, Lake Formation, Superset) — runs end-to-end on LocalStack at zero cost. Terraform IaC + CDKTF parity.
python aws lambda serverless athena etl terraform glue kinesis pyspark data-engineering data-lake redshift iceberg step-functions localstack apache-iceberg lake-formation eventbridge lakehouse
-
Updated
Apr 23, 2026 - Python
Kinesis Firehose → S3 → Glue → Lake Formation → Athena → QuickSight data platform
-
Updated
Jun 28, 2026 - HCL
Production-grade financial data lake on AWS — S3, Glue, Lake Formation, Athena, DMS. Built for BFSI analytics use case with PII masking and column-level access control.
aws cloudformation apache-spark athena glue pyspark data-engineering fintech data-lake lake-formation
-
Updated
Jul 21, 2026 - Python
8 hands-on AWS Certified Data Engineer Associate labs covering S3 data lakes, ingestion, Glue, Athena, ETL, data quality, Redshift, DynamoDB, orchestration, Lake Formation, KMS, monitoring, cost optimization, and exam review.
aws kms athena etl dynamodb s3 cloudwatch glue kinesis data-engineering data-lake redshift courseware certification aws-certification governance data-quality step-functions wsq lake-formation
-
Updated
Jul 13, 2026
Production-style AWS data lakehouse — Terraform, EMR Serverless, Apache Iceberg, and Lake Formation with idempotent Spark writes and governed access.
-
Updated
Jun 17, 2026 - Python
Improve this page
Add a description, image, and links to the lake-formation topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the lake-formation topic, visit your repo's landing page and select "manage topics."