Pinned Loading

1. real-time-data-pipeline-aws-snowflake real-time-data-pipeline-aws-snowflake Public

   Production-style real-time data ingestion pipeline built with AWS and Snowflake, featuring pre-stream validation, fault isolation, and automated Snowpipe ingestion.

   Python

2. aws-glue-snowflake-dbt-pipeline aws-glue-snowflake-dbt-pipeline Public

   Modern batch data pipeline using AWS Glue, S3, Snowflake, and dbt. Showcases secure ingestion, external stages, layered transformations, dbt testing, and production deployment with environment sepa…

   Python

3. snowflake-scd-type-1-pipeline snowflake-scd-type-1-pipeline Public

   Production-style SCD Type 1 data pipeline built with Snowflake and AWS S3, featuring automated ingestion via Snowpipe, change detection with Streams, and conditional orchestration using Tasks and s…

   PLpgSQL

4. scd-type-2-snowflake-dbt scd-type-2-snowflake-dbt Public

   Production-style Slowly Changing Dimension (SCD Type 2) pipeline built with Snowflake, dbt, and AWS S3. Demonstrates secure S3 ingestion, layered bronze/silver/gold modeling, dbt snapshots for hist…

   Python

5. containerized-lambda-cicd-data-ingestion containerized-lambda-cicd-data-ingestion Public

   A containerized AWS Lambda data ingestion pipeline with automated CI/CD using GitHub and AWS CodeBuild, extracting data from the Calendly API and storing it in Amazon S3

   Python

6. dbt-jaffle-shop dbt-jaffle-shop Public

   DBT Tutorial Repository