You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
This project demonstrates a data pipeline using Snowflake, Google Cloud Storage (GCS), and Pub/Sub for loading data incrementally into Snowflake tables. The pipeline is triggered by new files arriving in a specified GCS bucket, notifying Snowflake through Pub/Sub, and subsequently updating tables in Snowflake.
End-to-end data engineering pipeline using Snowpark pandas, Snowflake Stored Procedures, and Serverless Tasks for automated customer profile generation.
Production-style SCD Type 1 data pipeline built with Snowflake and AWS S3, featuring automated ingestion via Snowpipe, change detection with Streams, and conditional orchestration using Tasks and stored procedures. Demonstrates warehouse-native ELT and dimensional modeling best practices.
End-to-end Snowflake streaming data pipeline using Python, Snowpipe Streaming, Streams, Tasks, Dynamic Tables, and Snowpark for real-time ingestion and analytics.
A data platform architecture on Snowflake built from data contracts. RideFlow runs a data mesh with a database per domain, Bronze-to-Gold pipelines, quality checks and quarantine, using LakeLogic.
End-to-end Food Delivery Data Platform built using Snowflake Medallion Architecture, Streams, Tasks, Stored Procedures, Data Quality Framework, Quarantine Layer, and Streamlit Analytics Dashboard.