I'm a Computer Science graduate passionate about building scalable data platforms that transform raw data into meaningful business insights. My interests lie in Data Engineering, Analytics Engineering, Cloud Data Platforms, and Machine Learning.

Currently, I'm focused on building production-style projects using AWS, Apache Kafka, Airflow, SQL, Python, Docker, and Tableau while following software engineering best practices.

Python • SQL • Bash

Apache Kafka • Apache Airflow • ETL Pipelines • Data Validation • Data Modeling

AWS S3 • AWS Glue • Amazon Athena • IAM

Pandas • NumPy • Tableau • Excel • Matplotlib

Scikit-learn • Streamlit

Git • GitHub • Docker • VS Code

Kafka • Docker • Python • AWS

• Built a real-time event streaming pipeline for industrial IoT sensor data.
• Implemented Producer, Consumer, Event Processing, Validation, Alerting and Dead Letter Queue.
• Stored validated events in Parquet format for analytics-ready processing.
• Designed a modular architecture suitable for production-style data pipelines.

AWS S3 • Glue • Athena • Airflow • Tableau

• Designed an end-to-end metadata-driven ETL platform.
• Automated ingestion, transformation and querying of analytical datasets.
• Built dimensional models and interactive Tableau dashboards.
• Applied cloud-native data engineering concepts using AWS.

Python • Machine Learning • Streamlit

• Developed a machine learning application to predict weather conditions affecting deliveries.
• Built an interactive Streamlit application for prediction and visualization.
• Evaluated multiple ML models to improve predictive performance.

• Advanced Data Engineering
• Apache Spark
• Kafka Ecosystem
• AWS Data Services
• CI/CD for Data Pipelines

• Email- sujalgupta421@gmail.com

"I enjoy building systems that automate data movement, improve data quality, and convert raw information into actionable insights."