My Journey from Data Analyst to Data Engineer
-
Updated
Apr 7, 2026
#
python-data-engineering-etl-data-cleaning
Here are 3 public repositories matching this topic...
A Python-based ETL pipeline to clean, deduplicate, and structure raw shipping data
-
Updated
Apr 8, 2026 - Python
Production-grade, serverless AWS data pipeline simulating large-scale autonomous-vehicle telemetry-processing at fleet scale. This repository demonstrates end-to-end ingestion, Distributed Stream Triage, Columnar Storage Optimization with Apache Parquet, and Data Lakehouse Partitioning — with future Terraform Infrastructure as Code (IaC) modules.
docker-compose autonomous-vehicles data-quality apache-parquet etl-pipeline pyarrow aws-data-pipeline data-contracts pandera data-lakehouse terraform-infrastructure telemetry-processing hive-partitioning python-data-engineering-etl-data-cleaning serverless-etl python-data-engineering defensive-data-engineering containerized-etl
-
Updated
Jun 1, 2026 - Python
Improve this page
Add a description, image, and links to the python-data-engineering-etl-data-cleaning topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the python-data-engineering-etl-data-cleaning topic, visit your repo's landing page and select "manage topics."