Data Engineering Youtube Project
This project is a data pipeline that ETL Reddit data into a Redshift data warehouse. The pipeline includes a combination of tools and services: Apache Airflow, Celery, PostgreSQL, Amazon S3, AWS Glue, Amazon Athena, and Amazon Redshift.
AWS Serverless ETL Pipeline using Lambda, S3, Glue Crawler, Athena, Pandas and PyArrow
Real-time AWS ecommerce data pipeline using MSK Serverless, MSK Connect, S3, AWS Glue, Delta Lake, SCD Type 2, and Redshift Serverless.
Data engineering with a focus on AWS cloud services.
End-to-End Serverless Retail Data Lake & Analytics Pipeline using Python, PostgreSQL, AWS S3, AWS Lambda, AWS Glue, Amazon Athena, and Power BI.
AWS-based customer behavior analytics pipeline using S3, Glue, Athena, and SQL to analyze retention, revenue patterns, and customer segmentation.
To associate your repository with the amazon-glue topic, visit your repo's landing page and select "manage topics."