Simple demo of some features of the Esper Complex Event Processing (CEP) engine.
-
Updated
Apr 9, 2021 - Java
#
data-engin
Here are 7 public repositories matching this topic...
This project demonstrates real-world big data engineering practices using Apache Spark (PySpark). It covers the entire data pipeline — from ingestion, transformation, and validation to exploration and reporting. Ideal for data engineers and analysts looking to gain practical experience with Spark, Airflow, and data lake design.
-
Updated
May 28, 2025 - Python
Process of scheduled data extraction, transform and load is done using Apache Airflow and PySpark
api airflow twitter big-data spark apache-spark etl twitter-api apache-airflow etl-pipeline data-engin vitrinedev
-
Updated
Aug 28, 2023 - Jupyter Notebook
-
Updated
Sep 3, 2023 - Python
Github Analytics: A small scale end-to-end data engineering project with near real-time data update
-
Updated
Jul 12, 2026 - Jupyter Notebook
Pipeline ETL automatizado (DataOps) que extrae, procesa y visualiza ofertas de empleo tecnológico en Chile usando Node.js, Python, PostgreSQL y Streamlit.
nodejs python postgresql web-scraping dataops chile etl-pipeline github-actions streamlit data-engin
-
Updated
Jun 27, 2026 - JavaScript
Improve this page
Add a description, image, and links to the data-engin topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the data-engin topic, visit your repo's landing page and select "manage topics."