Pinned Loading

1. Banking-Delta-Lakehouse Banking-Delta-Lakehouse Public

   A daily banking lakehouse pipeline: PySpark ingests MySQL, MongoDB, and Databricks data into PostgreSQL, where SQL procedures build raw → staging → analytics → marts layers behind data-quality gate…

   PLpgSQL

2. DBT-Medallion-Pipeline DBT-Medallion-Pipeline Public

   Medallion (Bronze/Silver/Gold) data pipeline MongoDB → PostgreSQL, transformed with dbt, extracted via PySpark, orchestrated with Airflow.

   Python 1 1

3. Bike-Store-Relational-Database Bike-Store-Relational-Database Public

   PySpark incremental ETL pipeline from MongoDB to PostgreSQL, with automated data quality validation, schema evolution, upserts, analytics, and production-style monitoring.

   Python

4. pathway pathway Public

   Forked from pathwaycom/pathway

   Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

   Python

5. Data-Modelling Data-Modelling Public

   Production-style data warehouse: MongoDB → PostgreSQL Kimball warehouse with Dagster orchestration, Great Expectations quality gates, Docker, and Streamlit analytics.

   Python

6. Wine-Quality-Analysis Wine-Quality-Analysis Public

   End-to-end wine quality analysis with R and Python, covering EDA, regression, PCA, clustering, and classification with reproducible pipelines and Docker.

   R