DATA ENGINEERING
Olist Medallion ELT Pipeline
An end-to-end, containerized ELT pipeline on the Brazilian Olist e-commerce dataset, built on a Bronze/Silver/Gold medallion architecture.
ROLE
Data Engineer
TYPE
Team Final Project
YEAR
2026
1.55M+
rows processed
9
source tables
3
medallion layers
My role
As data engineer I helped model the star schema and build dbt transformations across the medallion layers, orchestrated daily runs with Apache Airflow, containerized the stack with Docker, and surfaced insights in Metabase. The pipeline processes 1.55M+ rows across nine source tables.
Impact & what I learned
A reproducible analytics pipeline that transforms raw transactional data into clean, query-ready data marts and business dashboards. I got hands-on with the modern data stack (dbt, Airflow, medallion architecture), dimensional modeling, and building containerized, reproducible workflows.
Tech stack
dbt
Apache Airflow
PostgreSQL
Docker
Metabase
Medallion architecture