Project Overview
This project is a learning project about data engineering, especially in the simple ETL (Extract, Transform, Load) stages using Apache Airflow, PostgreSQL, and Docker. Extracting transaction data from the MYSQL database used as the backend of the RM Simangat web, transforming it to suit analytical needs, and loading it into the PostgreSQL database as its data warehouse. Here, Docker is used to containerize all database and Airflow tools and configurations. Apache Airflow is used to ensure scheduling, monitoring, and data consistency throughout the process.