ETL Data Pipeline using Docker & PostgreSQL

Project Description

This project demonstrates a complete ETL (Extract, Transform, Load) pipeline built using Python and Docker.

The application connects to a PostgreSQL database running inside a Docker container, creates a sales table, and inserts sample data automatically.

The entire system is containerized using Docker Compose, ensuring scalability, portability, and easy deployment.

Key Features

Automated database connection using psycopg2

PostgreSQL database running inside Docker

Containerized Python application

Docker Compose multi-container setup

Automatic table creation

Automated data insertion

Volume persistence for database storage

Technologies Used

Python

Docker

Docker Compose

PostgreSQL

Linux (Ubuntu)

psycopg2