Loans Analysis Project

we’ve worked hard as a team to design and build a complete data pipeline and analytics solution focused on loan credit analysis. This project combined both batch and streaming data processing and was built using modern cloud and big data technologies.

️ Tech Stack:

Apache Spark for ETL and data transformation (Batch + Streaming)

Apache Kafka for real-time data ingestion

Apache Airflow for orchestrating workflows

Snowflake as the cloud data warehouse

Power BI for reporting and dashboarding

Source data: 5 years of loan data (CSV files)

What We Delivered:

A complete ETL pipeline from raw files to Snowflake.

Streaming pipeline with real-time processing using Kafka and Spark.

Interactive dashboard in Power BI for business insights.

A scalable and reliable data warehouse design.