weather-crawler-airflow

This project implements a Kubernetes-based weather data collection system using:

RKE2 Kubernetes Cluster (1 master, 1 worker)

Rancher for cluster management

Apache Airflow for scheduled execution

MongoDB for data storage

Python Crawler that fetches weather data from 3 sources