Designed a full-stack AI-powered programming teaching assistant, integrating local and cloud LLMs for real
time hints and automated quizzes.
•
Full-Stack Architecture: Built a microservices full-stack app (React 18/ Vite, Express, FastAPI, PostgreSQL)
with 8 Dockerized services via Docker Compose.
•
AI/ML Integration: Engineered a multi-model inference pipeline (Ollama, Groq, OpenAI-compatible), with
context-aware hints, off-topic filtering, and video-based quizzes.
•
Infrastructure & DevOps: Containerized the stack with Docker Compose, adding health checks, auto-restart,
GPU passthrough, and S3-compatible storage for media.
•
Security & Auth: Integrated Firebase auth, token-based API security, and encrypted API key storage for BYO
model support.