تفاصيل العمل

وصف العملAutomated Web Scraper & Price Alert System

A lightweight, automated web scraping and price monitoring system designed to track web data and send instant alerts upon changes. Optimized specifically to run efficiently on resource-constrained hardware environments.

🛠️ Tech Stack & Environment

OS: Linux Lite (An Ubuntu-based lightweight distribution).Language: Python 3.Core Libraries:requests: For fast HTTP requests with minimal resource footprint.beautifulsoup4: For rapid static HTML parsing without the overhead of heavy headless browsers.Automation: Integrated with Cron Utility (Crontab) to schedule and execute the script silently in the background every hour.

📦 Project Architecture & State Management

Upon execution, the script autonomously initializes and manages the following local ecosystem:

price_alert_scraper.py — The core object-oriented (OOP) Python scraping script.scraper_state.json — The script's persistent memory. It stores the last scraped price and execution timestamps to prevent redundant alerts and optimize bandwidth.scraper_log.txt — A structured tracking log documenting connection statuses, timestamps, and execution lifecycles.

⚠️ Current Implementation Status

Phase: Architecture Prototype & Functional Demo.Testing: Successfully tested against the bsyet.com root domain, returning a clean 200 OK response.Data Flow: The script currently captures the first numerical value on the landing page (reflecting the platform's default subscription rate of $34.99). It uses this value to successfully validate the automated differential comparison and state-saving logic. It does not extract individual sub-product names at this stage.

🚀 Future Roadmap

Target Refinement: Migrate from the root platform domain to explicit sub-merchant e-commerce product URLs.Data Enrichment: Integrate precise CSS/XPath selectors to extract specific product names, metadata, and images.Notification Layer: Activate immediate external webhooks via the Telegram Bot API.

ملفات مرفقة

بطاقة العمل

اسم المستقل
عدد الإعجابات
0
تاريخ الإضافة
تاريخ الإنجاز
المهارات