وصف العملAutomated Web Scraper & Price Alert System
A lightweight, automated web scraping and price monitoring system designed to track web data and send instant alerts upon changes. Optimized specifically to run efficiently on resource-constrained hardware environments.
🛠️ Tech Stack & Environment
OS: Linux Lite (An Ubuntu-based lightweight distribution).Language: Python 3.Core Libraries:requests: For fast HTTP requests with minimal resource footprint.beautifulsoup4: For rapid static HTML parsing without the overhead of heavy headless browsers.Automation: Integrated with Cron Utility (Crontab) to schedule and execute the script silently in the background every hour.
📦 Project Architecture & State Management
Upon execution, the script autonomously initializes and manages the following local ecosystem:
price_alert_scraper.py — The core object-oriented (OOP) Python scraping script.scraper_state.json — The script's persistent memory. It stores the last scraped price and execution timestamps to prevent redundant alerts and optimize bandwidth.scraper_log.txt — A structured tracking log documenting connection statuses, timestamps, and execution lifecycles.
⚠️ Current Implementation Status
Phase: Architecture Prototype & Functional Demo.Testing: Successfully tested against the bsyet.com root domain, returning a clean 200 OK response.Data Flow: The script currently captures the first numerical value on the landing page (reflecting the platform's default subscription rate of $34.99). It uses this value to successfully validate the automated differential comparison and state-saving logic. It does not extract individual sub-product names at this stage.
🚀 Future Roadmap
Target Refinement: Migrate from the root platform domain to explicit sub-merchant e-commerce product URLs.Data Enrichment: Integrate precise CSS/XPath selectors to extract specific product names, metadata, and images.Notification Layer: Activate immediate external webhooks via the Telegram Bot API.