Fido Fetch!
Automated ecommerce monitoring, product data extraction, price history, change detection, and competitive analysis at catalogue scale.
Overview
Fido Fetch is a Laravel and React-based product intelligence platform built to monitor ecommerce websites, track product data, detect pricing changes, identify missing products, and support competitive analysis across large product catalogues.
Problem
Ecommerce teams need to monitor competitor pricing, product availability, new products and missing/invalid product pages, but doing this manually across multiple websites is slow, inconsistent and difficult to scale.
Solution
I built an automated platform that crawls ecommerce websites, extracts product data, stores price history, tracks changes over time, and presents the results through internal dashboards and notifications.
Visual Walkthrough
Fido Fetch is supported by both a customer-facing dashboard and an internal operations platform called TheKennel, used to monitor scans, queues, crawl health and platform activity.
Key Features
- Automated product crawling and data extraction
- Product price tracking and historical price records
- Detection of price increases and decreases
- New product detection
- Missing or invalid product page detection
- Website-level scan controls
- User notifications and category counts
- Admin dashboards for product and website management
- Scheduled jobs and queue-driven workflows
- Database-backed reporting and product history
Technical Architecture
- Laravel backend
- React frontend components
- MySQL database
- Scheduled jobs and queues
- Product extraction services
- Scan logging and status tracking
- Authentication and user-specific website access
- API-style internal data flow
- Performance-conscious database queries and indexing
Technologies Used
What I Built
- Designed the database structure for websites, products, product prices, scan logs and notifications
- Built crawlers and product extraction logic
- Built dashboards for monitoring products and scan results
- Built notification flows for price changes, new products and missing products
- Added scan logging, status handling and error visibility
- Worked on performance, reliability and production troubleshooting
- Managed deployment and ongoing improvements
What It Demonstrates
This project demonstrates full-stack product development, ecommerce domain knowledge, backend architecture, database design, automation, scheduled processing, production debugging, and the ability to take an idea from concept through to a working platform.
Results & Impact
- Built to monitor 50+ ecommerce websites across the furniture sector.
- Automated manual competitor checks for price changes, new products and missing product pages.
- Created a scalable foundation that can be adapted to other ecommerce sectors.
- Improved visibility of product changes through dashboards, scan status tracking and notifications.
- Demonstrates SaaS-style product thinking, automation and full-stack delivery.
Technical Challenges
- Handling different ecommerce website structures and inconsistent product page markup.
- Detecting price changes reliably across multiple sites and product formats.
- Identifying missing products, invalid pages, redirects and unavailable listings.
- Keeping scans trackable with progress indicators, logs and status updates.
- Using scheduled jobs and queue-style workflows to avoid long-running manual processes.
- Designing dashboards that make large amounts of product data understandable quickly.
Explore Fido Fetch!
Visit the product intelligence platform to learn more.