Michael
38340cd59c
feat: implement web scraping service using Playwright, including popup handling, smart scrolling, and specialized logic for Amazon and B&M stores.
2025-12-24 09:12:12 +01:00
Michael
931c5d42a0
chore: add script to reproduce Amazon tracking issues using a local browser.
2025-12-24 08:40:54 +01:00
Michael
a0da02ab8d
amazon tracking
2025-12-23 19:56:08 +01:00
Michael
384baa3575
feat: Introduce AI extraction schema with validation, prompt generation, and a verification script to improve price extraction reliability.
2025-12-18 16:32:32 +01:00
Michael
ef7cd7c1cf
feat: Add BMStores product parser and a new Playwright-based scraping service with popup handling.
2025-12-18 15:20:19 +01:00
Michael
51ede950ff
feat: Add scheduled item tracking service with dedicated web scraping and data extraction capabilities.
2025-12-18 13:23:53 +01:00
Michael
d50b18690e
feat: Add scheduler and scraper services for automated item tracking and price extraction.
2025-12-18 12:38:32 +01:00
Michael
4e9f2662bc
feat: add Playwright-based scraping service for tracking items.
2025-12-18 11:11:30 +01:00
Michael
5428459f36
feat: Add web scraping service for tracking and AI extraction verification script.
2025-12-18 11:05:09 +01:00
Michael
6fab64b229
feat: Add ScraperService with Playwright for robust web scraping, including browser management, configurable scraping options, and automated popup handling.
2025-12-18 10:56:06 +01:00
Michael
4590273801
docs: revise task.md to address screenshot update caching instead of popup obscuration.
2025-12-18 08:34:02 +01:00
Michael
2c0a573a66
feat: Add web scraping service using Playwright and Browserless, and a new scheduler service.
2025-12-02 17:15:28 +01:00
Michael
2b21cd176c
feat: add TrackingScraperService for Playwright-based web scraping with popup handling and smart scrolling capabilities.
2025-12-02 09:28:08 +01:00
Michael
f223dc5a29
feat: Increase Amazon limit to 50 and fix screenshot framing
...
- Increased default Amazon search results limit from 20 to 50 in backend and frontend
- Improved TrackingScraperService to target main product area on Amazon (avoiding reviews)
- Added specific selectors for Amazon product page (#imgTagWrapperId, #productTitle, etc.)
2025-12-01 16:18:35 +01:00
Michael
a792060f08
feat: Add TrackingScraperService with enhanced popup handling for screenshots
...
- Add 47 popup selectors (vs 12 generic before)
- Support French RGPD platforms (Axeptio, Didomi, OneTrust, TarteAuCitron)
- Amazon-specific detection and handling (6 selectors)
- Retry logic with verification pass
- Double popup cleanup before screenshot
- Increased timeouts for slow animations
- New _verify_no_popups() helper function
This resolves popup visibility issues in the Suivi/Dashboard screenshots.
2025-12-01 12:27:51 +01:00
Michael