Commit Graph
25 Commits
Author SHA1 Message Date
Michael 7f6e97d2ba feat: Add new browserless service, update product data, and remove tracking scripts from HTML dump. 2025-12-29 17:32:18 +01:00
Michael ef7cd7c1cf feat: Add BMStores product parser and a new Playwright-based scraping service with popup handling. 2025-12-18 15:20:19 +01:00
Michael ed7f23d657 chore: Update task plan to focus on removing obscuring popups from product screenshots. 2025-12-18 08:14:56 +01:00
Michael d8b3014021 Resolve merge conflict in browserless_service.py: Keep navigation logic and fix screenshot path 2025-12-02 17:04:49 +01:00
Michael 241970cf70 feat: implement BrowserlessService for persistent browser management with auto-reconnection and enhanced price extraction. 2025-12-02 16:54:40 +01:00
Michael 8a8ef02168 feat: Introduce BrowserlessService for persistent web scraping with enhanced Amazon price extraction, alongside initial scheduler service and task tracking. 2025-12-02 13:59:39 +01:00
Michael 3bbab058c6 feat: implement persistent browserless service for robust web scraping and price extraction with auto-reconnection. 2025-12-02 11:46:32 +01:00
Michael e7875f35a7 feat: Add French localization file with comprehensive translations for the application UI. 2025-12-02 09:51:56 +01:00
Michael 86aae8f628 Merge branch 'origin/antigravity' into antigravity
Resolved conflict in browserless_service.py by merging Amazon interstitial selectors.
Combined local robust selectors with remote additions for maximum coverage.
2025-12-02 09:37:31 +01:00
Michael 5516562cb6 fix: Handle Amazon interstitials and dynamic screenshot updates
- Added Amazon 'Continue' interstitial selectors to BrowserlessService
- Ported robust popup handling from TrackingScraperService to BrowserlessService
- Updated ItemService to fetch dynamic screenshot URLs from PriceHistory
  (fixes issue where forced updates didn't show new screenshots)
2025-12-02 09:27:12 +01:00
Michael 9111aa02b9 feat: Add Playwright script to detect and analyze Amazon "Continuer les achats" popup elements. 2025-12-01 17:26:47 +01:00
Michael 9178512465 feat: implement BrowserlessService for unified, persistent Playwright browser management with auto-reconnection and enhanced price extraction. 2025-12-01 17:14:12 +01:00
Michael 9855040f3e feat: Implement improved search service with supporting models, schemas, and API routers, and refactor site verification script. 2025-11-30 23:33:05 +01:00
Michael e9f6c6e0be feat: Add BrowserlessService for persistent, auto-reconnecting browser operations with enhanced price and content extraction. 2025-11-30 14:46:21 +01:00
Michael 3813173e01 feat: add search_config module centralizing site definitions, proxy settings, user agents, and cookie banner selectors. 2025-11-30 14:14:31 +01:00
Michael c6b9befc9a feat: introduce BrowserlessService for persistent, auto-reconnecting browser operations and enhanced price extraction 2025-11-30 13:25:13 +01:00
Michael 93d73dbed8 feat: Implement BrowserlessService for robust browser automation with auto-reconnection, popup handling, and price extraction capabilities. 2025-11-30 12:43:22 +01:00
Michael 23afe4bc6c feat: Add new services for search orchestration, browser automation, and scheduling. 2025-11-30 12:39:26 +01:00
Michael 420dd3144a feat: add NewSearchService to orchestrate multi-site e-commerce searches and scrape item details. 2025-11-29 17:10:20 +01:00
Michael f976ae1127 feat: Implement web scraping and search system with centralized configuration, browserless integration, and a verification script. 2025-11-29 13:09:53 +01:00
Michael 97a8e7a951 feat: implement web scraping debugger and consolidate search site configurations. 2025-11-29 10:56:43 +01:00
Michael 22f8aedaa4 feat: Add centralized search configuration for sites, proxies, and user agents, and create browserless service module. 2025-11-29 09:51:10 +01:00
Michael f665a000af feat: add AI service for content extraction and Browserless service for web scraping 2025-11-29 09:46:29 +01:00
Michael 8d903202fb feat: introduce browserless, scheduler, and search services for advanced web scraping and data collection. 2025-11-29 09:02:34 +01:00
Michael 6019a80de9 feat: Add core search configuration for site definitions, proxies, and user agents, and introduce a browserless service. 2025-11-29 08:54:05 +01:00