Michael
38340cd59c
feat: implement web scraping service using Playwright, including popup handling, smart scrolling, and specialized logic for Amazon and B&M stores.
2025-12-24 09:12:12 +01:00
Michael
931c5d42a0
chore: add script to reproduce Amazon tracking issues using a local browser.
2025-12-24 08:40:54 +01:00
Michael
a0da02ab8d
amazon tracking
2025-12-23 19:56:08 +01:00
Michael
fcb23d090d
feat: add scheduler service for automated item price and stock checks with scraping, AI extraction, and specific site parsers.
2025-12-23 10:47:15 +01:00
Michael
48f149d38f
feat: implement improved search service with persistent browser connection and update search verification script.
2025-12-22 16:05:07 +01:00
Michael
39d4107e6d
test: Update search verification query and target site.
2025-12-22 15:42:33 +01:00
Michael
0ff229de13
feat: add price verification script and update task.md to investigate comparator price extraction issues.
2025-12-22 15:24:09 +01:00
Michael
954672cfc0
feat: Add catalogue management API with enseigne, catalogue, and scraping endpoints, and integrate Cataloguemate scraper.
2025-12-22 14:46:50 +01:00
Michael
81b7cce947
feat: implement Cataloguemate.fr scraper using BrowserlessService to replace the Tiendeo scraper.
2025-12-22 14:12:16 +01:00
Michael
7842eead4a
feat: add debug_catalog_images.py to analyze catalog image selectors and update task.md to reflect the new focus on catalog image fixes.
2025-12-22 13:49:27 +01:00
Michael
d2fe4bf22b
feat: Add Cataloguemate.fr scraper using BrowserlessService to replace the Tiendeo scraper.
2025-12-22 12:39:01 +01:00
Michael
d528818c29
feat: add Cataloguemate.fr scraper, replacing Tiendeo and utilizing BrowserlessService for robust scraping.
2025-12-22 12:27:34 +01:00
Michael
1376b3f44f
chore: remove obsolete debug and verification scripts and streamline walkthrough documentation.
2025-12-22 12:22:07 +01:00
Michael
4bf950c5eb
feat: Implement HTTPX fallback in Cataloguemate scraper for enhanced reliability and add associated implementation plan and debug script.
2025-12-22 12:16:33 +01:00
Michael
17b3009b1d
feat: Implement scheduler service for automated item price and stock tracking with hybrid extraction and bot detection.
2025-12-22 11:18:39 +01:00
Michael
2fae5350b3
feat: define canonical AI extraction schema with vision-first prompt and add vision priority verification script
2025-12-22 10:38:08 +01:00
Michael
83fa8ed734
feat: Add AI extraction schemas and prompt templates, and refine price extraction logic to prioritize TTC over HT.
2025-12-18 16:57:23 +01:00
Michael
384baa3575
feat: Introduce AI extraction schema with validation, prompt generation, and a verification script to improve price extraction reliability.
2025-12-18 16:32:32 +01:00
Michael
ef7cd7c1cf
feat: Add BMStores product parser and a new Playwright-based scraping service with popup handling.
2025-12-18 15:20:19 +01:00
Michael
51ede950ff
feat: Add scheduled item tracking service with dedicated web scraping and data extraction capabilities.
2025-12-18 13:23:53 +01:00
Michael
d50b18690e
feat: Add scheduler and scraper services for automated item tracking and price extraction.
2025-12-18 12:38:32 +01:00
Michael
4e9f2662bc
feat: add Playwright-based scraping service for tracking items.
2025-12-18 11:11:30 +01:00
Michael
5428459f36
feat: Add web scraping service for tracking and AI extraction verification script.
2025-12-18 11:05:09 +01:00
Michael
6fab64b229
feat: Add ScraperService with Playwright for robust web scraping, including browser management, configurable scraping options, and automated popup handling.
2025-12-18 10:56:06 +01:00
Michael
0d68859a5b
feat: add Playwright script to scrape gifi.fr product page and extract price information.
2025-12-18 10:42:31 +01:00
Michael
97664a4a16
fix: Improve ItemService screenshot management by prioritizing latest timestamped files and ensuring complete deletion.
2025-12-18 08:50:45 +01:00
Michael
4590273801
docs: revise task.md to address screenshot update caching instead of popup obscuration.
2025-12-18 08:34:02 +01:00
Michael
ed7f23d657
chore: Update task plan to focus on removing obscuring popups from product screenshots.
2025-12-18 08:14:56 +01:00
Michael
e930f4bbfa
feat: Implement main FastAPI application entry point, including database migrations, data seeding, and background task scheduling.
2025-12-02 18:52:41 +01:00
Michael
947152e132
feat: Implement scheduler_service for automated item price and stock tracking, including AI analysis and database updates.
2025-12-02 18:03:32 +01:00
Michael
fb89af5aba
Resolve merge conflict in scheduler_service.py
2025-12-02 17:52:48 +01:00
Michael
2c0a573a66
feat: Add web scraping service using Playwright and Browserless, and a new scheduler service.
2025-12-02 17:15:28 +01:00
LogiFlow
3c87a61e53
Merge pull request #224 from R0m1k3/antigravity
...
Antigravity
2025-12-02 17:06:32 +01:00
Michael
d8b3014021
Resolve merge conflict in browserless_service.py: Keep navigation logic and fix screenshot path
2025-12-02 17:04:49 +01:00
Michael
241970cf70
feat: implement BrowserlessService for persistent browser management with auto-reconnection and enhanced price extraction.
2025-12-02 16:54:40 +01:00
LogiFlow
7a06338313
Merge pull request #223 from R0m1k3/antigravity
...
feat: Introduce BrowserlessService for persistent web scraping with e…
2025-12-02 14:00:33 +01:00
Michael
8a8ef02168
feat: Introduce BrowserlessService for persistent web scraping with enhanced Amazon price extraction, alongside initial scheduler service and task tracking.
2025-12-02 13:59:39 +01:00
LogiFlow
1512b3b967
Merge pull request #222 from R0m1k3/antigravity
...
feat: implement persistent browserless service for robust web scrapin…
2025-12-02 11:46:58 +01:00
Michael
3bbab058c6
feat: implement persistent browserless service for robust web scraping and price extraction with auto-reconnection.
2025-12-02 11:46:32 +01:00
LogiFlow
9d056b525f
Merge pull request #221 from R0m1k3/antigravity
...
feat: Add French localization file with comprehensive translations fo…
2025-12-02 09:52:20 +01:00
Michael
e7875f35a7
feat: Add French localization file with comprehensive translations for the application UI.
2025-12-02 09:51:56 +01:00
LogiFlow
a74ea6e951
Merge pull request #220 from R0m1k3/antigravity
...
Antigravity
2025-12-02 09:37:51 +01:00
Michael
86aae8f628
Merge branch 'origin/antigravity' into antigravity
...
Resolved conflict in browserless_service.py by merging Amazon interstitial selectors.
Combined local robust selectors with remote additions for maximum coverage.
2025-12-02 09:37:31 +01:00
Michael
2b21cd176c
feat: add TrackingScraperService for Playwright-based web scraping with popup handling and smart scrolling capabilities.
2025-12-02 09:28:08 +01:00
Michael
5516562cb6
fix: Handle Amazon interstitials and dynamic screenshot updates
...
- Added Amazon 'Continue' interstitial selectors to BrowserlessService
- Ported robust popup handling from TrackingScraperService to BrowserlessService
- Updated ItemService to fetch dynamic screenshot URLs from PriceHistory
(fixes issue where forced updates didn't show new screenshots)
2025-12-02 09:27:12 +01:00
LogiFlow
468ad432b9
Merge pull request #219 from R0m1k3/antigravity
...
feat: Add Playwright script to detect and analyze Amazon "Continuer l…
2025-12-01 17:27:13 +01:00
Michael
9111aa02b9
feat: Add Playwright script to detect and analyze Amazon "Continuer les achats" popup elements.
2025-12-01 17:26:47 +01:00
LogiFlow
e198ab72ab
Merge pull request #218 from R0m1k3/antigravity
...
feat: implement BrowserlessService for unified, persistent Playwright…
2025-12-01 17:14:35 +01:00
Michael
9178512465
feat: implement BrowserlessService for unified, persistent Playwright browser management with auto-reconnection and enhanced price extraction.
2025-12-01 17:14:12 +01:00
LogiFlow
8b1267cf44
Merge pull request #217 from R0m1k3/antigravity
...
feat: Add automated item checking scheduler service and new dashboard…
2025-12-01 17:09:29 +01:00
Michael
LogiFlow