551 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Michael	acfc5c6397	feat: Enhance Amazon stealth with comprehensive anti-detection ... Added comprehensive stealth techniques to bypass Amazon bot detection: - Complete HTTP headers (Accept, Accept-Language, Sec-Fetch-*, etc.) - Extended chrome object with loadTimes, csi, app - Permissions API override - Plugins, languages, platform spoofing - Battery API mocking This significantly improves bot detection evasion compared to the basic 2-line stealth that was insufficient for Amazon's detection systems.	2025-12-01 13:55:57 +01:00
LogiFlow	aaad0abf90	Merge pull request #213 from R0m1k3/antigravity ... Antigravity	2025-12-01 13:29:12 +01:00
Michael	2429fa2018	Revert "fix: Remove homepage redirect to avoid Amazon bot detection" ... This reverts commit 5d3d181f5e.	2025-12-01 13:26:05 +01:00
Michael	5d3d181f5e	fix: Remove homepage redirect to avoid Amazon bot detection ... Amazon detects the homepage-then-search pattern as bot behavior and blocks with 2065 byte pages. Now navigating directly to search URL to appear more natural. This reverts the homepage loading strategy from commit 85b19e7 as Amazon's bot detection has evolved and now flags this pattern.	2025-12-01 13:25:51 +01:00
LogiFlow	000829078a	Merge pull request #212 from R0m1k3/antigravity ... fix: Disable ImprovedSearchService auto-init to restore Amazon functi…	2025-12-01 13:23:00 +01:00
Michael	95846ec606	fix: Disable ImprovedSearchService auto-init to restore Amazon functionality ... ImprovedSearchService and AmazonScraperService were both connecting to Browserless at startup, causing connection conflicts and Amazon blocking (2065 byte pages). Now only AmazonScraperService initializes at startup, keeping Browserless in continuous connection for Amazon. ImprovedSearchService will initialize on-demand when needed. This restores Amazon search to working state as it was at commit 85b19e7.	2025-12-01 13:21:32 +01:00
Michael	8dd3082a9a	Merge branch 'antigravity' into main - Resolve conflicts ... Resolved conflicts by keeping antigravity improvements: - tracking_scraper_service.py: 47 popup selectors with RGPD/Amazon support - main.py: No auto-init of TrackingScraperService (on-demand only) This brings all popup handling improvements to main branch.	2025-12-01 13:13:58 +01:00
Michael	53a05f45e4	fix: Remove auto-initialization of TrackingScraperService to fix Amazon scraper ... TrackingScraperService now initializes on-demand instead of at startup. This prevents connection conflicts with AmazonScraperService and ImprovedSearchService since all services connect to the same Browserless instance. Fixes: Amazon scraper blocking issue (page too small - 2065 bytes)	2025-12-01 13:05:49 +01:00
Michael	e2a874bf6c	feat: implement TrackingScraperService for robust web scraping with Playwright, including shared browser management and popup handling.	2025-12-01 12:42:14 +01:00
Michael	a792060f08	feat: Add TrackingScraperService with enhanced popup handling for screenshots ... - Add 47 popup selectors (vs 12 generic before) - Support French RGPD platforms (Axeptio, Didomi, OneTrust, TarteAuCitron) - Amazon-specific detection and handling (6 selectors) - Retry logic with verification pass - Double popup cleanup before screenshot - Increased timeouts for slow animations - New _verify_no_popups() helper function This resolves popup visibility issues in the Suivi/Dashboard screenshots.	2025-12-01 12:27:51 +01:00
Michael	22e15515f6	Merge branch 'main' of https://github.com/R0m1k3/Priceflow	2025-12-01 11:32:14 +01:00
Michael	f27a75d9d6	feat: Implement initial application structure with routing, authentication flow, and responsive layout.	2025-12-01 11:32:12 +01:00
LogiFlow	4d11dfe820	Merge pull request #210 from R0m1k3/antigravity ... feat: introduce centralized search configuration for scraping, includ…	2025-12-01 09:34:21 +01:00
Michael	7592c2781e	feat: Implement the core FastAPI application, including database migrations, service orchestration, and a new tracking scraper service.	2025-12-01 09:32:37 +01:00
Michael	ffc2f0d632	feat: introduce centralized search configuration for scraping, including site selectors, proxies, and user agents.	2025-12-01 07:40:50 +01:00
LogiFlow	cf621da596	Merge pull request #209 from R0m1k3/antigravity ... feat: Introduce `ImprovedSearchService` utilizing Playwright for pers…	2025-12-01 01:30:27 +01:00
Michael	36ae466583	feat: Introduce ImprovedSearchService utilizing Playwright for persistent browser-based e-commerce scraping and price extraction, along with new search configuration.	2025-12-01 01:30:06 +01:00
LogiFlow	53b2b1e7fb	Merge pull request #208 from R0m1k3/antigravity ... feat: Add improved search and AI price extraction services, update Do…	2025-12-01 01:21:05 +01:00
Michael	b35401a87b	feat: Add improved search and AI price extraction services, update Docker Compose, and introduce benchmark verification script.	2025-12-01 01:20:39 +01:00
LogiFlow	2647ad5908	Merge pull request #207 from R0m1k3/antigravity ... feat: implement a new persistent browser-based search service for e-c…	2025-12-01 01:12:15 +01:00
Michael	8303e767f7	feat: implement a new persistent browser-based search service for e-commerce scraping.	2025-12-01 01:11:42 +01:00
LogiFlow	d7927dbb44	Merge pull request #206 from R0m1k3/antigravity ... feat: Add `ImprovedSearchService` for persistent browser-based e-comm…	2025-12-01 01:07:44 +01:00
Michael	8bad965e29	feat: Add ImprovedSearchService for persistent browser-based e-commerce search scraping.	2025-12-01 01:07:22 +01:00
LogiFlow	a0ff7d2311	Merge pull request #205 from R0m1k3/antigravity ... feat: Add ImprovedSearchService for persistent browser-based e-commer…	2025-12-01 01:06:04 +01:00
Michael	759a28b2d4	feat: Add ImprovedSearchService for persistent browser-based e-commerce search and scraping.	2025-12-01 01:05:40 +01:00
LogiFlow	185bcf55e5	Merge pull request #204 from R0m1k3/antigravity ... feat: add improved search service with persistent browser connection	2025-12-01 01:04:11 +01:00
Michael	4dbb9f6424	feat: add improved search service with persistent browser connection	2025-12-01 01:03:51 +01:00
LogiFlow	8b6a3e9229	Merge pull request #203 from R0m1k3/antigravity ... feat: implement product search page with site selection, real-time re…	2025-12-01 01:02:14 +01:00
Michael	93840804a4	feat: implement product search page with site selection, real-time results, and monitoring integration	2025-12-01 01:01:53 +01:00
LogiFlow	7eac22aebf	Merge pull request #202 from R0m1k3/antigravity ... feat: Add improved search service with persistent browser connection …	2025-12-01 01:00:46 +01:00
Michael	39893e8c1e	feat: Add improved search service with persistent browser connection for e-commerce scraping.	2025-12-01 01:00:25 +01:00
LogiFlow	548cd296f4	Merge pull request #201 from R0m1k3/antigravity ... feat: Implement AI-powered price extraction using Gemma 2 and an impr…	2025-12-01 00:57:27 +01:00
Michael	b5c5961618	feat: Implement AI-powered price extraction using Gemma 2 and an improved search service with persistent browser connections for web scraping.	2025-12-01 00:57:05 +01:00
LogiFlow	14448ffe4b	Merge pull request #200 from R0m1k3/antigravity ... feat: Implement comprehensive search configurations for discount stor…	2025-12-01 00:37:25 +01:00
Michael	c159036583	feat: Implement comprehensive search configurations for discount stores and add Gifi-specific search and analysis tools.	2025-12-01 00:36:54 +01:00
LogiFlow	0d300085d6	Merge pull request #199 from R0m1k3/antigravity ... feat: introduce new search configuration, improved search service, an…	2025-11-30 23:55:09 +01:00
Michael	63073d03b5	feat: introduce new search configuration, improved search service, and Carrefour search integration test.	2025-11-30 23:54:48 +01:00
LogiFlow	6ae2c41b00	Merge pull request #198 from R0m1k3/antigravity ... feat: introduce improved search service with persistent browser and m…	2025-11-30 23:54:20 +01:00
Michael	bf97cd22e7	feat: introduce improved search service with persistent browser and modular parsers	2025-11-30 23:49:34 +01:00
LogiFlow	c1e350affa	Merge pull request #197 from R0m1k3/antigravity ... feat: add improved search service with persistent browser connection …	2025-11-30 23:46:14 +01:00
Michael	7cb0e2f94b	feat: add improved search service with persistent browser connection and modular site-specific parsers	2025-11-30 23:45:51 +01:00
LogiFlow	b21b000eb5	Merge pull request #196 from R0m1k3/antigravity ... feat: implement improved search service using persistent browser conn…	2025-11-30 23:43:32 +01:00
Michael	8bf9ddb2d7	feat: implement improved search service using persistent browser connection and modular parsers, alongside a BeautifulSoup check utility.	2025-11-30 23:43:11 +01:00
LogiFlow	2d7373b075	Merge pull request #195 from R0m1k3/antigravity ... feat: introduce improved search service with persistent browser conne…	2025-11-30 23:40:49 +01:00
Michael	87568866e7	feat: introduce improved search service with persistent browser connection and modular site-specific parsers.	2025-11-30 23:40:22 +01:00
LogiFlow	f9f2f0ebc2	Merge pull request #194 from R0m1k3/antigravity ... feat: add improved search service with persistent browser, modular pa…	2025-11-30 23:35:58 +01:00
Michael	4dd77bd889	feat: add improved search service with persistent browser, modular parsers, and popup handling.	2025-11-30 23:35:40 +01:00
LogiFlow	6a1034666e	Merge pull request #193 from R0m1k3/antigravity ... feat: Implement improved search service with supporting models, schem…	2025-11-30 23:33:27 +01:00
Michael	9855040f3e	feat: Implement improved search service with supporting models, schemas, and API routers, and refactor site verification script.	2025-11-30 23:33:05 +01:00
LogiFlow	5e377e5d30	Merge pull request #192 from R0m1k3/antigravity ... feat: Implement improved search service with persistent browser and m…	2025-11-30 22:21:33 +01:00