4 Commits

Include renames

Author	SHA1	Message	Date
Claude	5bee3e3396	feat: Add more site configs and fix screenshot display ... - Add search URLs for French discount stores: stokomani, gifi, bmstores, centrakor, lafoirfouille, tedi, leclerc, carrefour, auchan - Fix screenshot URL construction in search results - Include screenshot_url in AI extraction results and error cases	2025-11-22 15:24:02 +00:00
Claude	ccc9c0080e	fix: Fix AI service call and domain URL building ... - Use AIService.analyze_image() class method instead of module function - Handle AIExtractionResponse tuple return type properly - Add _clean_domain() to strip protocol/www from stored domains - Fixes "https://https://" URL duplication issue	2025-11-22 15:09:50 +00:00
Claude	df613cf64f	fix: Use Browserless for search page scraping ... - Replace httpx with Playwright/Browserless for search pages - Handles JavaScript-rendered content and bot detection - Add wait selectors for each site to ensure content is loaded - Block images and tracking scripts for faster loading - Sequential site scraping to avoid overloading Browserless	2025-11-22 15:05:47 +00:00
Claude	3b095801c5	feat: Replace DuckDuckGo with direct site search ... - Remove duckduckgo-search dependency (unreliable results) - Add direct_search_service.py that scrapes sites' search pages directly - Add search_url and product_link_selector fields to SearchSite model - Add beautifulsoup4 and lxml for HTML parsing - Update schemas with new fields - Add database migration for new columns Direct search is more reliable as it queries each site's own search functionality instead of relying on external search engines.	2025-11-22 15:00:49 +00:00