Commit Graph
29 Commits
Author SHA1 Message Date
Michael ffc2f0d632 feat: introduce centralized search configuration for scraping, including site selectors, proxies, and user agents. 2025-12-01 07:40:50 +01:00
Michael 36ae466583 feat: Introduce ImprovedSearchService utilizing Playwright for persistent browser-based e-commerce scraping and price extraction, along with new search configuration. 2025-12-01 01:30:06 +01:00
Michael c159036583 feat: Implement comprehensive search configurations for discount stores and add Gifi-specific search and analysis tools. 2025-12-01 00:36:54 +01:00
Michael 63073d03b5 feat: introduce new search configuration, improved search service, and Carrefour search integration test. 2025-11-30 23:54:48 +01:00
Michael 9855040f3e feat: Implement improved search service with supporting models, schemas, and API routers, and refactor site verification script. 2025-11-30 23:33:05 +01:00
Michael 64067347d1 feat: implement new search service with multiple site parsers, search configuration, and supporting inspection/verification scripts. 2025-11-30 22:04:14 +01:00
Michael b44082aeb4 feat: Implement new product parsers for Stokomani, Auchan, Carrefour, and Gifi, and add a centralized search configuration module. 2025-11-30 20:26:19 +01:00
Michael 078060f155 feat: Add abstract base parser with product result dataclass and implement Stokomani parser for search results. 2025-11-30 19:03:26 +01:00
Michael c2f042beee feat: Implement improved search service with centralized configuration and site-specific parsers for various retailers. 2025-11-30 18:05:34 +01:00
Michael 33d9042b10 feat: add search_config module for browserless, proxy, user agent, and site-specific search configurations, and create list_missing_sites script. 2025-11-30 16:57:44 +01:00
Michael 7ba8850838 feat: Implement new search service with comprehensive configuration for various e-commerce sites, proxies, and user agents. 2025-11-30 16:36:51 +01:00
Michael f20bae52bd feat: introduce core search configuration for sites, proxies, and user agents, alongside selector diagnosis and HTML dumping utilities. 2025-11-30 16:27:02 +01:00
Michael 79dc4bfafc feat: Implement centralized search configuration with site definitions, proxy settings, and user agents, and add a debugging script. 2025-11-30 15:58:27 +01:00
Michael 3813173e01 feat: add search_config module centralizing site definitions, proxy settings, user agents, and cookie banner selectors. 2025-11-30 14:14:31 +01:00
Michael 906c6b483d feat: add core search configuration including Browserless settings, proxies, user agents, site-specific selectors, and cookie banner handlers. 2025-11-29 18:28:20 +01:00
Michael b47af1655d feat: add debug script to display search site configurations and database entries 2025-11-29 17:46:20 +01:00
Michael 5d7f872dae feat: Add new search service for multi-site product search and item detail scraping. 2025-11-29 17:28:59 +01:00
Michael 74bdcfa63e feat: introduce search configuration for sites, proxies, user agents, and cookie banners. 2025-11-29 17:22:28 +01:00
Michael 420dd3144a feat: add NewSearchService to orchestrate multi-site e-commerce searches and scrape item details. 2025-11-29 17:10:20 +01:00
Michael 30dfb44517 feat: Add new multi-site search service with browserless and AI integration, including site-specific configurations. 2025-11-29 13:52:07 +01:00
Michael 8399b819da feat: Add centralized search configuration for e-commerce sites and a verification script. 2025-11-29 13:21:45 +01:00
Michael f976ae1127 feat: Implement web scraping and search system with centralized configuration, browserless integration, and a verification script. 2025-11-29 13:09:53 +01:00
Michael 7f85a9764c feat: Add Stokomani raw HTML data and new search configuration. 2025-11-29 11:25:49 +01:00
Michael 66a8371665 feat: Add centralized search configuration including site definitions, proxies, user agents, and cookie acceptance selectors. 2025-11-29 11:09:48 +01:00
Michael 0f5c6dc1c6 feat: introduce NewSearchService to orchestrate e-commerce searches and scrape product details. 2025-11-29 11:05:01 +01:00
Michael 97a8e7a951 feat: implement web scraping debugger and consolidate search site configurations. 2025-11-29 10:56:43 +01:00
Michael bcc3b0900f feat: Add core search configuration and service for web scraping, including site-specific selectors, proxies, and user agents. 2025-11-29 10:32:01 +01:00
Michael 22f8aedaa4 feat: Add centralized search configuration for sites, proxies, and user agents, and create browserless service module. 2025-11-29 09:51:10 +01:00
Michael 6019a80de9 feat: Add core search configuration for site definitions, proxies, and user agents, and introduce a browserless service. 2025-11-29 08:54:05 +01:00