Commit Graph
130 Commits
Author SHA1 Message Date
Michael 99650a992b feat: Add Cataloguemate.fr scraper to replace Tiendeo and introduce new Catalogues frontend page. 2025-11-30 11:17:28 +01:00
Michael 03d79e45fb feat: Introduce Cataloguemate.fr scraper service and associated catalogue administration UI. 2025-11-30 10:49:47 +01:00
Michael d772e85ae4 feat: Add catalogue and enseigne API endpoints with scraping and scheduling services. 2025-11-30 10:39:16 +01:00
Michael df8fbded92 feat: add Cataloguemate.fr scraper to replace Tiendeo and utilize BrowserlessService for robust scraping. 2025-11-30 02:47:11 +01:00
Michael cde1f75d3a feat: Add Cataloguemate.fr scraper service to replace Tiendeo, utilizing BrowserlessService for robust scraping. 2025-11-30 02:45:24 +01:00
Michael 101e5f0656 feat: add Cataloguemate.fr scraper to replace Tiendeo and utilize BrowserlessService for catalog and page scraping 2025-11-30 02:42:53 +01:00
Michael efb161a5ef feat: Add Cataloguemate.fr scraper, replacing Tiendeo and utilizing BrowserlessService for catalog and page scraping. 2025-11-30 02:35:27 +01:00
Michael ec97822087 feat: Implement Cataloguemate.fr scraper using BrowserlessService to replace Tiendeo and fetch promotional catalogs. 2025-11-30 02:29:58 +01:00
Michael 1176eec95a feat: add Cataloguemate.fr scraper service for promotional catalogs. 2025-11-30 02:13:42 +01:00
Michael 69cfa4cfa9 feat: add Cataloguemate.fr scraper to replace Tiendeo for improved reliability and simpler structure. 2025-11-30 02:09:24 +01:00
Michael c6dd114584 feat: Add Cataloguemate.fr scraper service to replace Tiendeo for promotional catalog data. 2025-11-30 02:05:40 +01:00
Michael af096c7980 feat: Implement Cataloguemate.fr scraper service, add catalogue router and scheduler, and remove Tiendeo scraper verification. 2025-11-30 01:56:56 +01:00
Michael 544825e354 feat: add Tiendeo.fr catalog scraper service using Crawl4AI for promotional catalogs. 2025-11-30 01:33:46 +01:00
Michael 607f47c0f0 feat: add Tiendeo.fr scraper service using Crawl4AI for promotional catalog extraction and parsing. 2025-11-30 01:29:00 +01:00
Michael 2b974aacf9 feat: Implement Tiendeo.fr scraper using Crawl4AI to extract promotional catalogs and their pages. 2025-11-30 01:17:40 +01:00
Michael 2692f76cf0 feat: add Tiendeo.fr scraper service for promotional catalogs using Crawl4AI 2025-11-30 01:12:25 +01:00
Michael 79612690b3 feat: add Tiendeo scraper service with Crawl4AI and update project dependencies and Dockerfile. 2025-11-30 01:06:08 +01:00
Michael 34ac9b343a feat: add Bonial and Tiendeo catalog scrapers 2025-11-30 00:22:36 +01:00
Michael a7aefb3e56 feat: add Bonial.fr catalog scraper service using Playwright. 2025-11-29 23:59:50 +01:00
Michael 1fc0c6e69e feat: Implement Bonial.fr scraper service to extract promotional catalogs using Playwright. 2025-11-29 23:55:44 +01:00
Michael 2f492cfe03 feat: Implement Bonial.fr scraper service using Playwright to extract promotional catalogs. 2025-11-29 23:45:30 +01:00
Michael 468b11c195 feat: Add Bonial.fr scraper service using Playwright to extract promotional catalogs and their details. 2025-11-29 23:33:36 +01:00
Michael b7f049d414 feat: Implement Bonial.fr scraper service using Playwright to extract promotional catalogs and their details. 2025-11-29 23:25:44 +01:00
Michael 3d3d7c18c1 feat: implement Bonial.fr scraper service for promotional catalogs using Playwright. 2025-11-29 22:31:24 +01:00
Michael da90ea12f2 feat: implement Bonial.fr catalog scraper using Playwright 2025-11-29 20:04:06 +01:00
Michael c011f1d6bf feat: Add Bonial.fr scraper service to fetch promotional catalogs using Playwright. 2025-11-29 19:57:32 +01:00
Michael c8fcfd7a4d feat: Add Bonial.fr scraper service for promotional catalogs. 2025-11-29 19:51:34 +01:00
Michael debc1a973f feat: implement scheduled catalog scraping service 2025-11-29 19:36:52 +01:00
Michael 58e6be3f0d feat: Add initial application structure, core data models, and a new catalog module with Bonial scraping capabilities. 2025-11-29 19:26:56 +01:00
Michael 5d7f872dae feat: Add new search service for multi-site product search and item detail scraping. 2025-11-29 17:28:59 +01:00
Michael 420dd3144a feat: add NewSearchService to orchestrate multi-site e-commerce searches and scrape item details. 2025-11-29 17:10:20 +01:00
Michael 48d1ab3a05 feat: introduce new search service to orchestrate multi-site product searches and scrape item details. 2025-11-29 14:17:46 +01:00
Michael 30dfb44517 feat: Add new multi-site search service with browserless and AI integration, including site-specific configurations. 2025-11-29 13:52:07 +01:00
Michael f976ae1127 feat: Implement web scraping and search system with centralized configuration, browserless integration, and a verification script. 2025-11-29 13:09:53 +01:00
Michael 0f5c6dc1c6 feat: introduce NewSearchService to orchestrate e-commerce searches and scrape product details. 2025-11-29 11:05:01 +01:00
Michael 97a8e7a951 feat: implement web scraping debugger and consolidate search site configurations. 2025-11-29 10:56:43 +01:00
Michael bcc3b0900f feat: Add core search configuration and service for web scraping, including site-specific selectors, proxies, and user agents. 2025-11-29 10:32:01 +01:00
Michael 292eb3d12e feat: Add NewSearchService for orchestrating e-commerce searches, including site-specific parsing and AI-powered item detail scraping. 2025-11-29 09:59:58 +01:00
Michael 22f8aedaa4 feat: Add centralized search configuration for sites, proxies, and user agents, and create browserless service module. 2025-11-29 09:51:10 +01:00
Michael f665a000af feat: add AI service for content extraction and Browserless service for web scraping 2025-11-29 09:46:29 +01:00
Michael 86559ff2d7 feat: implement NewSearchService for orchestrating e-commerce searches, parsing results, and scraping item details. 2025-11-29 09:37:33 +01:00
Michael 867274a9ab feat: Introduce AI service for data extraction, including dynamic configuration, response parsing, and repair. 2025-11-29 09:27:35 +01:00
Michael 8d903202fb feat: introduce browserless, scheduler, and search services for advanced web scraping and data collection. 2025-11-29 09:02:34 +01:00
Michael 654145d499 Merge origin/main into antigravity: Resolve conflict by accepting deletion of direct_search_service.py 2025-11-29 08:57:48 +01:00
Michael 6019a80de9 feat: Add core search configuration for site definitions, proxies, and user agents, and introduce a browserless service. 2025-11-29 08:54:05 +01:00
Michael b6c1fc1cda feat: Add AI-powered data extraction and direct search services 2025-11-29 02:53:35 +01:00
Michael a6662e8891 feat: Add direct e-commerce search service using Playwright/Browserless with anti-bot measures and Amazon-specific handling. 2025-11-29 02:38:18 +01:00
Michael 352fc72bfa feat: Implement direct e-commerce search service using Playwright and Browserless with anti-bot and proxy rotation capabilities. 2025-11-29 02:31:30 +01:00
Michael fa890f67dc feat: add direct e-commerce search service using Playwright with anti-bot measures for scraping. 2025-11-29 02:24:20 +01:00
Michael bad2cfca20 feat: Add direct e-commerce search service using Playwright with anti-bot measures including rotating proxies, user agents, and stealth JavaScript. 2025-11-29 02:17:17 +01:00