Commit Graph
283 Commits
Author SHA1 Message Date
Michael df8fbded92 feat: add Cataloguemate.fr scraper to replace Tiendeo and utilize BrowserlessService for robust scraping. 2025-11-30 02:47:11 +01:00
Michael cde1f75d3a feat: Add Cataloguemate.fr scraper service to replace Tiendeo, utilizing BrowserlessService for robust scraping. 2025-11-30 02:45:24 +01:00
Michael 101e5f0656 feat: add Cataloguemate.fr scraper to replace Tiendeo and utilize BrowserlessService for catalog and page scraping 2025-11-30 02:42:53 +01:00
Michael efb161a5ef feat: Add Cataloguemate.fr scraper, replacing Tiendeo and utilizing BrowserlessService for catalog and page scraping. 2025-11-30 02:35:27 +01:00
Michael 11d297764d feat: Add API endpoints for managing and querying catalogues, enseignes, and scraping statistics. 2025-11-30 02:33:15 +01:00
Michael ec97822087 feat: Implement Cataloguemate.fr scraper using BrowserlessService to replace Tiendeo and fetch promotional catalogs. 2025-11-30 02:29:58 +01:00
Michael 1176eec95a feat: add Cataloguemate.fr scraper service for promotional catalogs. 2025-11-30 02:13:42 +01:00
Michael 69cfa4cfa9 feat: add Cataloguemate.fr scraper to replace Tiendeo for improved reliability and simpler structure. 2025-11-30 02:09:24 +01:00
Michael c6dd114584 feat: Add Cataloguemate.fr scraper service to replace Tiendeo for promotional catalog data. 2025-11-30 02:05:40 +01:00
Michael be3de83601 feat: add script to debug catalog list and page content extraction for cataloguemate.fr 2025-11-30 02:00:59 +01:00
Michael af096c7980 feat: Implement Cataloguemate.fr scraper service, add catalogue router and scheduler, and remove Tiendeo scraper verification. 2025-11-30 01:56:56 +01:00
Michael 544825e354 feat: add Tiendeo.fr catalog scraper service using Crawl4AI for promotional catalogs. 2025-11-30 01:33:46 +01:00
Michael 607f47c0f0 feat: add Tiendeo.fr scraper service using Crawl4AI for promotional catalog extraction and parsing. 2025-11-30 01:29:00 +01:00
Michael 2b974aacf9 feat: Implement Tiendeo.fr scraper using Crawl4AI to extract promotional catalogs and their pages. 2025-11-30 01:17:40 +01:00
Michael 2692f76cf0 feat: add Tiendeo.fr scraper service for promotional catalogs using Crawl4AI 2025-11-30 01:12:25 +01:00
Michael 79612690b3 feat: add Tiendeo scraper service with Crawl4AI and update project dependencies and Dockerfile. 2025-11-30 01:06:08 +01:00
Michael 34ac9b343a feat: add Bonial and Tiendeo catalog scrapers 2025-11-30 00:22:36 +01:00
Michael a7aefb3e56 feat: add Bonial.fr catalog scraper service using Playwright. 2025-11-29 23:59:50 +01:00
Michael 1fc0c6e69e feat: Implement Bonial.fr scraper service to extract promotional catalogs using Playwright. 2025-11-29 23:55:44 +01:00
Michael 2f492cfe03 feat: Implement Bonial.fr scraper service using Playwright to extract promotional catalogs. 2025-11-29 23:45:30 +01:00
Michael 468b11c195 feat: Add Bonial.fr scraper service using Playwright to extract promotional catalogs and their details. 2025-11-29 23:33:36 +01:00
Michael b7f049d414 feat: Implement Bonial.fr scraper service using Playwright to extract promotional catalogs and their details. 2025-11-29 23:25:44 +01:00
Michael 6ed923c1ee feat: add CatalogueAdmin component to manage and monitor catalogue scraping operations. 2025-11-29 23:17:28 +01:00
Michael 09a647a437 feat: Implement API endpoints for retrieving enseignes, paginated catalogues, detailed catalogue information, catalogue pages, and scraping statistics. 2025-11-29 23:11:28 +01:00
Michael 237e4a2adf feat: add Vite configuration with React plugin and path aliases. 2025-11-29 23:02:52 +01:00
Michael 5be93653ef feat: add Vite configuration for React project, including path aliases and build output directory. 2025-11-29 22:59:40 +01:00
Michael efb5211621 feat: add CatalogueAdmin component to manage catalogue scraping, display statistics, and view logs. 2025-11-29 22:55:09 +01:00
Michael 5c0d5cebf7 feat: Add Catalogues page for displaying, searching, and filtering promotional catalogues by enseigne. 2025-11-29 22:50:44 +01:00
Michael b224c4988a feat: implement API router for catalogue and enseigne management with filtering and pagination 2025-11-29 22:39:34 +01:00
Michael 3d3d7c18c1 feat: implement Bonial.fr scraper service for promotional catalogs using Playwright. 2025-11-29 22:31:24 +01:00
Michael ba932b79ef feat: add Bonial.fr catalog scraper service using Playwright for promotional catalog data extraction. 2025-11-29 20:35:23 +01:00
Michael da90ea12f2 feat: implement Bonial.fr catalog scraper using Playwright 2025-11-29 20:04:06 +01:00
Michael c011f1d6bf feat: Add Bonial.fr scraper service to fetch promotional catalogs using Playwright. 2025-11-29 19:57:32 +01:00
Michael c8fcfd7a4d feat: Add Bonial.fr scraper service for promotional catalogs. 2025-11-29 19:51:34 +01:00
Michael debc1a973f feat: implement scheduled catalog scraping service 2025-11-29 19:36:52 +01:00
Michael 1bdeb272d6 fix: Correct alembic upgrade command from head to heads. 2025-11-29 19:34:58 +01:00
Michael b9059aeeda chore: Add Alembic merge migration for catalog module and notification channels. 2025-11-29 19:32:54 +01:00
Michael 58e6be3f0d feat: Add initial application structure, core data models, and a new catalog module with Bonial scraping capabilities. 2025-11-29 19:26:56 +01:00
Michael 906c6b483d feat: add core search configuration including Browserless settings, proxies, user agents, site-specific selectors, and cookie banner handlers. 2025-11-29 18:28:20 +01:00
Michael a0a48ced19 feat: add script to verify search service functionality across all configured sites, including Browserless connection and detailed reporting. 2025-11-29 18:15:12 +01:00
Michael b47af1655d feat: add debug script to display search site configurations and database entries 2025-11-29 17:46:20 +01:00
Michael 5d7f872dae feat: Add new search service for multi-site product search and item detail scraping. 2025-11-29 17:28:59 +01:00
Michael 74bdcfa63e feat: introduce search configuration for sites, proxies, user agents, and cookie banners. 2025-11-29 17:22:28 +01:00
Michael 420dd3144a feat: add NewSearchService to orchestrate multi-site e-commerce searches and scrape item details. 2025-11-29 17:10:20 +01:00
Michael 48d1ab3a05 feat: introduce new search service to orchestrate multi-site product searches and scrape item details. 2025-11-29 14:17:46 +01:00
Michael 89f6f7d3ae build: Remove app volume mount, adjust Alembic script path, and clean up entrypoint. 2025-11-29 14:06:53 +01:00
Michael eeb7ff9d6a debug: Add recursive listing of 'app' directory in docker entrypoint. 2025-11-29 14:00:44 +01:00
Michael 30dfb44517 feat: Add new multi-site search service with browserless and AI integration, including site-specific configurations. 2025-11-29 13:52:07 +01:00
Michael d54427bdbe build: add volume mount for application code to enable local development. 2025-11-29 13:31:37 +01:00
Michael 8399b819da feat: Add centralized search configuration for e-commerce sites and a verification script. 2025-11-29 13:21:45 +01:00