Commit Graph
258 Commits
Author SHA1 Message Date
Michael 5be93653ef feat: add Vite configuration for React project, including path aliases and build output directory. 2025-11-29 22:59:40 +01:00
Michael efb5211621 feat: add CatalogueAdmin component to manage catalogue scraping, display statistics, and view logs. 2025-11-29 22:55:09 +01:00
Michael 5c0d5cebf7 feat: Add Catalogues page for displaying, searching, and filtering promotional catalogues by enseigne. 2025-11-29 22:50:44 +01:00
Michael b224c4988a feat: implement API router for catalogue and enseigne management with filtering and pagination 2025-11-29 22:39:34 +01:00
Michael 3d3d7c18c1 feat: implement Bonial.fr scraper service for promotional catalogs using Playwright. 2025-11-29 22:31:24 +01:00
Michael ba932b79ef feat: add Bonial.fr catalog scraper service using Playwright for promotional catalog data extraction. 2025-11-29 20:35:23 +01:00
Michael da90ea12f2 feat: implement Bonial.fr catalog scraper using Playwright 2025-11-29 20:04:06 +01:00
Michael c011f1d6bf feat: Add Bonial.fr scraper service to fetch promotional catalogs using Playwright. 2025-11-29 19:57:32 +01:00
Michael c8fcfd7a4d feat: Add Bonial.fr scraper service for promotional catalogs. 2025-11-29 19:51:34 +01:00
Michael debc1a973f feat: implement scheduled catalog scraping service 2025-11-29 19:36:52 +01:00
Michael 1bdeb272d6 fix: Correct alembic upgrade command from head to heads. 2025-11-29 19:34:58 +01:00
Michael b9059aeeda chore: Add Alembic merge migration for catalog module and notification channels. 2025-11-29 19:32:54 +01:00
Michael 58e6be3f0d feat: Add initial application structure, core data models, and a new catalog module with Bonial scraping capabilities. 2025-11-29 19:26:56 +01:00
Michael 906c6b483d feat: add core search configuration including Browserless settings, proxies, user agents, site-specific selectors, and cookie banner handlers. 2025-11-29 18:28:20 +01:00
Michael a0a48ced19 feat: add script to verify search service functionality across all configured sites, including Browserless connection and detailed reporting. 2025-11-29 18:15:12 +01:00
Michael b47af1655d feat: add debug script to display search site configurations and database entries 2025-11-29 17:46:20 +01:00
Michael 5d7f872dae feat: Add new search service for multi-site product search and item detail scraping. 2025-11-29 17:28:59 +01:00
Michael 74bdcfa63e feat: introduce search configuration for sites, proxies, user agents, and cookie banners. 2025-11-29 17:22:28 +01:00
Michael 420dd3144a feat: add NewSearchService to orchestrate multi-site e-commerce searches and scrape item details. 2025-11-29 17:10:20 +01:00
Michael 48d1ab3a05 feat: introduce new search service to orchestrate multi-site product searches and scrape item details. 2025-11-29 14:17:46 +01:00
Michael 89f6f7d3ae build: Remove app volume mount, adjust Alembic script path, and clean up entrypoint. 2025-11-29 14:06:53 +01:00
Michael eeb7ff9d6a debug: Add recursive listing of 'app' directory in docker entrypoint. 2025-11-29 14:00:44 +01:00
Michael 30dfb44517 feat: Add new multi-site search service with browserless and AI integration, including site-specific configurations. 2025-11-29 13:52:07 +01:00
Michael d54427bdbe build: add volume mount for application code to enable local development. 2025-11-29 13:31:37 +01:00
Michael 8399b819da feat: Add centralized search configuration for e-commerce sites and a verification script. 2025-11-29 13:21:45 +01:00
Michael f976ae1127 feat: Implement web scraping and search system with centralized configuration, browserless integration, and a verification script. 2025-11-29 13:09:53 +01:00
Michael 7f85a9764c feat: Add Stokomani raw HTML data and new search configuration. 2025-11-29 11:25:49 +01:00
Michael 66a8371665 feat: Add centralized search configuration including site definitions, proxies, user agents, and cookie acceptance selectors. 2025-11-29 11:09:48 +01:00
Michael 0f5c6dc1c6 feat: introduce NewSearchService to orchestrate e-commerce searches and scrape product details. 2025-11-29 11:05:01 +01:00
Michael 97a8e7a951 feat: implement web scraping debugger and consolidate search site configurations. 2025-11-29 10:56:43 +01:00
Michael bcc3b0900f feat: Add core search configuration and service for web scraping, including site-specific selectors, proxies, and user agents. 2025-11-29 10:32:01 +01:00
Michael 292eb3d12e feat: Add NewSearchService for orchestrating e-commerce searches, including site-specific parsing and AI-powered item detail scraping. 2025-11-29 09:59:58 +01:00
Michael 22f8aedaa4 feat: Add centralized search configuration for sites, proxies, and user agents, and create browserless service module. 2025-11-29 09:51:10 +01:00
Michael f665a000af feat: add AI service for content extraction and Browserless service for web scraping 2025-11-29 09:46:29 +01:00
Michael 86559ff2d7 feat: implement NewSearchService for orchestrating e-commerce searches, parsing results, and scraping item details. 2025-11-29 09:37:33 +01:00
Michael 867274a9ab feat: Introduce AI service for data extraction, including dynamic configuration, response parsing, and repair. 2025-11-29 09:27:35 +01:00
Michael 8d903202fb feat: introduce browserless, scheduler, and search services for advanced web scraping and data collection. 2025-11-29 09:02:34 +01:00
Michael 654145d499 Merge origin/main into antigravity: Resolve conflict by accepting deletion of direct_search_service.py 2025-11-29 08:57:48 +01:00
Michael 6019a80de9 feat: Add core search configuration for site definitions, proxies, and user agents, and introduce a browserless service. 2025-11-29 08:54:05 +01:00
Michael b6c1fc1cda feat: Add AI-powered data extraction and direct search services 2025-11-29 02:53:35 +01:00
LogiFlow a78d24fe5a Merge pull request #86 from R0m1k3/antigravity
Merge pull request #85 from R0m1k3/main
2025-11-29 02:44:38 +01:00
LogiFlow fa463ec50a Merge pull request #85 from R0m1k3/main
Merge pull request #84 from R0m1k3/antigravity
2025-11-29 02:44:18 +01:00
LogiFlow be5b64ce0f Merge pull request #84 from R0m1k3/antigravity
Merge pull request #83 from R0m1k3/main
2025-11-29 02:43:57 +01:00
LogiFlow daaad442e5 Merge pull request #83 from R0m1k3/main
commit
2025-11-29 02:40:36 +01:00
LogiFlow 33b4a43cc1 Merge pull request #82 from R0m1k3/antigravity
feat: Add direct e-commerce search service using Playwright/Browserle…
2025-11-29 02:38:40 +01:00
Michael a6662e8891 feat: Add direct e-commerce search service using Playwright/Browserless with anti-bot measures and Amazon-specific handling. 2025-11-29 02:38:18 +01:00
LogiFlow a6f195c491 Merge pull request #81 from R0m1k3/antigravity
feat: Implement direct e-commerce search service using Playwright and…
2025-11-29 02:31:52 +01:00
Michael 352fc72bfa feat: Implement direct e-commerce search service using Playwright and Browserless with anti-bot and proxy rotation capabilities. 2025-11-29 02:31:30 +01:00
LogiFlow 2add7eadbe Merge pull request #80 from R0m1k3/antigravity
feat: add direct e-commerce search service using Playwright with anti…
2025-11-29 02:24:45 +01:00
Michael fa890f67dc feat: add direct e-commerce search service using Playwright with anti-bot measures for scraping. 2025-11-29 02:24:20 +01:00