 Michael
|
2b974aacf9
|
feat: Implement Tiendeo.fr scraper using Crawl4AI to extract promotional catalogs and their pages.
|
2025-11-30 01:17:40 +01:00 |
|
|
Michael
|
2692f76cf0
|
feat: add Tiendeo.fr scraper service for promotional catalogs using Crawl4AI
|
2025-11-30 01:12:25 +01:00 |
|
|
Michael
|
79612690b3
|
feat: add Tiendeo scraper service with Crawl4AI and update project dependencies and Dockerfile.
|
2025-11-30 01:06:08 +01:00 |
|
|
Michael
|
34ac9b343a
|
feat: add Bonial and Tiendeo catalog scrapers
|
2025-11-30 00:22:36 +01:00 |
|
|
Michael
|
a7aefb3e56
|
feat: add Bonial.fr catalog scraper service using Playwright.
|
2025-11-29 23:59:50 +01:00 |
|
|
Michael
|
1fc0c6e69e
|
feat: Implement Bonial.fr scraper service to extract promotional catalogs using Playwright.
|
2025-11-29 23:55:44 +01:00 |
|
|
Michael
|
2f492cfe03
|
feat: Implement Bonial.fr scraper service using Playwright to extract promotional catalogs.
|
2025-11-29 23:45:30 +01:00 |
|
|
Michael
|
468b11c195
|
feat: Add Bonial.fr scraper service using Playwright to extract promotional catalogs and their details.
|
2025-11-29 23:33:36 +01:00 |
|
|
Michael
|
b7f049d414
|
feat: Implement Bonial.fr scraper service using Playwright to extract promotional catalogs and their details.
|
2025-11-29 23:25:44 +01:00 |
|
|
Michael
|
6ed923c1ee
|
feat: add CatalogueAdmin component to manage and monitor catalogue scraping operations.
|
2025-11-29 23:17:28 +01:00 |
|
|
Michael
|
09a647a437
|
feat: Implement API endpoints for retrieving enseignes, paginated catalogues, detailed catalogue information, catalogue pages, and scraping statistics.
|
2025-11-29 23:11:28 +01:00 |
|
|
Michael
|
237e4a2adf
|
feat: add Vite configuration with React plugin and path aliases.
|
2025-11-29 23:02:52 +01:00 |
|
|
Michael
|
5be93653ef
|
feat: add Vite configuration for React project, including path aliases and build output directory.
|
2025-11-29 22:59:40 +01:00 |
|
|
Michael
|
efb5211621
|
feat: add CatalogueAdmin component to manage catalogue scraping, display statistics, and view logs.
|
2025-11-29 22:55:09 +01:00 |
|
|
Michael
|
5c0d5cebf7
|
feat: Add Catalogues page for displaying, searching, and filtering promotional catalogues by enseigne.
|
2025-11-29 22:50:44 +01:00 |
|
|
Michael
|
b224c4988a
|
feat: implement API router for catalogue and enseigne management with filtering and pagination
|
2025-11-29 22:39:34 +01:00 |
|
|
Michael
|
3d3d7c18c1
|
feat: implement Bonial.fr scraper service for promotional catalogs using Playwright.
|
2025-11-29 22:31:24 +01:00 |
|
|
Michael
|
ba932b79ef
|
feat: add Bonial.fr catalog scraper service using Playwright for promotional catalog data extraction.
|
2025-11-29 20:35:23 +01:00 |
|
|
Michael
|
da90ea12f2
|
feat: implement Bonial.fr catalog scraper using Playwright
|
2025-11-29 20:04:06 +01:00 |
|
|
Michael
|
c011f1d6bf
|
feat: Add Bonial.fr scraper service to fetch promotional catalogs using Playwright.
|
2025-11-29 19:57:32 +01:00 |
|
|
Michael
|
c8fcfd7a4d
|
feat: Add Bonial.fr scraper service for promotional catalogs.
|
2025-11-29 19:51:34 +01:00 |
|
|
Michael
|
debc1a973f
|
feat: implement scheduled catalog scraping service
|
2025-11-29 19:36:52 +01:00 |
|
|
Michael
|
1bdeb272d6
|
fix: Correct alembic upgrade command from head to heads.
|
2025-11-29 19:34:58 +01:00 |
|
|
Michael
|
b9059aeeda
|
chore: Add Alembic merge migration for catalog module and notification channels.
|
2025-11-29 19:32:54 +01:00 |
|
|
Michael
|
58e6be3f0d
|
feat: Add initial application structure, core data models, and a new catalog module with Bonial scraping capabilities.
|
2025-11-29 19:26:56 +01:00 |
|
|
Michael
|
906c6b483d
|
feat: add core search configuration including Browserless settings, proxies, user agents, site-specific selectors, and cookie banner handlers.
|
2025-11-29 18:28:20 +01:00 |
|
|
Michael
|
a0a48ced19
|
feat: add script to verify search service functionality across all configured sites, including Browserless connection and detailed reporting.
|
2025-11-29 18:15:12 +01:00 |
|
|
Michael
|
b47af1655d
|
feat: add debug script to display search site configurations and database entries
|
2025-11-29 17:46:20 +01:00 |
|
|
Michael
|
5d7f872dae
|
feat: Add new search service for multi-site product search and item detail scraping.
|
2025-11-29 17:28:59 +01:00 |
|
|
Michael
|
74bdcfa63e
|
feat: introduce search configuration for sites, proxies, user agents, and cookie banners.
|
2025-11-29 17:22:28 +01:00 |
|
|
Michael
|
420dd3144a
|
feat: add NewSearchService to orchestrate multi-site e-commerce searches and scrape item details.
|
2025-11-29 17:10:20 +01:00 |
|
|
Michael
|
48d1ab3a05
|
feat: introduce new search service to orchestrate multi-site product searches and scrape item details.
|
2025-11-29 14:17:46 +01:00 |
|
|
Michael
|
89f6f7d3ae
|
build: Remove app volume mount, adjust Alembic script path, and clean up entrypoint.
|
2025-11-29 14:06:53 +01:00 |
|
|
Michael
|
eeb7ff9d6a
|
debug: Add recursive listing of 'app' directory in docker entrypoint.
|
2025-11-29 14:00:44 +01:00 |
|
|
Michael
|
30dfb44517
|
feat: Add new multi-site search service with browserless and AI integration, including site-specific configurations.
|
2025-11-29 13:52:07 +01:00 |
|
|
Michael
|
d54427bdbe
|
build: add volume mount for application code to enable local development.
|
2025-11-29 13:31:37 +01:00 |
|
|
Michael
|
8399b819da
|
feat: Add centralized search configuration for e-commerce sites and a verification script.
|
2025-11-29 13:21:45 +01:00 |
|
|
Michael
|
f976ae1127
|
feat: Implement web scraping and search system with centralized configuration, browserless integration, and a verification script.
|
2025-11-29 13:09:53 +01:00 |
|
|
Michael
|
7f85a9764c
|
feat: Add Stokomani raw HTML data and new search configuration.
|
2025-11-29 11:25:49 +01:00 |
|
|
Michael
|
66a8371665
|
feat: Add centralized search configuration including site definitions, proxies, user agents, and cookie acceptance selectors.
|
2025-11-29 11:09:48 +01:00 |
|
|
Michael
|
0f5c6dc1c6
|
feat: introduce NewSearchService to orchestrate e-commerce searches and scrape product details.
|
2025-11-29 11:05:01 +01:00 |
|
|
Michael
|
97a8e7a951
|
feat: implement web scraping debugger and consolidate search site configurations.
|
2025-11-29 10:56:43 +01:00 |
|
|
Michael
|
bcc3b0900f
|
feat: Add core search configuration and service for web scraping, including site-specific selectors, proxies, and user agents.
|
2025-11-29 10:32:01 +01:00 |
|
|
Michael
|
292eb3d12e
|
feat: Add NewSearchService for orchestrating e-commerce searches, including site-specific parsing and AI-powered item detail scraping.
|
2025-11-29 09:59:58 +01:00 |
|
|
Michael
|
22f8aedaa4
|
feat: Add centralized search configuration for sites, proxies, and user agents, and create browserless service module.
|
2025-11-29 09:51:10 +01:00 |
|
|
Michael
|
f665a000af
|
feat: add AI service for content extraction and Browserless service for web scraping
|
2025-11-29 09:46:29 +01:00 |
|
|
Michael
|
86559ff2d7
|
feat: implement NewSearchService for orchestrating e-commerce searches, parsing results, and scraping item details.
|
2025-11-29 09:37:33 +01:00 |
|
|
Michael
|
867274a9ab
|
feat: Introduce AI service for data extraction, including dynamic configuration, response parsing, and repair.
|
2025-11-29 09:27:35 +01:00 |
|
|
Michael
|
8d903202fb
|
feat: introduce browserless, scheduler, and search services for advanced web scraping and data collection.
|
2025-11-29 09:02:34 +01:00 |
|
|
Michael
|
654145d499
|
Merge origin/main into antigravity: Resolve conflict by accepting deletion of direct_search_service.py
|
2025-11-29 08:57:48 +01:00 |
|