 Michael
|
3d3d7c18c1
|
feat: implement Bonial.fr scraper service for promotional catalogs using Playwright.
|
2025-11-29 22:31:24 +01:00 |
|
|
Michael
|
ba932b79ef
|
feat: add Bonial.fr catalog scraper service using Playwright for promotional catalog data extraction.
|
2025-11-29 20:35:23 +01:00 |
|
|
Michael
|
da90ea12f2
|
feat: implement Bonial.fr catalog scraper using Playwright
|
2025-11-29 20:04:06 +01:00 |
|
|
Michael
|
c011f1d6bf
|
feat: Add Bonial.fr scraper service to fetch promotional catalogs using Playwright.
|
2025-11-29 19:57:32 +01:00 |
|
|
Michael
|
c8fcfd7a4d
|
feat: Add Bonial.fr scraper service for promotional catalogs.
|
2025-11-29 19:51:34 +01:00 |
|
|
Michael
|
debc1a973f
|
feat: implement scheduled catalog scraping service
|
2025-11-29 19:36:52 +01:00 |
|
|
Michael
|
1bdeb272d6
|
fix: Correct alembic upgrade command from head to heads.
|
2025-11-29 19:34:58 +01:00 |
|
|
Michael
|
b9059aeeda
|
chore: Add Alembic merge migration for catalog module and notification channels.
|
2025-11-29 19:32:54 +01:00 |
|
|
Michael
|
58e6be3f0d
|
feat: Add initial application structure, core data models, and a new catalog module with Bonial scraping capabilities.
|
2025-11-29 19:26:56 +01:00 |
|
|
Michael
|
906c6b483d
|
feat: add core search configuration including Browserless settings, proxies, user agents, site-specific selectors, and cookie banner handlers.
|
2025-11-29 18:28:20 +01:00 |
|
|
Michael
|
a0a48ced19
|
feat: add script to verify search service functionality across all configured sites, including Browserless connection and detailed reporting.
|
2025-11-29 18:15:12 +01:00 |
|
|
Michael
|
b47af1655d
|
feat: add debug script to display search site configurations and database entries
|
2025-11-29 17:46:20 +01:00 |
|
|
Michael
|
5d7f872dae
|
feat: Add new search service for multi-site product search and item detail scraping.
|
2025-11-29 17:28:59 +01:00 |
|
|
Michael
|
74bdcfa63e
|
feat: introduce search configuration for sites, proxies, user agents, and cookie banners.
|
2025-11-29 17:22:28 +01:00 |
|
|
Michael
|
420dd3144a
|
feat: add NewSearchService to orchestrate multi-site e-commerce searches and scrape item details.
|
2025-11-29 17:10:20 +01:00 |
|
|
Michael
|
48d1ab3a05
|
feat: introduce new search service to orchestrate multi-site product searches and scrape item details.
|
2025-11-29 14:17:46 +01:00 |
|
|
Michael
|
89f6f7d3ae
|
build: Remove app volume mount, adjust Alembic script path, and clean up entrypoint.
|
2025-11-29 14:06:53 +01:00 |
|
|
Michael
|
eeb7ff9d6a
|
debug: Add recursive listing of 'app' directory in docker entrypoint.
|
2025-11-29 14:00:44 +01:00 |
|
|
Michael
|
30dfb44517
|
feat: Add new multi-site search service with browserless and AI integration, including site-specific configurations.
|
2025-11-29 13:52:07 +01:00 |
|
|
Michael
|
d54427bdbe
|
build: add volume mount for application code to enable local development.
|
2025-11-29 13:31:37 +01:00 |
|
|
Michael
|
8399b819da
|
feat: Add centralized search configuration for e-commerce sites and a verification script.
|
2025-11-29 13:21:45 +01:00 |
|
|
Michael
|
f976ae1127
|
feat: Implement web scraping and search system with centralized configuration, browserless integration, and a verification script.
|
2025-11-29 13:09:53 +01:00 |
|
|
Michael
|
7f85a9764c
|
feat: Add Stokomani raw HTML data and new search configuration.
|
2025-11-29 11:25:49 +01:00 |
|
|
Michael
|
66a8371665
|
feat: Add centralized search configuration including site definitions, proxies, user agents, and cookie acceptance selectors.
|
2025-11-29 11:09:48 +01:00 |
|
|
Michael
|
0f5c6dc1c6
|
feat: introduce NewSearchService to orchestrate e-commerce searches and scrape product details.
|
2025-11-29 11:05:01 +01:00 |
|
|
Michael
|
97a8e7a951
|
feat: implement web scraping debugger and consolidate search site configurations.
|
2025-11-29 10:56:43 +01:00 |
|
|
Michael
|
bcc3b0900f
|
feat: Add core search configuration and service for web scraping, including site-specific selectors, proxies, and user agents.
|
2025-11-29 10:32:01 +01:00 |
|
|
Michael
|
292eb3d12e
|
feat: Add NewSearchService for orchestrating e-commerce searches, including site-specific parsing and AI-powered item detail scraping.
|
2025-11-29 09:59:58 +01:00 |
|
|
Michael
|
22f8aedaa4
|
feat: Add centralized search configuration for sites, proxies, and user agents, and create browserless service module.
|
2025-11-29 09:51:10 +01:00 |
|
|
Michael
|
f665a000af
|
feat: add AI service for content extraction and Browserless service for web scraping
|
2025-11-29 09:46:29 +01:00 |
|
|
Michael
|
86559ff2d7
|
feat: implement NewSearchService for orchestrating e-commerce searches, parsing results, and scraping item details.
|
2025-11-29 09:37:33 +01:00 |
|
|
Michael
|
867274a9ab
|
feat: Introduce AI service for data extraction, including dynamic configuration, response parsing, and repair.
|
2025-11-29 09:27:35 +01:00 |
|
|
Michael
|
8d903202fb
|
feat: introduce browserless, scheduler, and search services for advanced web scraping and data collection.
|
2025-11-29 09:02:34 +01:00 |
|
|
Michael
|
654145d499
|
Merge origin/main into antigravity: Resolve conflict by accepting deletion of direct_search_service.py
|
2025-11-29 08:57:48 +01:00 |
|
|
Michael
|
6019a80de9
|
feat: Add core search configuration for site definitions, proxies, and user agents, and introduce a browserless service.
|
2025-11-29 08:54:05 +01:00 |
|
|
Michael
|
b6c1fc1cda
|
feat: Add AI-powered data extraction and direct search services
|
2025-11-29 02:53:35 +01:00 |
|
|
Michael
|
a6662e8891
|
feat: Add direct e-commerce search service using Playwright/Browserless with anti-bot measures and Amazon-specific handling.
|
2025-11-29 02:38:18 +01:00 |
|
|
Michael
|
352fc72bfa
|
feat: Implement direct e-commerce search service using Playwright and Browserless with anti-bot and proxy rotation capabilities.
|
2025-11-29 02:31:30 +01:00 |
|
|
Michael
|
fa890f67dc
|
feat: add direct e-commerce search service using Playwright with anti-bot measures for scraping.
|
2025-11-29 02:24:20 +01:00 |
|
|
Michael
|
3cb0b202d3
|
Merge branch 'antigravity' of https://github.com/R0m1k3/Priceflow into antigravity
|
2025-11-29 02:17:20 +01:00 |
|
|
Michael
|
bad2cfca20
|
feat: Add direct e-commerce search service using Playwright with anti-bot measures including rotating proxies, user agents, and stealth JavaScript.
|
2025-11-29 02:17:17 +01:00 |
|
|
Michael
|
87165a8b9b
|
feat: Implement direct search service with Playwright/Browserless, including anti-bot measures, proxy rotation, and stealth JavaScript.
|
2025-11-29 02:07:59 +01:00 |
|
|
Michael
|
394fa3c118
|
feat: implement AI service for data extraction with dynamic configuration and robust response handling.
|
2025-11-29 02:00:42 +01:00 |
|
|
Michael
|
091caad347
|
feat: add web scraping and search services using Playwright with anti-detection mechanisms.
|
2025-11-29 01:56:25 +01:00 |
|
|
Michael
|
7a73650264
|
feat: add DirectSearchService for robust e-commerce product search using Playwright/Browserless with advanced bot detection evasion.
|
2025-11-29 01:52:31 +01:00 |
|
|
Michael
|
e6bf46659d
|
refactor: Improve browser lifecycle management in ScraperService to prevent connection errors
|
2025-11-29 01:39:43 +01:00 |
|
|
Michael
|
0439b74bc3
|
fix: Remove duplicate 'finally' block in scraper_service.py causing SyntaxError
|
2025-11-29 01:24:34 +01:00 |
|
|
Michael
|
405756963a
|
fix: Resolve IndentationError in scraper_service.py caused by loop removal
|
2025-11-29 01:20:58 +01:00 |
|
|
Michael
|
aa9d2af5b2
|
feat: Implement hybrid proxy strategy for Amazon scraping - fallback to Direct IP on last retry
|
2025-11-29 01:17:03 +01:00 |
|
|
Michael
|
dd558b0e43
|
fix: Correct proxy usage in scraper_service.py to handle dict format
|
2025-11-29 01:07:02 +01:00 |
|
|
Michael
|
4c410ef48f
|
fix: Correct Playwright proxy format - use dict with server/username/password instead of URL string
|
2025-11-29 01:02:41 +01:00 |
|
|
Michael
|
df2191cdbd
|
debug: Add proxy initialization logs to verify proxy loading
|
2025-11-29 00:53:55 +01:00 |
|
|
Michael
|
8080a97e25
|
feat: Add same 10 rotating proxies to scraper_service for individual product pages
|
2025-11-29 00:50:08 +01:00 |
|
|
Michael
|
b7e373d9eb
|
feat: Add 10 rotating proxies for Amazon to bypass IP bans
|
2025-11-29 00:47:17 +01:00 |
|
|
Michael
|
26df52b664
|
revert: Use Amazon config from commit 698dbaa (15 commits back)
|
2025-11-29 00:40:27 +01:00 |
|
|
Michael
|
3c4094d4de
|
revert: Back to working Amazon configuration from ee8a146 - simpler is better
|
2025-11-29 00:39:25 +01:00 |
|
|
Michael
|
c88f52c136
|
fix: Add ref=nb_sb_noss parameter to Amazon URLs as in working version + increase retry delays
|
2025-11-29 00:34:09 +01:00 |
|
|
Michael
|
eb48c4aa33
|
feat: Add direct search service for e-commerce scraping via Browserless with bot evasion.
|
2025-11-29 00:30:12 +01:00 |
|
|
Michael
|
34dc9f6f40
|
fix: Apply working Amazon anti-blocking strategy from scraper_service - warmup + no image blocking
|
2025-11-29 00:22:52 +01:00 |
|
|
Michael
|
46442d5e0c
|
Merge: resolved conflicts in direct_search_service.py
|
2025-11-29 00:12:28 +01:00 |
|
|
Michael
|
69aefdbac3
|
Fix: Resolve merge conflict in direct_search_service.py by confirming random import
|
2025-11-29 00:06:51 +01:00 |
|
|
Michael
|
0d102b73d0
|
feat: Implement direct e-commerce search service using Playwright/Browserless with anti-bot techniques like User-Agent rotation, proxy support, and stealth JS, particularly for Amazon.
|
2025-11-28 23:59:50 +01:00 |
|
|
Michael
|
b75ad636dd
|
feat: add product search orchestration service with direct, light scraper, and browserless methods
|
2025-11-28 23:57:51 +01:00 |
|
|
Michael
|
3caea8316b
|
feat: Add Playwright-based web scraping service with advanced stealth techniques and proxy support, including Amazon-specific logic.
|
2025-11-28 23:53:45 +01:00 |
|
|
Michael
|
f187e6cb9d
|
feat: Implement direct e-commerce search service with advanced anti-bot stealth using Playwright/Browserless.
|
2025-11-24 13:10:40 +01:00 |
|
|
Michael
|
ba28f0b711
|
feat: implement direct e-commerce search service with site-specific configurations using Playwright.
|
2025-11-24 13:05:21 +01:00 |
|
|
Michael
|
ee8a14668c
|
feat: Implement direct e-commerce search service using Playwright/Browserless to scrape product information from various configured retail websites.
|
2025-11-24 13:04:03 +01:00 |
|
|
Michael
|
97039484fa
|
feat: add direct search service for e-commerce sites using Playwright/Browserless with predefined site configurations.
|
2025-11-24 13:03:47 +01:00 |
|
|
Michael
|
8053955097
|
feat: add direct e-commerce search service using Playwright/Browserless with predefined site configurations
|
2025-11-24 13:01:47 +01:00 |
|
|
Michael
|
5f4d3afbae
|
feat: Implement authentication and authorization with user management and admin-only debug endpoints.
|
2025-11-24 07:40:22 +01:00 |
|
|
Michael
|
25b0a824c2
|
chore: add .dockerignore to exclude common development and build artifacts from Docker builds.
|
2025-11-24 07:34:45 +01:00 |
|
|
Michael
|
fac4968485
|
chore: Install frontend dependencies.
|
2025-11-24 07:25:50 +01:00 |
|
|
Michael
|
e45290350c
|
feat: implement direct e-commerce search service with Playwright/Browserless and add supporting admin page and debug routes.
|
2025-11-24 07:18:12 +01:00 |
|
|
Michael
|
df052ae4f7
|
feat: add direct e-commerce search service via Browserless/Playwright with site-specific configurations.
|
2025-11-24 00:47:34 +01:00 |
|
|
Michael
|
95deddaffb
|
feat: implement product search orchestration service with direct, light scraping, and browserless AI extraction strategies.
|
2025-11-24 00:28:00 +01:00 |
|
|
Michael
|
4ab859114e
|
feat: Add direct search service for e-commerce sites using Playwright/Browserless and configured selectors.
|
2025-11-24 00:22:28 +01:00 |
|
|
Michael
|
a9cb4e4ac5
|
feat: Implement dashboard page for item management and add/edit item modal.
|
2025-11-24 00:09:59 +01:00 |
|
|
Michael
|
18d5f3dbf1
|
feat: Add notification service with Apprise integration for email, Discord, and Mattermost channels.
|
2025-11-23 23:47:45 +01:00 |
|
|
Michael
|
f720a7aa17
|
feat: Implement a new notification service using Apprise for sending notifications via various channels.
|
2025-11-23 23:42:00 +01:00 |
|
|
Michael
|
7dfc9e1af3
|
feat: Add notification service to send messages via Apprise with support for various channels.
|
2025-11-23 23:36:26 +01:00 |
|
|
Michael
|
a26bd343ec
|
feat: add comprehensive admin page for user, system settings, notification, and job management.
|
2025-11-23 23:24:35 +01:00 |
|
|
Michael
|
9637d77cef
|
feat: Initialize core application structure with item tracking, price history, and notification channel management.
|
2025-11-23 23:17:52 +01:00 |
|
|
Michael
|
40225676fe
|
feat: Add Pydantic schemas for items, price history, settings, and search functionality.
|
2025-11-23 23:00:30 +01:00 |
|
|
Michael
|
e1aa76434f
|
Merge branch 'antigravity' of https://github.com/R0m1k3/Priceflow into antigravity
|
2025-11-23 22:57:13 +01:00 |
|
|
Michael
|
38f56b8b63
|
db: drop notification tables and columns, and add an Alembic merge revision.
|
2025-11-23 22:57:09 +01:00 |
|
|
Michael
|
2cf7f28f06
|
feat: Add initial Pydantic schemas for item tracking, price history, search sites, and search results.
|
2025-11-23 22:51:09 +01:00 |
|
|
Michael
|
b5e3b44e5a
|
feat: Implement scheduled item price tracking with AI analysis, core backend services, and a dashboard item management modal.
|
2025-11-23 22:48:01 +01:00 |
|
|
Michael
|
c9a5f91dd2
|
feat: Introduce PriceHistoryModal component to display product price history, chart, and statistics.
|
2025-11-23 22:30:51 +01:00 |
|
|
Michael
|
3ae3e84e37
|
feat: Introduce item API endpoints for CRUD, category management, price checks, and their Pydantic schemas.
|
2025-11-23 22:27:09 +01:00 |
|
|
Michael
|
38af998a09
|
feat: add scraper service with URL simplification, Playwright integration, and retry logic for web scraping.
|
2025-11-23 22:18:11 +01:00 |
|
|
Michael
|
ddc5c18ea1
|
feat: add Pydantic schemas for notification profiles, items, settings, search sites, and search results.
|
2025-11-23 22:00:01 +01:00 |
|
|
Michael
|
47e4fc705c
|
Merge branch 'antigravity'
|
2025-11-23 21:49:52 +01:00 |
|
|
Michael
|
3eb78101a3
|
fix: handle empty category strings as None in update endpoint
|
2025-11-23 21:49:28 +01:00 |
|
|
Michael
|
308fcfb5e5
|
feat: add ItemCard component to display item details, prices, stock status, and actions with i18n support.
|
2025-11-23 21:40:17 +01:00 |
|
|
Michael
|
f79f7d818c
|
test: add TEST 2025 prefix to verify deployment
|
2025-11-23 21:31:34 +01:00 |
|
|
Michael
|
31aaa490df
|
chore: force frontend build cache invalidation
|
2025-11-23 19:21:50 +01:00 |
|
|
Michael
|
cfd2524413
|
Merge branch 'antigravity'
|
2025-11-23 18:53:46 +01:00 |
|
|
Michael
|
78b20e1f5c
|
fix: add missing provider fields to newProfile initial state in Settings.jsx
|
2025-11-23 18:53:27 +01:00 |
|
|
Michael
|
8afa65f9ee
|
feat: add direct search service for e-commerce sites using Playwright/Browserless with pre-configured French retailers.
|
2025-11-23 17:37:23 +01:00 |
|
|
Michael
|
0ccc2fd9fc
|
feat: add login page with authentication functionality and favicons
|
2025-11-23 17:30:57 +01:00 |
|