 Michael
|
74bdcfa63e
|
feat: introduce search configuration for sites, proxies, user agents, and cookie banners.
|
2025-11-29 17:22:28 +01:00 |
|
|
Michael
|
420dd3144a
|
feat: add NewSearchService to orchestrate multi-site e-commerce searches and scrape item details.
|
2025-11-29 17:10:20 +01:00 |
|
|
Michael
|
48d1ab3a05
|
feat: introduce new search service to orchestrate multi-site product searches and scrape item details.
|
2025-11-29 14:17:46 +01:00 |
|
|
Michael
|
89f6f7d3ae
|
build: Remove app volume mount, adjust Alembic script path, and clean up entrypoint.
|
2025-11-29 14:06:53 +01:00 |
|
|
Michael
|
eeb7ff9d6a
|
debug: Add recursive listing of 'app' directory in docker entrypoint.
|
2025-11-29 14:00:44 +01:00 |
|
|
Michael
|
30dfb44517
|
feat: Add new multi-site search service with browserless and AI integration, including site-specific configurations.
|
2025-11-29 13:52:07 +01:00 |
|
|
Michael
|
d54427bdbe
|
build: add volume mount for application code to enable local development.
|
2025-11-29 13:31:37 +01:00 |
|
|
Michael
|
8399b819da
|
feat: Add centralized search configuration for e-commerce sites and a verification script.
|
2025-11-29 13:21:45 +01:00 |
|
|
Michael
|
f976ae1127
|
feat: Implement web scraping and search system with centralized configuration, browserless integration, and a verification script.
|
2025-11-29 13:09:53 +01:00 |
|
|
Michael
|
7f85a9764c
|
feat: Add Stokomani raw HTML data and new search configuration.
|
2025-11-29 11:25:49 +01:00 |
|
|
Michael
|
66a8371665
|
feat: Add centralized search configuration including site definitions, proxies, user agents, and cookie acceptance selectors.
|
2025-11-29 11:09:48 +01:00 |
|
|
Michael
|
0f5c6dc1c6
|
feat: introduce NewSearchService to orchestrate e-commerce searches and scrape product details.
|
2025-11-29 11:05:01 +01:00 |
|
|
Michael
|
97a8e7a951
|
feat: implement web scraping debugger and consolidate search site configurations.
|
2025-11-29 10:56:43 +01:00 |
|
|
Michael
|
bcc3b0900f
|
feat: Add core search configuration and service for web scraping, including site-specific selectors, proxies, and user agents.
|
2025-11-29 10:32:01 +01:00 |
|
|
Michael
|
292eb3d12e
|
feat: Add NewSearchService for orchestrating e-commerce searches, including site-specific parsing and AI-powered item detail scraping.
|
2025-11-29 09:59:58 +01:00 |
|
|
Michael
|
22f8aedaa4
|
feat: Add centralized search configuration for sites, proxies, and user agents, and create browserless service module.
|
2025-11-29 09:51:10 +01:00 |
|
|
Michael
|
f665a000af
|
feat: add AI service for content extraction and Browserless service for web scraping
|
2025-11-29 09:46:29 +01:00 |
|
|
Michael
|
86559ff2d7
|
feat: implement NewSearchService for orchestrating e-commerce searches, parsing results, and scraping item details.
|
2025-11-29 09:37:33 +01:00 |
|
|
Michael
|
867274a9ab
|
feat: Introduce AI service for data extraction, including dynamic configuration, response parsing, and repair.
|
2025-11-29 09:27:35 +01:00 |
|
|
Michael
|
8d903202fb
|
feat: introduce browserless, scheduler, and search services for advanced web scraping and data collection.
|
2025-11-29 09:02:34 +01:00 |
|
|
Michael
|
654145d499
|
Merge origin/main into antigravity: Resolve conflict by accepting deletion of direct_search_service.py
|
2025-11-29 08:57:48 +01:00 |
|
|
Michael
|
6019a80de9
|
feat: Add core search configuration for site definitions, proxies, and user agents, and introduce a browserless service.
|
2025-11-29 08:54:05 +01:00 |
|
|
Michael
|
b6c1fc1cda
|
feat: Add AI-powered data extraction and direct search services
|
2025-11-29 02:53:35 +01:00 |
|
 LogiFlow
|
a78d24fe5a
|
Merge pull request #86 from R0m1k3/antigravity
Merge pull request #85 from R0m1k3/main
|
2025-11-29 02:44:38 +01:00 |
|
|
LogiFlow
|
fa463ec50a
|
Merge pull request #85 from R0m1k3/main
Merge pull request #84 from R0m1k3/antigravity
|
2025-11-29 02:44:18 +01:00 |
|
|
LogiFlow
|
be5b64ce0f
|
Merge pull request #84 from R0m1k3/antigravity
Merge pull request #83 from R0m1k3/main
|
2025-11-29 02:43:57 +01:00 |
|
|
LogiFlow
|
daaad442e5
|
Merge pull request #83 from R0m1k3/main
commit
|
2025-11-29 02:40:36 +01:00 |
|
|
LogiFlow
|
33b4a43cc1
|
Merge pull request #82 from R0m1k3/antigravity
feat: Add direct e-commerce search service using Playwright/Browserle…
|
2025-11-29 02:38:40 +01:00 |
|
|
Michael
|
a6662e8891
|
feat: Add direct e-commerce search service using Playwright/Browserless with anti-bot measures and Amazon-specific handling.
|
2025-11-29 02:38:18 +01:00 |
|
|
LogiFlow
|
a6f195c491
|
Merge pull request #81 from R0m1k3/antigravity
feat: Implement direct e-commerce search service using Playwright and…
|
2025-11-29 02:31:52 +01:00 |
|
|
Michael
|
352fc72bfa
|
feat: Implement direct e-commerce search service using Playwright and Browserless with anti-bot and proxy rotation capabilities.
|
2025-11-29 02:31:30 +01:00 |
|
|
LogiFlow
|
2add7eadbe
|
Merge pull request #80 from R0m1k3/antigravity
feat: add direct e-commerce search service using Playwright with anti…
|
2025-11-29 02:24:45 +01:00 |
|
|
Michael
|
fa890f67dc
|
feat: add direct e-commerce search service using Playwright with anti-bot measures for scraping.
|
2025-11-29 02:24:20 +01:00 |
|
|
LogiFlow
|
3cf1c57466
|
Merge pull request #79 from R0m1k3/antigravity
Antigravity
|
2025-11-29 02:17:45 +01:00 |
|
|
Michael
|
3cb0b202d3
|
Merge branch 'antigravity' of https://github.com/R0m1k3/Priceflow into antigravity
|
2025-11-29 02:17:20 +01:00 |
|
|
Michael
|
bad2cfca20
|
feat: Add direct e-commerce search service using Playwright with anti-bot measures including rotating proxies, user agents, and stealth JavaScript.
|
2025-11-29 02:17:17 +01:00 |
|
|
LogiFlow
|
6cb145626f
|
Merge pull request #78 from R0m1k3/main
commit
|
2025-11-29 02:09:11 +01:00 |
|
|
Michael
|
87165a8b9b
|
feat: Implement direct search service with Playwright/Browserless, including anti-bot measures, proxy rotation, and stealth JavaScript.
|
2025-11-29 02:07:59 +01:00 |
|
|
LogiFlow
|
326272ae56
|
Merge pull request #77 from R0m1k3/antigravity
feat: implement AI service for data extraction with dynamic configura…
|
2025-11-29 02:05:07 +01:00 |
|
|
Michael
|
394fa3c118
|
feat: implement AI service for data extraction with dynamic configuration and robust response handling.
|
2025-11-29 02:00:42 +01:00 |
|
|
LogiFlow
|
a4c0431443
|
Merge pull request #76 from R0m1k3/antigravity
Antigravity
|
2025-11-29 01:56:44 +01:00 |
|
|
Michael
|
091caad347
|
feat: add web scraping and search services using Playwright with anti-detection mechanisms.
|
2025-11-29 01:56:25 +01:00 |
|
|
Michael
|
7a73650264
|
feat: add DirectSearchService for robust e-commerce product search using Playwright/Browserless with advanced bot detection evasion.
|
2025-11-29 01:52:31 +01:00 |
|
|
Michael
|
e6bf46659d
|
refactor: Improve browser lifecycle management in ScraperService to prevent connection errors
|
2025-11-29 01:39:43 +01:00 |
|
|
Michael
|
0439b74bc3
|
fix: Remove duplicate 'finally' block in scraper_service.py causing SyntaxError
|
2025-11-29 01:24:34 +01:00 |
|
|
Michael
|
405756963a
|
fix: Resolve IndentationError in scraper_service.py caused by loop removal
|
2025-11-29 01:20:58 +01:00 |
|
|
Michael
|
aa9d2af5b2
|
feat: Implement hybrid proxy strategy for Amazon scraping - fallback to Direct IP on last retry
|
2025-11-29 01:17:03 +01:00 |
|
|
Michael
|
dd558b0e43
|
fix: Correct proxy usage in scraper_service.py to handle dict format
|
2025-11-29 01:07:02 +01:00 |
|
|
Michael
|
4c410ef48f
|
fix: Correct Playwright proxy format - use dict with server/username/password instead of URL string
|
2025-11-29 01:02:41 +01:00 |
|
|
Michael
|
df2191cdbd
|
debug: Add proxy initialization logs to verify proxy loading
|
2025-11-29 00:53:55 +01:00 |
|