Commit Graph

  • 22f8aedaa4 feat: Add centralized search configuration for sites, proxies, and user agents, and create browserless service module. Michael 2025-11-29 09:51:10 +01:00
  • 07ce37ca5c Merge pull request #91 from R0m1k3/antigravity LogiFlow 2025-11-29 09:46:47 +01:00
  • f665a000af feat: add AI service for content extraction and Browserless service for web scraping Michael 2025-11-29 09:46:29 +01:00
  • 96d3f1ef32 Merge pull request #90 from R0m1k3/antigravity LogiFlow 2025-11-29 09:38:11 +01:00
  • 86559ff2d7 feat: implement NewSearchService for orchestrating e-commerce searches, parsing results, and scraping item details. Michael 2025-11-29 09:37:33 +01:00
  • fea7b2274b Merge pull request #89 from R0m1k3/antigravity LogiFlow 2025-11-29 09:27:57 +01:00
  • 867274a9ab feat: Introduce AI service for data extraction, including dynamic configuration, response parsing, and repair. Michael 2025-11-29 09:27:35 +01:00
  • ba6cde364a Merge pull request #88 from R0m1k3/antigravity LogiFlow 2025-11-29 09:17:24 +01:00
  • 8d903202fb feat: introduce browserless, scheduler, and search services for advanced web scraping and data collection. Michael 2025-11-29 09:02:34 +01:00
  • b50a47d999 Merge pull request #87 from R0m1k3/antigravity LogiFlow 2025-11-29 08:58:50 +01:00
  • 654145d499 Merge origin/main into antigravity: Resolve conflict by accepting deletion of direct_search_service.py Michael 2025-11-29 08:57:48 +01:00
  • 6019a80de9 feat: Add core search configuration for site definitions, proxies, and user agents, and introduce a browserless service. Michael 2025-11-29 08:54:05 +01:00
  • b6c1fc1cda feat: Add AI-powered data extraction and direct search services Michael 2025-11-29 02:53:35 +01:00
  • a78d24fe5a Merge pull request #86 from R0m1k3/antigravity LogiFlow 2025-11-29 02:44:38 +01:00
  • fa463ec50a Merge pull request #85 from R0m1k3/main LogiFlow 2025-11-29 02:44:18 +01:00
  • be5b64ce0f Merge pull request #84 from R0m1k3/antigravity LogiFlow 2025-11-29 02:43:57 +01:00
  • daaad442e5 Merge pull request #83 from R0m1k3/main LogiFlow 2025-11-29 02:40:36 +01:00
  • 33b4a43cc1 Merge pull request #82 from R0m1k3/antigravity LogiFlow 2025-11-29 02:38:40 +01:00
  • a6662e8891 feat: Add direct e-commerce search service using Playwright/Browserless with anti-bot measures and Amazon-specific handling. Michael 2025-11-29 02:38:18 +01:00
  • a6f195c491 Merge pull request #81 from R0m1k3/antigravity LogiFlow 2025-11-29 02:31:52 +01:00
  • 352fc72bfa feat: Implement direct e-commerce search service using Playwright and Browserless with anti-bot and proxy rotation capabilities. Michael 2025-11-29 02:31:30 +01:00
  • 2add7eadbe Merge pull request #80 from R0m1k3/antigravity LogiFlow 2025-11-29 02:24:45 +01:00
  • fa890f67dc feat: add direct e-commerce search service using Playwright with anti-bot measures for scraping. Michael 2025-11-29 02:24:20 +01:00
  • 3cf1c57466 Merge pull request #79 from R0m1k3/antigravity LogiFlow 2025-11-29 02:17:45 +01:00
  • 3cb0b202d3 Merge branch 'antigravity' of https://github.com/R0m1k3/Priceflow into antigravity Michael 2025-11-29 02:17:20 +01:00
  • bad2cfca20 feat: Add direct e-commerce search service using Playwright with anti-bot measures including rotating proxies, user agents, and stealth JavaScript. Michael 2025-11-29 02:17:17 +01:00
  • 6cb145626f Merge pull request #78 from R0m1k3/main LogiFlow 2025-11-29 02:09:11 +01:00
  • 87165a8b9b feat: Implement direct search service with Playwright/Browserless, including anti-bot measures, proxy rotation, and stealth JavaScript. Michael 2025-11-29 02:07:59 +01:00
  • 326272ae56 Merge pull request #77 from R0m1k3/antigravity LogiFlow 2025-11-29 02:05:07 +01:00
  • 394fa3c118 feat: implement AI service for data extraction with dynamic configuration and robust response handling. Michael 2025-11-29 02:00:42 +01:00
  • a4c0431443 Merge pull request #76 from R0m1k3/antigravity LogiFlow 2025-11-29 01:56:44 +01:00
  • 091caad347 feat: add web scraping and search services using Playwright with anti-detection mechanisms. Michael 2025-11-29 01:56:25 +01:00
  • 7a73650264 feat: add DirectSearchService for robust e-commerce product search using Playwright/Browserless with advanced bot detection evasion. Michael 2025-11-29 01:52:31 +01:00
  • e6bf46659d refactor: Improve browser lifecycle management in ScraperService to prevent connection errors Michael 2025-11-29 01:39:43 +01:00
  • 0439b74bc3 fix: Remove duplicate 'finally' block in scraper_service.py causing SyntaxError Michael 2025-11-29 01:24:34 +01:00
  • 405756963a fix: Resolve IndentationError in scraper_service.py caused by loop removal Michael 2025-11-29 01:20:58 +01:00
  • aa9d2af5b2 feat: Implement hybrid proxy strategy for Amazon scraping - fallback to Direct IP on last retry Michael 2025-11-29 01:17:03 +01:00
  • dd558b0e43 fix: Correct proxy usage in scraper_service.py to handle dict format Michael 2025-11-29 01:07:02 +01:00
  • 4c410ef48f fix: Correct Playwright proxy format - use dict with server/username/password instead of URL string Michael 2025-11-29 01:02:41 +01:00
  • df2191cdbd debug: Add proxy initialization logs to verify proxy loading Michael 2025-11-29 00:53:55 +01:00
  • 8080a97e25 feat: Add same 10 rotating proxies to scraper_service for individual product pages Michael 2025-11-29 00:50:08 +01:00
  • b7e373d9eb feat: Add 10 rotating proxies for Amazon to bypass IP bans Michael 2025-11-29 00:47:17 +01:00
  • 26df52b664 revert: Use Amazon config from commit 698dbaa (15 commits back) Michael 2025-11-29 00:40:27 +01:00
  • 3c4094d4de revert: Back to working Amazon configuration from ee8a146 - simpler is better Michael 2025-11-29 00:39:25 +01:00
  • c88f52c136 fix: Add ref=nb_sb_noss parameter to Amazon URLs as in working version + increase retry delays Michael 2025-11-29 00:34:09 +01:00
  • eb48c4aa33 feat: Add direct search service for e-commerce scraping via Browserless with bot evasion. Michael 2025-11-29 00:30:12 +01:00
  • 34dc9f6f40 fix: Apply working Amazon anti-blocking strategy from scraper_service - warmup + no image blocking Michael 2025-11-29 00:22:52 +01:00
  • 46442d5e0c Merge: resolved conflicts in direct_search_service.py Michael 2025-11-29 00:12:28 +01:00
  • 69aefdbac3 Fix: Resolve merge conflict in direct_search_service.py by confirming random import Michael 2025-11-29 00:06:51 +01:00
  • 0d102b73d0 feat: Implement direct e-commerce search service using Playwright/Browserless with anti-bot techniques like User-Agent rotation, proxy support, and stealth JS, particularly for Amazon. Michael 2025-11-28 23:59:50 +01:00
  • b75ad636dd feat: add product search orchestration service with direct, light scraper, and browserless methods Michael 2025-11-28 23:57:51 +01:00
  • 3caea8316b feat: Add Playwright-based web scraping service with advanced stealth techniques and proxy support, including Amazon-specific logic. Michael 2025-11-28 23:53:45 +01:00
  • f187e6cb9d feat: Implement direct e-commerce search service with advanced anti-bot stealth using Playwright/Browserless. Michael 2025-11-24 13:10:40 +01:00
  • ba28f0b711 feat: implement direct e-commerce search service with site-specific configurations using Playwright. Michael 2025-11-24 13:05:21 +01:00
  • ee8a14668c feat: Implement direct e-commerce search service using Playwright/Browserless to scrape product information from various configured retail websites. Michael 2025-11-24 13:04:03 +01:00
  • 97039484fa feat: add direct search service for e-commerce sites using Playwright/Browserless with predefined site configurations. Michael 2025-11-24 13:03:47 +01:00
  • 8053955097 feat: add direct e-commerce search service using Playwright/Browserless with predefined site configurations Michael 2025-11-24 13:01:47 +01:00
  • 4ed574e814 Merge pull request #74 from R0m1k3/claude/fix-amazon-search-error-01Gnft8Nyjh9KkpKuavHaaPc LogiFlow 2025-11-24 09:40:49 +01:00
  • 698dbaa029 feat: Add dedicated Amazon extraction without generic filters claude/fix-amazon-search-error-01Gnft8Nyjh9KkpKuavHaaPc Claude 2025-11-24 08:39:11 +00:00
  • 9cae86d733 Merge pull request #73 from R0m1k3/claude/fix-amazon-search-error-01Gnft8Nyjh9KkpKuavHaaPc LogiFlow 2025-11-24 09:31:54 +01:00
  • 10ec21f4f5 feat: Add proxy support for Amazon scraping Claude 2025-11-24 08:30:55 +00:00
  • 4c3b69b577 Merge pull request #72 from R0m1k3/claude/fix-amazon-search-error-01Gnft8Nyjh9KkpKuavHaaPc LogiFlow 2025-11-24 09:26:37 +01:00
  • e62ff09667 feat: Enhanced stealth JavaScript with comprehensive anti-detection Claude 2025-11-24 08:25:23 +00:00
  • 1e1a4465dc Merge pull request #71 from R0m1k3/claude/fix-amazon-search-error-01Gnft8Nyjh9KkpKuavHaaPc LogiFlow 2025-11-24 09:18:42 +01:00
  • 2384fca9ca fix: Make migration idempotent - check if columns exist before adding Claude 2025-11-24 08:17:49 +00:00
  • ffbeffcfca Merge pull request #70 from R0m1k3/claude/fix-amazon-search-error-01Gnft8Nyjh9KkpKuavHaaPc LogiFlow 2025-11-24 09:15:34 +01:00
  • 30861acdb8 fix: Correct migration dependency chain to avoid multiple heads Claude 2025-11-24 08:14:39 +00:00
  • ec80a409f8 Merge pull request #69 from R0m1k3/claude/fix-amazon-search-error-01Gnft8Nyjh9KkpKuavHaaPc LogiFlow 2025-11-24 09:12:40 +01:00
  • 898e19cf0a fix: Remove duplicate downloadDebugFile function causing build failure Claude 2025-11-24 08:12:05 +00:00
  • 8a9ec6a6db fix: Add database migration for search_sites missing columns Claude 2025-11-24 08:11:15 +00:00
  • f30479516c Merge pull request #68 from R0m1k3/claude/fix-amazon-search-error-01Gnft8Nyjh9KkpKuavHaaPc LogiFlow 2025-11-24 09:10:42 +01:00
  • 3bae422c38 fix: Add stealth JavaScript injection to bypass Amazon bot detection Claude 2025-11-24 08:07:49 +00:00
  • e62117f9b9 feat: Add per-site debug toggle for HTML dump control Claude 2025-11-24 08:01:39 +00:00
  • 6e3492b5cc Merge pull request #67 from R0m1k3/claude/fix-amazon-search-error-01Gnft8Nyjh9KkpKuavHaaPc LogiFlow 2025-11-24 08:50:20 +01:00
  • 7243bcfaa1 fix: Improve Amazon scraping to avoid 503 blocking errors Claude 2025-11-24 07:45:09 +00:00
  • 640975aeb6 Merge pull request #66 from R0m1k3/claude/debug-api-search-service-01Xdnq66w9L6D5odAiw99Dsa LogiFlow 2025-11-24 08:34:10 +01:00
  • ffeeafa318 fix: Add missing debug tab rendering in Admin page claude/debug-api-search-service-01Xdnq66w9L6D5odAiw99Dsa Claude 2025-11-24 07:32:00 +00:00
  • df9295ce21 Merge pull request #65 from R0m1k3/claude/debug-api-search-service-01Xdnq66w9L6D5odAiw99Dsa LogiFlow 2025-11-24 08:28:06 +01:00
  • a8ff8217b3 fix: Use absolute paths for debug_dumps directory Claude 2025-11-24 07:27:45 +00:00
  • 119e7e3963 Merge pull request #64 from R0m1k3/antigravity LogiFlow 2025-11-24 07:40:44 +01:00
  • 5f4d3afbae feat: Implement authentication and authorization with user management and admin-only debug endpoints. Michael 2025-11-24 07:40:22 +01:00
  • 7149448f80 Merge pull request #63 from R0m1k3/antigravity LogiFlow 2025-11-24 07:35:08 +01:00
  • 25b0a824c2 chore: add .dockerignore to exclude common development and build artifacts from Docker builds. Michael 2025-11-24 07:34:45 +01:00
  • 24430b0383 Merge pull request #62 from R0m1k3/antigravity LogiFlow 2025-11-24 07:26:59 +01:00
  • fac4968485 chore: Install frontend dependencies. Michael 2025-11-24 07:25:50 +01:00
  • de4887eeb7 Merge pull request #61 from R0m1k3/antigravity LogiFlow 2025-11-24 07:18:34 +01:00
  • e45290350c feat: implement direct e-commerce search service with Playwright/Browserless and add supporting admin page and debug routes. Michael 2025-11-24 07:18:12 +01:00
  • 7093bee3a4 Merge pull request #60 from R0m1k3/antigravity LogiFlow 2025-11-24 00:48:02 +01:00
  • df052ae4f7 feat: add direct e-commerce search service via Browserless/Playwright with site-specific configurations. Michael 2025-11-24 00:47:34 +01:00
  • cab6dcb77d Merge pull request #59 from R0m1k3/antigravity LogiFlow 2025-11-24 00:28:21 +01:00
  • 95deddaffb feat: implement product search orchestration service with direct, light scraping, and browserless AI extraction strategies. Michael 2025-11-24 00:28:00 +01:00
  • 903ff1abae Merge pull request #58 from R0m1k3/antigravity LogiFlow 2025-11-24 00:22:50 +01:00
  • 4ab859114e feat: Add direct search service for e-commerce sites using Playwright/Browserless and configured selectors. Michael 2025-11-24 00:22:28 +01:00
  • be7c0a313e Merge pull request #57 from R0m1k3/antigravity LogiFlow 2025-11-24 00:10:25 +01:00
  • a9cb4e4ac5 feat: Implement dashboard page for item management and add/edit item modal. Michael 2025-11-24 00:09:59 +01:00
  • 97668ca39e Merge pull request #56 from R0m1k3/antigravity LogiFlow 2025-11-23 23:48:09 +01:00
  • 18d5f3dbf1 feat: Add notification service with Apprise integration for email, Discord, and Mattermost channels. Michael 2025-11-23 23:47:45 +01:00
  • 18e8d21288 Merge pull request #55 from R0m1k3/antigravity LogiFlow 2025-11-23 23:42:20 +01:00
  • f720a7aa17 feat: Implement a new notification service using Apprise for sending notifications via various channels. Michael 2025-11-23 23:42:00 +01:00
  • 3552980115 Merge pull request #54 from R0m1k3/antigravity LogiFlow 2025-11-23 23:37:49 +01:00