Michael/Priceflow
1
0 Fork 0
mirror of https://github.com/R0m1k3/Priceflow.git synced 2026-10-14 10:46:32 +02:00
Code Issues Packages Projects Releases Wiki Activity
116 Commits 10 Branches 0 Tags
098cf007f8369366e1c0ee3ecf99d4b1f15c91b4
Commit Graph
116 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
LogiFlow 098cf007f8 Merge pull request #48 from R0m1k3/antigravity 
feat: Introduce item API endpoints for CRUD, category management, pri…
 2025-11-23 22:27:31 +01:00
Michael 3ae3e84e37 feat: Introduce item API endpoints for CRUD, category management, price checks, and their Pydantic schemas. 2025-11-23 22:27:09 +01:00
LogiFlow 19a80746dc Merge pull request #47 from R0m1k3/antigravity 
feat: add scraper service with URL simplification, Playwright integra…
 2025-11-23 22:18:29 +01:00
Michael 38af998a09 feat: add scraper service with URL simplification, Playwright integration, and retry logic for web scraping. 2025-11-23 22:18:11 +01:00
Michael ddc5c18ea1 feat: add Pydantic schemas for notification profiles, items, settings, search sites, and search results. 2025-11-23 22:00:01 +01:00
Michael 47e4fc705c Merge branch 'antigravity' 2025-11-23 21:49:52 +01:00
Michael 3eb78101a3 fix: handle empty category strings as None in update endpoint 2025-11-23 21:49:28 +01:00
Michael 308fcfb5e5 feat: add ItemCard component to display item details, prices, stock status, and actions with i18n support. 2025-11-23 21:40:17 +01:00
Michael f79f7d818c test: add TEST 2025 prefix to verify deployment 2025-11-23 21:31:34 +01:00
Michael 31aaa490df chore: force frontend build cache invalidation 2025-11-23 19:21:50 +01:00
Michael cfd2524413 Merge branch 'antigravity' 2025-11-23 18:53:46 +01:00
Michael 78b20e1f5c fix: add missing provider fields to newProfile initial state in Settings.jsx 2025-11-23 18:53:27 +01:00
LogiFlow 2b51dbb27b Merge pull request #46 from R0m1k3/antigravity 
Antigravity
 2025-11-23 17:38:05 +01:00
Michael 8afa65f9ee feat: add direct search service for e-commerce sites using Playwright/Browserless with pre-configured French retailers. 2025-11-23 17:37:23 +01:00
Michael 0ccc2fd9fc feat: add login page with authentication functionality and favicons 2025-11-23 17:30:57 +01:00
LogiFlow 6714a974b5 Merge pull request #45 from R0m1k3/antigravity 
feat: Introduce a comprehensive settings page for managing notificati…
 2025-11-23 17:13:57 +01:00
Michael 8962853de8 feat: Introduce a comprehensive settings page for managing notification profiles, AI configuration, scraper behavior, and job schedules. 2025-11-23 17:13:35 +01:00
LogiFlow b2759215ed Merge pull request #44 from R0m1k3/antigravity 
feat: Implement product search orchestration service combining direct…
 2025-11-23 16:26:39 +01:00
Michael 184763b2da feat: Implement product search orchestration service combining direct site search, light scraping, and Browserless/AI fallback. 2025-11-23 16:26:13 +01:00
LogiFlow 4cf2f6e1c7 Merge pull request #43 from R0m1k3/antigravity 
feat: Implement direct product search service using Browserless for e…
 2025-11-23 16:06:52 +01:00
Michael e551927327 feat: Add direct e-commerce search service using Playwright/Browserless with site-specific configurations. 2025-11-23 16:06:16 +01:00
Michael 9a6ebf6f06 feat: Implement direct product search service using Browserless for e-commerce sites and add a search flow verification script. 2025-11-23 15:45:09 +01:00
LogiFlow 13cebf4a4a Merge pull request #42 from R0m1k3/antigravity 
feat: Implement dashboard delete confirmation UI, add a text utility,…
 2025-11-23 15:18:37 +01:00
Michael 7c8da4a337 feat: Implement dashboard delete confirmation UI, add a text utility, and install frontend dependencies. 2025-11-23 15:18:04 +01:00
LogiFlow 0c0352e253 Merge pull request #41 from R0m1k3/antigravity 
feat: Implement search functionality with new frontend page, backend …
 2025-11-23 14:54:46 +01:00
Michael cb9cdfcca0 feat: Implement search functionality with new frontend page, backend router, service, and database migration. 2025-11-23 14:54:22 +01:00
LogiFlow fede429525 Merge pull request #40 from R0m1k3/antigravity 
feat: Add initial frontend application entry point, dependencies, and…
 2025-11-23 14:52:14 +01:00
Michael 45bb055566 feat: Add initial frontend application entry point, dependencies, and test configuration. 2025-11-23 14:51:42 +01:00
LogiFlow 3b315c7a41 Merge pull request #39 from R0m1k3/antigravity 
feat: Add AI service, database migration, French locale, and Marquee …
 2025-11-23 14:49:04 +01:00
Michael fb447677b2 feat: Add AI service, database migration, French locale, and Marquee UI component. 2025-11-23 14:45:15 +01:00
LogiFlow 7dd153c604 Merge pull request #38 from R0m1k3/antigravity 
feat: Add initial database migration and UI label component, alongsid…
 2025-11-23 14:38:07 +01:00
Michael 8d124bf0f8 feat: Add initial database migration and UI label component, alongside frontend dependency installation. 2025-11-23 14:37:35 +01:00
LogiFlow 5884aa2378 Merge pull request #37 from R0m1k3/claude/hardcode-website-urls-01QrWZK7suQnuBrxYgK1r5JC 
fix: Rename use-auth.js to use-auth.jsx for JSX support
 2025-11-23 10:25:41 +01:00
Claude 1dcb2849e2 fix: Rename use-auth.js to use-auth.jsx for JSX support 2025-11-23 09:24:05 +00:00
LogiFlow f21484d996 Merge pull request #36 from R0m1k3/claude/hardcode-website-urls-01QrWZK7suQnuBrxYgK1r5JC 
fix: Improve product selectors and URL filtering
 2025-11-23 10:21:32 +01:00
Claude 1dd6d4dae1 feat: Add authentication system and admin panel 
- Add User model with authentication
- Create JWT-based auth service
- Add login page with admin/admin default credentials
- Create admin panel with user management, settings, and site configuration
- Move settings to admin section (admin only)
- Change search page from multi-site checkboxes to single site selector
- Add logout functionality to layout
- Protect routes with authentication
 2025-11-23 09:15:56 +00:00
Claude 5e5f49a5f6 fix: Improve Amazon search reliability and URL validation 
Amazon selectors simplified:
- Remove overly restrictive [href*='/ref='] requirement
- Use simpler data-asin and s-result-item selectors
- Wait for [data-component-type='s-search-result']

URL validation improved (_is_non_product_url):
- For Amazon: ONLY accept URLs containing /dp/ or /gp/product/
- Reject Amazon URLs with /ref=cs_ (error page links)
- Reject Amazon redirect URLs without product paths
- Add patterns: /503, /error, /robot, /captcha
- Add French site patterns: /application, /courses

Navigation link filter improvements:
- Add more Amazon error patterns: /ref=nb_, /ref=sr_
- Add /ap/signin, /gp/yourstore, /gp/cart
 2025-11-23 09:02:51 +00:00
Claude 0a786b1c49 fix: Improve product selectors and URL filtering 
Product selectors improvements:
- E.Leclerc: Target only /fp/ links, exclude promo/promotion URLs
- Auchan: Target only /p/*.html product links
- Carrefour: Target only /p/*.html product links
- Amazon FR/US: Target only /dp/ links with ASIN, exclude logo/nav links

URL filtering improvements (_is_navigation_link):
- Add French site-specific patterns: /application, /courses, /ep-
- Add promo/offers exclusions: /promo/, /offres/, /promotions/
- Add service pages: /magasin, /services/, /recettes
- Add Amazon-specific: /ref=cs_, /logo, /nav_, /gp/help
- Add generic exclusions: /home, /newsletter, /wishlist

These changes ensure only actual product URLs are captured,
not navigation links, app pages, or promotional banners.
 2025-11-23 08:43:21 +00:00
LogiFlow fb4176b71f Merge pull request #35 from R0m1k3/claude/hardcode-website-urls-01QrWZK7suQnuBrxYgK1r5JC 
fix: Correct search URLs for French supermarkets
 2025-11-23 09:30:14 +01:00
Claude d2f95f5508 fix: Correct search URLs for French supermarkets 
- E.Leclerc: Fix URL from /cat/recherche~q= to /recherche?q=
  (the old URL was showing promotions instead of search results)
- Auchan: Keep correct URL /recherche?text=
- Carrefour: Keep correct URL /s?q=
- Amazon FR/US: Simplify configuration, remove complex anti-bot
  headers that were causing more issues than helping
- Simplify browserless search function (remove special Amazon handling)
 2025-11-23 08:29:28 +00:00
LogiFlow 356c5a6ef4 Merge pull request #34 from R0m1k3/claude/hardcode-website-urls-01QrWZK7suQnuBrxYgK1r5JC 
Claude/hardcode website urls 01 qr wzk7su qnu brx yg k1r5 jc
 2025-11-23 09:16:57 +01:00
Claude 00d3aa9f1e fix: Improve Amazon search with anti-bot bypass measures 
- Add special handling for Amazon (FR and US):
  - Custom User-Agent and HTTP headers mimicking real browser
  - Don't block images (Amazon uses them for bot detection)
  - Extra wait time and scroll for lazy-loaded content
  - Timezone set to Europe/Paris
  - Additional Sec-Fetch-* headers for authenticity
- Update Amazon product selectors with more robust patterns:
  - a.a-link-normal for direct product links
  - [data-asin]:not([data-asin='']) for filtering empty ASINs
  - .s-main-slot targeting main search results
- Add &ref=nb_sb_noss parameter to avoid redirects
 2025-11-23 08:15:29 +00:00
Claude 3293b5d58a fix: Improve French price extraction and cookie handling 
AI Schema:
- Improve extraction prompt for French e-commerce pages
- Add specific instructions for French price format (comma decimal, space thousands)
- Add French stock status terms (Ajouter au panier, Disponible, etc.)
- Fix price normalization to handle French format:
  - "12,99" -> 12.99
  - "1 234,56" -> 1234.56
  - "1.234,56" -> 1234.56

Scraper Service:
- Add comprehensive cookie/popup selectors for French sites:
  - E.Leclerc, Auchan, Carrefour (OneTrust, Didomi)
  - Cdiscount (#footer_tc_privacy_button_2)
  - Boulanger (.bcom-consent-accept-all)
  - Gifi, Centrakor (Magento cookie buttons)
  - PrestaShop sites (Stokomani, B&M)
- Add common CMP platform selectors
- Add French text-based selectors for cookie acceptance
 2025-11-23 08:12:43 +00:00
LogiFlow 2484ec66a3 Merge pull request #33 from R0m1k3/claude/hardcode-website-urls-01QrWZK7suQnuBrxYgK1r5JC 
fix: Improve French e-commerce sites configuration
 2025-11-23 09:06:31 +01:00
Claude ee40ae68fc fix: Improve French e-commerce sites configuration 
- Change default currency from USD to EUR for all French sites
- Update AI extraction prompt to use EUR by default
- Fix E.Leclerc search URL pattern
- Improve product selectors for Auchan, Carrefour, Amazon France
- Add Amazon France language parameter for better results
- Enhance cookie acceptance with site-specific selectors:
  - Amazon (#sp-cc-accept)
  - E.Leclerc (#onetrust-accept-btn-handler)
  - Auchan (#popin_tc_privacy_button_2, #didomi-notice-agree-button)
  - Carrefour (#onetrust-accept-btn-handler)
  - Cdiscount (#footer_tc_privacy_button_2)
  - And more CMP platforms (Didomi, OneTrust, Tarteaucitron, etc.)
- Improve cookie handling with iframe support and retry logic
 2025-11-23 07:54:49 +00:00
LogiFlow c0ec22f7bb Merge pull request #32 from R0m1k3/claude/hardcode-website-urls-01QrWZK7suQnuBrxYgK1r5JC 
feat: Hardcode French e-commerce websites configuration
 2025-11-23 08:41:50 +01:00
Claude e1a9bd2657 feat: Hardcode French e-commerce websites configuration 
- Remove ability to add/edit/delete search sites from settings UI
- Configure 16 French e-commerce sites with search URLs:
  - Discount: Gifi, Stokomani, B&M, Centrakor, L'Incroyable, Action, La Foir'Fouille
  - Grandes Surfaces: E.Leclerc, Auchan, Carrefour
  - E-commerce: Amazon France, Cdiscount
  - Électronique: Darty, Boulanger, Fnac
- Add automatic database seeding on application startup
- Add /api/search-sites/seed and /api/search-sites/reset endpoints
- Add cookie consent banner handling for sites that require it
- Simplify Settings page to only show site list with toggle for active state
 2025-11-23 07:40:12 +00:00
LogiFlow c6a9ef681e Merge pull request #31 from R0m1k3/claude/design-product-search-01Ea9dWZqZpuKFwBwVmp26PG 
Claude/design product search 01 ea9d w zq zpu k fw bw vmp26 pg
 2025-11-22 17:00:19 +01:00
Claude 7d92549a45 fix: Improve gifi.fr product link detection with .html pattern 2025-11-22 15:59:30 +00:00
Claude d132f991a9 fix: Add /products/ pattern for stokomani.fr 2025-11-22 15:58:18 +00:00