Commit Graph
3 Commits
Author SHA1 Message Date
Michael 0ab7ac5a38 feat: add Amazon scraper service using Playwright, Browserless, and stealth for persistent sessions. 2025-12-24 12:04:58 +01:00
Claude 038dc43b60 fix: Correct proxy configuration for Crawl4AI compatibility
- Changed proxy format from dict to string (http://user:pass@ip:port)
- Updated get_random_proxy() to return Crawl4AI-compatible format
- Replaced deprecated 'proxy' with 'proxy_config' in BrowserConfig
- Fixed test script to handle new proxy format
- Added credential hiding in proxy logging for security

Fixes AttributeError: 'dict' object has no attribute 'strip'
2025-11-30 09:26:02 +00:00
Claude 49b8c3653f test: Add comprehensive test suite for Amazon France scraper
- Test basic search functionality
- Test multiple queries with delays
- Test anti-detection system (proxies, user-agents)
- Detailed logging for debugging
- Success/failure reporting
2025-11-30 00:37:40 +00:00