Claude df613cf64f fix: Use Browserless for search page scraping ...

- Replace httpx with Playwright/Browserless for search pages
- Handles JavaScript-rendered content and bot detection
- Add wait selectors for each site to ensure content is loaded
- Block images and tracking scripts for faster loading
- Sequential site scraping to avoid overloading Browserless

2025-11-22 15:05:47 +00:00

..

alembic

fix: Correct Alembic migration chain for search_sites table

2025-11-22 11:08:39 +00:00

routers

feat: Add multi-site product search system with SearXNG integration

2025-11-22 11:03:48 +00:00

services

fix: Use Browserless for search page scraping

2025-11-22 15:05:47 +00:00

utils

Add files via upload

2025-11-22 10:01:25 +01:00

__init__.py

Add files via upload

2025-11-22 10:01:25 +01:00

ai_schema.py

Add files via upload

2025-11-22 10:01:25 +01:00

database.py

Add files via upload

2025-11-22 10:01:25 +01:00

limiter.py

Add files via upload

2025-11-22 10:01:25 +01:00

main.py

feat: Replace DuckDuckGo with direct site search

2025-11-22 15:00:49 +00:00

models.py

feat: Replace DuckDuckGo with direct site search

2025-11-22 15:00:49 +00:00

notification_sender.py

Add files via upload

2025-11-22 10:01:25 +01:00

schemas.py

feat: Replace DuckDuckGo with direct site search

2025-11-22 15:00:49 +00:00

url_validation.py

Add files via upload

2025-11-22 10:01:25 +01:00