mirror of
https://github.com/R0m1k3/Priceflow.git
synced 2026-10-11 17:29:14 +02:00
feat: Replace DuckDuckGo with direct site search
- Remove duckduckgo-search dependency (unreliable results) - Add direct_search_service.py that scrapes sites' search pages directly - Add search_url and product_link_selector fields to SearchSite model - Add beautifulsoup4 and lxml for HTML parsing - Update schemas with new fields - Add database migration for new columns Direct search is more reliable as it queries each site's own search functionality instead of relying on external search engines.
This commit is contained in:
7 files changed
+379
-198
No files matched your search
+2
-1
@@ -23,7 +23,8 @@ dependencies = [
|
||||
"alembic",
|
||||
"tenacity",
|
||||
"slowapi",
|
||||
"duckduckgo-search",
|
||||
"beautifulsoup4",
|
||||
"lxml",
|
||||
]
|
||||
|
||||
[build-system]
|
||||
|
||||
Reference in new issue
Block a user