Priceflow/task.md

# Task Board: Catalog Image Fix

## 🚀 Current Focus

- [ ] Investigate Comparator Price Extraction (User reported false prices)
- [x] Fix Catalog Images (Generic/Missing icons)
- [/] **Amazon Login Wall Fix** (Redirected by User)

## 📋 Master Plan

- [x] Analyze `verify_extraction_logic.py`, `ai_service.py`, `ai_schema.py`, `tracking_scraper_service.py`.
- [x] Proposal Phase: Vision Priority accepted.
- [x] Implementation Phase:
  - [x] Update `ai_schema.py`.
  - [x] Fix `scheduler_service.py`.
- [x] Verification Phase: Verified with `verify_vision_priority.py`.
- [x] **Catalog Retrieval Fix**:
  - [x] Reproduce failure (Confirmed Browserless issue).
  - [x] Fix `cataloguemate_scraper.py` with HTTP fallback.
  - [x] Cleanup debug files.
- [x] **Catalog Image Fix**:
  - [x] Analyze page HTML for correct image selectors (Found Thumbor URL).
  - [x] **Check PDF availability** (Browser Task).
  - [x] **Refine Scraper Logic**:
    - [x] Update `cataloguemate_scraper.py` to grab `src` and prioritize Thumbor.
    - [x] Update `routers/catalogues.py` to clean up bad images.
  - [x] **Cleanup Bad Data**:
    - [x] Run cleanup endpoint.
  - [x] Verify fix with new scrape.
- [/] **Comparator Price Fix**:
  - [ ] Reproduce "False Price" issue with script.
  - [ ] Audit `improved_search_service.py` extraction logic (Lowest Price vs AI).
  - [ ] Implement robust price validation/filtering.
  - [ ] Verify fix.

## 📝 Progress Log

- **2025-12-22**: Vision Priority implemented and verified.
- **2025-12-22**: Fixed Catalog Retrieval using HTTP fallback.
- **2025-12-22**: Investigating generic icon issue. Found images are served via Thumbor.
- **2025-12-22**: **FIXED**: Scraper now targets Thumbor images. Wiped bad catalogs.
- **2025-12-24**: User prioritized Amazon Login Wall fix.
- **2025-12-24**: Reproduction script `test_amazon_scraper.py` patched to use local browser. Verifying issue.