Data Freshness Monitor

What is data freshness?

Data freshness measures how old the price information is for a given retailer. Fresh data (<1 day) ensures users get accurate pricing. Stale data (>7 days) may be outdated and unreliable.

What do the freshness categories mean?

• Fresh: <1 day old — excellent
• Aging: 1-7 days old — acceptable
• Stale: 7-14 days old — needs attention
• Critical: >14 days old — requires action

Why is a retailer's data stale?

Common causes include: scraper failures (e.g., FlareSolverr 403 errors), network timeouts, retailer website changes, or rate-limiting. Check the scraper diagnostics for details.

How do I fix stale data?

The monitor will suggest actions. Usually: run a manual full scrape for that retailer, check FlareSolverr connectivity, or investigate recent website changes.

How often is data refreshed?

Scrapers run on a scheduled basis (typically every 12-24 hours per retailer). Manual refreshes can be triggered via the admin panel.

What if all retailers are stale?

This suggests a systemic issue (e.g., FlareSolverr down, network connectivity issue, or database problem). Check infrastructure health and scraper logs immediately.