← jwatte.com

URL Parameter Crawl-Waste Audit

E-commerce and large-blog sites routinely spray URLs like /products?sort=price&filter=red&page=2&utm_source=email. Googlebot crawls the combinatorial explosion; 80% of crawl budget goes to duplicates of the same canonical page. This auditor clusters URLs by parameter fingerprint and tells you which parameters to block.

Context and background

Read the story behind this tool: When 80% of Your Crawl Budget Goes to ?sort=price Duplicates →

Inputs

Option A: sitemap URL (auto-extract). Option B: paste URL list (one per line, from GSC Coverage export or Screaming Frog).