Audit 1,000 Pages at Once | Day 25 — Free Mind
Day 25 / 100Technical SEO · GSC

Audit 1,000 Pages at Once

By Aryan Ahire, Founder — Free Mind Consultancy · Published October 18, 2026 · Part of 100 Days of Marketing Engineering

Once a site passes even a few dozen pages, checking indexing status page-by-page in Search Console one URL at a time stops being realistic. Search Console's bulk reports, combined with a proper crawl, close that gap in one pass instead of a hundred manual checks.

Where Search Console already does the heavy lifting

  • Pages report — grouped by Indexed vs. Not indexed, with a reason attached to every group.
  • Sitemaps report — the gap between submitted and actually-indexed count is often the fastest signal that something's wrong.
  • “Discovered — currently not indexed” vs. “Crawled — currently not indexed” — these sound similar but mean different things and need different fixes; the first means Google hasn't gotten to it yet, the second means it looked and chose not to index it.

The actual workflow

Export Pages report→ Crawl the site→ Cross-reference→ Prioritize by traffic potential
  1. Export the full Pages report from Search Console.
  2. Run a crawler across the whole site.
  3. Cross-reference the two lists — pages that exist but were never crawled, or crawled but never indexed, surface immediately.
  4. Prioritize fixes by realistic traffic potential, not by raw page count.

What a crawler adds that GSC alone can't show

Broken internal links, duplicate title and meta tags across pages, and orphaned pages with no internal links pointing to them at all — Search Console can tell you a page is indexed or not, but it can't tell you a page is structurally orphaned inside your own site.

Read this with healthy skepticism

“Not indexed” isn't always a problem that needs fixing. Thin filter pages, pagination, and near-duplicate variants are often correctly excluded on purpose — don't blindly chase 100% indexation as if every excluded page is a bug.

Free Mind's SEO agent runs this exact Search Console + crawler cross-reference as a standing part of every technical audit.

Explore Technical SEO services
Sources: Google Search Console Help documentation on the Pages report and indexing states.