Skip to main content

Diagnosing 'Crawled – currently not indexed' on Commerce Sites

2 min read Updated: Mar 05, 2026
Commerce SEO Technical SEO Indexing

The Problem

You've launched your commerce site, submitted the sitemap, and waited. Weeks later, Google Search Console shows hundreds of pages with the status "Crawled – currently not indexed".

This is one of the most frustrating SEO issues for commerce teams.

Why This Happens

Google crawls your pages but decides not to index them. Common reasons:

  • Duplicate content (especially with layered navigation)
  • Low-quality content (thin product descriptions)
  • Canonical conflicts (wrong canonical tags)
  • Crawl budget exhaustion (too many URL parameters)

Diagnosis Steps

1. Check Canonical Tags

curl -I https://yourstore.com/product.html | grep canonical

Some commerce stacks generate self-referencing canonicals incorrectly, especially with URL rewrites.

2. Inspect Layered Navigation

Layered navigation (filters) can create thousands of URLs:

/category.html
/category.html?price=100-200
/category.html?color=red
/category.html?price=100-200&color=red

Solution: Use robots.txt or noindex meta tags on filtered URLs.

3. Review Crawl Stats

In Google Search Console:

  • Go to Settings → Crawl Stats
  • Check if Googlebot is wasting time on parameter URLs

Fixes

Block Parameter URLs in robots.txt

User-agent: *
Disallow: /*?price=
Disallow: /*?color=
Disallow: /*?*&

Improve Product Content

Thin content kills indexing. Add:

  • Detailed descriptions (300+ words)
  • Unique content per product
  • Structured data (Product schema)

Canonical Strategy

Ensure canonical tags point to the correct version:

<link rel="canonical" href="https://yourstore.com/product.html">

Not:

<link rel="canonical" href="https://yourstore.com/product.html?SID=abc123">

Monitoring

Track recovery in Google Search Console:

  • Pages → Indexing
  • Watch for status changes over 2-4 weeks

Conclusion

"Crawled – currently not indexed" is fixable. Focus on:

  • Clean URL structure
  • Quality content
  • Proper canonicals
  • Crawl budget optimization

Most commerce sites see measurable improvement within 30 days.