Skip to main content

Diagnosing 'Crawled – currently not indexed' on Magento

2 min read Updated: Mar 05, 2026
Magento SEO Technical SEO Indexing

The Problem

You've launched your Magento store, submitted the sitemap, and waited. Weeks later, Google Search Console shows hundreds of pages with the status "Crawled – currently not indexed".

This is one of the most frustrating SEO issues for Magento store owners.

Why This Happens

Google crawls your pages but decides not to index them. Common reasons:

  • Duplicate content (especially with layered navigation)
  • Low-quality content (thin product descriptions)
  • Canonical conflicts (wrong canonical tags)
  • Crawl budget exhaustion (too many URL parameters)

Diagnosis Steps

1. Check Canonical Tags

curl -I https://yourstore.com/product.html | grep canonical

Magento 2 sometimes generates self-referencing canonicals incorrectly, especially with URL rewrites.

2. Inspect Layered Navigation

Layered navigation (filters) can create thousands of URLs:

/category.html
/category.html?price=100-200
/category.html?color=red
/category.html?price=100-200&color=red

Solution: Use robots.txt or noindex meta tags on filtered URLs.

3. Review Crawl Stats

In Google Search Console:

  • Go to Settings → Crawl Stats
  • Check if Googlebot is wasting time on parameter URLs

Fixes

Block Parameter URLs in robots.txt

User-agent: *
Disallow: /*?price=
Disallow: /*?color=
Disallow: /*?*&

Improve Product Content

Thin content kills indexing. Add:

  • Detailed descriptions (300+ words)
  • Unique content per product
  • Structured data (Product schema)

Canonical Strategy

Ensure canonical tags point to the correct version:

<link rel="canonical" href="https://yourstore.com/product.html">

Not:

<link rel="canonical" href="https://yourstore.com/product.html?SID=abc123">

Monitoring

Track recovery in Google Search Console:

  • Pages → Indexing
  • Watch for status changes over 2-4 weeks

Conclusion

"Crawled – currently not indexed" is fixable. Focus on:

  • Clean URL structure
  • Quality content
  • Proper canonicals
  • Crawl budget optimization

Most Magento stores see improvements within 30 days.