Crawled, Currently Not Indexed: Is Something Broken?

By Bob Nevans

Is something broken?

Open Google Search Console, go to Indexing → Pages, and look under "Why pages aren't indexed". One line is often the biggest and the most alarming: Crawled - currently not indexed.

On a site we build and run, that line said 361 pages on 14 November. On 18 November it said 455. Only 297 of the site's pages were indexed.

What the report says

It isn't an error report. "Crawled - currently not indexed" means Google fetched the page, read it, and didn't add it to search results. Google's own help page says it doesn't index every page on the web, so this message is common and doesn't necessarily mean anything needs attention. For pages that matter, it points you to the URL Inspection tool to look for real problems, like pages blocked from its crawler. What it won't tell you is why it held a particular page back.

Two neighbouring lines are worth knowing:

  • Discovered - currently not indexed: Google knows the address but hasn't fetched it yet.
  • Duplicate without user-selected canonical: Google found pages that look like copies, and the site didn't say which one is the main one. That one is in your hands. A canonical tag on each page names the real address.

Don't read 455 URLs. Group them.

A list of hundreds of addresses is hard to think about. Sort it by the first part of the path and it becomes a handful of questions. Then open one page from each group and look at what a search engine actually receives. Here's ours, from 18 November, with what one sample page showed:

  • Glossary (117 entries and the index): 118 pages. About 300 words of text. Short, but not empty.
  • Videos: 96 pages. About 200 words. 48 of them share a name with a blog post, and the matching post had about 1,000 words. Each page names itself as the main one.
  • Blog posts: 88 pages. Not sampled yet. These need a look one by one.
  • Blog tag pages: 68 pages. Over 10,000 words, because the tag page repeats the posts it lists. Not thin: repeated.
  • Card pages: 40 pages. About 140 words to a crawler.
  • Spreads (31 and the index): 32 pages. About 600 words.
  • Other: 13 pages. Look at each.

That's one page per group. It tells us where to look, not why Google said no. Two things surprised us. The tag pages weren't thin at all: they were long and made of text that lives elsewhere. And the video pages are short companions to fuller posts with nearly the same name. We haven't changed anything yet. That's our next job, and we'll write up what actually moved the numbers.

What to do with each group

  • Pages that don't need to be in search (tag lists, filtered views, thank-you pages): consider marking them noindex, especially when they mostly repeat other pages.
  • Two pages for one subject (a short video page and a full post): decide which one should be found, and point the other at it with a canonical tag, or merge them.
  • Short pages that should be found (a glossary term people really search for): make each one worth reading on its own. More explanation, an example, links to related pages.
  • Pages that look full to people but short to crawlers: check what a crawler receives, not what your browser shows. If the main text only appears after scripts run, a search engine may see far less than you do. That's crawler rendering, and our free LLMO meter reads a page without running its scripts.
  • Then wait, and watch the trend over weeks, not days.

The short version

"Crawled, currently not indexed" doesn't mean your site is broken. It's Google telling you which pages it hasn't chosen to show. Group them, look at one page from each group the way a crawler sees it, decide what each group is for, and fix the page, not the report.

Back to the blog index