Technical SEO

"Crawled, currently not indexed" in Search Console: how to fix it

TS Talha Shahzad··9 min read
The short version
  • The status means Google read your page but chose not to show it to searchers.
  • This is usually a quality signal rather than a technical crawling block.
  • Accidental noindex tags and canonical conflicts should be ruled out first.
  • SaaS programmatic and templated pages frequently get skipped if they lack unique value.
  • Consolidating thin pages and updating internal links forces Google to re-evaluate.

If Google Search Console flags your URLs as crawled but not indexed, it means Google successfully visited the pages but decided the content was not valuable enough to warrant inclusion in search results. This status is rarely a technical crawl block. It is a quality verdict that you can resolve by auditing for accidental noindex tags, removing duplicate or thin template-driven content, and upgrading the page value before requesting a re-index.

When you see this error, do not panic. It simply means the search engine did its job but did not like what it found. To get your pages into the search results, you must apply the crawled currently not indexed fix: identify the quality gaps Google detected, enrich the page content, and update your internal linking structure.

Understanding the difference between crawled and discovered

Before diving into the fix, you need to understand exactly what Google is telling you. The Page Indexing report in Google Search Console divides unindexed pages into two primary buckets: "discovered, currently not indexed" and "crawled, currently not indexed." The difference between these two states is critical for your technical SEO strategy.

"Discovered, currently not indexed" means Google knows the page exists. It likely found the URL in your sitemap or followed a link from another page. However, Google has not actually crawled the page yet. This is usually a crawl budget or scheduling issue. Google knows about the page but has not gotten around to reading the code.

"Crawled, currently not indexed" is a completely different story. This status means Google did get around to reading the code. The crawler (Googlebot) visited your URL, fetched the HTML, parsed the text, and analyzed the layout. After looking at the page, Google decided to exclude it from the index. Google saw the page and chose to ignore it.

In my experience building over 450 web projects, this is almost always a quality signal. Google has limited storage space and computing resources. It will not waste those resources index-proofing content that looks thin, repetitive, or unhelpful to searchers.

Rule out the basic technical blockers first

Although this status is usually a quality issue, you must rule out basic technical mistakes before rewriting your content. Sometimes a simple configuration error tells Google not to index a page, even if the content is excellent.

First, check for accidental noindex tags. Developers often place a <meta name="robots" content="noindex"> tag in the head code of staging sites to keep search engines from indexing work in progress. If that code is pushed to production without removing the tag, Googlebot will crawl the page, read the noindex directive, and exclude the page. You can check this by opening the page, right-clicking to view the source code, and searching for the word noindex.

Second, verify your canonical tags. A canonical tag tells Google which version of a page is the master copy. If page A contains a canonical tag pointing to page B, Google will crawl page A but index page B. This is normal behavior, but if you accidentally pointed your canonical tags to the wrong URLs, your main pages will remain unindexed.

Finally, check your HTTP response headers. Sometimes security plugins or server configurations inject a X-Robots-Tag: noindex response header. This has the same effect as a meta tag but is invisible in the HTML source code. You can use the URL Inspection tool in Google Search Console to verify if Google detected any noindex directives during its crawl.

The real culprit: thin and templated content

Once you have ruled out technical tags, you must look at content quality. For SaaS founders, this is where the real work begins. The most common cause of this indexing issue is thin or templated content, particularly on programmatically generated pages.

Many startups launch directories, integration libraries, or location pages using templates. For example, a SaaS platform might generate 500 pages with titles like "How to integrate Tool X with Tool Y" or "Best workflows for Teams in City Z."

If these pages only change the tool names and keep the rest of the text identical, Google will notice. Its algorithms are highly sophisticated at identifying near-duplicate templates. If a visitor gains no unique value from visiting page 15 versus page 140, Google will index a few representative samples and throw the rest into the crawled but not indexed bucket.

The same problem happens with thin blog posts. If you publish short articles that simply summarize what is already ranking on the first page of Google, without adding original data, case studies, or unique insights, Google has no reason to index them. Why should it store a weaker version of an article it already has in its index?

Want a website that turns visitors into customers, not just compliments?

Book a 15-min intro

How to audit your site for indexing leaks

To fix the issue systematically, you need to audit your unindexed URLs. You can do this using the tools built directly into Google Search Console.

Start by exporting the list of affected URLs from the Page Indexing report. Open Google Search Console, click on "Pages" under the Indexing menu, and locate the row labeled "Crawled, currently not indexed." Click on it to see the list of URLs and export them to a spreadsheet.

Group the URLs by template or directory. If you notice that all your unindexed pages live under /integrations/ or /blog/, you know the problem is systemic to that section of your site.

Next, run a URL inspection on a few key pages. Click the magnifying glass icon next to a URL in the list. This displays the detailed crawl information. Check the "User-agent" to confirm Google crawled it with the mobile bot, check the "Canonical declared by user" to see if it matches the "Google-selected canonical," and verify that crawling was allowed.

If Google selected a different canonical URL than the one you declared, it means Google believes your page is a duplicate of another page on your site. This is a clear sign that you need to differentiate the content or consolidate the URLs.

Practical steps to get your pages indexed

Once you have identified the pages Google is skipping, you need to apply the crawled currently not indexed fix. Here is the step-by-step process I use to resolve this issue on client websites:

1. Consolidate thin or duplicate pages

If you have multiple pages targeting very similar topics, the best fix is consolidation. Instead of having five short pages that struggle to index, merge them into one comprehensive, high-value resource.

For example, if you have separate thin pages for "SaaS marketing tools," "SaaS sales tools," and "SaaS operations tools," consolidate them into a single guide titled "The Ultimate SaaS Tech Stack." Once the new page is live, set up permanent 301 redirects from the old, thin URLs to the new, comprehensive URL. This passes the link equity and tells Google where to find the valuable content.

2. Inject unique value into programmatic pages

If you must keep programmatic pages, you must make them unique. Do not just swap out keywords in a template.

Add real data, dynamic screenshots, or user-generated content. If you are building integration pages, show real diagrams of the data flow, provide copy-pasteable code snippets, or list specific use cases that other sites do not cover. The goal is to make each page look like a human wrote it for a specific purpose.

3. Build a clear internal linking structure

Google uses internal links to understand the hierarchy and importance of your pages. If a page has zero internal links pointing to it, or if it is buried five clicks deep in your site architecture, Google will assume it is not important.

Link to your unindexed pages from high-authority pages on your domain, such as your homepage, your main features page, or popular blog posts. This passes page authority and signals to Google that these pages are critical parts of your site. You can read more about page layout and hierarchy on my strategy page.

4. Improve page speed and user experience

Google prioritizes pages that load quickly and offer a great user experience. If your unindexed pages are bloated with heavy images, slow JavaScript, or layout shifts, Googlebot might decide the pages are not worth indexing.

Compress your images, defer non-critical scripts, and ensure your pages pass Core Web Vitals. If you build your site on a clean platform like Webflow or Framer, optimization is much simpler, but you still need to monitor your scripts and assets.

5. Re-request indexing in Google Search Console

After you have improved the quality and structure of your pages, you can ask Google to look at them again. Go to Google Search Console, paste the URL into the search bar at the top, and click "Request Indexing."

Do not do this manually for hundreds of pages, as Google enforces daily limits on manual requests. For large batches of pages, update the <lastmod> tag in your XML sitemap to the current date. This tells Google that the content has changed and prompts the crawler to re-visit the pages during its next crawl cycle.

Why indexing is an ongoing trust game

Getting indexed is not a one-time task. It is a relationship built on trust between your site and Google's crawlers. If you publish high-quality content consistently, Google will crawl your site more frequently and index your new pages faster.

If you publish thin, automated content that users immediately bounce from, Google will lose trust in your domain. The crawler will visit less often, and your new pages will start landing in the crawled but not indexed bucket by default.

Focus on creating pages that genuinely help your target audience. Before you hit publish on any new page, ask yourself if a searcher would find it useful. If the answer is no, do not publish it. A smaller site with 50 highly valuable, indexed pages will always outperform a bloated site with 5,000 thin, unindexed pages.

If you are planning a website rebuild or need help structuring your pages to maximize conversion and search visibility, you can check out my home page to see how I build conversion-first websites. Fix the quality first, and the indexing will follow.

Prefer to hire through Upwork?
Top Rated Plus, 100% Job Success, 450+ projects shipped. See the reviews and start a contract.
Hire me on Upwork

FAQ

Why does Google crawl my page but not index it?

Google has read the content of your page but determined it doesn't offer enough unique value, relevance, or quality to be included in search results. It is an algorithmic decision, not a technical crawling failure.

How long does it take for Google to index a page after I fix it?

It can take anywhere from a few days to several weeks. After improving the page, you can request indexing in Google Search Console, but Google will only index the page once its crawlers re-evaluate the content and find it helpful.

Can a sitemap fix crawled but not indexed issues?

No, a sitemap only helps Google find the page. Since Google has already crawled the page, a sitemap will not change the indexing decision. You must improve the content quality or fix structural issues first.

Should I delete pages that are crawled but not indexed?

Only if they offer no value to your visitors. If the pages are duplicates or extremely thin, you should delete and redirect them to a main page. If they are important pages, you need to enrich them with unique content.

All posts
the next step is small

Want a site that does this for you?

15 minutes, no deck, no pressure. Worst case, you leave with a free plan.

keep reading

More notes