freeseobot

Why Isn't My Page Indexed? Every Search Console Status

Every reason in Google Search Console's Page indexing report explained in plain English, whether it is a real problem, and exactly what to do about each.

By freeseobot Editorial · Published · 6 min read

A page is usually not indexed for one of four reasons: Google has been told not to index it (noindex or a robots.txt block), Google could not load it (server errors, 404s, login walls), Google sees it as a duplicate of another page, or Google found it but decided it was not worth crawling or indexing yet. Search Console's Page indexing report tells you which, and the URL Inspection tool confirms it for a single page.

Not every unindexed page is a problem. Google says it is normal not to index pages you blocked on purpose, duplicates, and filter variations. What matters is whether the pages you care about are indexed.

How do you check whether a page is indexed?

  1. In Search Console, paste the full URL into the search bar at the top. This opens URL Inspection.
  2. Read the headline: "URL is on Google" or "URL is not on Google", plus the reason.
  3. Click Test live URL to check the current version, in case you have already fixed something since Google's last visit.
  4. If the live test passes and the page is important, click Request indexing.

For the site-wide picture, open Indexing > Pages. The table under "Why pages aren't indexed" lists each reason and how many URLs it affects. You cannot search for a single URL in that report; use URL Inspection for that.

Every "not indexed" reason, explained

Status in Search Console What it means Usually a problem? What to do
Server error (5xx) Your server failed when Google requested the page Yes Check hosting logs, resource limits and security plugins; fix, then validate
Redirect error Redirect chain too long, a loop, an over-long URL, or a bad URL in the chain Yes Point each old URL straight to its final destination in one hop
URL blocked by robots.txt Your robots.txt stops Google crawling the page Only if you want it indexed Remove the Disallow rule that matches
URL marked 'noindex' The page tells Google not to index it Only if you want it indexed Remove the noindex meta tag or X-Robots-Tag header
Soft 404 The page looks like an error or empty page but returns a 200 "OK" code Yes Return a real 404 for missing pages, or add real content
Blocked due to unauthorized request (401) Google hit a login prompt Only if the page should be public Remove the login requirement for public pages
Not found (404) The page does not exist Usually no Redirect it with a 301 if it moved; otherwise leave it
Blocked due to access forbidden (403) Your server refused Googlebot Yes, if the page should be public Check firewall, CDN and bot-protection rules
URL blocked due to other 4xx issue Another client error Yes Inspect the URL to see the exact code
Crawled - currently not indexed Google fetched the page and chose not to index it for now Often Improve the page (see below); Google says resubmitting is not needed
Discovered - currently not indexed Google knows the URL but has not crawled it yet Sometimes Add internal links; check server speed and duplicate URLs
Alternate page with proper canonical tag This page correctly points to another canonical version No Nothing
Duplicate without user-selected canonical Google sees it as a copy and picked another URL Depends Add a canonical tag, or make the content genuinely different
Duplicate, Google chose different canonical than user Google ignored your canonical tag Depends Check the two pages really are duplicates; align redirects, links and sitemap
Page with redirect This URL redirects elsewhere No Nothing, if the redirect is intended

There are also two indexed with a warning states:

  • Indexed, though blocked by robots.txt. Other sites link to the page, so Google indexed it without reading it. To remove it, unblock it in robots.txt and add noindex; to keep it, just unblock it.
  • Page indexed without content. Google indexed the URL but could not read the content, for example because of an unsupported format or cloaking.

The four most common problems and how to fix them

Accidental noindex

This is the classic mistake after a site launch. Many CMS platforms have a "discourage search engines" setting used during development. Look for this in your page source:

<meta name="robots" content="noindex">

Or in the HTTP response headers:

X-Robots-Tag: noindex

Remove it, then use Test live URL to confirm before requesting indexing.

robots.txt blocking the wrong thing

A rule such as Disallow: / under User-agent: * blocks the whole site. Note that robots.txt is the wrong tool for keeping pages out of Google: Google says a blocked page can still be indexed if others link to it. Use noindex for that, and let Google crawl the page so it can see the tag. Our robots.txt guide explains how rule groups work.

Crawled - currently not indexed

This is a quality and value judgement, not a technical error. Common causes:

  • Thin pages with little original content
  • Many near-identical pages, such as location pages with only the town name changed
  • Pages with no internal links pointing to them
  • Tag, archive and search result pages

Fixes: merge thin pages into stronger ones, add genuinely useful content, link to the page from relevant pages on your site, and remove low-value URLs from your sitemap. Google's guide to generative AI features warns that creating many pages for query variations can breach its scaled content abuse policy.

Discovered - currently not indexed

Google's explanation is that it wanted to crawl the URL but expected this to overload your site, so it rescheduled. On small sites it more often means the page is poorly linked or Google sees too many similar URLs. Improve server response times, link to the page from your navigation or related pages, and stop generating endless parameter URLs (for example ?sort=price&colour=red combinations).

Check your sitemap

A sitemap lists the URLs you want indexed. Google treats sitemap inclusion as a weak canonical signal, so only list the canonical, indexable version of each page: no redirects, no 404s, no noindex pages.

Google's limits are 50,000 URLs or 50MB uncompressed per sitemap file. Google ignores <priority> and <changefreq>, and uses <lastmod> only if it is consistently accurate. Our free sitemap generator builds a clean file you can submit under Indexing > Sitemaps.

Validating a fix

After fixing an issue across your site:

  1. Open the reason in the Page indexing report.
  2. Click Validate fix. Click it once only.
  3. Google rechecks the affected URLs. Its help page says this typically takes up to about two weeks, sometimes longer, and it emails you the result.

If validation fails, open See details to find the URL that still has the problem.

For a full health check beyond indexing, work through our technical SEO checklist for small business websites.

FAQ

How long does it take Google to index a new page?

Google does not publish a fixed time. Its documentation notes crawling can take anywhere from several days to several months depending on how often Google decides a page needs refreshing. Internal links from already-indexed pages and an up-to-date sitemap help it find new pages sooner.

Should I keep clicking Request indexing?

No. One request per important change is enough. Google's help says it recrawls pages automatically and suggests asking only when an important change has gone unnoticed for a week or more.

Is it bad that most of my pages are not indexed?

Not necessarily. Redirects, alternate canonical pages, 404s for deleted pages, and filter or tag URLs all show as "not indexed" and are normal. Check that your key pages, starting with your home page, are indexed.

Does an unindexed page appear in AI Overviews?

No. Google requires a page to be indexed and eligible to show a snippet before it can appear as a supporting link in AI Overviews or AI Mode.

Sources

More guides