Free tool
Website index checker
Start with your homepage. If it fails here, your whole site is at risk.
Site-wide red flags
- Disallow: / in robots.txt — blocks the entire site. Usually a staging file shipped to production.
- Global noindex — a CMS "discourage search engines" setting or a framework default.
- X-Robots-Tag on every response — set at the CDN or server, invisible in the HTML.
- robots.txt returning 5xx — Google treats it as "block everything".
- Empty app shell — Lovable, Bolt and other SPA builds that ship no text in the HTML.
Many pages to check? Use the bulk index checker.
More free tools
FAQ
Questions
How often should I check?+
After every deploy — that's when these break. Monitoring does it automatically.