Get Found signal · 6 of 100 points
AI assistants allowed in.
report label: AI crawler access (robots.txt)
What we measure
Whether your robots.txt blocks the AI crawlers (GPTBot, ClaudeBot, PerplexityBot, Google-Extended) that read sites for answer engines.
Why AI engines care
If the crawlers can't read you, nothing else on this list matters — blocked is invisible, no matter how good the content is.
What passes
No AI-engine crawlers disallowed in robots.txt.
How the fix arrives
The scan shows exactly which bots are blocked; the fix is a robots.txt that welcomes them (we hand you the file contents).
See this signal measured on your app.
Free scan of all 9 signals — real fetch, no signup, fixes included.
The other 8 signals
A clear page titleA one-line description for AI and searchA machine-readable fact sheetA clean outline of headingsAn AI intro file (llms.txt)Enough real text for AI to readLink-preview tagsOne official address per page
How the whole score works: the methodology.