Get Found signal · 6 of 100 points
AI crawlers allowed in.
report label: AI crawler access (robots.txt)
What we measure
Whether your robots.txt blocks the AI crawlers (GPTBot, ClaudeBot, PerplexityBot, Google-Extended) that read sites for answer engines.
Why AI engines care
If the crawlers can't read you, nothing else on this list matters. Blocked is invisible, no matter how good the content is.
What passes
No AI-engine crawlers disallowed in robots.txt.
How the fix arrives
The scan shows exactly which bots are blocked; the fix is a robots.txt that welcomes them (we hand you the file contents).
Want this read clean, and shipped with proof?
This reading is one module of the Get Shipped method: we scope the work, gate every change and end on a plain go or no-go, in writing. Start with a call.
The other 8 signals
A clear page titleA one-line description for AI and searchA machine-readable fact sheetA clean outline of headingsAn AI intro file (llms.txt)Enough real text for AI to readLink-preview tagsOne official address per page
How the whole score works: the methodology.