AIO
AI visibility (AIO)
Check whether AI crawlers are allowed in and can read your content without running JavaScript.
What we check
Full audits run 5 AI visibility checks across your crawled pages. The free instant scan runs 4 of them on a single page. These are WebGrowthEngine's own documented heuristics over signals we can observe. They are not an industry standard and cannot predict whether a specific engine or AI assistant will rank or cite you.
Access
- AI crawlers allowed by robots.txt. If robots.txt blocks an AI service's crawler, that service cannot read your pages. Blocking may be a deliberate choice.
- Content present without JavaScript. Many AI crawlers do not run JavaScript; content that only appears after scripts run may be invisible to them.
- Snippets and quoting not restricted. nosnippet or max-snippet:0 stops search and AI features from quoting the page.
Extractability
- Readable text versus markup. When readable text is a tiny fraction of a heavy page, it is harder for machines to extract the content reliably.
- llms.txt file. llms.txt is an emerging, non-standard proposal with limited support. It is reported for information and never scored.
Related guides
Decide how AI crawlers may access your site
Check which AI crawlers your robots.txt allows, make sure your content is readable without JavaScript, and understand ll...
Control indexing with noindex, and avoid excluding important pages
Understand robots meta tags and the X-Robots-Tag header, find pages you excluded by accident, and control how much searc...
See how your website scores
A free instant scan takes about ten seconds. No account needed.