Product
What does your site allow AI to read?
Free tools · Crawler checker
Check the robots.txt rules for one page. Search access and model-training preferences are different choices.
What this check can tell you
This reads robots.txt and matches its rules to your page. It does not test a verified crawler, login restrictions or bot protection. An allowed rule does not guarantee that an engine can read or cite the page.
GPTBot and ClaudeBot cover training, separately from their providers’ search crawlers. Google-Extended covers Gemini training and grounding; it does not control inclusion in Google Search.
For ChatGPT-User and Perplexity-User, robots.txt may not apply. Other sources can also lead an engine to name your business.
What does AI say about your business?
Run your free scan ↗See the answers, the competitors and the next fix.