Can AI assistants read your site?
Partly. 2 AI assistants can't read your site.
yourbusiness.comIt can't show you in its answers.
Alexa can't use your pages in its answers.
5 more can read your site
ChatGPT can still find you.
3 more allowed
For whoever runs your website
We read https://yourbusiness.com/robots.txt.
OAI-SearchBotOpenAI. Allowed. Nothing in your robots.txt stops it.
ChatGPT-UserOpenAI. Allowed. Nothing in your robots.txt stops it.
Claude-SearchBotAnthropic. Allowed. Nothing in your robots.txt stops it.
Claude-UserAnthropic. Allowed. Nothing in your robots.txt stops it.
PerplexityBotPerplexity. Blocked by name. It can't show you in its answers.
meta-webindexerMeta. Allowed. Nothing in your robots.txt stops it.
Amzn-SearchBotAmazon. Blocked by name. Alexa can't use your pages in its answers.
MistralAI-IndexMistral. Allowed. Nothing in your robots.txt stops it.
BingbotMicrosoft. Allowed. Nothing in your robots.txt stops it.
GPTBotOpenAI. Blocked by name. ChatGPT can still find you.
ClaudeBotAnthropic. Allowed. Nothing in your robots.txt stops it.
Google-ExtendedGoogle. Allowed. Nothing in your robots.txt stops it.
Applebot-ExtendedApple. Allowed. Nothing in your robots.txt stops it.
No llms.txt at https://yourbusiness.com/llms.txt. It is a short plain-text guide to your site for AI assistants. It is optional, and not every assistant reads it yet.
What this check can't see
A firewall or bot protection setting at your host can also turn these crawlers away, and that does not show in either file.
How to check it yourself