Is GPTBot blocked on your site?
Check which AI crawlers can read your site: the ones that put you in ChatGPT, Claude and Perplexity answers, and the ones that only collect training data.
- OAI-SearchBotSearchAllowed
- GPTBotTrainingAllowed
- ClaudeBotTrainingAllowed
- PerplexityBotSearchBlocked
- Google-ExtendedTrainingAllowed
Every AI crawler that matters
GPTBot, OAI-SearchBot, ClaudeBot, PerplexityBot, Google-Extended and more, each marked allowed or blocked.
Search crawlers and training crawlers
Know which ones put you in AI answers and which only collect training data.
Firewall blocks too
We fetch your homepage as a browser and as an AI agent, and flag it when the answers differ.
This checks one thing. The free scan checks everything.
- What ChatGPT, Gemini, Claude, Perplexity and Google's AI say about you, with a free account
- 157 checks across up to 50 pages, scored in plain English
- Every fix in the order that matters, with steps for your platform
Questions
Can't find your answer? The help center covers every part of the report, or ask us directly.
What is the difference between GPTBot and OAI-SearchBot?
GPTBot collects pages to train OpenAI's models. OAI-SearchBot fetches pages so ChatGPT can cite them in search answers. You can block the first and still appear in ChatGPT, but blocking the second keeps you out of its search results.
My robots.txt allows everything. Why are crawlers still blocked?
Some hosts and firewalls block AI crawlers before robots.txt is ever read. This check requests your homepage as a browser and as an AI agent and flags it when the answers differ.
Does llms.txt help AI find me?
Very little today. Most AI crawlers never request it. Unblocking search crawlers matters far more.
Can I use this as a robots.txt tester?
Yes, for AI crawlers. It reads your live robots.txt, tests each AI crawler against its rules, and then checks whether your firewall lets that crawler through. On WordPress, the robots.txt is made by WordPress itself, so check it here before you edit it.