Is GPTBot blocked on your site?

Crawlmouse requests pages from your site as GPTBot and the other AI crawlers, and shows you what each one got back.

Free · up to 500 pages · about two minutes · nothing to install · the result is kept 24 hours; one email keeps it longer

GPTBot is one of OpenAI’s crawlers, and blocking it is your choice.

GPTBot collects pages for OpenAI’s model training. Disallowing it tells OpenAI your pages should not be used in that training, and OpenAI’s documentation says each of its crawler settings is independent: blocking GPTBot does not take you out of ChatGPT search, which is OAI-SearchBot’s job.

CrawlerWhat it doesIn the AI readability grade
GPTBotCollects pages for OpenAI model training. Blocking it does not affect ChatGPT citations.shown, not counted
OAI-SearchBotFetches pages for ChatGPT search results and citations.counted
ChatGPT-UserFetches a page when a ChatGPT user follows or asks about a link.counted

Because blocking GPTBot is a choice, Crawlmouse shows it and does not count it towards your AI readability grade. The grade counts OAI-SearchBot, ChatGPT-User, PerplexityBot and Claude-SearchBot.

A block is not always written in robots.txt. A firewall rule can answer GPTBot with a 403 (on Cloudflare, error 1020) while robots.txt allows it. So the audit reads robots.txt and also requests pages as each crawler, and keeps the answer: status, headers, first bytes.

Each request carries the crawler’s user agent, tagged "Crawlmouse/2.0 (+https://crawlmouse.com/bot)". A rule that matches the whole string exactly will not fire on the tagged version, so a block can be under-reported.

Two minutes from now you’ll know what each crawler sees.