GPTBot

What is GPTBot?

GPTBot is OpenAI's crawler, the one that visits websites for the company behind ChatGPT. It's controlled from robots.txt like any other agent. Worth not confusing it with the other two names OpenAI declares: OAI-SearchBot, which indexes for ChatGPT's search feature, and ChatGPT-User, which visits a page the moment someone asks about it. Blocking one doesn't block the others, and many sites have only one of the three set up without ever having decided to.

Related terms

robots.txt

The file that tells crawlers which parts of your site they can access.

ClaudeBot

Anthropic's crawler. Two other names are handled separately.

Crawl budget

How many pages a crawler is willing to request from you in a given period.

And what about your brand?

We’ll tell you how many times your brand shows up in ChatGPT, Gemini, Perplexity, and Claude when someone asks about your category, and who shows up in your place. Free, no card required.

I want my free diagnosis Check my site’s access