Google-Extended

What is Google-Extended?

Google-Extended isn't a crawler with its own name, it's a token written in robots.txt to decide whether Google can use a website's content in its generative AI products, Gemini among them. What matters most is what it doesn't do: blocking it doesn't remove the site from search or change its ranking, since that's still handled separately by Googlebot. Some sites added it thinking it would protect them and now can't figure out why they aren't showing up.

Related terms

robots.txt

The file that tells crawlers which parts of your site they can access.

AI Overviews

The AI-generated summaries Google shows above its search results.

GPTBot

OpenAI's crawler. Not the only name the company declares.

And what about your brand?

We’ll tell you how many times your brand shows up in ChatGPT, Gemini, Perplexity, and Claude when someone asks about your category, and who shows up in your place. Free, no card required.

I want my free diagnosis Check my site’s access