What is Google-Extended?
Google-Extended is a control token, not a crawler run by Google. Here is what Google says it is for, and how to allow or block it.
What it is for
What Google says: Control token, not a separate crawler. Googlebot does the fetching. Blocking this name asks Google not to use your content for its Gemini models. Google says it does not affect your place in Google Search.
Control tokens are names you can use in robots.txt to say how your content may be used. The company's normal crawler does the fetching, so blocking the token does not stop that crawler visiting.
Is Google-Extended blocked on your site?
Free. Checks your robots.txt for Google-Extended and 13 other AI crawlers.
How to block Google-Extended
Add this group to the robots.txt file at the root of your site:
User-agent: Google-Extended
Disallow: /How to allow Google-Extended
If nothing in your robots.txt names Google-Extended and your User-agent: * group does not say Disallow: /, it is already allowed. If an older rule blocks it, remove that group, or say so explicitly:
User-agent: Google-Extended
Allow: /robots.txt is a request, not a lock, and a "block AI bots" setting at your host or CDN can turn Google-Extended away whatever robots.txt says. More on writing the rules
Operators publish these names and change them. This page reflects what Google has said publicly; check Google's own documentation before you rely on it. See the full AI crawler list.