AI crawlers

What is ChatGPT-User?

ChatGPT-User is a user fetcher run by OpenAI. Here is what OpenAI says it is for, and how to allow or block it.

What it is for

What OpenAI says: User fetches. Visits a page when a ChatGPT user's request needs it.

User fetchers visit a page because a person asked an assistant something that needs it. Because a person asked, some companies say these fetchers may not apply robots.txt rules the way a crawler does; check the operator's documentation.

Is ChatGPT-User blocked on your site?

Free. Checks your robots.txt for ChatGPT-User and 13 other AI crawlers.

How to block ChatGPT-User

Add this group to the robots.txt file at the root of your site:

User-agent: ChatGPT-User
Disallow: /

How to allow ChatGPT-User

If nothing in your robots.txt names ChatGPT-User and your User-agent: * group does not say Disallow: /, it is already allowed. If an older rule blocks it, remove that group, or say so explicitly:

User-agent: ChatGPT-User
Allow: /

robots.txt is a request, not a lock, and a "block AI bots" setting at your host or CDN can turn ChatGPT-User away whatever robots.txt says. More on writing the rules

Other OpenAI agents

Operators publish these names and change them. This page reflects what OpenAI has said publicly; check OpenAI's own documentation before you rely on it. See the full AI crawler list.

Start monthly monitoring

We scan your homepage every month and email you a report with what is new, fixed and still open. Cancel any time.

You will pay $39 a month. Price shown in your local currency.

Tell me when it's ready

We'll email you once, when this is available. No spam, and no sharing your address.