AI crawlers

What is Amazonbot?

Amazonbot is a search crawler run by Amazon. Here is what Amazon says it is for, and how to allow or block it.

What it is for

What Amazon says: General. Amazon says it uses it to improve its products and services, which can include its AI.

Search crawlers build an index that an AI assistant or search product uses to find and link to pages when it answers questions. Blocking one can mean that product cannot show or link to your pages.

Is Amazonbot blocked on your site?

Free. Checks your robots.txt for Amazonbot and 13 other AI crawlers.

How to block Amazonbot

Add this group to the robots.txt file at the root of your site:

User-agent: Amazonbot
Disallow: /

How to allow Amazonbot

If nothing in your robots.txt names Amazonbot and your User-agent: * group does not say Disallow: /, it is already allowed. If an older rule blocks it, remove that group, or say so explicitly:

User-agent: Amazonbot
Allow: /

robots.txt is a request, not a lock, and a "block AI bots" setting at your host or CDN can turn Amazonbot away whatever robots.txt says. More on writing the rules

Operators publish these names and change them. This page reflects what Amazon has said publicly; check Amazon's own documentation before you rely on it. See the full AI crawler list.

Start monthly monitoring

We scan your homepage every month and email you a report with what is new, fixed and still open. Cancel any time.

You will pay $39 a month. Price shown in your local currency.

Tell me when it's ready

We'll email you once, when this is available. No spam, and no sharing your address.