How to edit robots.txt on Wix
for AI crawlers

What Wix says

Wix's help centre calls editing robots.txt an advanced feature. It warns that changes can cause issues with your site appearing in search results, and that Wix Customer Care cannot help with changes you make to the file. By default the file lets search engine bots reach all your pages, apart from pages that are password protected, members only, or set not to be indexed.

The steps

From Wix's article "Editing your site's robots.txt file":

1. In your site's dashboard go to SEO & GEO.
2. Scroll down to Tools and settings.
3. Click Robots.txt Editor, then View File.
4. Write your rules under "This is your current file" (do not delete what is already there).
5. Click Save Changes, then Save.

To undo, go back to the same place, click View File, then Reset to Default and confirm.

If you see "Blocked by robots.txt" in Google Search Console or Wix Site Inspection, Wix says you do not need to edit robots.txt, especially if you never have; check the page's own settings first (for example indexing turned off for that page).

What to add

Add groups below the existing lines. If Wix offers the menu with a different name (the label has changed over time), look for "Robots.txt Editor" in your SEO tools.

Which crawlers to name

Most AI crawlers publish a name you can put in robots.txt. Their owners describe different purposes, and you can treat them differently:

• Training crawlers (for example GPTBot, ClaudeBot, CCBot): collect pages that may be used to train models.
• Search crawlers (for example OAI-SearchBot, Claude-SearchBot, PerplexityBot): find pages to show or link in an AI assistant's search answers. Blocking these may make your business less likely to be named there.
• Control tokens (Google-Extended, Applebot-Extended): they do not crawl; they tell Google or Apple whether content already crawled may be used for certain AI purposes. Google says Google-Extended does not affect Google Search ranking.

The lines below block the training-related names and leave search alone. Change them to suit your business. Our AI crawler list says what each name is for, and the AI crawler checker shows what your robots.txt says today.

User-agent: GPTBot
Disallow: /

User-agent: ClaudeBot
Disallow: /

User-agent: Google-Extended
Disallow: /

User-agent: Applebot-Extended
Disallow: /

User-agent: CCBot
Disallow: /

What this does not do

• robots.txt is a request that well-behaved crawlers follow. It does not technically stop anything, and it does not remove content already collected.
• It does not control whether a person using an AI assistant can have it fetch your page; those visits use their own names (for example ChatGPT-User, Claude-User).
• A firewall or bot-protection setting on your host can turn crawlers away whatever robots.txt says. The checker shows both.

After you save

Open yoursite.com/robots.txt in a browser to see the live file, then run the checker to confirm the names are blocked and nothing you wanted allowed got caught. Not sure whether to block at all? Read allowing or blocking AI crawlers in robots.txt.

Written with AI from the platforms' own help pages (read 26 October 2026) and checked against them. Menus and options change: if yours differ, follow the platform's current help page. This is general information, not advice.