Does blocking GPTBot remove my store from ChatGPT?

Not through Shopify. Shopify says blocking crawlers affects only open-web discoverability, and Shopify Catalog still sends your product data to its agentic channels. Blocking can still limit what an assistant can read from your public pages.

What is the difference between a training crawler and a search crawler?

A training crawler collects content to train models. A search crawler indexes pages so an assistant can find and cite them. Companies name them separately so you can allow one and block the other.

Can my CDN block AI agents without me knowing?

Yes. Bot-protection and firewall rules can return an error to AI user agents even when robots.txt allows them. Test with the command above.

Will allowing AI crawlers slow my store down?

Crawler traffic is usually small next to shopper traffic, but a heavy page costs more to fetch. Keeping product pages light helps both shoppers and crawlers.

Block or allow AI crawlers on Shopify?

Answers the question: Should I block or allow GPTBot, ClaudeBot and other AI crawlers on my Shopify store?

Three kinds of AI crawler

AI companies use different bots for different jobs, and they have separate names so site owners can treat them differently.

Kind	What it does	Examples
Search bots	Index pages so an assistant can find and cite them	OAI-SearchBot, Claude-SearchBot, PerplexityBot
User agents	Fetch a page when a person asks an assistant about it	ChatGPT-User, Claude-User, Perplexity-User
Training bots	Collect content to train models	GPTBot, ClaudeBot, and Google’s Google-Extended control

These names and their roles change. Check each company’s current documentation before you write rules, and do not rely on an old blog post.

How to decide

Do you want to be found and cited in AI answers? Then allow the search bots and the user agents. Without them, an assistant cannot read your public pages.
Do you object to your content being used for training? That is a business choice. You can block training bots while allowing the others, because they are named separately.
Is anything blocking bots without your knowing? A firewall, CDN or bot-protection setting can refuse AI user agents even when robots.txt allows them. The page then loads for a browser and fails for a crawler.

Shopify specifics

Shopify generates a default robots.txt for every store. Shopify lets you customise it through a theme template, so follow Shopify’s own documentation before you change anything, and keep private paths such as the cart and checkout closed.

How to test

If you are comfortable with a terminal, compare what a crawler receives with what a browser receives:

curl -sI -A "GPTBot" https://yourstore.com/products/your-product

A 200 status means the page is served. A 403 means something is refusing that user agent. You can also run our free scan, which checks crawler access along with the rest of your store.

Frequently asked questions

Does blocking GPTBot remove my store from ChatGPT?: Not through Shopify. Shopify says blocking crawlers affects only open-web discoverability, and Shopify Catalog still sends your product data to its agentic channels. Blocking can still limit what an assistant can read from your public pages.
What is the difference between a training crawler and a search crawler?: A training crawler collects content to train models. A search crawler indexes pages so an assistant can find and cite them. Companies name them separately so you can allow one and block the other.
Can my CDN block AI agents without me knowing?: Yes. Bot-protection and firewall rules can return an error to AI user agents even when robots.txt allows them. Test with the command above.
Will allowing AI crawlers slow my store down?: Crawler traffic is usually small next to shopper traffic, but a heavy page costs more to fetch. Keeping product pages light helps both shoppers and crawlers.