Skip to content
Published Authored byBilly Reiner

Glossary · Defined term

robots.txt.liquid

robots.txt.liquid is the Shopify theme template that renders the store's /robots.txt file2. It is the only way to customise robots rules on a Shopify store. Shopify Support warns it can take down all traffic if edited incorrectly: "Incorrect use of the feature can result in loss of all traffic" — verbatim warning from the Shopify Help Center1.

The file lives at theme/templates/robots.txt.liquid. It must remain a Liquid template — it cannot be a JSON template — and it is not included in themes by default. Shopify Support's other verbatim warning: "Shopify Support can't help with edits to the robots.txt.liquid file"1. The merchant edits it; the merchant owns the consequences.

Definition

robots.txt.liquid is the Shopify theme template that renders the store's /robots.txt file. It is the only way to customise robots rules on a Shopify store, and Shopify Support warns it can take down all traffic if edited incorrectly.

Per Shopify's dev docs2: robots.txt.liquid "renders the robots.txt file, which is hosted at the /robots.txt URL." The file has three components — user agent, rules, and an optional sitemap URL — rendered through the robots.default_groups Liquid object3. Changes take effect instantly when saved; crawlers may lag.

What the default rules look like

Shopify serves a default robots.txt even when the theme has no robots.txt.liquid. On 16 September 2026 that default was a managed file that blocks the admin, cart, checkout, order and account pages and filter and sort combinations such as /collections/*+*, and leaves /search and /policies/ crawlable. Once a store adds the template, the robots.default_groups loop prints Shopify's older default set instead, which still blocks /search and /policies/.

Shopify's help page still lists the older six (/admin, /cart, /checkout, /collections/*+*, /search, /policies/) as the key default entries1, but the file Shopify's own demo store served that day no longer blocks the last two4.

Shopify's dev docs explicitly state it is "strongly recommended to use the provided Liquid objects whenever possible" because "The default rules are updated regularly to ensure that SEO best practices are always applied"2. Translation: don't replace the Liquid with plain text; you'll lock yourself out of Shopify's future defaults.

Where the file lives

The editable file lives in the theme's templates folder, at theme/templates/robots.txt.liquid. It is created through the theme code editor. Shopify serves it at the store's root: example.com/robots.txt. The file is not in the theme by default — merchants who want to customise must manually add it.

The Liquid objects exposed to the template3: robots.default_groups, group.user_agent, group.rules, group.sitemap. The sitemap object additionally exposes directive (which returns Sitemap) and value (the sitemap URL). Together these objects let merchants extend, override, or add to Shopify's default rules without losing the platform-side updates.

Customisations Shopify allows

Per Shopify Help: merchants can allow/disallow specific URLs, add crawl-delay rules, add sitemap URLs, and block specific crawlers. The platform supports the standard robots.txt grammar — User-agent, Allow, Disallow, Crawl-delay, Sitemap — and exposes Liquid object hooks to layer custom rules on top of the defaults rather than replacing them.

The most common 2026 question is which AI crawlers to block. Shopify allows all of them by default, so nothing needs adding to let AI engines fetch product and policy pages; blocking training crawlers costs no AI visibility, while blocking search and user-triggered fetchers takes the store out of those answers — the per-bot matrix is in AI bots in Shopify's robots.txt. Less common but important: disallowing app-leftover routes when a merchant uninstalls a Shopify app whose proxy URLs Google has already indexed. One deployment detail is worth knowing before you edit anything — ThemeKit deployments preserve robots.txt.liquid across theme updates and admin theme uploads do not1, which is covered in ThemeKit and robots.txt.liquid.

The warning Shopify ships and what you should do about it

The two Shopify Support warnings quoted at the top of this page are the whole risk profile of this file: the merchant edits it at the merchant's own risk, and Shopify's support team will not unwind a bad edit.

The full install lives in robots.txt.liquid on Shopify, which covers default rules, AI bot allow lists, app-route disallows, sitemap directives, and the ThemeKit-vs-admin upload distinction. If you'd rather not edit Liquid yourself, ShopifyRanked does it in 7 days for $499.

robots.txt.liquid is the canonical Shopify SEO mechanic.

Keep reading