Skip to content
Published Authored byBilly Reiner

Glossary · Defined term

robots.txt.liquid

robots.txt.liquid is the Shopify theme template that renders the store's /robots.txt file2. It is the only way to customise robots rules on a Shopify store. Shopify Support warns it can take down all traffic if edited incorrectly: "Incorrect use of the feature can result in loss of all traffic" — verbatim warning from the Shopify Help Center1.

The file lives at theme/templates/robots.txt.liquid. It must remain a Liquid template — it cannot be a JSON template — and it is not included in themes by default. Shopify Support's other verbatim warning: "Shopify Support can't help with edits to the robots.txt.liquid file"1. The merchant edits it; the merchant owns the consequences.

Definition

robots.txt.liquid is the Shopify theme template that renders the store's /robots.txt file. It is the only way to customise robots rules on a Shopify store, and Shopify Support warns it can take down all traffic if edited incorrectly.

Per Shopify's dev docs2: robots.txt.liquid "renders the robots.txt file, which is hosted at the /robots.txt URL." The file has three components — user agent, rules, and an optional sitemap URL — rendered through the robots.default_groups Liquid object3. Changes take effect instantly when saved; crawlers may lag.

What the default rules look like

Shopify's default robots.txt disallows /admin, /cart, /checkout, /collections/*+* (filtered duplicates), /search (internal search results), and /policies/. Those defaults are emitted by the robots.default_groups Liquid object even when no robots.txt.liquid template exists in the theme — the platform serves a sensible default.

Verbatim default template body from Shopify dev docs2: 

{% for group in robots.default_groups %}
  {{- group.user_agent -}}
  {% for rule in group.rules %}
    {{- rule -}}
  {% endfor %}
  {%- if group.sitemap != blank -%}
    {{ group.sitemap }}
  {%- endif -%}
{% endfor %}

Shopify's dev docs explicitly state it is "strongly recommended to use the provided Liquid objects whenever possible" because "The default rules are updated regularly to ensure that SEO best practices are always applied"2. Translation: don't replace the Liquid with plain text; you'll lock yourself out of Shopify's future defaults.

Where the file lives

The editable file lives in the theme's templates folder, at theme/templates/robots.txt.liquid. It is created through the theme code editor. Shopify serves it at the store's root: example.com/robots.txt. The file is not in the theme by default — merchants who want to customise must manually add it.

The Liquid objects exposed to the template3: robots.default_groups, group.user_agent, group.rules, group.sitemap. The sitemap object additionally exposes directive (which returns Sitemap) and value (the sitemap URL). Together these objects let merchants extend, override, or add to Shopify's default rules without losing the platform-side updates.

Customisations Shopify allows

Per Shopify Help: merchants can allow/disallow specific URLs, add crawl-delay rules, add sitemap URLs, and block specific crawlers. The platform supports the standard robots.txt grammar — User-agent, Allow, Disallow, Crawl-delay, Sitemap — and exposes Liquid object hooks to layer custom rules on top of the defaults rather than replacing them.

The most common 2026 customisation: adding AI bots (GPTBot, ClaudeBot, PerplexityBot, OAI-SearchBot, Google-Extended) to the allow list so AI engines can fetch product and policy pages at answer time. Less common but important: disallowing app-leftover routes when a merchant uninstalls a Shopify app whose proxy URLs Google has already indexed.

The warning Shopify ships and what you should do about it

Two verbatim warnings from the Shopify Help Center: 'Shopify Support can't help with edits to the robots.txt.liquid file' and 'Incorrect use of the feature can result in loss of all traffic.' The merchant edits this file at the merchant's own risk; Shopify's support team will not unwind a bad edit.

Practical install order: (1) confirm the file isn't already in your theme (most stock themes don't ship it); (2) create it via the code editor at templates/robots.txt.liquid; (3) start with the default Liquid loop verbatim; (4) layer the additions you need (AI bot allows, app-route disallows, custom sitemap URLs) by appending to the rendered output, not by replacing the loop; (5) verify the change at example.com/robots.txt; (6) submit the sitemap to Search Console and Bing Webmaster.

The full install lives in robots.txt.liquid on Shopify, which covers default rules, AI bot allow lists, app-route disallows, sitemap directives, and the ThemeKit-vs-admin upload distinction. If you'd rather not edit Liquid yourself, ShopifyRanked does it in 7 days for $499.

robots.txt.liquid is the canonical Shopify SEO mechanic.

Keep reading