Skip to main content

How do I fix "Blocked by robots.txt"?

Fixing "Blocked by robots.txt" issue on site audit.

Written by Julia

Pages that are blocked by robots.txt prevent search engines from crawling and indexing them. If detected pages should appear in search results, update your robots.txt rules.

What to do: Review the pages listed in the audit and confirm whether they should be accessible to search engines. If they should appear in search results, you may need to update your robots.txt rules.

How to fix: Review the robots.txt rules that are blocking the affected pages. In Shopify, robots.txt is generated automatically by default. If custom robots.txt rules are needed, a robots.txt.liquid template can be created and modified within the theme code. If no custom robots.txt template exists, the blocked pages may be affected by Shopify's default crawl directives or another SEO-related configuration.

To check whether a custom robots.txt template exists, please follow the steps below:

Step 1 - Navigate to Online Store → Themes → Edit code

Step 2 - Search for robots.txt.liquid

Step 3 - Review any custom rules that may be blocking the affected pages

Note: Pages that are intended to rank in search results should not be blocked by robots.txt

Did this answer your question?