No crawl, no ranking. Before a search engine can rank anything, it has to find and read your pages, and two unglamorous files steer most of that: sitemap.xml and robots.txt. Get them wrong and crawlers either skip pages you wanted indexed or burn their time on ones you didn't. Seokai's site audit pulls both files, checks them, and tells you what's off.
What these two files are for
Your sitemap.xml is the list of pages you want search engines to know about, basically a map of the store. Your robots.txt sets the ground rules for where crawlers may and may not go. Between them, they decide how efficiently your content gets discovered. A malformed sitemap or a robots.txt rule that's too aggressive can quietly keep perfectly good pages out of search.
Why you can't just set it and forget it
These files drift. Your store grows, you swap themes, you install an app that rewrites part of the theme, and a rule that was fine last year is now blocking a whole section. Nobody gets an alert when that happens; you just slowly lose traffic. Auditing on a schedule catches the silent stuff before it costs you. This is the technical floor everything else sits on.
What the audit looks at
- Whether your sitemap.xml exists, loads, and is valid XML.
- Whether robots.txt is present and isn't blocking pages you actually want indexed.
- Whether robots.txt points to your sitemap so crawlers can find it without guessing.
- The usual misconfigurations that throttle crawling or indexing.
Running it
- Open Seokai from your Shopify admin and go to the site audit section.
- Start the audit. Seokai fetches your sitemap.xml and robots.txt and inspects both.
- Read the findings. Each one is tagged by severity with a plain-language explanation.
- Fix what needs fixing, then re-run to confirm it's clean.
When to run it
Any time you change themes, install an app, or migrate the store, run the audit right after, then keep a periodic check on the calendar as routine maintenance. Pair it with the SEO health audit and you've covered both halves of the picture: can search engines reach your pages, and is the on-page metadata any good. A clean sitemap and robots.txt mean crawlers spend their budget on the pages you care about most.
