# https://www.robotstxt.org/robotstxt.html User-agent: * Allow: / # i18n hygiene. Locale-prefixed docs URLs are generated by Starlight but # are not real translations yet. The Worker redirects them to `/docs/...`; # the docs Head override also marks fallback HTML as `noindex, follow` as # a static-build backstop. Do not disallow them here: crawlers need to be # able to see the redirect/noindex signal. Sitemap: https://cloudpepper.io/sitemap-index.xml