User-agent: * Disallow: /admin/ Disallow: /internal/ Allow: /public/ Allow: / # Generic sitemap reference Sitemap: /sitemap.xml