User-Agent: * Allow: / Allow: /api/domains Allow: /api/domains/ Allow: /api/content Allow: /api/users/ Allow: /api/health Disallow: /dashboard Disallow: /settings Disallow: /admin Disallow: /api/ Disallow: /_next/ Sitemap: https://bestinthe.com/sitemap.xml