User-agent: * Allow: /hub/ Allow: /blog/ Disallow: /admin/ Disallow: /api-platform/ Disallow: /engine # AI Crawlers — explicit allow for public hub and blog content User-agent: GPTBot Allow: /hub/ Allow: /blog/ User-agent: OAI-SearchBot Allow: /hub/ Allow: /blog/ User-agent: ClaudeBot Allow: /hub/ Allow: /blog/ User-agent: PerplexityBot Allow: /hub/ Allow: /blog/ User-agent: Google-Extended Allow: /hub/ Allow: /blog/ User-agent: CCBot Allow: /hub/ Allow: /blog/ Sitemap: https://tsboi.ai/functions/generateSitemap