robots.txt
Content-Signal: search=yes, ai-train=no
User-agent: * Allow: / Allow: /api/mcp Allow: /api/markdown Disallow: /api/
Sitemap: https://www.guild.ai/sitemap.xml
# See also: https://www.guild.ai/llms.txt
# Answer-engine crawlers: allowed to read and cite. User-agent: GPTBot Allow: / Allow: /api/mcp Allow: /api/markdown Disallow: /api/
User-agent: ClaudeBot Allow: / Allow: /api/mcp Allow: /api/markdown Disallow: /api/
User-agent: PerplexityBot Allow: / Allow: /api/mcp Allow: /api/markdown Disallow: /api/
User-agent: OAI-SearchBot Allow: / Allow: /api/mcp Allow: /api/markdown Disallow: /api/
# Training-only crawlers: not allowed. User-agent: CCBot Disallow: /
User-agent: ByteSpider Disallow: /