# DemandIntel, we welcome AI crawlers and answer engines. # Machine-readable index: https://demandintel.io/llms.txt # Full-text bundle: https://demandintel.io/llms-full.txt # Sitemap: https://demandintel.io/sitemap.xml User-agent: Googlebot Allow: / User-agent: Bingbot Allow: / User-agent: DuckDuckBot Allow: / User-agent: Twitterbot Allow: / User-agent: facebookexternalhit Allow: / # AI answer engines / LLM crawlers, explicitly welcomed. User-agent: GPTBot Allow: / User-agent: OAI-SearchBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: ClaudeBot Allow: / User-agent: Claude-Web Allow: / User-agent: anthropic-ai Allow: / User-agent: PerplexityBot Allow: / User-agent: Perplexity-User Allow: / User-agent: Google-Extended Allow: / User-agent: Applebot Allow: / User-agent: Applebot-Extended Allow: / User-agent: CCBot Allow: / User-agent: Bytespider Allow: / User-agent: Amazonbot Allow: / User-agent: cohere-ai Allow: / User-agent: Meta-ExternalAgent Allow: / User-agent: * Content-Signal: search=yes, ai-input=yes, ai-train=yes Allow: / Disallow: /admin Disallow: /app Disallow: /rep Disallow: /accept-invite Disallow: /reset-password Disallow: /checkout Disallow: /auth/ Sitemap: https://demandintel.io/sitemap.xml