User-agent: * Allow: / Disallow: /api/ # AI search and citation bots — explicitly allowed. # NOTE: a crawler that matches a named group ignores the `User-agent: *` group # entirely, so the /api/ exclusion above does NOT apply here — each group has to # repeat it or these bots will crawl the edge functions. User-agent: GPTBot Allow: / Disallow: /api/ User-agent: ChatGPT-User Allow: / Disallow: /api/ User-agent: PerplexityBot Allow: / Disallow: /api/ User-agent: ClaudeBot Allow: / Disallow: /api/ User-agent: anthropic-ai Allow: / Disallow: /api/ User-agent: Google-Extended Allow: / Disallow: /api/ User-agent: Bingbot Allow: / Disallow: /api/ # Common Crawl — training dataset crawler, not a citation bot User-agent: CCBot Disallow: / # Sitemap Sitemap: https://slipstrim.io/sitemap.xml # See /llms.txt for structured AI-readable product context # See /pricing.md for machine-readable pricing data