# robots.txt for axel.trade (RFC 9309) # A.X.E.L welcomes AI agents: see https://axel.trade/llms.txt and # https://axel.trade/.well-known/api-catalog for programmatic access. # Content Signals (https://contentsignals.org/) Content-Signal: search=yes, ai-input=yes, ai-train=yes User-agent: * Allow: / Disallow: /portal Disallow: /ebay-drafts Disallow: /company-api/ # ── AI crawlers: explicitly welcome ────────────────────────── # One group, so the same private paths apply: a crawler obeys only the most # specific group naming it, and ignores the * group's Disallow lines. User-agent: GPTBot User-agent: OAI-SearchBot User-agent: ChatGPT-User User-agent: ClaudeBot User-agent: Claude-Web User-agent: Claude-User User-agent: Claude-SearchBot User-agent: Google-Extended User-agent: PerplexityBot User-agent: Perplexity-User User-agent: Applebot-Extended User-agent: CCBot User-agent: meta-externalagent Allow: / Disallow: /portal Disallow: /ebay-drafts Disallow: /company-api/ # Sitemaps Sitemap: https://axel.trade/sitemap.xml Sitemap: https://axel.trade/company-sitemaps/index.xml