# GTM Otto robots.txt # Machine-readable entry points: # /llms.txt : site overview for LLMs and agents # /sitemap.xml : every indexable page # /.well-known/mcp/server-card.json: the MCP server: endpoint, auth, tools # /.well-known/agent-card.json : the agent card # /.well-known/ai-catalog.json : Agentic Resource Discovery catalog (Agentmap below) # /.well-known/agent-skills/index.json : Agent Skills index (six SKILL.md recipes) # /.well-known/auth.md : how an agent signs in (OAuth or API key) # /llms-full.txt : every tool, skill, prompt and FAQ on one page # # GTM Otto is also an MCP server: https://agent.gtmotto.com/mcp (Streamable HTTP). # Setup guides: https://gtmotto.com/docs/mcp User-agent: * Content-Signal: search=yes, ai-input=yes, ai-train=yes Allow: / # Named AI crawlers — explicitly allowed. User-agent: GPTBot Allow: / User-agent: OAI-SearchBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: ClaudeBot Allow: / User-agent: Claude-Web Allow: / User-agent: anthropic-ai Allow: / User-agent: PerplexityBot Allow: / User-agent: CCBot Allow: / User-agent: Google-Extended Allow: / User-agent: Applebot-Extended Allow: / Sitemap: https://gtmotto.com/sitemap.xml Agentmap: https://gtmotto.com/.well-known/ai-catalog.json