← all MCP servers
AI Crawler Permission Check
ai.opencurrent/robots-ai-check
Check a site's robots.txt rules for AI crawlers (GPTBot, ClaudeBot, PerplexityBot and more).
remote endpoints
- streamable-http https://opencurrent.ai/mcp/robots
details
- version
- 0.1.0
- published
- 2026-11-21
last synced 2026-11-21
