← all MCP servers
io.github.sharozdawa/robotstxt-ai
Analyze and generate robots.txt with AI crawler detection for 20+ bots like GPTBot and ClaudeBot.
install
npm · stdio
npx -y robotstxt-ai-mcp@1.0.1
details
- version
- 1.0.1
- license
- MIT
- stars
- 0
- last commit
- 2026-03-22
- published
- 2026-03-21
last synced 2026-07-29