← all MCP servers

io.github.jmshinhwa/robots-txt-ai-crawler-audit

Checks robots.txt line by line and says what each AI crawler token actually controls - training, AI

install

npm · stdio
npx -y @readystack/robots-txt-ai-crawler-audit@0.1.3

details

category: browser
version: 0.1.3
license: NOASSERTION
stars: 1
last commit: 2026-10-28
published: 2026-09-19

https://github.com/jmshinhwa/readystack-themes

last synced 2026-10-17