← all MCP servers
Scrape-LE
io.github.nolindnaidoo/scrape-le
Analyse robots.txt content and report whether a path may be crawled.
install
npm · stdio
npx -y scrape-le-mcp@2.2.5
details
- category
- browser
- version
- 2.2.5
- license
- MIT
- stars
- 1
- last commit
- 2026-09-15
- published
- 2026-08-14
last synced 2026-09-15