← all MCP servers

Scrape-LE

io.github.nolindnaidoo/scrape-le

Analyse robots.txt content and report whether a path may be crawled.

install

npm · stdio
npx -y scrape-le-mcp@2.6.0

details

category: browser
version: 2.6.0
license: MIT
stars: 1
last commit: 2026-10-31
published: 2026-10-27

https://github.com/nolindnaidoo/scrape-le

last synced 2026-10-27