← all MCP servers

Scrape-LE

io.github.nolindnaidoo/scrape-le

Analyse robots.txt content and report whether a path may be crawled.

install

npm · stdio
npx -y scrape-le-mcp@2.2.2

details

category: browser
version: 2.2.2
license: MIT
stars: 1
last commit: 2026-08-05
published: 2026-08-05

https://github.com/nolindnaidoo/scrape-le

last synced 2026-08-05