← all MCP servers

TheCrawler

io.github.manchittlab/thecrawler

Universal web scraper with LLM-ready markdown, RAG chunking, PDF/DOCX support.

install

  • npm · stdio

    npx -y thecrawler@0.5.8

details

version
0.5.8
license
AGPL-3.0
stars
1
last commit
2026-07-02
published
2026-07-02
https://github.com/manchittlab/TheCrawler

last synced 2026-07-29