← all MCP servers

Agent Crawl Readiness

io.github.sadri-dridi/agent-crawl-readiness

Bounded crawl-readiness check for agent access: robots.txt, sitemap.xml, llms.txt, homepage.

remote endpoints

streamable-http https://agent-observatory-sensor.nolimit-observatory.workers.dev/s/agent-crawl-readiness/mcp

details

category: browser
version: 1.0.0
stars: 0
last commit: 2026-09-23
published: 2026-09-23

https://github.com/sadri-dridi/named-mcp-utilities

last synced 2026-09-24