Website Crawler — Markdown Pages, Sitemaps & RAG Provenance New this week NEW
Crawl sites to Markdown with sitemaps, globs and depth limits, obeying robots and crawl-delay
Install & connect
https://mcp.apify.com/?tools=hermeskd/website-to-markdownPublisher-declared remote endpoint. Availability, authentication and client compatibility are not independently verified here.
Freshness
Last registry update 5d ago · published Nov 2, 2026.
Registry position over time
Where Website Crawler — Markdown Pages, Sitemaps & RAG Provenance sits in the freshest-first index, tracked daily — new to the tracked index since the prior run. position movement fills in as the index runs daily.
About this server
Crawl sites to Markdown with sitemaps, globs and depth limits, obeying robots and crawl-delay
Hosted — runs on the provider's infrastructure; connect over HTTP/SSE. Indexed under Web & Search, alongside 11152 other servers. Health is freshness-derived from the registry's last-update timestamp; this index does not run the server, so capabilities and tool lists live in the source repository.