← Back to the index
Quiet · Local · npm
TheCrawler NEW
io.github.manchittlab/thecrawler copy
Universal web scraper with LLM-ready markdown, RAG chunking, PDF/DOCX support.
CategoryWeb & Search
TransportLocal
Registry freshnessQuiet
Version0.5.8
Distributionnpm
Maintainermanchittlab github ↗
Install & connect
Install · npmnpx
$ npx -y thecrawlerPublisher-declared package identifier. Verify current package, permissions and client configuration before running; execution has not been tested here.
Freshness
Quiet · no update in months
Last registry update 4mo ago · published Jul 2, 2026.
Registry position over time
Where TheCrawler sits in the freshest-first index, tracked daily — new to the tracked index since the prior run. position movement fills in as the index runs daily.
Current position#48140
Best position#48140
Since prior runNEW
About this server
Universal web scraper with LLM-ready markdown, RAG chunking, PDF/DOCX support.
Local — runs on your machine over stdio (npx / uvx / docker / bundle). Indexed under Web & Search, alongside 11152 other servers. Health is freshness-derived from the registry's last-update timestamp; this index does not run the server, so capabilities and tool lists live in the source repository.
More in Web & Search 11153
Iran EarthquakesLocalIran Software DownloadsLocalWebinarKit MCP by usefulapiRemoteGoTo Webinar MCP by usefulapiRemoteLiveWebinar MCP by usefulapiRemoteSlottable MCP by usefulapiRemoteBrandboom MCP by usefulapiRemoteIran AppsLocal
Browse all 11152 in Web & Search →