← Back to the index
Registry updated within 30 days · Local · npm

polite-crawler New this week NEW

io.github.mark1russell7/polite-crawler copy

A polite crawler for agents: obeys robots.txt, fetches each page once, finds and verifies quotes.

CategoryWeb & Search
TransportLocal
Registry freshnessRegistry updated within 30 days
Version0.5.0
Distributionnpm

Install & connect

Install · npmnpx
$ npx -y polite-crawler-mcp

Publisher-declared package identifier. Verify current package, permissions and client configuration before running; execution has not been tested here.

Freshness

Updated this week

Last registry update 1d ago · published Nov 5, 2026.

Registry position over time

Where polite-crawler sits in the freshest-first index, tracked daily — new to the tracked index since the prior run. position movement fills in as the index runs daily.

Current position#3276
Best position#3276
Since prior runNEW

About this server

A polite crawler for agents: obeys robots.txt, fetches each page once, finds and verifies quotes.

Local — runs on your machine over stdio (npx / uvx / docker / bundle). Indexed under Web & Search, alongside 11152 other servers. Health is freshness-derived from the registry's last-update timestamp; this index does not run the server, so capabilities and tool lists live in the source repository.

More in Web & Search 11153

Browse all 11152 in Web & Search →
Published · Nov 5, 2026
Updated · Nov 5, 2026
Source · official Model Context Protocol registry