robotstxt-ai NEW
Analyze and generate robots.txt with AI crawler detection for 20+ bots like GPTBot and ClaudeBot.
Install & connect
$ npx -y robotstxt-ai-mcpPublisher-declared package identifier. Verify current package, permissions and client configuration before running; execution has not been tested here.
Freshness
Last registry update 8mo ago · published Mar 21, 2026.
Registry position over time
Where robotstxt-ai sits in the freshest-first index, tracked daily — new to the tracked index since the prior run. position movement fills in as the index runs daily.
About this server
Analyze and generate robots.txt with AI crawler detection for 20+ bots like GPTBot and ClaudeBot.
Local — runs on your machine over stdio (npx / uvx / docker / bundle). Indexed under Web & Search, alongside 11152 other servers. Health is freshness-derived from the registry's last-update timestamp; this index does not run the server, so capabilities and tool lists live in the source repository.