Claude MCP / DirectoryBrowse servers ↗

MCP REGISTRY

io.github.jmshinhwa/robots-txt-ai-crawler-audit

io.github.jmshinhwa/robots-txt-ai-crawler-audit

Checks robots.txt line by line and says what each AI crawler token actually controls - training, AI

Source repository ↗How to connect ↓

Published packages

1

Package identifiers published by the server author.

NPM0.1.1

@readystack/robots-txt-ai-crawler-audit

Transport: Standard input / output

GET STARTED

Connect this server

  1. 01

    Check the setup guide

    Review the publisher’s documentation for supported clients and installation requirements.

  2. 02

    Configure your client

    Add the package or endpoint to your MCP client using the publisher’s instructions. Supply any required credentials in your client settings.

  3. 03

    Connect and explore

    Enable the server in your client and review its available tools and permissions.