Claude MCP / DirectoryBrowse servers ↗

MCP REGISTRY

TheCrawler

io.github.manchittlab/thecrawler

Universal web scraper with LLM-ready markdown, RAG chunking, PDF/DOCX support.

Source repository ↗How to connect ↓

Published packages

1

Package identifiers published by the server author.

NPM0.5.8

thecrawler

Transport: Standard input / output

GET STARTED

Connect this server

  1. 01

    Check the setup guide

    Review the publisher’s documentation for supported clients and installation requirements.

  2. 02

    Configure your client

    Add the package or endpoint to your MCP client using the publisher’s instructions. Supply any required credentials in your client settings.

  3. 03

    Connect and explore

    Enable the server in your client and review its available tools and permissions.