Claude MCP / DirectoryBrowse servers ↗

MCP REGISTRY

Website to Markdown

io.github.saulius876-lgtm/website-content-crawler

Web pages and whole sites to clean Markdown for RAG and AI agents. Crawls links and sitemaps.

Setup documentation ↗How to connect ↓

Remote connections

1

Use these endpoints with a compatible MCP client.

REMOTE ENDPOINTStreamable HTTP

https://mcp.apify.com/?tools=sauliusautomatesit/website-content-crawler-api

GET STARTED

Connect this server

  1. 01

    Check the setup guide

    Review the publisher’s documentation for supported clients and installation requirements.

  2. 02

    Configure your client

    Add the package or endpoint to your MCP client using the publisher’s instructions. Supply any required credentials in your client settings.

  3. 03

    Connect and explore

    Enable the server in your client and review its available tools and permissions.