Doc scraper: MCP server, setup and security

What Doc scraper does

According to its repository: “Crawl documentation sites into local Markdown or JSONL corpora and serve them with offline BM25 search, page reads, freshness checks and crawl diffs.”

The Model Context Protocol (MCP) is a standard plug between an AI agent and an outside service: once the server is connected, its tools show up in the agent, which decides when to call them. Doc scraper is listed under Web search and extraction, a category of 159 servers in the directory, where it ranks #41 by stars.

Topics declared by the repository: data-preparation, web-scraper, documentation, golang-cli, web-crawler.

Installing and connecting Doc scraper

Distribution modes declared in the official MCP registry:

• MCPB bundle (one-click install in Claude Desktop)

It works with any MCP-compatible client (Claude Desktop, Claude Code, Cursor, VS Code, Codex and most recent agents). You add one entry to the client's MCP configuration: server name, start command or URL, environment variables. Project language: Go.

Security: what to check

Connecting an MCP server means installing software that talks straight to your agent: it runs with your rights and the model trusts its tool descriptions. The risk therefore depends on what it can touch and how far its code can be trusted.

None of the risk signals we track (system access, secrets, missing licence, abandonment) applies to Doc scraper. That does not replace reading the code.

Good practice: grant only the rights needed (least privilege), require human approval for irreversible actions, and run the AI agent security check.

Project activity and maintenance

Created on April 27, 2025, the Sriram-PR/doc-scraper repository has 107 stars and 17 forks, with 8 open issues. It has more stars than 68% of the servers in the directory. It received changes this month. Version published in the registry: 2.22.0 (October 23, 2026).

Stars measure attention, not quality: a recent, heavily promoted project can collect them fast, while a useful but niche server will have few.