Web search and extraction · MCP server
MCP server webcrawl: MCP server, setup and security
MCP server webcrawl is an MCP server published on GitHub that lets an AI agent search and retrieve web crawl data from multiple crawling tools. Its repository has 46 stars and its last commit is from September 28, 2026, but it declares no licence.
| Adoption (stars) | 17/40 | |
|---|---|---|
| Maintenance | 30/30 | |
| Framework (licence, registry, official) | 5/30 |
What MCP server webcrawl does
According to its repository: “Search and retrieve web crawler data from WARC, wget, Katana, SiteOne and InterroBot crawls.”
The Model Context Protocol (MCP) is a standard plug between an AI agent and an outside service: once the server is connected, its tools show up in the agent, which decides when to call them. MCP server webcrawl is listed under Web search and extraction, a category of 159 servers in the directory, where it ranks #67 by stars.
Topics declared by the repository: knowledgebase, warc, wget, archivebox, httrack, katana.
Installing and connecting MCP server webcrawl
No package or remote server is declared in the official MCP registry: you install it from source, following the repository README.
It works with any MCP-compatible client (Claude Desktop, Claude Code, Cursor, VS Code, Codex and most recent agents). You add one entry to the client's MCP configuration: server name, start command or URL, environment variables. Project language: Python.
Security: what to check
Connecting an MCP server means installing software that talks straight to your agent: it runs with your rights and the model trusts its tool descriptions. The risk therefore depends on what it can touch and how far its code can be trusted.
Points found for MCP server webcrawl:
- No licence: without a licence the code is not legally reusable, even if it is public. Avoid it in a company setting without the author's agreement.
Good practice: grant only the rights needed (least privilege), require human approval for irreversible actions, and run the AI agent security check.
Project activity and maintenance
Created on March 26, 2025, the pragmar/mcp-server-webcrawl repository has 46 stars and 17 forks, with 1 open issues. It has more stars than 50% of the servers in the directory. It received changes this month.
Stars measure attention, not quality: a recent, heavily promoted project can collect them fast, while a useful but niche server will have few.
Verdict
MCP server webcrawl is a reasonable choice; check the points below before connecting it.
Strengths
- Active project: recent commit
Limitations
- No licence declared
- Install from source
Avoid if…
- Company use without the author's agreement
Alternatives
- Exa MCP server5.2K ★
- Brave search MCP server1.5K ★
- Arxiv MCP server3.2K ★
- JobSpy4.6K ★
- SearXNG Search1.3K ★
- Tavily MCP2.5K ★
Learn more
Frequently asked questions
How do I install MCP server webcrawl?
No package is declared in the MCP registry: clone the pragmar/mcp-server-webcrawl repository, follow its README, then declare the start command in your client's MCP configuration.
Is MCP server webcrawl free?
The code is public but has no declared licence: it is not formally free to reuse.
Is MCP server webcrawl safe?
Points to watch: no licence. Give it minimum rights and approve sensitive actions.
Is it an official server?
Nothing says so: it is a project published by pragmar on GitHub. Check who maintains it before giving it access.
What are the alternatives to MCP server webcrawl?
In the same category: Exa MCP server, Brave search MCP server, Arxiv MCP server, and JobSpy. Exa MCP server and Brave search MCP server score higher on our grid.
Related articles
- Build your own MCP server in 30 minutesOctober 24, 2026
- Automate your inbox with an AI agentOctober 18, 2026
- MCP, A2A, and tool calling: agent protocols explainedOctober 17, 2026
- Build an AI agent with n8n, without codingOctober 16, 2026
Neutrality. No affiliate links. No vendor pays to be reviewed, rated or ranked. Reviews are directed by François Chollet, neutral and factual, and every data point is dated and sourced. How we score