Developer tools: AI tools compared (31)

What developer tools tools are for

Developer tools in this category address specific parts of software delivery, including data extraction, API testing, documentation and connections between agents and internal applications. They serve developers, quality teams and people responsible for technical platforms. Their usefulness depends on how well they fit the work between gathering inputs and checking a release. A team might previously have written test cases manually after inspecting application traffic. With Keploy, it can create tests from real calls, then review the assertions and the behaviours covered. Mintlify addresses a different task by publishing documentation and building an interactive reference from OpenAPI. These examples represent distinct tools for distinct jobs. You still need to understand the software, review the resulting material and maintain it as the project changes. The practical benefit comes from integrating a suitable tool into an existing engineering process.

Example uses:

• You create tests from real application calls to check how an API behaves after a change.
• You publish an interactive reference from an OpenAPI specification so integration developers can explore documented requests.
• You extract the main content of web pages to prepare readable inputs for a later processing step.
• You constrain generated responses and test whether they match the output format your application expects to receive.
• You centralize agent connections to internal applications and assign permissions that reflect the roles within your team.

Our picks by need

These picks follow simple rules applied to the verified data, with no partnership or affiliate link:

• Best scored : Firecrawl. 83/100 on our access and transparency grid.
• Cheapest paid option : Credyt. First plan at $1 per month.
• To keep data in Europe : LMQL. Processing on your device.

The main tools at a glance

Firecrawl 83/100

Firecrawl lets developers extract web page content and crawl websites. It converts pages to Markdown, extracts structured JSON data, and retrieves pages found through web searches. Features: Extract the content of a web page; Crawl the pages of a website; Convert pages to Markdown. Entry price: $16 per month, with a free tier. Runs on: web browser and API. Data hosting: United States.

LMQL 81/100

LMQL lets developers write queries for language models and impose constraints on generated responses. It provides a visual environment for testing programs and inspecting the steps of generation. Features: Write queries for language models; Impose constraints on generated responses; Test programs in a visual environment. Free tier available. Runs on: web browser, Linux, macOS, and Windows. Data hosting: On device.

Keploy 78/100

Keploy supports developers by creating tests from real calls or an API specification. It simulates services and databases, replays tests in development pipelines, and detects regressions. Features: Create tests from real calls; Generate tests from an API specification; Simulate services and databases. Entry price: $19 per month, with a free tier. Runs on: web browser, Windows, macOS, Linux, browser extension, and API.

Jina Reader 73/100

Jina Reader extracts main web page content, converts URLs or PDFs to Markdown and returns structured JSON content. It serves developers preparing documents for search systems or language models. Features: Extract the main content of a web page; Convert a URL or PDF to Markdown; Return structured content in JSON. Entry price: $50 pay as you go, with a free tier. Runs on: web browser and API.

Metorial 73/100

Metorial helps teams connect agents to business applications. It centralizes MCP connections, manages permissions by person and role, records executed actions and administers credentials and OAuth connections. Features: Connect agents to business applications; Centralize MCP connections; Manage permissions by person and role. Entry price: $250 per month, with a free tier. Runs on: web browser and API. Data hosting: Several regions.

Mintlify 71/100

Mintlify is for developers publishing and maintaining documentation. It supports interactive references built from OpenAPI, an assistant answering readers’ questions, documentation updates through an agent, and page exports. Features: Publish a documentation website; Create an interactive reference from OpenAPI; Answer readers’ questions with an assistant. Entry price: $450 per month, with a free tier. Runs on: web browser, API, and Slack.

Metatron 68/100

Metatron helps developers extract technical decisions from a repository and its history. Proposed rules can be reviewed locally, supplied to coding agents, stored in Git and exported as readable files. Features: Extract technical decisions from a repository and its history; Have proposed rules approved in a local interface; Provide project conventions to coding agents. Free tier available. Runs on: web browser and API. Data hosting: On device.

Pagerly 68/100

Pagerly organizes on-call rotations for teams coordinating incident response. It synchronizes Slack groups with schedules, triggers phone or SMS alerts, assigns tasks automatically and publishes status pages. Features: Organize on-call rotations; Synchronize Slack groups with schedules; Trigger alerts by phone call or SMS. Entry price: $19 per month, with a free tier. Runs on: web browser, Slack, Microsoft Teams, API, iPhone and iPad, Android, and macOS. Data hosting: United States.

Hyperbrowser 63/100

Hyperbrowser lets developers launch hosted browser sessions to automate website actions and extract structured data. It also supports exploring site pages, searching the web, and running agents in a browser. Features: Launch hosted browser sessions; Automate actions on websites; Extract structured data. Entry price: $30 per month, with a free tier. Runs on: web browser and API.

Repomix 63/100

Repomix combines project files into one document for developers preparing code for analysis by an AI assistant. It counts tokens and can compress code to reduce context. Features: Combine project files into one document; Prepare code for analysis by an AI assistant; Count tokens per file. Free tier available. Runs on: web browser, Windows, macOS, Linux, and browser extension.

The category in figures

Of the 31 tools in the category, 27 (87%) offer a free tier, 74% have a public API and 1 have a French interface. The median entry price, per month, is $16.99 (across 19 tools with a published price). 12 disclose where data is hosted, 2 of them in Europe or on device.

Also useful

These tools belong to another category but also cover this need:

• Langfuse Langfuse tracks agent calls and steps, measures model costs and usage, and evaluates responses. It serves peop
• LM Studio LM Studio downloads language models and lets people chat with them on their computer. It serves users who want
• Codex Codex lets people developing software write and edit code, fix errors, run commands and tests, and review repo
• Opik Opik lets teams developing applications that use models record execution steps and compare experiments. It eva
• Arize Phoenix Arize Phoenix lets teams developing agents examine execution steps and evaluate response quality. It also supp
• Unsloth Unsloth serves people running and adapting models on their computers. It provides visual dataset preparation,
• Vanna Vanna serves teams querying databases through questions. It generates SQL queries, displays results as tables
• aider aider lets developers edit project files through a conversation using local or remote models. It identifies re
• AutoGen AutoGen lets people building AI agents assemble several agents within one workflow. It offers visual configura
• Hugging Face Hugging Face supports finding models, sharing datasets and testing applications in a browser. It serves people
• GitHub Copilot GitHub Copilot helps developers write and review code. It completes lines, generates functions and tests, answ
• Weaviate Weaviate lets teams developing RAG applications store documents and their vector representations. It supports

Choosing well and avoiding pitfalls

Choose a specific task and try the tool on a project that represents your working environment. For testing, inspect assertions and actual scenario coverage. For documentation, check source synchronization and French output if your readers need it. For extraction, compare results on difficult pages. Review export formats and integration with your delivery pipeline. Examine requested permissions, code handling and log retention. Relate the billing model to your own activity, whether the service measures calls, executions, users or processed content. Also establish how you would reproduce important checks if the service became unavailable.

Generated tests may preserve faulty behaviour without checking the intended business result. Polished documentation may describe an outdated release. Web extraction can omit tables or retain irrelevant material. Review assertions, identify documented versions and inspect extracted content. Remove secrets and personal information from submitted examples. Check the conditions governing collected material and restrict integration permissions. Keep essential checks reproducible outside the service where practical, and avoid treating a successful tool run as sufficient evidence that a release is ready.

To compare with the cost of using an AI model directly, see the API price calculator.

Free or paid?

Where available, free plans generally let you try a feature on a limited project or within usage restrictions. They can help establish whether the tool works with your environment. Paying may become useful when you integrate it into regular delivery, need shared team access or require suitable controls over permissions, retention and ongoing operational use.

Tools in the category with a free tier: Firecrawl, LMQL, Keploy, Jina Reader, Metorial, Mintlify, Metatron, and Pagerly.

For which jobs?

The profiles that use these tools most, based on the use cases documented by publishers: developers, data analysts, researchers, project managers, marketers, and students.