Llama 3.1 70B Instruct: pricing, context and benchmarks

What you need to know about Llama 3.1 70B Instruct

Llama 3.1 70B Instruct was released by Meta (United States) on July 23, 2024. It accepts text as input and produces text. Its context window reaches 131,072 tokens, larger than 29 % of the models in the registry, and it can write up to 16,384 tokens in one go.

Released more than 2 years ago, it belongs to a generation most vendors have since superseded.

Llama 3.1 70B Instruct pricing

On OpenRouter, Llama 3.1 70B Instruct costs $0.4 per million input tokens and $0.4 per million output tokens. Counting three tokens read for every token written, its average price is $0.4 per million, more expensive than 34 % of paid models (1.9 times cheaper than the median of $0.76).

A concrete example: a task that sends 2,000 tokens (about 1,500 words) and receives a 500-token answer costs $0.001. At 1,000 tasks a day, budget $30 a month. The price calculator redoes this with your own volumes.

Performance and benchmarks

Epoch AI does not yet publish a capabilities index for Llama 3.1 70B Instruct. We therefore show no made-up performance rating: only price, context and features count towards its score.

Scores published by Epoch AI on the benchmarks the site tracks:

Features, privacy and local use

• It supports tool calling, so it can drive an AI agent, call APIs or MCP servers.
• It can answer in an enforced JSON format (structured outputs).
• Its knowledge stops at December 2023.

Its weights are open and downloadable from Hugging Face: you can run it on your own machines without sending your data to a third party.

Other Meta models