meta-llama logo

Meta

Llama 3.1 70B Instruct

Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 70B instruct-tuned version is optimized for high quality dialogue usecases.

At a glance

Input / 1M
$0.40
Output / 1M
$0.40
Context
131K
Max output
16K
Intelligence
6.6
Released
Jul 2024
Text inputTool calling

Pricing

Llama 3.1 70B Instruct API pricing

Per-token rates, plus what common tasks actually cost.

Input tokensPer 1M tokens$0.40
Output tokensPer 1M tokens$0.40
Cached input (read)Per 1M tokensNot available
Cache writePer 1M tokensNot available

Chat message

2K in, 500 out

$1

per 1,000 requests

Coding task

30K in, 4K out

$13.60

per 1,000 requests

Long document summary

150K in, 2K out

$60.80

per 1,000 requests

Benchmarks

Llama 3.1 70B Instruct benchmark scores

Independent scores from Artificial Analysis. Higher is better.

Intelligence index

6.6

Coding index

Not available

Agentic index

Not available

Specs

Context window and capabilities

What it can read, what it can write, and which API features it supports.

Context window
131K tokens
Max output
16K tokens
Input types
Text
Output types
Text
Reasoning effort
Not available
Release date
July 23, 2024
Knowledge cutoff
December 31, 2023
  • Tool calling
  • Structured outputs
  • JSON mode
  • Reasoning
  • Temperature
  • Stop sequences
  • Deterministic seed
  • Verbosity control

FAQ

Frequently asked questions

How much does Llama 3.1 70B Instruct cost?

Llama 3.1 70B Instruct costs $0.40 per 1M input tokens and $0.40 per 1M output tokens through the API. A typical chat message costs about $1 per 1,000 messages.

What is the context window of Llama 3.1 70B Instruct?

Llama 3.1 70B Instruct accepts up to 131K tokens of input and can write up to 16K tokens in a single response.

What is the best alternative to Llama 3.1 70B Instruct?

Gemini 2.5 Flash Lite from Google is a strong alternative. It offers: higher intelligence score, larger 1.05m context, accepts image and file and audio and video.

Can I use Llama 3.1 70B Instruct alongside other models?

Yes. Shortcut Chat sends one prompt to Llama 3.1 70B Instruct and any other models you pick at the same time, so you can compare answers side by side.

meta-llama logo

Try Llama 3.1 70B Instruct next to every other model.

Use Llama 3.1 70B Instruct alongside all the other models. Use one at a time, or multiple together. Get the best answer from every AI.