AI model comparison

Qwen2.5 72B Instruct vs Llama 3.1 70B Instruct

Pricing, context window, benchmarks, and features compared side by side. Or skip the guesswork and send one prompt to both.

Qwen2.5 72B is the latest series of Qwen large language models.

Input / 1M
$0.36
Output / 1M
$0.40
Context
33K

Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 70B instruct-tuned version is optimized for high quality dialogue usecases.

Input / 1M
$0.40
Output / 1M
$0.40
Context
131K

At a glance

Quick verdict

How the two models stack up on the things people ask about most.

Lower price

qwen logo

Qwen2.5 72B Instruct

1.1x cheaper for a typical chat

Higher intelligence score

qwen logo

Qwen2.5 72B Instruct

7.7 vs 6.6 on Artificial Analysis

Larger context window

meta-llama logo

Llama 3.1 70B Instruct

131K vs 33K tokens

Newer release

qwen logo

Qwen2.5 72B Instruct

Released September 19, 2024

Benchmarks

Benchmark scores

Independent scores from Artificial Analysis. Higher is better.

Intelligence index

qwen logoQwen2.5 72B Instruct7.7
meta-llama logoLlama 3.1 70B Instruct6.6

Coding index

qwen logoQwen2.5 72B InstructNot available
meta-llama logoLlama 3.1 70B InstructNot available

Agentic index

qwen logoQwen2.5 72B InstructNot available
meta-llama logoLlama 3.1 70B InstructNot available

Pricing

Qwen2.5 72B Instruct vs Llama 3.1 70B Instruct API pricing

Per-token API rates. Cheaper option highlighted.

Metricqwen logoQwen2.5 72B Instructmeta-llama logoLlama 3.1 70B Instruct
Input tokensPer 1M tokens$0.36$0.40
Output tokensPer 1M tokens$0.40$0.40
Cached input (read)Per 1M tokensNot availableNot available
Cache writePer 1M tokensNot availableNot available

What it costs in practice

Estimated cost per 1,000 requests at standard rates. Coding and long-document figures also show the cost when the input is already cached.

Chat message

2K in, 500 out

qwen logoQwen2.5 72B Instruct$0.92
meta-llama logoLlama 3.1 70B Instruct$1

Coding task

30K in, 4K out

qwen logoQwen2.5 72B Instruct$12.40
meta-llama logoLlama 3.1 70B Instruct$13.60

Long document summary

150K in, 2K out

qwen logoQwen2.5 72B Instruct$54.80
meta-llama logoLlama 3.1 70B Instruct$60.80

Specs

Context window and capabilities

How much each model can read, how much it can write, and what it accepts as input.

Metricqwen logoQwen2.5 72B Instructmeta-llama logoLlama 3.1 70B Instruct
Context window33K tokens131K tokens
Max output16K tokens16K tokens
Input typesTextText
Output typesTextText
Reasoning effort levelsNot availableNot available
Default reasoning effortNot availableNot available
Release dateSeptember 19, 2024July 23, 2024

Features

Supported features

API features available for each model.

Metricqwen logoQwen2.5 72B Instructmeta-llama logoLlama 3.1 70B Instruct
Tool callingSupportedSupported
Structured outputsSupportedSupported
JSON modeSupportedSupported
ReasoningNot supportedNot supported
TemperatureSupportedSupported
Stop sequencesSupportedSupported
Deterministic seedSupportedSupported
Verbosity controlNot supportedNot supported

Our take

Qwen2.5 72B Instruct is 1.1x cheaper for a typical chat. Qwen2.5 72B Instruct scores higher on the Artificial Analysis Intelligence Index (7.7 vs 6.6). Llama 3.1 70B Instruct has the larger context window (131K vs 33K tokens). The right pick depends on your workload, so the quickest way to settle it is to send the same prompt to both and compare.

FAQ

Frequently asked questions

Is Qwen2.5 72B Instruct or Llama 3.1 70B Instruct cheaper?

Qwen2.5 72B Instruct is cheaper for a typical chat (2K input tokens and 500 output tokens). Qwen2.5 72B Instruct costs $0.36 per 1M input tokens and $0.40 per 1M output tokens, while Llama 3.1 70B Instruct costs $0.40 per 1M input tokens and $0.40 per 1M output tokens.

Which has a bigger context window, Qwen2.5 72B Instruct or Llama 3.1 70B Instruct?

Llama 3.1 70B Instruct supports up to 131K tokens of context, compared with 33K for Qwen2.5 72B Instruct.

Is Qwen2.5 72B Instruct smarter than Llama 3.1 70B Instruct?

On the Artificial Analysis Intelligence Index, Qwen2.5 72B Instruct scores 7.7 and Llama 3.1 70B Instruct scores 6.6, putting Qwen2.5 72B Instruct ahead. Benchmarks don't capture everything, so the best test is running your own prompts through both.

Can I use Qwen2.5 72B Instruct and Llama 3.1 70B Instruct at the same time?

Yes. Shortcut Chat sends one prompt to multiple models at once, so you can see Qwen2.5 72B Instruct and Llama 3.1 70B Instruct answer side by side and keep the better response.

qwen logometa-llama logo

Why choose? Ask both.

Send one prompt to Qwen2.5 72B Instruct and Llama 3.1 70B Instruct at the same time. Compare the answers side by side and keep the best one.