meta-llama logo

Meta

Llama 3.1 8B Instruct

Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 8B instruct-tuned version is fast and efficient.

At a glance

Input / 1M
$0.05
Output / 1M
$0.08
Context
131K
Max output
118K
Intelligence
6.9
Released
Jul 2024
Text inputTool calling

Pricing

Llama 3.1 8B Instruct API pricing

Per-token rates, plus what common tasks actually cost.

Input tokensPer 1M tokens$0.05
Output tokensPer 1M tokens$0.08
Cached input (read)Per 1M tokens$0.03
Cache writePer 1M tokensNot available

Chat message

2K in, 500 out

$0.14

per 1,000 requests

Coding task

30K in, 4K out

$1.82

per 1,000 requests

Long document summary

150K in, 2K out

$7.66

per 1,000 requests

Benchmarks

Llama 3.1 8B Instruct benchmark scores

Independent scores from Artificial Analysis. Higher is better.

Intelligence index

6.9

Coding index

5.4

Agentic index

Not available

Specs

Context window and capabilities

What it can read, what it can write, and which API features it supports.

Context window
131K tokens
Max output
118K tokens
Input types
Text
Output types
Text
Reasoning effort
Not available
Release date
July 23, 2024
Knowledge cutoff
December 31, 2023
  • Tool calling
  • Structured outputs
  • JSON mode
  • Reasoning
  • Temperature
  • Stop sequences
  • Deterministic seed
  • Verbosity control

FAQ

Frequently asked questions

How much does Llama 3.1 8B Instruct cost?

Llama 3.1 8B Instruct costs $0.05 per 1M input tokens and $0.08 per 1M output tokens through the API. A typical chat message costs about $0.14 per 1,000 messages.

What is the context window of Llama 3.1 8B Instruct?

Llama 3.1 8B Instruct accepts up to 131K tokens of input and can write up to 118K tokens in a single response.

What is the best alternative to Llama 3.1 8B Instruct?

gpt-oss-20b from OpenAI is a strong alternative. It offers: higher intelligence score, newer release.

Can I use Llama 3.1 8B Instruct alongside other models?

Yes. Shortcut Chat sends one prompt to Llama 3.1 8B Instruct and any other models you pick at the same time, so you can compare answers side by side.

meta-llama logo

Try Llama 3.1 8B Instruct next to every other model.

Use Llama 3.1 8B Instruct alongside all the other models. Use one at a time, or multiple together. Get the best answer from every AI.