Llama 3 70B API Pricing
As of October 10, 2026, Llama 3 70B costs $0.59 per 1M input tokens and $0.79 per 1M output tokens from Vercel AI Gateway, the lowest of 3 providers. It has an 8,192-token context window and returns up to 8,192 tokens per response.
- Input
- $0.59 / 1M tokens
- Output
- $0.79 / 1M tokens
- Context window
- 8,192 tokens
- Max output
- 8,192 tokens
- Providers
- 3
- Added to LiteLLM
- May 2024
Llama 3 70B pricing by provider
3 listings across 3 providers. Token prices are in US dollars per 1M tokens. The highlighted row is the price quoted above.
| Provider | Model name in LiteLLM | Input | Output | Context |
|---|---|---|---|---|
| Vercel AI Gateway | vercel_ai_gateway/meta/llama-3-70b | $0.59 | $0.79 | 8K |
| Replicate | replicate/meta/llama-3-70b | $0.65 | $2.75 | 8K |
| Snowflake Cortex | snowflake/llama3-70b | – | – | 8K |
What Llama 3 70B costs in practice
1,000 requests with 2,000 input and 500 output tokens each
| Vercel AI Gateway | $1.575 |
| Replicate | $2.675 |
Use Llama 3 70B with LiteLLM
Call Llama 3 70B through the LiteLLM Python SDK, or put it behind the LiteLLM proxy and send OpenAI-format requests to /v1/chat/completions. LiteLLM tracks the cost of every request at these prices.
from litellm import completion
response = completion(
model="vercel_ai_gateway/meta/llama-3-70b",
messages=[{"role": "user", "content": "Hello!"}],
)model_list:
- model_name: llama-3-70b
litellm_params:
model: vercel_ai_gateway/meta/llama-3-70b
# credentials: see the provider's LiteLLM docs pagecurl http://0.0.0.0:4000/v1/chat/completions \
-H "Content-Type: application/json" \
-H "Authorization: Bearer sk-1234" \
-d '{
"model": "llama-3-70b",
"messages": [{"role": "user", "content": "Hello!"}]
}'Llama 3 70B FAQ
How much does Llama 3 70B cost?
Llama 3 70B costs $0.59 per 1M input tokens and $0.79 per 1M output tokens from Vercel AI Gateway, the lowest of 3 providers.
What is the context window of Llama 3 70B?
Llama 3 70B has an 8,192-token context window and returns up to 8,192 tokens per response.
Which providers offer Llama 3 70B?
Llama 3 70B is available from 3 providers through LiteLLM: Vercel AI Gateway, Replicate and Snowflake Cortex. The lowest price is on Vercel AI Gateway.
How do I call Llama 3 70B with an OpenAI-compatible API?
Use the LiteLLM Python SDK with model="vercel_ai_gateway/meta/llama-3-70b", or add the model to the LiteLLM proxy's config.yaml and send requests to /v1/chat/completions from any OpenAI client. LiteLLM tracks the cost of every request at the prices on this page.
When did LiteLLM add Llama 3 70B?
Llama 3 70B was added to LiteLLM's model price file in May 2024.
Sources
Prices come from LiteLLM's open-source model_prices_and_context_window.json, which LiteLLM uses to calculate the cost of every request.
LiteLLM docs: Vercel AI Gateway, Replicate, Snowflake Cortex.
Provider pages: Vercel AI Gateway, Replicate, Snowflake Cortex.
