LiteLLMModels

Llama 3 70B API Pricing

As of October 10, 2026, Llama 3 70B costs $0.59 per 1M input tokens and $0.79 per 1M output tokens from Vercel AI Gateway, the lowest of 3 providers. It has an 8,192-token context window and returns up to 8,192 tokens per response.

By MetaModel ID vercel_ai_gateway/meta/llama-3-70bPrices updated Checked
Input
$0.59 / 1M tokens
Output
$0.79 / 1M tokens
Context window
8,192 tokens
Max output
8,192 tokens
Providers
3
Added to LiteLLM
May 2024

Llama 3 70B pricing by provider

3 listings across 3 providers. Token prices are in US dollars per 1M tokens. The highlighted row is the price quoted above.

ProviderModel name in LiteLLMInputOutputContext
Vercel AI Gatewayvercel_ai_gateway/meta/llama-3-70b$0.59$0.798K
Replicatereplicate/meta/llama-3-70b$0.65$2.758K
Snowflake Cortexsnowflake/llama3-70b––8K

What Llama 3 70B costs in practice

1,000 requests with 2,000 input and 500 output tokens each

Vercel AI Gateway$1.575
Replicate$2.675

Use Llama 3 70B with LiteLLM

Call Llama 3 70B through the LiteLLM Python SDK, or put it behind the LiteLLM proxy and send OpenAI-format requests to /v1/chat/completions. LiteLLM tracks the cost of every request at these prices.

Python SDK
from litellm import completion

response = completion(
    model="vercel_ai_gateway/meta/llama-3-70b",
    messages=[{"role": "user", "content": "Hello!"}],
)
Proxy config.yaml
model_list:
  - model_name: llama-3-70b
    litellm_params:
      model: vercel_ai_gateway/meta/llama-3-70b
      # credentials: see the provider's LiteLLM docs page
Call the proxy
curl http://0.0.0.0:4000/v1/chat/completions \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer sk-1234" \
  -d '{
    "model": "llama-3-70b",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

Llama 3 70B FAQ

How much does Llama 3 70B cost?

Llama 3 70B costs $0.59 per 1M input tokens and $0.79 per 1M output tokens from Vercel AI Gateway, the lowest of 3 providers.

What is the context window of Llama 3 70B?

Llama 3 70B has an 8,192-token context window and returns up to 8,192 tokens per response.

Which providers offer Llama 3 70B?

Llama 3 70B is available from 3 providers through LiteLLM: Vercel AI Gateway, Replicate and Snowflake Cortex. The lowest price is on Vercel AI Gateway.

How do I call Llama 3 70B with an OpenAI-compatible API?

Use the LiteLLM Python SDK with model="vercel_ai_gateway/meta/llama-3-70b", or add the model to the LiteLLM proxy's config.yaml and send requests to /v1/chat/completions from any OpenAI client. LiteLLM tracks the cost of every request at the prices on this page.

When did LiteLLM add Llama 3 70B?

Llama 3 70B was added to LiteLLM's model price file in May 2024.

Sources

Prices come from LiteLLM's open-source model_prices_and_context_window.json, which LiteLLM uses to calculate the cost of every request.

LiteLLM docs: Vercel AI Gateway, Replicate, Snowflake Cortex.

Provider pages: Vercel AI Gateway, Replicate, Snowflake Cortex.