Llama V3p1 70B Instruct API Pricing

Llama V3p1 70B Instruct pricing by provider

1 listing across 1 provider. Token prices are in US dollars per 1M tokens. The highlighted row is the price quoted above.

What Llama V3p1 70B Instruct costs in practice

1,000 requests with 2,000 input and 500 output tokens each

100 long-document requests with 100,000 input and 2,000 output tokens each

Use Llama V3p1 70B Instruct with LiteLLM

Call Llama V3p1 70B Instruct through the LiteLLM Python SDK, or put it behind the LiteLLM proxy and send OpenAI-format requests to /v1/chat/completions. LiteLLM tracks the cost of every request at these prices.

from litellm import completion

response = completion(
    model="fireworks_ai/accounts/fireworks/models/llama-v3p1-70b-instruct",
    messages=[{"role": "user", "content": "Hello!"}],
)

model_list:
  - model_name: llama-v3p1-70b-instruct
    litellm_params:
      model: fireworks_ai/accounts/fireworks/models/llama-v3p1-70b-instruct
      api_key: os.environ/FIREWORKS_AI_API_KEY

curl http://0.0.0.0:4000/v1/chat/completions \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer sk-1234" \
  -d '{
    "model": "llama-v3p1-70b-instruct",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

Llama V3p1 70B Instruct FAQ

More Meta models

• Llama V3p1 405B Instruct Long$0.10 / $0.10 per 1M tokens
• Llama V3p1 70B Instruct 1B$0.10 / $0.10 per 1M tokens
• Llama V3p1 Nemotron 70B Instruct$0.90 / $0.90 per 1M tokens
• Llama V3p1 405B Instruct$3 / $3 per 1M tokens
• Llama V3p1 8B Instruct$0.10 / $0.10 per 1M tokens
• Llama 3 70B Instruct Turbo$0.88 / $0.88 per 1M tokens
• Llama 3 8B Chat HF$0.20 / $0.20 per 1M tokens
• Llama 3.1 Nemotron 70B Instruct HF$0.88 / $0.88 per 1M tokens