Llama 2 70B Chat API Pricing

Llama 2 70B Chat pricing by provider

4 listings across 4 providers. Token prices are in US dollars per 1M tokens. The highlighted row is the price quoted above.

What Llama 2 70B Chat costs in practice

1,000 requests with 2,000 input and 500 output tokens each

Use Llama 2 70B Chat with LiteLLM

Call Llama 2 70B Chat through the LiteLLM Python SDK, or put it behind the LiteLLM proxy and send OpenAI-format requests to /v1/chat/completions. LiteLLM tracks the cost of every request at these prices.

from litellm import completion

response = completion(
    model="replicate/meta/llama-2-70b-chat",
    messages=[{"role": "user", "content": "Hello!"}],
)

model_list:
  - model_name: llama-2-70b-chat
    litellm_params:
      model: replicate/meta/llama-2-70b-chat
      # credentials: see the provider's LiteLLM docs page

curl http://0.0.0.0:4000/v1/chat/completions \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer sk-1234" \
  -d '{
    "model": "llama-2-70b-chat",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

Llama 2 70B Chat FAQ

More Meta models

• Llama 2 7B Chat HF LoraFree
• Llama 2 13B$0.10 / $0.50 per 1M tokens
• Llama 2 70B$0.65 / $2.75 per 1M tokens
• Llama 2 7B$0.05 / $0.25 per 1M tokens
• Llama 2 7B Chat$1.923 / $1.923 per 1M tokens
• Llama 2 13B Chat HF$0.25 / $0.25 per 1M tokens
• Llama 2 70B Chat HF$1 / $1 per 1M tokens
• Llama 2 7B Chat HF$0.15 / $0.15 per 1M tokens