Llama V2 7B Chat API Pricing

Llama V2 7B Chat pricing by provider

1 listing across 1 provider. Token prices are in US dollars per 1M tokens. The highlighted row is the price quoted above.

What Llama V2 7B Chat costs in practice

1,000 requests with 2,000 input and 500 output tokens each

Use Llama V2 7B Chat with LiteLLM

Call Llama V2 7B Chat through the LiteLLM Python SDK, or put it behind the LiteLLM proxy and send OpenAI-format requests to /v1/chat/completions. LiteLLM tracks the cost of every request at these prices.

from litellm import completion

response = completion(
    model="fireworks_ai/accounts/fireworks/models/llama-v2-7b-chat",
    messages=[{"role": "user", "content": "Hello!"}],
)

model_list:
  - model_name: llama-v2-7b-chat
    litellm_params:
      model: fireworks_ai/accounts/fireworks/models/llama-v2-7b-chat
      api_key: os.environ/FIREWORKS_AI_API_KEY

curl http://0.0.0.0:4000/v1/chat/completions \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer sk-1234" \
  -d '{
    "model": "llama-v2-7b-chat",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

Llama V2 7B Chat FAQ

More Meta models

• Llama V2 13B$0.20 / $0.20 per 1M tokens
• Llama V2 13B Chat$0.20 / $0.20 per 1M tokens
• Llama V2 70B$0.10 / $0.10 per 1M tokens
• Llama V2 70B Chat$0.90 / $0.90 per 1M tokens
• Llama V2 7B$0.20 / $0.20 per 1M tokens
• Llama 3 70B Instruct Turbo$0.88 / $0.88 per 1M tokens
• Llama 3 8B Chat HF$0.20 / $0.20 per 1M tokens
• Llama 3.1 Nemotron 70B Instruct HF$0.88 / $0.88 per 1M tokens