Llama3 2 90B Instruct API Pricing

Llama3 2 90B Instruct pricing by provider

2 listings across 1 provider. Token prices are in US dollars per 1M tokens. The highlighted row is the price quoted above.

What Llama3 2 90B Instruct costs in practice

1,000 requests with 2,000 input and 500 output tokens each

100 long-document requests with 100,000 input and 2,000 output tokens each

Llama3 2 90B Instruct features

• Function calling
• Image input

Use Llama3 2 90B Instruct with LiteLLM

Call Llama3 2 90B Instruct through the LiteLLM Python SDK, or put it behind the LiteLLM proxy and send OpenAI-format requests to /v1/chat/completions. LiteLLM tracks the cost of every request at these prices.

from litellm import completion

response = completion(
    model="meta.llama3-2-90b-instruct-v1:0",
    messages=[{"role": "user", "content": "Hello!"}],
)

model_list:
  - model_name: llama3-2-90b-instruct
    litellm_params:
      model: meta.llama3-2-90b-instruct-v1:0
      aws_region_name: os.environ/AWS_REGION_NAME

curl http://0.0.0.0:4000/v1/chat/completions \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer sk-1234" \
  -d '{
    "model": "llama3-2-90b-instruct",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

Llama3 2 90B Instruct FAQ

More Meta models

• Llama3 2 11B Instruct$0.16 / $0.16 per 1M tokens
• Llama 3 70B Instruct Turbo$0.88 / $0.88 per 1M tokens
• Llama 3 8B Chat HF$0.20 / $0.20 per 1M tokens
• Llama 3.1 Nemotron 70B Instruct HF$0.88 / $0.88 per 1M tokens
• Llama Prompt Guard 2 22M$0.03 / $0.03 per 1M tokens
• Llama Prompt Guard 2 86M$0.04 / $0.04 per 1M tokens
• Llama 2 7B Chat HF LoraFree
• Llama 3.3 70B Instruct FP8 Fast$0.293 / $2.253 per 1M tokens