Llama3 70B Instruct API Pricing

Llama3 70B Instruct pricing by provider

16 listings across 7 providers. Token prices are in US dollars per 1M tokens. The highlighted row is the price quoted above.

† This price differs from the other providers by more than 8x and is left out of the headline price. Check the provider's pricing page.

What Llama3 70B Instruct costs in practice

1,000 requests with 2,000 input and 500 output tokens each

Llama3 70B Instruct features

• Function calling
• Parallel tool calls
• Structured output
• PDF input

Use Llama3 70B Instruct with LiteLLM

Call Llama3 70B Instruct through the LiteLLM Python SDK, or put it behind the LiteLLM proxy and send OpenAI-format requests to /v1/chat/completions. LiteLLM tracks the cost of every request at these prices.

from litellm import completion

response = completion(
    model="vertex_ai/meta/llama3-70b-instruct-maas",
    messages=[{"role": "user", "content": "Hello!"}],
)

model_list:
  - model_name: llama3-70b-instruct
    litellm_params:
      model: vertex_ai/meta/llama3-70b-instruct-maas
      vertex_project: os.environ/VERTEX_PROJECT
      vertex_location: os.environ/VERTEX_LOCATION

curl http://0.0.0.0:4000/v1/chat/completions \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer sk-1234" \
  -d '{
    "model": "llama3-70b-instruct",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

Llama3 70B Instruct FAQ

More Meta models

• Llama 3 70B Instruct Turbo$0.88 / $0.88 per 1M tokens
• Llama 3 8B Chat HF$0.20 / $0.20 per 1M tokens
• Llama 3.1 Nemotron 70B Instruct HF$0.88 / $0.88 per 1M tokens
• Llama Prompt Guard 2 22M$0.03 / $0.03 per 1M tokens
• Llama Prompt Guard 2 86M$0.04 / $0.04 per 1M tokens
• Llama 2 7B Chat HF LoraFree
• Llama 3.3 70B Instruct FP8 Fast$0.293 / $2.253 per 1M tokens
• Llama 3.3 70B Instruct FP8 Dynamic$0.72 / $0.72 per 1M tokens