# Llama 3.1 70B Instruct API Pricing

As of October 10, 2026, Llama 3.1 70B Instruct is free to use from Google Vertex AI, the lowest of 11 providers. It has a 128,000-token context window and returns up to 2,048 tokens per response.

- Page: https://models.litellm.ai/models/llama-3.1-70b-instruct
- Lab: Meta
- LiteLLM model name: `vertex_ai/meta/llama-3.1-70b-instruct-maas`
- Context window: 128,000 tokens
- Max output: 2,048 tokens
- Added to LiteLLM: July 2024
- Prices updated: October 10, 2026

## Pricing by provider

Token prices in USD per 1M tokens.

| Provider | Model name | Input | Output | Cache read | Per image | Per second | Context |
|---|---|---|---|---|---|---|---|
| Google Vertex AI | `vertex_ai/meta/llama-3.1-70b-instruct-maas` | $0 | $0 | – | – | – | 128K |
| Amazon Bedrock | `meta.llama3-1-70b-instruct-v1:0` | $0.72 | $0.72 | – | – | – | 128K |
| Azure AI Foundry | `azure_ai/Meta-Llama-3.1-70B-Instruct` | $2.68 | $3.54 | – | – | – | 128K |
| DeepInfra | `deepinfra/meta-llama/Meta-Llama-3.1-70B-Instruct` | $0.40 | $0.40 | – | – | – | 128K |
| Hyperbolic | `hyperbolic/meta-llama/Meta-Llama-3.1-70B-Instruct` | $0.12 | $0.30 | – | – | – | 32K |
| Nebius AI Studio | `nebius/meta-llama/Meta-Llama-3.1-70B-Instruct` | $0.13 | $0.40 | – | – | – | 128K |
| Oracle Cloud (OCI) | `oci/meta.llama-3.1-70b-instruct` | $0.72 | $0.72 | – | – | – | 128K |
| OVHcloud | `ovhcloud/Meta-Llama-3_1-70B-Instruct` | $0.67 | $0.67 | – | – | – | 131K |
| Perplexity | `perplexity/llama-3.1-70b-instruct` | $1.00 | $1.00 | – | – | – | 128K |
| Weights & Biases | `wandb/meta-llama/Llama-3.1-70B-Instruct` | $0.80 | $0.80 | – | – | – | 131K |
| Amazon Bedrock (US cross-region) | `us.meta.llama3-1-70b-instruct-v1:0` | $0.72 | $0.72 | – | – | – | 128K |
| Lambda (fp8) | `lambda_ai/llama3.1-70b-instruct-fp8` | $0.12 | $0.30 | – | – | – | 128K |

## Cost examples

1,000 requests with 2,000 input and 500 output tokens each:

- Google Vertex AI: $0
- Hyperbolic: $0.39
- Nebius AI Studio: $0.46
- DeepInfra: $1.00

100 long-document requests with 100,000 input and 2,000 output tokens each:

- Google Vertex AI: $0
- Hyperbolic: $1.26
- Nebius AI Studio: $1.38
- DeepInfra: $4.08

## Features

Supported: Function calling, Parallel tool calls, Image input.

## Use it with LiteLLM

```python
from litellm import completion

response = completion(
    model="vertex_ai/meta/llama-3.1-70b-instruct-maas",
    messages=[{"role": "user", "content": "Hello!"}],
)
```

## FAQ

### How much does Llama 3.1 70B Instruct cost?

Llama 3.1 70B Instruct is free to use from Google Vertex AI, the lowest of 11 providers.

### What is the context window of Llama 3.1 70B Instruct?

Llama 3.1 70B Instruct has a 128,000-token context window and returns up to 2,048 tokens per response.

### Which providers offer Llama 3.1 70B Instruct?

Llama 3.1 70B Instruct is available from 11 providers through LiteLLM: Google Vertex AI, Amazon Bedrock, Azure AI Foundry, DeepInfra, Hyperbolic, Nebius AI Studio, Oracle Cloud (OCI), OVHcloud, Perplexity, Weights & Biases and Lambda. The lowest price is on Google Vertex AI.

### How do I call Llama 3.1 70B Instruct with an OpenAI-compatible API?

Use the LiteLLM Python SDK with model="vertex_ai/meta/llama-3.1-70b-instruct-maas", or add the model to the LiteLLM proxy's config.yaml and send requests to /v1/chat/completions from any OpenAI client. LiteLLM tracks the cost of every request at the prices on this page.

### What features does Llama 3.1 70B Instruct support?

Llama 3.1 70B Instruct supports function calling, parallel tool calls and image input.

### When did LiteLLM add Llama 3.1 70B Instruct?

Llama 3.1 70B Instruct was added to LiteLLM's model price file in July 2024.

Source: LiteLLM model price file, https://github.com/BerriAI/litellm/blob/main/model_prices_and_context_window.json