Anyscale model pricing
As of October 10, 2026, 12 Anyscale models are available through LiteLLM. The most recently added are CodeLlama 70B Instruct HF, Llama3 8B Instruct, Mixtral 8x22B Instruct V0.1. Prices below are Anyscale's list prices.
Anyscale models
| Model | Lab | Price | Context | Providers | Added |
|---|---|---|---|---|---|
| CodeLlama 70B Instruct HF | – | $1 / $1 per 1M tokens | 4K | 1 | May 2024 |
| Llama3 8B Instruct | Meta | $0.15 / $0.15 per 1M tokens | 8K | 8 | May 2024 |
| Mixtral 8x22B Instruct V0.1 | Mistral AI | $0.90 / $0.90 per 1M tokens | 64K | 3 | May 2024 |
| Llama3 70B Instruct | Meta | $1 / $1 per 1M tokens | 8K | 7 | Apr 2024 |
| Gemma 7B IT | $0.15 / $0.15 per 1M tokens | 8K | 2 | Mar 2024 | |
| Mixtral 8x7B Instruct V0.1 | Mistral AI | $0.15 / $0.15 per 1M tokens | 16K | 6 | Jan 2024 |
| Zephyr 7B Beta | – | $0.15 / $0.15 per 1M tokens | 16K | 2 | Nov 2023 |
| CodeLlama 34B Instruct HF | – | $1 / $1 per 1M tokens | 4K | 1 | Oct 2023 |
| Llama 2 13B Chat HF | Meta | $0.25 / $0.25 per 1M tokens | 4K | 1 | Oct 2023 |
| Llama 2 70B Chat HF | Meta | $1 / $1 per 1M tokens | 4K | 1 | Oct 2023 |
| Llama 2 7B Chat HF | Meta | $0.15 / $0.15 per 1M tokens | 4K | 1 | Oct 2023 |
| Mistral 7B Instruct V0.1 | Mistral AI | $0.15 / $0.15 per 1M tokens | 16K | 4 | Oct 2023 |