LiteLLMModels

CodeLlama 34B Instruct HF API Pricing

As of October 10, 2026, CodeLlama 34B Instruct HF costs $1.00 per 1M input tokens and $1.00 per 1M output tokens on Anyscale. It has a 4,096-token context window and returns up to 4,096 tokens per response.

Model ID anyscale/codellama/CodeLlama-34b-Instruct-hfPrices updated Checked
Input
$1.00 / 1M tokens
Output
$1.00 / 1M tokens
Context window
4,096 tokens
Max output
4,096 tokens
Providers
1
Added to LiteLLM
October 2023

CodeLlama 34B Instruct HF pricing by provider

1 listing across 1 provider. Token prices are in US dollars per 1M tokens. The highlighted row is the price quoted above.

ProviderModel name in LiteLLMInputOutputContext
Anyscaleanyscale/codellama/CodeLlama-34b-Instruct-hf$1.00$1.004K

What CodeLlama 34B Instruct HF costs in practice

1,000 requests with 2,000 input and 500 output tokens each

Anyscale$2.50

Use CodeLlama 34B Instruct HF with LiteLLM

Call CodeLlama 34B Instruct HF through the LiteLLM Python SDK, or put it behind the LiteLLM proxy and send OpenAI-format requests to /v1/chat/completions. LiteLLM tracks the cost of every request at these prices.

Python SDK
from litellm import completion

response = completion(
    model="anyscale/codellama/CodeLlama-34b-Instruct-hf",
    messages=[{"role": "user", "content": "Hello!"}],
)
Proxy config.yaml
model_list:
  - model_name: codellama-34b-instruct-hf
    litellm_params:
      model: anyscale/codellama/CodeLlama-34b-Instruct-hf
      # credentials: see the provider's LiteLLM docs page
Call the proxy
curl http://0.0.0.0:4000/v1/chat/completions \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer sk-1234" \
  -d '{
    "model": "codellama-34b-instruct-hf",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

CodeLlama 34B Instruct HF FAQ

How much does CodeLlama 34B Instruct HF cost?

CodeLlama 34B Instruct HF costs $1.00 per 1M input tokens and $1.00 per 1M output tokens on Anyscale.

What is the context window of CodeLlama 34B Instruct HF?

CodeLlama 34B Instruct HF has a 4,096-token context window and returns up to 4,096 tokens per response.

Which providers offer CodeLlama 34B Instruct HF?

CodeLlama 34B Instruct HF is available from Anyscale through LiteLLM, using the model name anyscale/codellama/CodeLlama-34b-Instruct-hf.

How do I call CodeLlama 34B Instruct HF with an OpenAI-compatible API?

Use the LiteLLM Python SDK with model="anyscale/codellama/CodeLlama-34b-Instruct-hf", or add the model to the LiteLLM proxy's config.yaml and send requests to /v1/chat/completions from any OpenAI client. LiteLLM tracks the cost of every request at the prices on this page.

When did LiteLLM add CodeLlama 34B Instruct HF?

CodeLlama 34B Instruct HF was added to LiteLLM's model price file in October 2023.

Sources

Prices come from LiteLLM's open-source model_prices_and_context_window.json, which LiteLLM uses to calculate the cost of every request.

Provider pages: Anyscale.