CodeLlama 34B Instruct API Pricing

CodeLlama 34B Instruct pricing by provider

2 listings across 2 providers. Token prices are in US dollars per 1M tokens. The highlighted row is the price quoted above.

What CodeLlama 34B Instruct costs in practice

1,000 requests with 2,000 input and 500 output tokens each

CodeLlama 34B Instruct features

• Function calling
• Parallel tool calls

Use CodeLlama 34B Instruct with LiteLLM

Call CodeLlama 34B Instruct through the LiteLLM Python SDK, or put it behind the LiteLLM proxy and send OpenAI-format requests to /v1/chat/completions. LiteLLM tracks the cost of every request at these prices.

from litellm import completion

response = completion(
    model="perplexity/codellama-34b-instruct",
    messages=[{"role": "user", "content": "Hello!"}],
)

model_list:
  - model_name: codellama-34b-instruct
    litellm_params:
      model: perplexity/codellama-34b-instruct
      api_key: os.environ/PERPLEXITYAI_API_KEY

curl http://0.0.0.0:4000/v1/chat/completions \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer sk-1234" \
  -d '{
    "model": "codellama-34b-instruct",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

CodeLlama 34B Instruct FAQ

Related models

• CodeLlama 34B Instruct HF$1 / $1 per 1M tokens