LiteLLMModels

Granite 3 8B Instruct API Pricing

As of October 10, 2026, Granite 3 8B Instruct costs $0.20 per 1M input tokens and $0.20 per 1M output tokens on IBM watsonx.ai. It has an 8,192-token context window and returns up to 1,024 tokens per response.

Model ID watsonx/ibm/granite-3-8b-instructPrices updated Checked
Input
$0.20 / 1M tokens
Output
$0.20 / 1M tokens
Context window
8,192 tokens
Max output
1,024 tokens
Providers
1
Added to LiteLLM
April 2025

Granite 3 8B Instruct pricing by provider

1 listing across 1 provider. Token prices are in US dollars per 1M tokens. The highlighted row is the price quoted above.

ProviderModel name in LiteLLMInputOutputContext
IBM watsonx.aiwatsonx/ibm/granite-3-8b-instruct$0.20$0.208K

What Granite 3 8B Instruct costs in practice

1,000 requests with 2,000 input and 500 output tokens each

IBM watsonx.ai$0.50

Granite 3 8B Instruct features

Use Granite 3 8B Instruct with LiteLLM

Call Granite 3 8B Instruct through the LiteLLM Python SDK, or put it behind the LiteLLM proxy and send OpenAI-format requests to /v1/chat/completions. LiteLLM tracks the cost of every request at these prices.

Python SDK
from litellm import completion

response = completion(
    model="watsonx/ibm/granite-3-8b-instruct",
    messages=[{"role": "user", "content": "Hello!"}],
)
Proxy config.yaml
model_list:
  - model_name: granite-3-8b-instruct
    litellm_params:
      model: watsonx/ibm/granite-3-8b-instruct
      # credentials: see the provider's LiteLLM docs page
Call the proxy
curl http://0.0.0.0:4000/v1/chat/completions \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer sk-1234" \
  -d '{
    "model": "granite-3-8b-instruct",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

Granite 3 8B Instruct FAQ

How much does Granite 3 8B Instruct cost?

Granite 3 8B Instruct costs $0.20 per 1M input tokens and $0.20 per 1M output tokens on IBM watsonx.ai.

What is the context window of Granite 3 8B Instruct?

Granite 3 8B Instruct has an 8,192-token context window and returns up to 1,024 tokens per response.

Which providers offer Granite 3 8B Instruct?

Granite 3 8B Instruct is available from IBM watsonx.ai through LiteLLM, using the model name watsonx/ibm/granite-3-8b-instruct.

How do I call Granite 3 8B Instruct with an OpenAI-compatible API?

Use the LiteLLM Python SDK with model="watsonx/ibm/granite-3-8b-instruct", or add the model to the LiteLLM proxy's config.yaml and send requests to /v1/chat/completions from any OpenAI client. LiteLLM tracks the cost of every request at the prices on this page.

What features does Granite 3 8B Instruct support?

Granite 3 8B Instruct supports function calling, structured output and prompt caching. It does not support parallel tool calls, image input, audio input and audio output.

When did LiteLLM add Granite 3 8B Instruct?

Granite 3 8B Instruct was added to LiteLLM's model price file in April 2025.

Sources

Prices come from LiteLLM's open-source model_prices_and_context_window.json, which LiteLLM uses to calculate the cost of every request.

LiteLLM docs: IBM watsonx.ai.

Provider pages: IBM watsonx.ai.