Granite 3 8B Instruct API Pricing
As of October 10, 2026, Granite 3 8B Instruct costs $0.20 per 1M input tokens and $0.20 per 1M output tokens on IBM watsonx.ai. It has an 8,192-token context window and returns up to 1,024 tokens per response.
- Input
- $0.20 / 1M tokens
- Output
- $0.20 / 1M tokens
- Context window
- 8,192 tokens
- Max output
- 1,024 tokens
- Providers
- 1
- Added to LiteLLM
- April 2025
Granite 3 8B Instruct pricing by provider
1 listing across 1 provider. Token prices are in US dollars per 1M tokens. The highlighted row is the price quoted above.
| Provider | Model name in LiteLLM | Input | Output | Context |
|---|---|---|---|---|
| IBM watsonx.ai | watsonx/ibm/granite-3-8b-instruct | $0.20 | $0.20 | 8K |
What Granite 3 8B Instruct costs in practice
1,000 requests with 2,000 input and 500 output tokens each
| IBM watsonx.ai | $0.50 |
Granite 3 8B Instruct features
- Function calling
- Parallel tool calls
- Structured output
- Image input
- Audio input
- Audio output
- Prompt caching
Use Granite 3 8B Instruct with LiteLLM
Call Granite 3 8B Instruct through the LiteLLM Python SDK, or put it behind the LiteLLM proxy and send OpenAI-format requests to /v1/chat/completions. LiteLLM tracks the cost of every request at these prices.
from litellm import completion
response = completion(
model="watsonx/ibm/granite-3-8b-instruct",
messages=[{"role": "user", "content": "Hello!"}],
)model_list:
- model_name: granite-3-8b-instruct
litellm_params:
model: watsonx/ibm/granite-3-8b-instruct
# credentials: see the provider's LiteLLM docs pagecurl http://0.0.0.0:4000/v1/chat/completions \
-H "Content-Type: application/json" \
-H "Authorization: Bearer sk-1234" \
-d '{
"model": "granite-3-8b-instruct",
"messages": [{"role": "user", "content": "Hello!"}]
}'Granite 3 8B Instruct FAQ
How much does Granite 3 8B Instruct cost?
Granite 3 8B Instruct costs $0.20 per 1M input tokens and $0.20 per 1M output tokens on IBM watsonx.ai.
What is the context window of Granite 3 8B Instruct?
Granite 3 8B Instruct has an 8,192-token context window and returns up to 1,024 tokens per response.
Which providers offer Granite 3 8B Instruct?
Granite 3 8B Instruct is available from IBM watsonx.ai through LiteLLM, using the model name watsonx/ibm/granite-3-8b-instruct.
How do I call Granite 3 8B Instruct with an OpenAI-compatible API?
Use the LiteLLM Python SDK with model="watsonx/ibm/granite-3-8b-instruct", or add the model to the LiteLLM proxy's config.yaml and send requests to /v1/chat/completions from any OpenAI client. LiteLLM tracks the cost of every request at the prices on this page.
What features does Granite 3 8B Instruct support?
Granite 3 8B Instruct supports function calling, structured output and prompt caching. It does not support parallel tool calls, image input, audio input and audio output.
When did LiteLLM add Granite 3 8B Instruct?
Granite 3 8B Instruct was added to LiteLLM's model price file in April 2025.
Sources
Prices come from LiteLLM's open-source model_prices_and_context_window.json, which LiteLLM uses to calculate the cost of every request.
LiteLLM docs: IBM watsonx.ai.
Provider pages: IBM watsonx.ai.
