Phi 3 Medium 128K Instruct API Pricing

Phi 3 Medium 128K Instruct pricing by provider

1 listing across 1 provider. Token prices are in US dollars per 1M tokens. The highlighted row is the price quoted above.

What Phi 3 Medium 128K Instruct costs in practice

1,000 requests with 2,000 input and 500 output tokens each

100 long-document requests with 100,000 input and 2,000 output tokens each

Phi 3 Medium 128K Instruct features

• Image input

Use Phi 3 Medium 128K Instruct with LiteLLM

Call Phi 3 Medium 128K Instruct through the LiteLLM Python SDK, or put it behind the LiteLLM proxy and send OpenAI-format requests to /v1/chat/completions. LiteLLM tracks the cost of every request at these prices.

from litellm import completion

response = completion(
    model="azure_ai/Phi-3-medium-128k-instruct",
    messages=[{"role": "user", "content": "Hello!"}],
)

model_list:
  - model_name: phi-3-medium-128k-instruct
    litellm_params:
      model: azure_ai/Phi-3-medium-128k-instruct
      # credentials: see the provider's LiteLLM docs page

curl http://0.0.0.0:4000/v1/chat/completions \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer sk-1234" \
  -d '{
    "model": "phi-3-medium-128k-instruct",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

Phi 3 Medium 128K Instruct FAQ

More Microsoft models

• Phi 3 Vision 128K Instruct$0.20 / $0.20 per 1M tokens
• Phi 3 Medium 4K Instruct$0.17 / $0.68 per 1M tokens
• Phi 3 Mini 128K Instruct$0.10 / $0.10 per 1M tokens
• Phi 3 Mini 4K Instruct$0.13 / $0.52 per 1M tokens
• Phi 3 Small 128K Instruct$0.15 / $0.60 per 1M tokens
• Phi 3 Small 8K Instruct$0.15 / $0.60 per 1M tokens
• Phi 3.5 Mini Instruct$0.13 / $0.52 per 1M tokens
• Phi 3.5 MoE Instruct$0.16 / $0.64 per 1M tokens