Phi 3.5 MoE Instruct API Pricing

Phi 3.5 MoE Instruct pricing by provider

1 listing across 1 provider. Token prices are in US dollars per 1M tokens. The highlighted row is the price quoted above.

What Phi 3.5 MoE Instruct costs in practice

1,000 requests with 2,000 input and 500 output tokens each

100 long-document requests with 100,000 input and 2,000 output tokens each

Phi 3.5 MoE Instruct features

• Image input

Use Phi 3.5 MoE Instruct with LiteLLM

Call Phi 3.5 MoE Instruct through the LiteLLM Python SDK, or put it behind the LiteLLM proxy and send OpenAI-format requests to /v1/chat/completions. LiteLLM tracks the cost of every request at these prices.

from litellm import completion

response = completion(
    model="azure_ai/Phi-3.5-MoE-instruct",
    messages=[{"role": "user", "content": "Hello!"}],
)

model_list:
  - model_name: phi-3.5-moe-instruct
    litellm_params:
      model: azure_ai/Phi-3.5-MoE-instruct
      # credentials: see the provider's LiteLLM docs page

curl http://0.0.0.0:4000/v1/chat/completions \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer sk-1234" \
  -d '{
    "model": "phi-3.5-moe-instruct",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

Phi 3.5 MoE Instruct FAQ

More Microsoft models

• Phi 3 Vision 128K Instruct$0.20 / $0.20 per 1M tokens
• Phi 3 Medium 128K Instruct$0.17 / $0.68 per 1M tokens
• Phi 3 Medium 4K Instruct$0.17 / $0.68 per 1M tokens
• Phi 3 Mini 128K Instruct$0.10 / $0.10 per 1M tokens
• Phi 3 Mini 4K Instruct$0.13 / $0.52 per 1M tokens
• Phi 3 Small 128K Instruct$0.15 / $0.60 per 1M tokens
• Phi 3 Small 8K Instruct$0.15 / $0.60 per 1M tokens
• Phi 3.5 Mini Instruct$0.13 / $0.52 per 1M tokens