Medlm Medium API Pricing
Medlm Medium is available through LiteLLM. It has a 32,768-token context window and returns up to 8,192 tokens per response.
- Context window
- 32,768 tokens
- Max output
- 8,192 tokens
- Providers
- 1
- Added to LiteLLM
- July 2024
Medlm Medium pricing by provider
1 listing across 1 provider. Token prices are in US dollars per 1M tokens. The highlighted row is the price quoted above.
| Provider | Model name in LiteLLM | Per 1M chars | Context |
|---|---|---|---|
| Google Vertex AI | vertex_ai/medlm-medium | $0.50 | 32K |
Use Medlm Medium with LiteLLM
Call Medlm Medium through the LiteLLM Python SDK, or put it behind the LiteLLM proxy and send OpenAI-format requests to /v1/chat/completions. LiteLLM tracks the cost of every request at these prices.
from litellm import completion
response = completion(
model="vertex_ai/medlm-medium",
messages=[{"role": "user", "content": "Hello!"}],
)curl http://0.0.0.0:4000/v1/chat/completions \
-H "Content-Type: application/json" \
-H "Authorization: Bearer sk-1234" \
-d '{
"model": "medlm-medium",
"messages": [{"role": "user", "content": "Hello!"}]
}'Medlm Medium FAQ
What is the context window of Medlm Medium?
Medlm Medium has a 32,768-token context window and returns up to 8,192 tokens per response.
When did LiteLLM add Medlm Medium?
Medlm Medium was added to LiteLLM's model price file in July 2024.
Sources
Prices come from LiteLLM's open-source model_prices_and_context_window.json, which LiteLLM uses to calculate the cost of every request. Provider pricing pages:
LiteLLM docs: Google Vertex AI.
Provider pages: Google Vertex AI.