Medlm Large API Pricing
Medlm Large is available through LiteLLM. It has an 8,192-token context window and returns up to 1,024 tokens per response.
- Context window
- 8,192 tokens
- Max output
- 1,024 tokens
- Providers
- 1
- Added to LiteLLM
- July 2024
Medlm Large pricing by provider
1 listing across 1 provider. Token prices are in US dollars per 1M tokens. The highlighted row is the price quoted above.
| Provider | Model name in LiteLLM | Per 1M chars | Context |
|---|---|---|---|
| Google Vertex AI | vertex_ai/medlm-large | $5.00 | 8K |
Use Medlm Large with LiteLLM
Call Medlm Large through the LiteLLM Python SDK, or put it behind the LiteLLM proxy and send OpenAI-format requests to /v1/chat/completions. LiteLLM tracks the cost of every request at these prices.
from litellm import completion
response = completion(
model="vertex_ai/medlm-large",
messages=[{"role": "user", "content": "Hello!"}],
)curl http://0.0.0.0:4000/v1/chat/completions \
-H "Content-Type: application/json" \
-H "Authorization: Bearer sk-1234" \
-d '{
"model": "medlm-large",
"messages": [{"role": "user", "content": "Hello!"}]
}'Medlm Large FAQ
What is the context window of Medlm Large?
Medlm Large has an 8,192-token context window and returns up to 1,024 tokens per response.
When did LiteLLM add Medlm Large?
Medlm Large was added to LiteLLM's model price file in July 2024.
Sources
Prices come from LiteLLM's open-source model_prices_and_context_window.json, which LiteLLM uses to calculate the cost of every request. Provider pricing pages:
LiteLLM docs: Google Vertex AI.
Provider pages: Google Vertex AI.