LiteLLMModels

New AI models in July 2024

22 models were added to LiteLLM's price file in July 2024, newest first, with each one's headline price and context window.

AddedModelLabPriceContextProviders
July 2024Codestral MambaMistral AI$0.25 / $0.25 per 1M tokens256K1
July 2024DeepSeek Coder V2 InstructDeepSeekFree32K2
July 2024Firefunction V2–$0.90 / $0.90 per 1M tokens8K1
July 2024Gemini Gemma 2 27B ITGoogle$0.35 / $1.05 per 1M tokens8K1
July 2024Gemini Gemma 2 9B ITGoogle$0.35 / $1.05 per 1M tokens8K1
July 2024GPT-4o MiniOpenAI$0.15 / $0.60 per 1M tokens128K7
July 2024Jamba Instruct deprecatedAI21 Labs$0.50 / $0.70 per 1M tokens70K3
July 2024Llama 3.1 405B InstructMeta$1 / $3 per 1M tokens128K7
July 2024Llama 3.1 70B InstructMetaFree128K11
July 2024Llama 3.1 8B InstantMeta$0.20 / $0.50 per 1M tokens128K1
July 2024Llama 3.1 8B InstructMetaFree128K13
July 2024Llama3 405B InstructMetaFree32K1
July 2024Llama3.1MetaFree8K1
July 2024Medlm Large––8K1
July 2024Medlm Medium––32K1
July 2024Mistral NemoMistral AI$0.04 / $0.17 per 1M tokens60K3
July 2024Mixtral 8x22B Instruct HFMistral AI$1.20 / $1.20 per 1M tokens64K1
July 2024Open Mistral NemoMistral AI$0.30 / $0.30 per 1M tokens128K1
July 2024Qwen2 72B Instruct deprecatedAlibaba$0.90 / $0.90 per 1M tokens32K2
July 2024TTS-1 deprecatedOpenAI$15 per 1M characters–2
July 2024TTS-1 HD deprecatedOpenAI$30 per 1M characters–2
July 2024Yi Large–$3 / $3 per 1M tokens32K1