LiteLLMModels

New AI models in May 2024

20 models were added to LiteLLM's price file in May 2024, newest first, with each one's headline price and context window.

AddedModelLabPriceContextProviders
May 2024BGE Large En–$0.10 per 1M tokens5121
May 2024CodeLlama 70B Instruct HF–$1 / $1 per 1M tokens4K1
May 2024DBRX Instruct–$1.20 / $1.20 per 1M tokens32K1
May 2024DeepSeek Chat deprecatedDeepSeek$0.28 / $0.42 per 1M tokens128K2
May 2024DeepSeek CoderDeepSeek$0.14 / $0.28 per 1M tokens128K1
May 2024Firellava 13B–$0.20 / $0.20 per 1M tokens4K1
May 2024GPT-4oOpenAI$2.50 / $10 per 1M tokens128K7
May 2024Llama 2 13BMeta$0.10 / $0.50 per 1M tokens4K1
May 2024Llama 2 70BMeta$0.65 / $2.75 per 1M tokens4K1
May 2024Llama 2 7BMeta$0.05 / $0.25 per 1M tokens4K1
May 2024Llama 3 70BMeta$0.59 / $0.79 per 1M tokens8K3
May 2024Llama 3 8BMeta$0.05 / $0.25 per 1M tokens8K3
May 2024Llama3MetaFree8K1
May 2024Llama3 8B InstructMetaFree32K8
May 2024Mistral 7B Instruct V0.2Mistral AIFree32K3
May 2024Mistral 7B V0.1Mistral AI$0.05 / $0.25 per 1M tokens4K1
May 2024Mixtral 8x22B InstructMistral AI$1.20 / $1.20 per 1M tokens64K2
May 2024Mixtral 8x22B Instruct V0.1Mistral AIFree64K3
May 2024Titan Embed Text V2Amazon$0.02 per 1M tokens8K2
May 2024WizardLM 2 8x22BMicrosoft$0.48 / $0.48 per 1M tokens64K2