Llama 3.2 Nv Rerankqa 1B V2 API Pricing

Llama 3.2 Nv Rerankqa 1B V2 pricing by provider

2 listings across 1 provider. Token prices are in US dollars per 1M tokens. The highlighted row is the price quoted above.

Use Llama 3.2 Nv Rerankqa 1B V2 with LiteLLM

Call Llama 3.2 Nv Rerankqa 1B V2 through the LiteLLM Python SDK, or put it behind the LiteLLM proxy and send OpenAI-format requests to /v1/rerank. LiteLLM tracks the cost of every request at these prices.

from litellm import completion

response = completion(
    model="nvidia_nim/nvidia/llama-3_2-nv-rerankqa-1b-v2",
    messages=[{"role": "user", "content": "Hello!"}],
)

model_list:
  - model_name: llama-3_2-nv-rerankqa-1b-v2
    litellm_params:
      model: nvidia_nim/nvidia/llama-3_2-nv-rerankqa-1b-v2
      # credentials: see the provider's LiteLLM docs page

curl http://0.0.0.0:4000/v1/chat/completions \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer sk-1234" \
  -d '{
    "model": "llama-3_2-nv-rerankqa-1b-v2",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

Llama 3.2 Nv Rerankqa 1B V2 FAQ

More Meta models

• Llama Rank V1$0.10 per 1M input tokens
• Llama 3 70B Instruct Turbo$0.88 / $0.88 per 1M tokens
• Llama 3 8B Chat HF$0.20 / $0.20 per 1M tokens
• Llama 3.1 Nemotron 70B Instruct HF$0.88 / $0.88 per 1M tokens
• Llama Prompt Guard 2 22M$0.03 / $0.03 per 1M tokens
• Llama Prompt Guard 2 86M$0.04 / $0.04 per 1M tokens
• Llama 2 7B Chat HF LoraFree
• Llama 3.3 70B Instruct FP8 Fast$0.293 / $2.253 per 1M tokens