Inference
Quickly deploy a public or custom model to a dedicated inference endpoint.
- Model
- Parameters
- Size
- Context Window
gte-Qwen2-1.5B-instructContinue- 1.5 B
- 2 GB
- 128 K
Qwen2.5-7B-InstructContinue- 7 B
- 4.7 GB
- 128 K
Qwen2.5-Coder-32B-InstructContinue- 32 B
- 20 GB
- 128 K
Qwen2.5-Instruct-GPTQ-Int8Continue- 14 B
- 4.7 GB
- 128 K
Qwen3-14BContinue- 14.2 B
- 9 GB
- 32 K
Qwen3-30B-A3BContinue- 30 B
- 17 GB
- 128 K
Qwen3-32BContinue- 32.8 B
- 33 GB
- 128 K
QwQ-32BContinue- 32.5 B
- 65.5 GB
- 32 K
QwQ-32B-PreviewContinue- 32.5 B
- 65.5 GB
- 32 K
Mistral-7B-Instruct-v0.3Continue- 7 B
- 4.1 GB
- 32 K
Mistral-Nemo-Instruct-2407Continue- 12.2 B
- 7.1 GB
- 128 K
Mistral-Small-Instruct-2409Continue- 7 B
- 4.7 GB
- 128 K
Mistral-Small-Instruct-2501Continue- 24 B
- 14 GB
- 128 K
DeepSeek-R1-Distill-LlamaContinue- 70 B
- 4.7 GB
- 128 K
DeepSeek-R1-Distill-QwenContinue- 32 B
- 20 GB
- 128 K
DeepSeek-R1-Distill-QwenContinue- 14 B
- 9 GB
- 130 K
