qwen2.5:72b
qwen2 · 72.7B · Q4_K_M
1 benchmark across different hardware
Avg Score
75 /100
75–75
Avg Speed
4.4 tok/s
4.4–4.4
Avg TTFT
529 ms
Benchmarks
1
| Hardware | RAM | Score | tok/s | TTFT | Verdict |
|---|---|---|---|---|---|
| Cortex-X925 (NVIDIA NVIDIA_DGX_Spark) | 122 GB | 75 | 4.4 | 529 ms | Not Rec. |