mistral-small:24b
llama · 23.6B · Q4_K_M
1 benchmark across different hardware
Avg Score
75 /100
75–75
Avg Speed
14.3 tok/s
14.3–14.3
Avg TTFT
327 ms
Benchmarks
1
| Hardware | RAM | Score | tok/s | TTFT | Verdict |
|---|---|---|---|---|---|
| Cortex-X925 (NVIDIA NVIDIA_DGX_Spark) | 122 GB | 75 | 14.3 | 327 ms | Good |