Intel Xeon® E5-2637 v3
Dell Inc. Precision Tower 7910
96 GB RAM · 12 models tested
Avg Score
79 /100
Avg Speed
35.8 tok/s
Models Tested
12
| Model | Size | Score | tok/s | TTFT | Verdict |
|---|---|---|---|---|---|
| qwen3-30b-a3b-t16-c32k-instruct:latest | 30.5B Q4_K_M | 94 | 116.0 | 575 ms | Excellent |
| qwen3-30b-a3b-t16-c32k-instruct:latest | 30.5B Q4_K_M | 93 | 100.0 | 1.3s | Excellent |
| qwen3.5:35b-a3b-q4_K_M | 36.0B Q4_K_M | 90 | 47.1 | 1.1s | Excellent |
| qwen3.5:35b-a3b-q4_K_M | 36.0B Q4_K_M | 90 | 48.4 | 1.1s | Excellent |
| qwen3:30b-a3b-instruct-2507-q4_K_M | 30.5B Q4_K_M | 83 | 17.7 | 1.2s | Excellent |
| qwen3.5:35b-a3b-q4_K_M | 36.0B Q4_K_M | 82 | 20.4 | 1.4s | Excellent |
| qwen3.5:35b-a3b-q4_K_M | 36.0B Q4_K_M | 81 | 24.2 | 1.6s | Excellent |
| qwen3-next:80b-a3b-instruct-q4_K_M | 79.7B Q4_K_M | 80 | 14.9 | 1.8s | Excellent |
| qwen3-next:80b-a3b-instruct-q4_K_M | 79.7B Q4_K_M | 78 | 8.7 | 1.3s | Good |
| qwen3-next:80b-a3b-instruct-q4_K_M | 79.7B Q4_K_M | 78 | 8.7 | 1.5s | Good |
| llama3.3:70b-instruct-q4_K_M | 70.6B Q4_K_M | 51 | 1.7 | 5.6s | Not Rec. |
| qwen3.5:35b-a3b-q4_K_M | 36.0B Q4_K_M | 49 | 21.6 | 30.0s | Not Rec. |