Intel Xeon® E5-4650 v2
Dell Inc. PowerEdge R820
256 GB RAM · 5 models tested
Avg Score
72 /100
Avg Speed
6.5 tok/s
Models Tested
5
| Model | Size | Score | tok/s | TTFT | Verdict |
|---|---|---|---|---|---|
| qwen3.5-35b-a3b-t48-c8k:latest | 36.0B Q4_K_M | 81 | 17.2 | 845 ms | Not Rec. |
| qwen3.5-35b-a3b-t48-c8k:latest | 36.0B Q4_K_M | 78 | 7.1 | 997 ms | Not Rec. |
| qwen3-next:80b-a3b-instruct-q4_K_M | 79.7B Q4_K_M | 74 | 3.9 | 2.1s | Not Rec. |
| qwen3-235b-a22b-t48-c8k:latest | 235.1B Q4_K_M | 65 | 2.4 | 5.8s | Not Rec. |
| qwen3-235b-a22b-t48-c8k:latest | 235.1B Q4_K_M | 61 | 1.7 | 3.4s | Not Rec. |