Intel Gen Intel® Core™ i9-11900H
Docker Container
15 GB RAM · 24 models tested
Avg Score
78 /100
Avg Speed
10.4 tok/s
Models Tested
24
| Model | Size | Score | tok/s | TTFT | Verdict |
|---|---|---|---|---|---|
| unsloth/gemma-4-26b-a4b-it-qat | 26B Q4_K_XL | 85 | 11.9 | 3.3s | Excellent |
| gemma-4-26b-a4b-it@iq3_xxs | 26B IQ3_XXS | 83 | 10.3 | 3.5s | Excellent |
| unsloth/gemma-4-26b-a4b-it@q4_k_m | 26B Q4_K_M | 83 | 9.4 | 4.1s | Excellent |
| google/gemma-4-26b-a4b-it-qat | 26B Q4_0 | 82 | 12.0 | 2.8s | Excellent |
| gemma-4-e2b-it-qat | Q4_K_XL | 81 | 22.2 | 1.1s | Excellent |
| lmstudio-community/gemma-4-26b-a4b-it | 26B Q4_K_M | 81 | 9.9 | 4.4s | Excellent |
| qwen3.5-35b-a3b | 35B IQ3_XXS | 80 | 10.6 | 3.2s | Excellent |
| unsloth/gemma-4-e4b-it@q4_k_m | Q4_K_M | 79 | 10.8 | 2.0s | Good |
| unsloth/gemma-4-e4b-it-qat | Q4_K_XL | 79 | 12.1 | 2.1s | Good |
| gemma-4-e2b-it@q5_k_xl | Q5_K_XL | 79 | 17.2 | 1.6s | Good |
| qwen3.6-35b-a3b | 35B IQ3_XXS | 79 | 9.3 | 3.6s | Good |
| google/gemma-4-e4b-it-qat | Q4_0 | 78 | 11.4 | 2.2s | Good |
| gemma-4-e4b-it@q5_k_xl | Q5_K_XL | 77 | 9.3 | 3.4s | Good |
| lmstudio-community/gemma-4-e2b-it | Q8_0 | 77 | 13.3 | 1.4s | Good |
| qwen3.6-35b-a3b-mtp | 35B IQ3_XXS | 77 | 9.2 | 4.7s | Good |
| lmstudio-community/gemma-4-e4b-it-qat | Q4_0 | 77 | 11.4 | 2.2s | Good |
| qwen3.5-35b-a3b-mtp | 35B IQ3_XXS | 77 | 7.8 | 5.6s | Good |
| lmstudio-community/gemma-4-e4b-it | Q4_K_M | 76 | 10.8 | 2.0s | Good |
| unsloth/gemma-4-12b-it-qat | 12B Q4_K_XL | 75 | 6.0 | 5.1s | Good |
| lmstudio-community/gemma-4-12b-it-qat | 12B Q4_0 | 75 | 5.8 | 5.3s | Good |
| unsloth/gemma-4-e2b-it@q8_0 | Q8_0 | 75 | 13.0 | 1.5s | Good |
| google/gemma-4-12b-it-qat | 12B Q4_0 | 74 | 5.0 | 5.5s | Good |
| unsloth/qwen3.5-9b@q4_k_m | 9B Q4_K_M | 73 | 6.5 | 4.1s | Good |
| qwen3.5-9b@q5_k_xl | 9B Q5_K_XL | 73 | 5.6 | 5.6s | Good |