vanilj/palmyra-fin-70b-32k:IQ2_XXS
llama · 70.6B · IQ2_XXS
1 benchmark across different hardware
Avg Score
45 /100
45–45
Avg Speed
6.8 tok/s
6.8–6.8
Avg TTFT
692 ms
Benchmarks
1
| Hardware | RAM | Score | tok/s | TTFT | Verdict |
|---|---|---|---|---|---|
| AMD RYZEN AI MAX+ 395 (AZW GTR Pro) | 125 GB | 45 | 6.8 | 692 ms | Not Rec. |