vanilj/palmyra-fin-70b-32k:IQ2_XXS
OLLAMA GGUFllama · 70.6B · IQ2_XXS
Aug 5, 2026 · AMD RYZEN AI MAX+ 395
qwen3.5-35b-a3b-t48-c8k:latest
OLLAMA GGUFqwen35moe · 36.0B · Q4_K_M
Sep 6, 2026 · Intel Xeon® E5-4650 v2
Global Score
45 vs 81
Hardware Fit
54 vs 63
Quality Score
41 vs 88
Hardware
vanilj/palmyra-fin… qwen3.5-35b-a3b-t4…
MachineAZW GTR ProDell Inc. PowerEdge R820
CPUAMD RYZEN AI MAX+ 395Intel Xeon® E5-4650 v2
Cores3280
RAM125 GB256 GB
GPURadeon 8060SMicrosoft Remote Display Adapter, NVIDIA Tesla P4, NVIDIA Tesla P4, Microsoft Basic Display Adapter
OSUbuntu 24.04.4 LTSMicrosoft Windows Server 2022 Datacenter 10.0.20348
Archx64x64
Power Modelow-powerbalanced
Performance
vanilj/palmyra-fin… qwen3.5-35b-a3b-t4…
Tokens/sec6.817.2
First chunk692 ms845 ms
TTFT692 ms845 ms
Load time0.2 s103.1 s
Memory usage27.9 GB21.9 GB
Memory %22%9%
HW Fit Score Breakdown
vanilj/palmyra-fin-70b-…
Speed
6/50
TTFT
18/20
Memory
30/30
qwen3.5-35b-a3b-t48-c8k…
Speed
16/50
TTFT
17/20
Memory
30/30
Quality
vanilj/palmyra-fin-70b-…
Reasoning
7/20
Coding
2/20
Instruction
14/20
Structured
11/15
Math
0/15
Multilingual
7/10
Reasoning: Weak Coding: Poor Instruction Following: Adequate Structured Output: Adequate Math: Poor Multilingual: Adequate
qwen3.5-35b-a3b-t48-c8k…
Reasoning
17/20
Coding
18/20
Instruction
16/20
Structured
15/15
Math
12/15
Multilingual
10/10
Reasoning: Strong Coding: Strong Instruction Following: Strong Structured Output: Strong Math: Strong Multilingual: Strong
Run yours and compare
$
npm install -g metrillm@latest$
metrillmRequires Node 20+ and Ollama or LM Studio running
Or run without installing: npx metrillm@latest