vanilj/palmyra-fin-70b-32k:IQ2_XXS

OLLAMA GGUF

llama · 70.6B · IQ2_XXS

Not Rec.

Aug 5, 2026 · AMD RYZEN AI MAX+ 395

qwen3-235b-a22b-t48-c8k:latest

OLLAMA GGUF

qwen3moe · 235.1B · Q4_K_M

Not Rec.

Sep 7, 2026 · Intel Xeon® E5-4650 v2

Global Score

45 vs 65

Hardware Fit

54 vs 29

Quality Score

41 vs 81

Hardware

vanilj/palmyra-fin… qwen3-235b-a22b-t4…

MachineAZW GTR ProDell Inc. PowerEdge R820

CPUAMD RYZEN AI MAX+ 395Intel Xeon® E5-4650 v2

Cores3280

RAM125 GB256 GB

GPURadeon 8060SMicrosoft Remote Display Adapter, NVIDIA Tesla P4, NVIDIA Tesla P4, Microsoft Basic Display Adapter

OSUbuntu 24.04.4 LTSMicrosoft Windows Server 2022 Datacenter 10.0.20348

Archx64x64

Power Modelow-powerbalanced

Performance

vanilj/palmyra-fin… qwen3-235b-a22b-t4…

Tokens/sec6.82.4

First chunk692 ms5833 ms

TTFT692 ms5.8 s

Load time0.2 s0.0 s

Memory usage27.9 GB135.1 GB

Memory %22%53%

HW Fit Score Breakdown

vanilj/palmyra-fin-70b-…

Speed

6/50

TTFT

18/20

Memory

30/30

qwen3-235b-a22b-t48-c8k…

Speed

2/50

TTFT

3/20

Memory

24/30

Quality

vanilj/palmyra-fin-70b-…

Reasoning

7/20

Coding

2/20

Instruction

14/20

Structured

11/15

Math

0/15

Multilingual

7/10

Reasoning: Weak Coding: Poor Instruction Following: Adequate Structured Output: Adequate Math: Poor Multilingual: Adequate

qwen3-235b-a22b-t48-c8k…

Reasoning

19/20

Coding

15/20

Instruction

10/20

Structured

14/15

Math

13/15

Multilingual

10/10

Reasoning: Strong Coding: Adequate Instruction Following: Adequate Structured Output: Strong Math: Strong Multilingual: Strong

View vanilj/palmyra-fin… details | View qwen3-235b-a22b-t4… details

Run yours and compare

$ npm install -g metrillm@latest

$ metrillm

Requires Node 20+ and Ollama or LM Studio running

Or run without installing: npx metrillm@latest