yi-coder-1.5b-chat

LM-STUDIO GGUF

llama · 1.5B · Q4_K_M

Marginal

Mar 7, 2026 · Intel Core™ i5-5300U

gemma-3-27b-it-qat

LM-STUDIO MLX

gemma3 · 27B · 4bit

Good

Mar 5, 2026 · Apple M4 Pro

Global Score

45 vs 76

Hardware Fit

67 vs 51

Quality Score

35 vs 87

Hardware

yi-coder-1.5b-chat gemma-3-27b-it-qat

MachineLENOVO 20BUS00700Mac mini

CPUIntel Core™ i5-5300UApple M4 Pro

Cores414

RAM16 GB64 GB

GPUIntel(R) HD Graphics 5500Apple M4 Pro

OSMicrosoft Windows 10 Professionnel 10.0.19045macOS 15.7.4

Archx64arm64

Power Modebalancedbalanced

Performance

yi-coder-1.5b-chat gemma-3-27b-it-qat

Tokens/sec7.78.9

First chunk2668 ms3976 ms

TTFT2.7 s4.0 s

Load timeN/AN/A

Memory usage0.9 GB15.7 GB

Memory %6%25%

HW Fit Score Breakdown

yi-coder-1.5b-chat

Speed

26/50

TTFT

17/20

Memory

24/30

gemma-3-27b-it-qat

Speed

12/50

TTFT

9/20

Memory

30/30

Quality

yi-coder-1.5b-chat

Reasoning

4/20

Coding

12/20

Instruction

6/20

Structured

6/15

Math

1/15

Multilingual

6/10

Reasoning: Poor Coding: Adequate Instruction Following: Weak Structured Output: Weak Math: Poor Multilingual: Adequate

gemma-3-27b-it-qat

Reasoning

16/20

Coding

18/20

Instruction

17/20

Structured

15/15

Math

11/15

Multilingual

10/10

Reasoning: Strong Coding: Strong Instruction Following: Strong Structured Output: Strong Math: Adequate Multilingual: Strong

View yi-coder-1.5b-chat details | View gemma-3-27b-it-qat details

Run yours and compare

$ npm install -g metrillm@latest

$ metrillm

Requires Node 20+ and Ollama or LM Studio running

Or run without installing: npx metrillm@latest