llama-3.1-8b-instruct

llama · 8B · Q8_0

ASUS (AMD Ryzen 5 5500)

31 GB · Nobara Linux 43

Tested on April 26, 2026 · Submitted by MingDaMong

Top 24% Compare

Global Score

81 /100

Excellent

Hardware Fit

100/100

Quality

73/100

Get this model

Get it in LM Studio

Search and download models directly from the app

🤗

Find on HuggingFace

MLX versions & conversions

Hardware

Machine: ASUS
CPU: AMD Ryzen 5 5500
Cores: 12 threads (6 cores)
Frequency: 3.82 GHz
RAM: 31 GB
GPU: Navi 44 [Radeon RX 9060 XT]
OS: Nobara Linux 43
Arch: x64
Power Mode: performance

Performance

Tokens/sec Tokens generated per second — higher is better: 35.6
Standard deviation Variation of speed across benchmark runs — lower means more consistent: ±0.1
First chunk latency Delay before the first streamed chunk arrives from runtime: 52 ms
Time to first token How fast the model starts responding — lower is better: 256 ms
Load time Time to load the model into memory before inference: N/A
Memory usage RAM consumed during inference — percentage of total system memory: 8.6 GB (28%)
Total tokens Total number of tokens generated across all benchmark prompts: 1310

Score breakdown

Speed

50/50

Time to first token

20/20

Memory

30/30

Quality

Reasoning

13/20

Coding

17/20

Instruction following

13/20

Structured output

15/15

Math

5/15

Multilingual

10/10

Category levels

Reasoning: Adequate Coding: Strong Instruction Following: Adequate Structured Output: Strong Math: Weak Multilingual: Strong

Metadata

Spec version: 0.2.1
Runtime: LM Studio 0.4.12+1
Model format: GGUF
Hardware profile: BALANCED
Result hash: bdf9dce5cf325dd9cf993609a88f84d6c87742e3a8cbad5ef74ade8fd28db7a8

Interpretation

Hardware fit: 100/100. Overall suitability: EXCELLENT (Global 81/100). Category profile: Reasoning: Adequate, Coding: Strong, Instruction Following: Adequate, Structured Output: Strong, Math: Weak, Multilingual: Strong.

Warnings

Model memory footprint is estimated via LM Studio CLI rather than measured from a fresh load.

Bench Environment

Thermal: nominal CPU load: avg 10% (peak 14%)

Run yours now

$ npm install -g metrillm@latest

$ metrillm

Requires Node 20+ and Ollama or LM Studio running

Or run without installing: npx metrillm@latest