hf.co/bartowski/ai9stars_G9v3-3B-GGUF:BF16
llama · 2.99B · BF16
4 benchmarks across different hardware
Avg Score
67 /100
64–76
Avg Speed
29.8 tok/s
29.6–29.9
Avg TTFT
144 ms
Benchmarks
4
| Hardware | RAM | Score | tok/s | TTFT | Verdict |
|---|---|---|---|---|---|
| Apple M1 Pro (MacBook Pro) | 16 GB | 76 | 29.9 | 105 ms | Good |
| Apple M1 Pro (MacBook Pro) | 16 GB | 65 | 29.6 | 264 ms | Good |
| Apple M1 Pro (MacBook Pro) | 16 GB | 64 | 29.9 | 100 ms | Good |
| Apple M1 Pro (MacBook Pro) | 16 GB | 64 | 29.9 | 108 ms | Good |