Models measured on a Ryzen AI MAX+ 395#
The models the engine is checked against, with the number each one measured on the Strix Halo box at the current pins. One row is one model file on one route; the standard each number was taken in is in How we measure, and the routes are described in HRX and NPU engine. Every ggml weight type runs on HRX, including NVFP4, Q2_0, MXFP4 and the ternary TQ, PTQ and PQ formats.
| model | file, route | measured |
|---|---|---|
| Qwen3.8-27B | UD-Q4_K_XL, HRX | decode 36.0 tok/s with MTP on code prompts; 56.6 tok/s with the DFlash2 drafter (post) |
| Qwen3.8-Flash-Next (MoE) | HRX | prefill 287 tok/s, decode 24.0 tok/s |
| Zyphra ZAYA1-8B | Q4_K_M, HRX | decode 157 tok/s |
| PrismML Ternary-Bonsai-2-27B | PQ2_0, 6.7 GiB, HRX | decode 43.3 tok/s with MTP (NPU post) |
| Microsoft BitNet b1.58 2B-4T | TQ2_0 ternary GGUF (TQ1_0 runs too), 1.11 GiB, 2.06 bits per weight, HRX | end to end on the Radeon 8060S, no CPU fallback; decode tg128 123.4 tok/s after the TQ2_0 load-time repack onto the packed-ternary decode kernel (101.6 before it, same binary); perplexity 102.42 on HRX vs 102.56 on the CPU, same file (post) |
| Qwen3-0.6B | NPU route | decode 88.6 tok/s in the release gate |
| gpt-oss-20b | MXFP4, HRX | runs on HRX |
The numbers move with the pins; a row changes when its measurement is retaken. The Lemonade
release the engine runs inside is the weekly pin in third_party/lemonade (Lemonade).
Our own models on Hugging Face#
Some of these files are ours, published under the 1bit-MONSTER organization:
huggingface.co/1bit-MONSTER. It carries re-hosted quantizations of
upstream models, our own NPU packs, and the prebuilt kernels a pack needs beside it — ZR1-1.5B-GGUF, for
one, holds its Q8 container's kernels in npu-container-q8/npu/. The model repositories are public: a
download needs no account, no token, and no request to us. (The appliance image is separate: it is a
release artifact and is not published yet — Releases.)
The organization is a catalogue, not an endorsement list. It holds more repositories than this page has measurements for, and publishing a file is not a claim that it runs well here. The rows above are that claim; the org is where the bytes come from.