1bit engine
One engine behind an OpenAI-compatible API, running inside Lemonade: the XDNA 2 NPU, HRX and Vulkan on the Radeon iGPU, ZINC for NVIDIA and Apple GPUs, MLX on Apple Silicon.
latest · 2026-09-241bit.MONSTER is now 1bit engine. 1bit.MONSTER grew fast: an inference engine, a model zoo, benchmarks, a store, a voice assistant and a lot of experiments, all in one repository with all of its history. The engine that came out of it is now its own project, 1bit engine, and this site is its…read the post →What the engine is, what runs where, and who it is built on.
engineDocs →Every device, every component, and how to run them.
docsBlog →The build log: what moved over, what got faster, what broke.
blogBenchmarks →Measured, not projected. Every number with how it was taken.
wiki1bit serve →The engine runs inside Lemonade: Lemonade runs 1bit serve as a backend, the way it runs llama-server. 1bit serve…
serveLemonade →The 1bit engine runs inside Lemonade. Lemonade is the server users talk to, with its own catalog, downloads, router and…
lemonadeNPU →The fast lane runs one whole-layer kernel per decoder layer, plus an lm-head kernel. For each token, the host submits…
npuHRX + Vulkan →One llama.cpp build with two GPU backends, ggml-hrx (AMD's HRX runtime) and ggml-vulkan. Its single llama-server…
hrxVulkan (upstream) →1bit serve --device vulkan runs a llama-server built from upstream llama.cpp (MIT), pinned to its latest release in…
vulkanLean (ROCmFP4, ROCmI4) →1bit serve --lean trades accuracy for speed. It runs models in the AMD-focused formats of ROCmFPX (MIT), a llama.cpp…
leanZINC →ZINC (MIT) is a single-binary GGUF engine written in Zig. It has its own kernels for four GPU backends, and serves…
zincApple Silicon →On macOS, 1bit serve --device mlx serves MLX models. The executor is the server binary of lemon-mlx-engine (fork…
appleLaya router →Step 4 of the port (docs/PORTING.md): Laya picks where each request runs. Laya (Apache-2.0) is a non-autoregressive…
layaTokenizers →The engine reads any model's tokenizer.json through Hugging Face tokenizers, the Rust library behind the tokenizers npm…
tokenizersLinux kernel →The engine's NPU driver (amdxdna) and GPU driver (amdgpu) come from the kernel, so the kernel is pinned like every…
kernelPorting map →This repository is the working 1bit-MONSTER engine, ported without its history. Each step below is one PR (or a short…
PORTING