[KongchangAI]
ModelQNPUTER

QNPUTER

A hybrid model that compiles a 32-bit RISC-V CPU into large model weights, adding 11 layers before Qwen's original 32 layers to achieve exact computation.

Timeline (last 90 days)

Oct 31

Developer DVN is Agro compiled an entire 32-bit CPU into the model weights of Qwen 3.5; the CPU was not trained, and the weights were directly computed by a compiler and filled in.

Unverified50%
Oct 31

The Qwen 3.5 model with the compiled-in CPU got 39 of the same 40 multi-digit multiplication problems correct.

Unverified50%
Oct 31

QNPUTER is a 32-bit RISC-V CPU placed in front of Qwen's original 32 layers, making the whole model 43 layers; the original Qwen weights are unchanged, the 11 new layers have about 1.04 million non-zero weights, while Qwen itself has about 4.1 billion parameters.

Unverified50%
Oct 31

QNPUTER passes the official RISC-V test suite, and the author used 61 programs to confirm that its output is completely consistent with the reference machine and the QEMU emulator, with every token aligned with the reference machine.

Unverified50%
Oct 31

The 11 layers newly added by QNPUTER, taken on their own, can run a stripped-down version of Python.

Unverified50%
Oct 31

In a comparison on 40 large-number multiplication problems, the original Qwen 3.5 got 22 right, the version equipped with QNPUTER got 39 right, and the one connected to real Python got 40 right; the results returned by QNPUTER were all correct, and the errors originated in Qwen itself, such as dropping signs when copying answers or calling 44 times repeatedly without finishing.

Unverified50%
Oct 31

With the QNPUTER approach, on an NVIDIA L4 GPU a single calculator call takes half a second to one second using a dedicated acceleration program; if only ordinary model code is used, it is more than ten times slower.

Unverified50%
Oct 31

With QNPUTER, the model file goes from 9.3GB to 18.8GB, and most of the increase is padding zeros.

Unverified50%
Oct 31

The author released an experimental version: running a small language model with 260,000 parameters as a C program on QNPUTER, with the weights loaded into CPU memory as data, takes about 41 seconds to generate each token.

Unverified50%
Oct 31

Developer Drew Brionig used QNPUTER's compiler to compile the NES processor into a model with the same structure and ran NES games.

Unverified50%

All Facts (10)

Unverified

Developer DVN is Agro compiled an entire 32-bit CPU into the model weights of Qwen 3.5; the CPU was not trained, and the weights were directly computed by a compiler and filled in.

50%
Unverified

The Qwen 3.5 model with the compiled-in CPU got 39 of the same 40 multi-digit multiplication problems correct.

50%
Unverified

QNPUTER is a 32-bit RISC-V CPU placed in front of Qwen's original 32 layers, making the whole model 43 layers; the original Qwen weights are unchanged, the 11 new layers have about 1.04 million non-zero weights, while Qwen itself has about 4.1 billion parameters.

50%
Unverified

QNPUTER passes the official RISC-V test suite, and the author used 61 programs to confirm that its output is completely consistent with the reference machine and the QEMU emulator, with every token aligned with the reference machine.

50%
Unverified

The 11 layers newly added by QNPUTER, taken on their own, can run a stripped-down version of Python.

50%
Unverified

In a comparison on 40 large-number multiplication problems, the original Qwen 3.5 got 22 right, the version equipped with QNPUTER got 39 right, and the one connected to real Python got 40 right; the results returned by QNPUTER were all correct, and the errors originated in Qwen itself, such as dropping signs when copying answers or calling 44 times repeatedly without finishing.

50%
Unverified

With the QNPUTER approach, on an NVIDIA L4 GPU a single calculator call takes half a second to one second using a dedicated acceleration program; if only ordinary model code is used, it is more than ten times slower.

50%
Unverified

With QNPUTER, the model file goes from 9.3GB to 18.8GB, and most of the increase is padding zeros.

50%
Unverified

The author released an experimental version: running a small language model with 260,000 parameters as a C program on QNPUTER, with the weights loaded into CPU memory as data, takes about 41 seconds to generate each token.

50%
Unverified

Developer Drew Brionig used QNPUTER's compiler to compile the NES processor into a model with the same structure and ran NES games.

50%

Source Articles