Compared with the dense LoRA baseline, the sparse circuits produced by TopKLoRA are up to an order of magnitude smaller.