[KongchangAI]
ModelHuginn-3.5B

Huginn-3.5B

A looped Transformer model with 3.5B parameters that improves parameter efficiency by repeatedly applying the same layers.

Timeline (last 90 days)

Nov 17

On seven benchmarks, LoopFill achieves an average speedup of 5.13x over greedy autoregressive decoding on Huginn-3.5B.

Unverified50%
Nov 17

LoopFill achieves a 25% speedup over the strongest baseline LoopAhead on Huginn-3.5B.

Unverified50%

All Facts (2)

Source Articles