ModelDeep Equilibrium Model / 深度均衡模型

DEQ

Deep Equilibrium Model, a deep learning architecture that achieves the equivalent of infinite-depth networks by solving for fixed points. It is an important precursor to looped language models.

Timeline (last 90 days)

Oct 9

The architectural inspiration for Looped Language Models comes from earlier works such as the Universal Transformer and DEQ (Deep Equilibrium Model).

Unverified50%

All Facts (1)

Unverified

The architectural inspiration for Looped Language Models comes from earlier works such as the Universal Transformer and DEQ (Deep Equilibrium Model).

50%

Source Articles

LoopOPD: Enabling Looped Language Models to Self-Distill for Recursive Self-ImprovementOct 9