ModernBERT-large
A large encoder model in the ModernBERT series with approximately 421M parameters, suited to efficient text representation.
Timeline (last 90 days)
Laya uses the Apache 2.0 license, is fully self-hostable (laya-serve), and also has a free Demo Space; it consists of ModernBERT-large 421M and mmBERT-base 322M encoders and can run on a T4 or even a CPU, with CPU latency of 193–464ms.
Laya pairs a bidirectional ModernBERT-large encoder with a Transformer head trained from scratch that scores [MASK] option tokens.
All Facts (2)
Laya pairs a bidirectional ModernBERT-large encoder with a Transformer head trained from scratch that scores [MASK] option tokens.
60%UnverifiedLaya uses the Apache 2.0 license, is fully self-hostable (laya-serve), and also has a free Demo Space; it consists of ModernBERT-large 421M and mmBERT-base 322M encoders and can run on a T4 or even a CPU, with CPU latency of 193–464ms.
50%