[KongchangAI]
ModelLIA / Laya

Laya AI

A non-autoregressive model specialized for decision-making, built on a BERT/M-BERT backbone that discriminatively scores candidate answers. A single forward pass outputs a decision with calibrated probabilities at a latency of approximately 35 milliseconds, with a model size of approximately 850 MB.

Timeline (last 90 days)

Oct 25

Laya AI is a non-autoregressive decision model that outputs answers with calibrated probabilities in a single forward pass, taking about 35 milliseconds.

Unverified50%
Oct 25

Laya AI's model file (saved tensors) is about 850MB.

Unverified50%
Oct 25

Laya AI can run on both CPU and GPU, and running on a 20-core CPU uses only about 30% of the CPU.

Unverified50%
Oct 25

Laya AI uses a BERT/M-BERT backbone network to score candidate answers discriminatively, rather than generating text token by token.

Unverified50%
Oct 25

Laya is installed by installing the library via pip, and on first run it automatically downloads the model from Hugging Face.

Unverified50%
Oct 25

Laya supports discrete multiple-choice tasks, where the caller dynamically provides candidate labels at runtime, and the model scores each candidate independently and normalizes the scores into a probability distribution.

Unverified50%
Oct 25

In the customer service ticket routing example, given a duplicate-charge complaint text, Laya outputs that it should be routed to the billing department, along with the probability and the language being English.

Expired50%
Oct 25

Laya's base checkpoint can be fine-tuned on custom domain data, and the fine-tuning data only needs "state-question-correct option" triples, without generative target text.

Unverified50%
Oct 25

Laya excels at closed-ended questions (quickly scoring given a state and options) and is not suitable for open-ended generation, multi-turn dialogue, or complex reasoning.

Unverified50%
Oct 25

Laya can complement traditional LLMs: the LLM handles understanding and generation, while Laya handles low-latency deterministic decisions.

Unverified50%

All Facts (9)

Source Articles