[KongchangAI]
ConceptNgram 表

N-gram Table

A lookup structure that records common contiguous word fragments in text and their subsequent continuations, used in speculative decoding to quickly propose candidate tokens and increase the hit rate.

Timeline (last 90 days)

Nov 4

The Kunon 3.8 FlashNext model comes with an Ngram table of about 51B parameters.

Unverified50%
Nov 4

Strata maps the Ngram table onto NVMe SSDs and reads it on demand, rather than keeping it resident in memory or VRAM.

Unverified50%
Nov 4

The random read performance (IOPS and latency) of the Ngram table on NVMe directly affects first-token latency, not sequential bandwidth or capacity.

Unverified50%

All Facts (3)

Source Articles