Contextual Hidden State

The dense vector representation output by each layer of the target model when processing an input sequence, incorporating preceding context. It encodes the model's understanding of the current context and can be reused by a draft model for short-range prediction.