ConceptBatch Invariance
Batch Invariance
An inference consistency technique that, by fixing the computation graph and reduction order, makes the output for a single request independent of the batch it belongs to, ensuring reproducible results.
Timeline (last 90 days)
Oct 23
DeepSeek-Infer has batch invariance, ensuring that the model's result for the same request remains consistent no matter which batch it is computed in.
Unverified50%