Conceptintermediate layer sampling
Intermediate Layer Sampling
A technique for extracting embedding representations from intermediate layers of a Transformer rather than the final layer, skipping subsequent layer computation and thereby reducing computational load and shortening inference time.
Timeline (last 90 days)
Nov 5
Sampling embeddings from intermediate layers of the Transformer can significantly shorten end-to-end evaluation time.
Unverified50%