Classification Head
The final linear layer in a neural network used for classification tasks. Its weight matrix has the shape [hidden_size × num_classes], and its output dimension is strictly equal to the number of classes, making it non-trivially extensible once the dimension is fixed.
Core Facts
Timeline (last 90 days)
The output of a judgment-type decision model is a closed, structured result, which is essentially a classification or regression task involving a single forward pass, with no autoregressive iteration overhead.
A classification head is typically a simple fully connected layer with Softmax activation that maps a high-dimensional feature vector to a probability distribution over each category.
In a hybrid architecture, only the lightweight classification head needs to run at inference time without calling the full large model each time, thereby reducing latency and cost.
All Facts (3)
The output of a judgment-type decision model is a closed, structured result, which is essentially a classification or regression task involving a single forward pass, with no autoregressive iteration overhead.
65%UnverifiedA classification head is typically a simple fully connected layer with Softmax activation that maps a high-dimensional feature vector to a probability distribution over each category.
50%UnverifiedIn a hybrid architecture, only the lightweight classification head needs to run at inference time without calling the full large model each time, thereby reducing latency and cost.
50%