Conceptactivation probe / 监控探针
Activation Probe
A lightweight linear classifier attached to the hidden states of a specific layer in a large language model, used to monitor the model's internal states in real time. It maps high-dimensional activation vectors to labels and is commonly applied in AI safety monitoring scenarios.
Timeline (last 90 days)
Oct 13
Activation probes are a class of lightweight monitoring tools, usually a small classifier or transformer, trained to read the internal activation vectors of one or several layers during large model inference, thereby determining whether the model is currently invoking a certain type of specific knowledge or is in a certain intentional state.
Unverified50%