ConceptRepresentation Analysis
Representation Analysis
A technique in the field of AI safety that inspects a model's internal neuron activation patterns, attention distributions, or hidden-layer representations to determine whether the model has understood certain dangerous concepts, even when the model does not express them in its outputs.
Timeline (last 90 days)
Oct 13
Representation analysis determines whether a model understands certain dangerous concepts by examining the activation patterns of internal neurons, attention distributions, or hidden-layer representations.
Unverified50%