[KongchangAI]
ConceptΔH / Delta-H

Delta-H Output

An expert importance metric in the MAEP framework that evaluates an expert's actual effect on model behavior by measuring the change in the MoE layer output after removing that expert, accounting for token reassignment effects.

Timeline (last 90 days)

Nov 5

MAEP contains two core components: Delta-H Output (measuring the magnitude of change in the MoE layer's output after removing an expert) and low-attention visual tokens as the visual-side pruning signal.

Unverified50%

All Facts (1)

Source Articles