ConceptHe 初始化
Kaiming Initialization
A weight initialization method designed for ReLU and its variants. It sets weight variance proportional to twice the reciprocal of the input dimension, compensating for the halving of variance at each layer caused by the zeroed lower half of the ReLU function.