[KongchangAI]
ConceptNeuron Splitting

Neuron Splitting

A network structure expansion method that duplicates a neuron with high representation flux into two child neurons, approximately preserving the original network function by means such as halving the outgoing edge weights.

Timeline (last 90 days)

Oct 27

When a neuron splits, having the two child neurons each inherit half of the parent neuron's output weights (e.g., outgoing edge weights multiplied by 0.5) and keeping their parameters identical at the initial moment preserves the network function unchanged at the instant of splitting.

Unverified50%

All Facts (1)

Source Articles