Unverified50% confidenceFactExact time

Branch pruning performs backpropagation only on the sampled preference branch, restricting gradient computation to a single branch.

1

Sources

50%

Confidence

Long-term

Relevance

10/22/2026

First Seen

Sources

Random Pruning of the DPO Computation Graph: 1.4x Training Speedup and Lower Peak Memory

Related Entities

branch pruningconcept

Related Claims

Unverifiedclipnorm constrains the L2 norm of the overall gradient vector while preserving the relative proportions of individual parameter gradients, whereas clipvalue independently truncates the gradient value of each parameter and may alter the gradient direction.71% similar

Cite This Claim

Stable URI

https://kongchang.com/claim/1084416

API

curl https://kongchang.com/api/v1/knowledge/claims/1084416

MCP

get_claim(id=1084416)