[KongchangAI]
Concept

DARE

A model merging method that reduces parameter conflicts during merging by randomly dropping a portion of parameter increments and rescaling.

Timeline (last 90 days)

Nov 5

Conflict-resolution merging methods (such as TIES-Merging, DARE, etc.) aim to resolve parameter conflicts when merging multiple fine-tuned models.

Unverified50%
Oct 7

DARE (Drop And REscale) reduces parameter interference during multi-task vector superposition through random sparsification.

Unverified50%

All Facts (2)

Source Articles