[KongchangAI]
Concept

GRADMM

A gradient-based synthetic data generation method for LLM fine-tuning that generates training data by reconstructing source text or pursuing linguistic fluency. It serves as a comparison baseline for the DASA method.

Timeline (last 90 days)

Sep 30

DASA outperforms the baseline method GRADMM in most comparisons.

Unverified50%
Sep 30

Under the synthetic settings evaluated, DASA provides a 3.6 to 4.9× speedup compared to GRADMM, with comparable peak GPU memory usage.

Unverified50%
Sep 30

The comparison baseline GRADMM tends to attempt to reconstruct the source text or pursue linguistic fluency.

Unverified50%

All Facts (3)

Source Articles