Short-Range Pretraining Trial
A low-cost proxy evaluation strategy that obtains rough representations after a small number of training steps and evaluates downstream performance, used to rank candidate configurations. It is commonly used in neural architecture search and meta-learning.
Timeline (last 90 days)
TAPES evaluates the downstream utility of candidate target sets through short-range joint pretraining trials, rather than using target predictability as the selection criterion.
The effectiveness of short-range pretraining trials relies on an empirical assumption: the relative merits of short-range training are highly correlated with those of full training.
All Facts (2)
TAPES evaluates the downstream utility of candidate target sets through short-range joint pretraining trials, rather than using target predictability as the selection criterion.
50%UnverifiedThe effectiveness of short-range pretraining trials relies on an empirical assumption: the relative merits of short-range training are highly correlated with those of full training.
50%