ConceptSelf-Instruct方法
Self-Instruct
A training method that uses an existing language model to automatically generate instruction-following data. The model generates task descriptions and corresponding responses to expand training datasets without requiring extensive manual annotation. It is an important technical paradigm in synthetic data generation.
Timeline (last 90 days)
Sep 17
Typical examples of synthetic data methods include Meta's Self-Instruct, DeepMind's AlphaCode training pipeline, and the RLHF data augmentation mentioned in OpenAI's GPT-4 technical report
Unverified50%
Aug 25
典型的合成数据技术包括 Self-Instruct、Evol-Instruct 以及基于种子数据的扩写和改写
Unverified50%