LLaMA-Factory
An open-source fine-tuning framework for large language models that supports efficient fine-tuning of various mainstream LLMs. It provides a unified and user-friendly training interface designed to streamline the model fine-tuning process.
Timeline (last 90 days)
MiniCPM-V 4.7 is compatible with the SGLang, vLLM, llama.cpp, and Ollama inference frameworks, and supports the SWIFT and LLaMA-Factory fine-tuning frameworks.
Axolotl simplifies the reproduction cost of fine-tuning experiments through a configuration-driven approach, while LLaMA-Factory provides a one-stop solution aimed at domestic users.
Common data format specifications include the Alpaca format and the ShareGPT format, both of which are supported for automatic parsing by mainstream training frameworks such as LLaMA-Factory and Axolotl.
LayerSmith recently added a set of image configurations targeting large model training and fine-tuning, covering LoRA/QLoRA, advanced PyTorch training, and LLaMA-Factory.
LLaMA-Factory is a training framework that integrates multiple PEFT methods and supports the complete pipeline from data preprocessing to export.
LLaMA-Factory is one of the most mainstream open-source large model fine-tuning frameworks, supporting supervised fine-tuning (SFT) and reinforcement learning from human feedback (RLHF) and other fine-tuning methods for dozens of mainstream open-source models including LLaMA, Qwen, and ChatGLM.
LLaMA-Factory provides a visual Web UI, enabling users to complete fine-tuning tasks without a deep understanding of the underlying algorithms.
Xingchen 4.0 29B is compatible with fine-tuning tools such as MindFormers and LLaMA-Factory, as well as inference frameworks such as SGLang and vLLM.
Unsloth's differentiated positioning is as an acceleration layer embedded within the existing Hugging Face ecosystem, where users need only replace a few lines of code to gain speed and memory benefits, and it is compatible with rather than competing against tools such as Axolotl and LLaMA-Factory.
对于生产环境部署建议选择经过社区充分验证的稳定版本，学习实验则可追新以接触最前沿的技术实现
All Facts (11)
LLaMA-Factory和Unsloth是社区中成熟的LoRA微调和SFT工具
90%UnverifiedMiniCPM-V 4.7 is compatible with the SGLang, vLLM, llama.cpp, and Ollama inference frameworks, and supports the SWIFT and LLaMA-Factory fine-tuning frameworks.
50%UnverifiedAxolotl simplifies the reproduction cost of fine-tuning experiments through a configuration-driven approach, while LLaMA-Factory provides a one-stop solution aimed at domestic users.
50%UnverifiedCommon data format specifications include the Alpaca format and the ShareGPT format, both of which are supported for automatic parsing by mainstream training frameworks such as LLaMA-Factory and Axolotl.
50%UnverifiedLLaMA-Factory is a training framework that integrates multiple PEFT methods and supports the complete pipeline from data preprocessing to export.
50%UnverifiedLLaMA-Factory provides a visual Web UI, enabling users to complete fine-tuning tasks without a deep understanding of the underlying algorithms.
50%UnverifiedLLaMA-Factory is one of the most mainstream open-source large model fine-tuning frameworks, supporting supervised fine-tuning (SFT) and reinforcement learning from human feedback (RLHF) and other fine-tuning methods for dozens of mainstream open-source models including LLaMA, Qwen, and ChatGLM.
50%UnverifiedXingchen 4.0 29B is compatible with fine-tuning tools such as MindFormers and LLaMA-Factory, as well as inference frameworks such as SGLang and vLLM.
50%UnverifiedUnsloth's differentiated positioning is as an acceleration layer embedded within the existing Hugging Face ecosystem, where users need only replace a few lines of code to gain speed and memory benefits, and it is compatible with rather than competing against tools such as Axolotl and LLaMA-Factory.
50%Unverified对于生产环境部署建议选择经过社区充分验证的稳定版本，学习实验则可追新以接触最前沿的技术实现
50%UnverifiedLayerSmith recently added a set of image configurations targeting large model training and fine-tuning, covering LoRA/QLoRA, advanced PyTorch training, and LLaMA-Factory.
50%