LLaMA-Factory is one of the most mainstream open-source large model fine-tuning frameworks, supporting supervised fine-tuning (SFT) and reinforcement learning from human feedback (RLHF) and other fine-tuning methods for dozens of mainstream open-source models including LLaMA, Qwen, and ChatGLM.