Safety alignment in LLM training is typically achieved through methods like RLHF (Reinforcement Learning from Human Feedback) and Constitutional AI