GPT series models are based on the Transformer architecture and are alignment-optimized through large-scale text pretraining and Reinforcement Learning from Human Feedback (RLHF).