Codex's predecessor was based on the GPT-3 architecture and became the benchmark model in the field of code generation at the time through the fine-tuning process.