The core challenge of multi-agent architecture lies in the coordination cost between agents, including ensuring consistent output style, interface compatibility, and absence of conflicts among multiple agents.