MoT elevates the idea of MoE to the module level; the model internally contains multiple heterogeneous Transformer submodules, each designed for a specific modality or task type, with a routing mechanism deciding which submodules to invoke based on the input type and task instruction.