Multimodal Large Language Model (MLLM) Agent

A system that uses a multimodal large language model as its decision-making core and can perceive textual and visual interfaces and invoke tools or execute actions such as clicking and swiping. A typical architecture comprises three stages: perception, reasoning and planning, and action execution.