[KongchangAI]
Model

PSGAgent

An agent framework for panoptic scene graph generation (PSG) that uses a think-act-observe loop to let a multimodal large language model dynamically invoke region zoom-in and visual highlighting tools, overcoming the perceptual limits of a static observer.

Timeline (last 90 days)

Nov 6

The researchers proposed PSGAgent, an agent framework that enhances PSG visual perception through a "think-act-observe" loop.

Unverified50%
Nov 6

The PSGAgent framework includes a Region Zoom-In Tool for zooming in on small objects or boundary relations to obtain higher-resolution local views.

Unverified50%
Nov 6

The PSGAgent framework includes a Visual Highlight Tool that filters irrelevant contextual noise through relation-oriented segmentation, focusing the model on foreground objects and relations relevant to the current reasoning.

Unverified50%
Nov 6

PSGAgent adopts a two-stage training pipeline: the first stage builds an error-aware multimodal chain-of-thought (M-CoT) dataset for cold-start learning; the second stage uses a hierarchical reward mechanism combined with group sequence policy optimization (GSPO) to learn the tool-use policy.

Unverified50%
Nov 6

PSGAgent achieves SOTA performance on the PSG benchmark, demonstrating strong capabilities in both overall and fine-grained scene understanding.

Unverified50%
Nov 6

The significance of PSGAgent extends beyond the PSG task itself: it offers a paradigm that multimodal large models can draw on in scenarios requiring fine-grained visual reasoning—teaching models to actively perceive rather than passively receive.

Unverified50%

All Facts (6)

Source Articles