Unverified50% confidenceFactExact time
PhyMetric's evaluation is performed by a VLM as the judge, answering on question-aware sampled frames, after which accuracy is aggregated at four levels: scene, dimension, physical category, and model.
1
Sources
50%
Confidence
Long-term
Relevance
10/15/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedThe paper argues that assertions about hosted model behavior must be explicitly annotated along four dimensions: the model identifier tested, the service period, the measurement tool, and the inference configuration.70% similarUnverifiedVLM训练需要精确对齐的图文配对数据集，若图文对应关系出现偏差，模型会学到错误的跨模态映射69% similarUnverifiedEmbodied evaluation is having a model complete tasks in a simulated or real physical environment, involving action sequence planning, changes in environmental state, and causal inference, where the correctness of the task depends on the final environmental state rather than intermediate answers.68% similarUnverifiedA systematic evaluation covered the performance of 16 frontier vision-language models (VLMs) in document parsing scenarios.68% similarVerifiedQLoRA quantizes the base model to 4-bit precision for storage, while applying LoRA adapters on top of the quantized model for training.65% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1038892API
curl https://kongchang.com/api/v1/knowledge/claims/1038892MCP
get_claim(id=1038892)