Agile Deliberation
A human-machine collaboration framework proposed by Google Research for subjective image classification, in which borderline samples are referred to users for judgment to iteratively adjust the classifier and achieve concept alignment.
Timeline (last 90 days)
Google Research released the Agile Deliberation framework to handle gray-area problems in subjective image classification.
Agile Deliberation hands boundary samples to users for judgment, clarifying concept definitions through concrete image comparisons and forming a human-machine collaborative concept alignment loop.
In 18 real user sessions, Agile Deliberation improved the F1 score of the Gemini-based classifier by 10.5 points compared with the zero-shot baseline.
Agile Deliberation's improvement comes from human clarification of boundary cases, rather than more labeled data or a larger model.
Agile Deliberation relies on real user sessions, and its effectiveness is related to the quality of interaction the user invests.
The scale of 18 sessions indicates that Agile Deliberation is still early validation, and its performance at larger scale remains to be observed.
How Agile Deliberation aggregates judgments when multiple people's opinions conflict has not yet been disclosed.
All Facts (7)
Agile Deliberation's improvement comes from human clarification of boundary cases, rather than more labeled data or a larger model.
50%UnverifiedAgile Deliberation hands boundary samples to users for judgment, clarifying concept definitions through concrete image comparisons and forming a human-machine collaborative concept alignment loop.
50%UnverifiedIn 18 real user sessions, Agile Deliberation improved the F1 score of the Gemini-based classifier by 10.5 points compared with the zero-shot baseline.
50%UnverifiedHow Agile Deliberation aggregates judgments when multiple people's opinions conflict has not yet been disclosed.
50%UnverifiedAgile Deliberation relies on real user sessions, and its effectiveness is related to the quality of interaction the user invests.
50%UnverifiedThe scale of 18 sessions indicates that Agile Deliberation is still early validation, and its performance at larger scale remains to be observed.
50%UnverifiedGoogle Research released the Agile Deliberation framework to handle gray-area problems in subjective image classification.
50%