ChangeMyView
A discussion community on Reddit where users post their views and invite others to persuade them with well-reasoned arguments. Community rules require replies to provide in-depth reasoning rather than simple rebuttals, making it an important data source for studying real persuasive dialogue.
Timeline (last 90 days)
PerSo is a new benchmark for evaluating the social intelligence of LLMs in real persuasion scenarios, with data sourced from the ChangeMyView (CMV) community on Reddit.
The ChangeMyView community mandates that repliers directly challenge the OP's viewpoint rather than attack the person, and has a special mechanism: when the OP believes a reply successfully changed their mind, they can reply with a Δ (delta) marker.
PerSo leverages the Δ mechanism of the ChangeMyView community, so that high-performing persuasion strategies are not the researchers' subjective judgments but have been validated through community practice; such conversation data with natural outcome labels is quite rare in the field of persuasion research.
The research team built the CMV2BAS dataset based on the Webis-CMV-20 corpus, containing long, multi-threaded ChangeMyView discussions, each with LLM-derived bipolar argumentation structure annotations and delta event labels (opinion changed vs. unchanged).
In the CMV community, when a user successfully changes someone else's opinion, the other party grants a delta mark, which provides relatively clean labels for supervised learning.
All Facts (5)
The ChangeMyView community mandates that repliers directly challenge the OP's viewpoint rather than attack the person, and has a special mechanism: when the OP believes a reply successfully changed their mind, they can reply with a Δ (delta) marker.
50%UnverifiedPerSo leverages the Δ mechanism of the ChangeMyView community, so that high-performing persuasion strategies are not the researchers' subjective judgments but have been validated through community practice; such conversation data with natural outcome labels is quite rare in the field of persuasion research.
50%UnverifiedThe research team built the CMV2BAS dataset based on the Webis-CMV-20 corpus, containing long, multi-threaded ChangeMyView discussions, each with LLM-derived bipolar argumentation structure annotations and delta event labels (opinion changed vs. unchanged).
50%UnverifiedIn the CMV community, when a user successfully changes someone else's opinion, the other party grants a delta mark, which provides relatively clean labels for supervised learning.
50%UnverifiedPerSo is a new benchmark for evaluating the social intelligence of LLMs in real persuasion scenarios, with data sourced from the ChangeMyView (CMV) community on Reddit.
50%