Loading...
Detecting Persuasion Techniques in Online Propaganda: An AI-annotation Intervention
Xiao, Lu Xiao, Yimin Da San Martino, Giovanni Nakov, Preslav Zheng, Changzhou
Xiao, Lu
Xiao, Yimin
Da San Martino, Giovanni
Nakov, Preslav
Zheng, Changzhou
Files
Loading...
0105.pdf
Adobe PDF, 639.62 KB
Supervisor
Department
Natural Language Processing
Embargo End Date
Type
Conference proceeding
Date
2025
License
Language
English
Collections
Research Projects
Organizational Units
Journal Issue
Abstract
In today's digital world, online propaganda poses a growing threat to society. To address this challenge, we explored the potential of a real-time training intervention. This intervention exposes people to manipulative text identified by AI and provides cognitive guidance to help them recognize and critically analyze similar cases. To examine whether people trust AI technology enough to read the annotations and follow them, we conducted a one-factor experiment. Our findings show no difference in training performance whether the annotations are claimed to be provided by domain experts or by AI. The intervention is effective in improving people’s ability to identify propagandistic texts and persuasion techniques, and performance varies by technique. We also found that people judge the texts based on one or more of three aspects: the content of the material, the author’s intention inferred from the material, and their personal ideology related to the topic of the material.
Citation
L. Xiao, Y. Xiao, G. Da San Martino, P. Nakov, and C. Zheng, “Detecting Persuasion Techniques in Online Propaganda: An AI-annotation Intervention,” Jan. 2025, doi: 10.24251/HICSS.2025.126.
Source
Proceedings of the 58th Hawaii International Conference on System Sciences
Conference
Keywords
Cognitive, Neuroscience Research in IS, AI, Annotation, Online propaganda, Persuasion, Training
Subjects
Source
Publisher
University of Hawai