Multilingual Characterization and Extraction of Narratives from Online News: Annotation Guidelines
Piskorski, Jakub Mahmoud, Tarek Nikolaidis, Nikolaos Campos, Ricardo Jorge, Alipio Mario Dimitrov, Dimitar Silvano, Purificacao Yangarber, Roman Sharma, Shivam Chakraborty, Tanmoy
Piskorski, Jakub
Mahmoud, Tarek
Nikolaidis, Nikolaos
Campos, Ricardo
Jorge, Alipio Mario
Dimitrov, Dimitar
Silvano, Purificacao
Yangarber, Roman
Sharma, Shivam
Chakraborty, Tanmoy
Supervisor
Department
Natural Language Processing
Embargo End Date
Type
Conference proceeding
Date
2025
License
Language
English
Collections
Research Projects
Organizational Units
Journal Issue
Abstract
We introduce SemEval-2025 Task 10 on Multilingual Characterization and Extraction of Narratives from Online News, which focuses on the identification and analysis of narratives in online news media. The task is structured into three subtasks: (1) Entity Framing, to identify the roles that relevant entities play within narratives, (2) Narrative Classification, to assign documents fine-grained narratives according to a given, topic-specific taxonomy of narrative labels, and (3) Narrative Extraction, to provide a justification for the dominant narrative of the document. To this end, we analyze news articles across two critical domains, Ukraine-Russia War and Climate Change, in five languages: Bulgarian, English, Hindi, Portuguese, and Russian. This task introduces a novel multilingual and multifaceted framework for studying how online news media construct and disseminate manipulative narratives. By addressing these challenges, our work contributes to the broader effort of detecting, understanding, and mitigating the spread of propaganda and disinformation. The task attracted a lot of interest: 310 teams registered, with 66 submitting official results on the test set.
Citation
J. Piskorski et al., “SemEval 2025 Task 10: Multilingual Characterization and Extraction of Narratives from Online News,” 2025. [Online]. Available: https://aclanthology.org/2025.semeval-1.331/
Source
Proceedings of the 19th International Workshop on Semantic Evaluation (SemEval-2025)
Conference
19th International Workshop on Semantic Evaluation (SemEval-2025)
Keywords
Subjects
Source
19th International Workshop on Semantic Evaluation (SemEval-2025)
Publisher
Association for Computational Linguistics