Loki: An Open-Source Tool for Fact Verification
Li, Haonan Han, Xudong Wang, Hao Wang, Yuxia Wang, Minghan Xing, Rui Geng, Yilin Zhai, Zenan Nakov, Preslav Baldwin, Timothy
Li, Haonan
Han, Xudong
Wang, Hao
Wang, Yuxia
Wang, Minghan
Xing, Rui
Geng, Yilin
Zhai, Zenan
Nakov, Preslav
Baldwin, Timothy
Supervisor
Department
Natural Language Processing
Embargo End Date
Type
Conference proceeding
Date
2025
License
Language
English
Collections
Research Projects
Organizational Units
Journal Issue
Abstract
We introduce LOKI, an open-source tool designed to address the growing problem of misinformation. LOKI adopts a human-centered approach, striking a balance between the quality of fact-checking and the cost of human involvement. It decomposes the fact-checking task into a five-step pipeline: breaking down long texts into individual claims, assessing their check-worthiness, generating queries, retrieving evidence, and verifying the claims. Instead of fully automating the claim verification process, LOKI provides essential information at each step to assist human judgment, especially for general users such as journalists and content moderators. Moreover, it has been optimized for latency, robustness, and cost efficiency at a commercially usable level. LOKI is released under an MIT license and is available on GitHub.1 We also provide a video presenting the system and its capabilities.
Citation
H. Li et al., “Loki: An Open-Source Tool for Fact Verification,” Proceedings - International Conference on Computational Linguistics, COLING, vol. Part, pp. 28–36, Jan. 2025.
Source
Proceedings - International Conference on Computational Linguistics, COLING
Conference
Keywords
Fact verification, Human-centered AI, Claim extraction, Evidence retrieval, Misinformation detection
Subjects
Source
Publisher
Association for Computational Linguistics