Loading...
LLM Fine-Tuning: Concepts, Opportunities, and Challenges
Wu, Xiao-Kun Chen, Min Li, Wanyi Wang, Rui Lu, Limeng Liu, Jia Hwang, Kai Hao, Yixue Pan, Yanru Meng, Qingguo
Wu, Xiao-Kun
Chen, Min
Li, Wanyi
Wang, Rui
Lu, Limeng
Liu, Jia
Hwang, Kai
Hao, Yixue
Pan, Yanru
Meng, Qingguo
Files
Loading...
BDCC-09-00087.pdf
Adobe PDF, 4.63 MB
Supervisor
Department
Machine Learning
Embargo End Date
Type
Journal article
Date
2025
License
Language
English
Collections
Research Projects
Organizational Units
Journal Issue
Abstract
As a foundation of large language models, fine-tuning drives rapid progress, broad applicability, and profound impacts on human–AI collaboration, surpassing earlier technological advancements. This paper provides a comprehensive overview of large language model (LLM) fine-tuning by integrating hermeneutic theories of human comprehension, with a focus on the essential cognitive conditions that underpin this process. Drawing on Gadamer’s concepts of Vorverständnis, Distanciation, and the Hermeneutic Circle, the paper explores how LLM fine-tuning evolves from initial learning to deeper comprehension, ultimately advancing toward self-awareness. It examines the core principles, development, and applications of fine-tuning techniques, emphasizing its growing significance across diverse field and industries. The paper introduces a new term, “Tutorial Fine-Tuning (TFT)”, which annotates a process of intensive tuition given by a “tutor” to a small number of “students”, to define the latest round of LLM fine-tuning advancements. By addressing key challenges associated with fine-tuning, including ensuring adaptability, precision, credibility and reliability, this paper explores potential future directions for the co-evolution of humans and AI. By bridging theoretical perspectives with practical implications, this work provides valuable insights into the ongoing development of LLMs, emphasizing their potential to achieve higher levels of cognitive and operational intelligence.
Citation
X.-K. Wu et al., “LLM Fine-Tuning: Concepts, Opportunities, and Challenges,” Big Data and Cognitive Computing 2025, vol. 9, no. 4, p. 87, Apr. 2025, doi: 10.3390/BDCC9040087.
Source
Big Data and Cognitive Computing
Conference
Keywords
large language models (LLM); fine-tuning; hermeneutics; comprehension; tutorial fine-tuning; human–AI co-evolution
Subjects
Source
Publisher
MDPI