KnowTuning: Knowledge-aware Fine-tuning for Large Language Models (2024.emnlp-main)
Copied to clipboard
Yougang Lyu, Lingyong Yan, Shuaiqiang Wang, Haibo Shi, Dawei Yin, Pengjie Ren, Zhumin Chen, Maarten Rijke, Zhaochun Ren
| Challenge: | Large language models (LLMs) are a default solution for many natural language processing tasks. |
| Approach: | They propose a knowledge-aware fine-tuning method to improve LLMs' knowledge awareness . they propose augmentation and comparison stages to improve accuracy and reliability . |
| Outcome: | The proposed method generates more facts with less factual error rate under fine-grained facts evaluation. |
Similar Papers
Fine-Tuning or Retrieval? Comparing Knowledge Injection in LLMs (2024.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) encapsulate a vast amount of factual information within their pre-trained weights. |
| Approach: | They compare unsupervised fine-tuning and retrieval-augmented generation approaches to learning new factual information. |
| Outcome: | The proposed models outperform unsupervised fine-tuning and retrieval-augmented generation (RAG) on knowledge-intensive tasks across different topics. |
Does Fine-Tuning LLMs on New Knowledge Encourage Hallucinations? (2024.emnlp-main)
Copied to clipboard
| Challenge: | Pre-training Large Language Models (LLMs) on textual corpora embeds substantial factual knowledge in their parameters, which is essential for excelling in various downstream applications. |
| Approach: | They propose to use supervised fine-tuning to align large language models to new factual information that is not acquired through pre-training. |
| Outcome: | The proposed model is trained to generate facts that are not grounded in pre-existing knowledge, but hallucinates when examples with new knowledge are learned. |
From Misleading Queries to Accurate Answers: A Three-Stage Fine-Tuning Method for LLMs (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods focus on correcting the output but overlook the ability of LLMs to detect and correct misleading content in the input itself. |
| Approach: | They propose a three-stage fine-tuning method that improves LLMs' ability to detect and correct misleading information in input queries. |
| Outcome: | The proposed method improves accuracy and factuality of LLM responses while also reducing hallucinations. |
Know the Unknown: An Uncertainty-Sensitive Method for LLM Instruction Tuning (2025.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) have impressive capabilities but face significant challenges from hallucinations, which arise from insufficient knowledge or context. |
| Approach: | They propose a novel two-stage approach for contextual question answering that enhances LLMs’ ability to recognise their knowledge boundaries while the second reinforces instruction adherence through carefully designed causal prompts. |
| Outcome: | The proposed approach significantly reduces incorrect answers in contextual QA and improves models’ faithfulness to parametric knowledge, mitigating hallucinations in general QA tasks. |
Logits-Based Finetuning (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for developing compact and efficient large language models lack token-level dependencies and linguistic diversity. |
| Approach: | They propose a logits-based fine-tuning framework that integrates supervised learning and knowledge distillation to build enriched training targets using teacher logits and ground truth labels. |
| Outcome: | The proposed method outperforms existing methods on a large-scale logits dataset and a series of science-focused models. |
Knowledge of Knowledge: Exploring Known-Unknowns Uncertainty with Large Language Models (2024.findings-acl)
Copied to clipboard
| Challenge: | Known-unknown questions are characterized by high uncertainty due to the absence of definitive answers. |
| Approach: | They introduce a dataset with known-unknown questions and establish a categorization framework to clarify the origins of uncertainty in such queries. |
| Outcome: | The proposed model improved in distinguishing between known and unknown queries within open-ended question-answering scenarios. |
Take the essence and discard the dross: A Rethinking on Data Selection for Fine-Tuning Large Language Models (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing studies focus on data selection but lack a clear, unified framework . variability in experimental settings complicates systematic comparisons . |
| Approach: | They propose a three-stage scheme to standardize data selection for fine-tuning large language models . they propose unified comparison approach that incorporates ratio-based efficiency and ranking-based feasibility metrics to address inconsistencies across experiments. |
| Outcome: | The proposed scheme outperforms existing methods in a dozen key studies and identifies key challenges. |
Complexity-aware fine-tuning (2026.findings-eacl)
Copied to clipboard
| Challenge: | General-purpose Large Language Models (LLMs) are often fine-tuned through supervised fine- tuning (SFT) to enhance performance in specific domains. |
| Approach: | They propose a novel approach that uses reasoning only for complex data identified by entropy to refine large language models. |
| Outcome: | The proposed model outperforms the standard SFT approach while using 81% less data. |
Fine-tuning Large Language Models with Limited Data: A Survey and Practical Guide (2026.tacl-1)
Copied to clipboard
| Challenge: | Pre-trained language models provide strong foundations, but effective adaptation under data scarcity requires efficient and efficient fine-tuning techniques. |
| Approach: | They propose to review parameter-efficient fine-tuning techniques that lower training and deployment costs and domain and cross-lingual adaptation methods for both encoder and decoder models. |
| Outcome: | The proposed techniques lower training and deployment costs, domain and cross-lingual adaptation methods, and model specialization strategies. |
Learning to Verify Summary Facts with Fine-Grained LLM Feedback (2025.coling-main)
Copied to clipboard
| Challenge: | Recent advances in large language models (LLMs) have significantly enhanced the text summarization performance, but hallucination issues still occur in summaries. |
| Approach: | They propose a large-scale dataset containing fine-grained factual feedback on summaries that can be fine tuned by using Large Language Models (LLMs) they employ 10 distinct LLMs for diverse summary generation and Llama-3-70B-Instruct for feedback. |
| Outcome: | The proposed model outperforms models trained on smaller human-annotated datasets while maintaining high performance. |