Challenge: Existing studies highlight that large language models are receptive to external information that contradicts their parametric knowledge, but little research has been conducted on the direct impact of instruction-tuning on this phenomenon.
Approach: They examine how instruction-tuning influences LLMs' susceptibility to misinformation, particularly in knowledge conflict situations.
Outcome: The proposed model is more user-oriented and more likely to accept misinformation when it is presented by the user.

Similar Papers

From Language Modeling to Instruction Following: Understanding the Behavior Shift in LLMs after Instruction Tuning (2024.naacl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) have achieved remarkable success in aligning with user intentions.
Approach: They develop local and global explanation methods and a feed-forward-based method for input-output attribution to investigate the impact of instruction tuning on user intentions.
Outcome: The proposed method compares explanations from pre-trained and instruction-tuned models . it empowers LLMs to recognize the instruction parts of user prompts, it encourages response generation .
Psychometric Predictive Power of Large Language Models (2024.findings-naacl)

Copied to clipboard

Challenge: despite efforts to align large language models with human preferences, instruction tuning does not always make LLMs human-like from a cognitive modeling perspective.
Approach: They find that instruction tuning does not always make large language models human-like from a cognitive perspective.
Outcome: The proposed prompts improve predictive power but are still inferior to small base models.
Stronger Models are Not Always Stronger Teachers for Instruction Tuning (2025.naacl-long)

Copied to clipboard

Challenge: Existing methods to optimize instruction-following capabilities of large language models (LLMs) assume that larger or stronger models are stronger teachers and therefore adopt smaller models as response generators.
Approach: They propose to use large-scale instruction datasets to tune large language models to align with specific tasks and user intents.
Outcome: The proposed metric outperforms most baselines in identifying the effectiveness of response generators.
Dynamics of Instruction Fine-Tuning for Chinese Large Language Models (2025.coling-main)

Copied to clipboard

Challenge: Instruction tuning is a burgeoning method to elicit the general intelligence of Large Language Models.
Approach: They investigate the effects of data quantity, model size, and data construction methods on instruction tuning for Chinese LLMs.
Outcome: The proposed model includes over 40,000 high-quality instruction instances covering ten underlying abilities.
Multilingual Instruction Tuning With Just a Pinch of Multilinguality (2024.findings-acl)

Copied to clipboard

Challenge: Using multilingual instruction tuning, large language models can be used to follow instructions in multiple languages . a multilingual model can be tuned on a wide range of languages, yet most datasets are limited to English .
Approach: They investigate how multilinguality during instruction tuning affects instruction-following across languages . they find that only 40 multilingual examples improve multilingual instruction- follow .
Outcome: The results show that multilingual models perform better on multilingual mixtures compared to monolingual models . the results suggest that building multilingual instruction-tuned models can be done with only 2-4 languages .
LLM Sensitivity Challenges in Abusive Language Detection: Instruction-Tuned vs. Human Feedback (2025.coling-main)

Copied to clipboard

Challenge: Existing studies show that instruction-tuned LLMs under-predict positive classes . however, they are overly sensitive and can be applied for abuse detection without fine-tuning .
Approach: They show that instruction-tuned LLMs tend to under-predict positive classes . they also show that label frequency in the prompt helps with the significant over-prediction .
Outcome: The proposed models under-predict positive classes in social media, whereas they are overly sensitive.
LongForm: Effective Instruction Tuning with Reverse Instructions (2024.findings-emnlp)

Copied to clipboard

Challenge: Prior work on instruction tuning relies on expensive human annotation and crowd-sourced datasets with alignment issues.
Approach: They propose a method to generate instructions via LLMs from human-written corpus examples using reverse instructions.
Outcome: The proposed method outperforms larger language models without instruction tuning on tasks such as story/recipe generation and long-form question answering.
Demystifying Instruction Mixing for Fine-tuning Large Language Models (2024.acl-srw)

Copied to clipboard

Challenge: Instruction tuning is effective for aligning large language models with human instructions, but the procedure to optimizing the mixing of instruction datasets is still unclear.
Approach: They categorize instructions into three primary types: NLP downstream tasks, coding, and general chat.
Outcome: The proposed method improves performance of large language models (LLMs) but it is difficult to combine different instruction datasets to optimize overall performance.
Know the Unknown: An Uncertainty-Sensitive Method for LLM Instruction Tuning (2025.findings-acl)

Copied to clipboard

Challenge: Large language models (LLMs) have impressive capabilities but face significant challenges from hallucinations, which arise from insufficient knowledge or context.
Approach: They propose a novel two-stage approach for contextual question answering that enhances LLMs’ ability to recognise their knowledge boundaries while the second reinforces instruction adherence through carefully designed causal prompts.
Outcome: The proposed approach significantly reduces incorrect answers in contextual QA and improves models’ faithfulness to parametric knowledge, mitigating hallucinations in general QA tasks.
OpinionGPT: Modelling Explicit Biases in Instruction-Tuned LLMs (2024.naacl-demo)

Copied to clipboard

Challenge: Current research seeks to de-bias such models, or suppress potentially biased answers.
Approach: They present a web demo to test the biases of instruction-tuned Large Language Models . they identify 11 different biase based on a corpus of data .
Outcome: The proposed demo shows that biases in instruction-tuning are explicit and transparent . the demo shows how the model was trained and showcases the web application .

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations