Logit Separability-Driven Samples and Multiple Class-Related Words Selection for Advancing In-Context Learning (2025.naacl-long)
Copied to clipboard
| Challenge: | Effective organization of in-context learning (ICL) demonstrations is key to improving the quality of large language models (LLMs). |
| Approach: | They propose a logit separability-based method that integrates multiple class-related words into each sample-label pair to improve LLM understanding. |
| Outcome: | The proposed method improves ICL performance by providing clearer instructions and richer label information. |
Similar Papers
Tutor-ICL: Guiding Large Language Models for Improved In-Context Learning Performance (2024.findings-emnlp)
Copied to clipboard
| Challenge: | In-context learning (ICL) is a dominant paradigm in natural language processing. |
| Approach: | They propose a prompting method for classification tasks using exemplar answers in a *comparative format' they also propose introducing a test instance before the exemplars to improve performance . |
| Outcome: | The proposed method achieves up to 13.76% increase in accuracy on classification tasks across decoder-only and encoder-decoder LLMs. |
Enhancing Input-Label Mapping in In-Context Learning with Contrastive Decoding (2025.acl-short)
Copied to clipboard
| Challenge: | Prior research has found that large language models overlook input-label mapping information in ICL, relying more on their pre-trained knowledge. |
| Approach: | They propose a novel method that contrasts input-label mappings between positive and negative in-context examples to improve model performance. |
| Outcome: | The proposed method improves performance on 7 natural language understanding tasks without additional training. |
IAD: In-Context Learning Ability Decoupler of Large Language Models in Meta-Training (2024.lrec-main)
Copied to clipboard
| Challenge: | In-context Learning (ICL) is a paradigm in which LLMs acquire task-specific knowledge by processing input-output pairs provided as prompts. |
| Approach: | They propose an In-context learning Ability Decoupler to separate ICL ability from general ability of LLMs in meta-training phase . they first identify parameters suitable for ICL by transference-driven gradient importance and propose a new max-margin loss to emphasize the separation of the two abilities. |
| Outcome: | The proposed model separates the ICL ability from the general ability of LLMs in the meta-training phase, where the I-related parameters are tuned to adapt for ICL tasks. |
An Empirical Study of In-context Learning in LLMs for Machine Translation (2024.findings-acl)
Copied to clipboard
| Challenge: | Recent studies focus on optimizing translation quality, with limited attention to understanding specific aspects of ICL that influence the said quality. |
| Approach: | They conduct the first of its kind, exhaustive study of in-context learning for machine translation (MT) they establish that ICL is primarily example-driven and not instruction-driven . |
| Outcome: | The proposed model is based on examples and not instruction-driven learning. |
Balanced Multi-Factor In-Context Learning for Multilingual Large Language Models (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches address key factors that influence multilingual ICL, but they do not integrate them into the model. |
| Approach: | They propose a method that quantifies and optimally balances three factors for improved example selection. |
| Outcome: | Experiments on mCSQA and TYDI show that the proposed method outperforms existing methods. |
Multilingual LLMs are Better Cross-lingual In-context Learners with Alignment (2023.acl-long)
Copied to clipboard
| Challenge: | a handful of studies have explored ICL in a cross-lingual setting . emergence of large-scale, pretrained, Transformer-based language models has marked the commencement of an avant-garde era in NLP. |
| Approach: | They propose a novel prompt construction strategy to bridge the gap between ICL and cross-lingual text classification. |
| Outcome: | The proposed approach outperforms random prompt selection by a large margin across three tasks using 44 different cross-lingual pairs. |
Data Curation Alone Can Stabilize In-context Learning (2023.acl-long)
Copied to clipboard
| Challenge: | In-context learning (ICL) is a new paradigm for few-shot learning with pretrainable large language models . however, randomly sampling examples from a training set leads to high variance in performance . |
| Approach: | They propose two methods to select training examples from a training set and then carefully curate them from corresponding subsets. |
| Outcome: | The proposed method improves accuracy over sampling from the entire training set. |
ICLEval: Evaluating In-Context Learning Ability of Large Language Models (2025.coling-main)
Copied to clipboard
| Challenge: | Existing evaluation frameworks focus on language abilities and knowledge, often overlooking the assessment of ICL ability. |
| Approach: | They propose to evaluate the ICL ability of Large Language Models (LLMs) using the ICLEval benchmark. |
| Outcome: | The proposed benchmark demonstrates that ICL ability is universally present in different LLMs and model size is not the sole determinant of ICL efficacy. |
Inference and Verbalization Functions During In-Context Learning (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Previous work has found that, in some settings, ICL performance is minimally affected by using demonstrations with irrelevant label words. |
| Approach: | They hypothesize that large language models (LMs) perform in-context learning from a handful of demonstrations via two sequential processes: an inference function that solves the task and a verbalization function that maps the inferred answer to the label space. |
| Outcome: | The proposed model can be localized in specific layers across open-source models, including GEMMA-7B, MISTRAL-7B-V0.3, GEIMA-2-27B, and LLAMA-3.1-70B. |
LLMs are Better Than You Think: Label-Guided In-Context Learning for Named Entity Recognition (2025.emnlp-main)
Copied to clipboard
| Challenge: | Named Entity Recognition (NER) tasks are performed using only a few demonstrations. |
| Approach: | They propose a method that leverages training labels through token-level statistics to improve ICL performance. |
| Outcome: | The proposed method outperforms existing methods on five NER datasets and is robust in low-resource settings. |