Challenge: Existing methods to improve reasoning abilities of Large Language Models (LLMs) have limitations due to excessive growth in context length, causing large hardware burden.
Approach: They propose a novel Unified ICL framework that unifies demonstration compression, demonstration selection, and final response generation.
Outcome: The proposed framework unifies demonstration compression, demonstration selection, and final response generation.

Similar Papers

Learning to Select In-Context Demonstration Preferred by Large Language Model (2025.findings-acl)

Copied to clipboard

Challenge: In-context learning (ICL) enables large language models to perform tasks with only a few examples as demonstrations.
Approach: They propose a generative preference learning framework that leverages LLM feedback to directly optimize demonstration selection for ICL.
Outcome: Experiments on 19 datasets across 11 task categories show that GenICL achieves superior performance than existing methods in selecting the most effective demonstrations.
Enhancing In-Context Learning via Implicit Demonstration Augmentation (2024.acl-long)

Copied to clipboard

Challenge: In-context learning (ICL) is a new paradigm for pre-trained language models that can make predictions for unseen inputs without updating parameters.
Approach: They propose a method that enables a model to augmented copies of a demonstration by leveraging their deep feature distribution and a logit calibration mechanism.
Outcome: The proposed method significantly improves the average and worst-case accuracy across diverse PLMs and tasks.
TABGEN-ICL: Residual-Aware In-Context Example Selection for Tabular Data Generation (2025.findings-acl)

Copied to clipboard

Challenge: Existing approaches to tabular data generation require fine-tuning, which is computationally expensive.
Approach: They propose a new in-context learning framework to prompt a fixed LLM with in-constitut examples to enhance the in-text learning ability of LLMs for tabular data generation.
Outcome: The proposed framework outperforms random selection strategies on five real-world tabular datasets and reduces error rate by 42.2% on fidelity metric.
Enhancing Text-to-SQL Capabilities of Large Language Models: A Study on Prompt Design Strategies (2023.findings-emnlp)

Copied to clipboard

Challenge: In-context learning (ICL) is a new approach to natural language processing tasks that rely on large language models to make predictions based on context . recent studies have shown that neural symbolic design is the preferred choice for question answering systems because of its limited working memory and unreliable long-term memory.
Approach: They propose to extend in-context learning to question answering tasks that utilize structured knowledge sources and to explore various prompt design strategies for employing LLMs.
Outcome: The proposed approach outperforms the state-of-the-art system by 2.5 points and the best fine-tuned system by 5.1 points on the Spider dataset.
Effective Demonstration Annotation for In-Context Learning via Language Model-Based Determinantal Point Process (2024.emnlp-main)

Copied to clipboard

Challenge: Existing studies on large-scale labeled support sets are not feasible in practical scenarios.
Approach: They introduce a language model-based determinant point process that considers uncertainty and diversity of unlabeled instances for optimal selection.
Outcome: The proposed method can effectively select canonical examples on 9 NLU and 2 Generation datasets.
Beyond In-Context Learning: Aligning Long-form Generation of Large Language Models via Task-Inherent Attribute Guidelines (2025.findings-acl)

Copied to clipboard

Challenge: In-context learning is an important but not fully understood ability of pre-trained large language models.
Approach: They propose a tool that generates two streams of guidelines capturing task language and format distributions and prompts them to define them by prompting.
Outcome: The proposed model improves both strong open- and closed-source LLMs by over 5% in both zero- and few-shot settings.
Self-ICL: Zero-Shot In-Context Learning with Self-Generated Demonstrations (2023.emnlp-main)

Copied to clipboard

Challenge: Large language models (LLMs) have shown striking ability to adapt to target tasks with a few input-output demonstrations.
Approach: They propose a framework which bootstraps LMs’ intrinsic capabilities to perform zero-shot ICL.
Outcome: The proposed framework outperforms baselines on 23 BIG-Bench Hard tasks on average accuracy and head-to-head comparison.
In-Context Learning with Iterative Demonstration Selection (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing literature has highlighted the importance of selecting examples that are diverse or semantically similar to the test sample . Existing studies have shown that the optimal selection dimension, i.e., diversity or similarity, is task-specific.
Approach: They propose to use zero-shot chain-of-thought reasoning to iteratively select examples that are diverse but still strongly correlated with the test sample as ICL demonstrations.
Outcome: The proposed method outperforms existing demonstration selection methods on reasoning, question answering, and topic classification tasks.
OpenICL: An Open-Source Framework for In-context Learning (2023.acl-demo)

Copied to clipboard

Challenge: In-context Learning (ICL) is a new paradigm for large language model evaluation.
Approach: They propose an open-source toolkit for ICL and LLM evaluation.
Outcome: The proposed framework is highly flexible and flexible and can be easily combined with other tools to suit users' needs.
Revisiting In-Context Learning with Long Context Language Models (2025.findings-acl)

Copied to clipboard

Challenge: In-Context Learning (ICL) is a technique by which language models make predictions based on examples provided in their input context.
Approach: They revisited previous studies using in-context learning techniques . they found that using a data augmentation approach, they significantly improved ICL performance .
Outcome: The proposed approach significantly improves ICL performance on 18 datasets spanning 4 tasks . the proposed approach does not improve performance over a simple random sample selection method .

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations