Challenge: In-context learning is an important but not fully understood ability of pre-trained large language models.
Approach: They propose a tool that generates two streams of guidelines capturing task language and format distributions and prompts them to define them by prompting.
Outcome: The proposed model improves both strong open- and closed-source LLMs by over 5% in both zero- and few-shot settings.

Similar Papers

Tutor-ICL: Guiding Large Language Models for Improved In-Context Learning Performance (2024.findings-emnlp)

Copied to clipboard

Challenge: In-context learning (ICL) is a dominant paradigm in natural language processing.
Approach: They propose a prompting method for classification tasks using exemplar answers in a *comparative format' they also propose introducing a test instance before the exemplars to improve performance .
Outcome: The proposed method achieves up to 13.76% increase in accuracy on classification tasks across decoder-only and encoder-decoder LLMs.
Ensemble-Instruct: Instruction Tuning Data Generation with a Heterogeneous Mixture of LMs (2023.findings-emnlp)

Copied to clipboard

Challenge: Empirical studies with different instruction-tuned LMs show that our proposed method yields higher-quality instruction tuning data than Self-Instruct.
Approach: They propose to use in-context learning techniques to train strong conversational agents . they propose to categorize and simplify ICL templates to make prompt learning easier .
Outcome: Empirical results show that the proposed method yields higher-quality instruction tuning data than Self-Instruct and improves performance of both vanilla and instruction-tuned LMs.
Guideline Learning for In-Context Information Extraction (2023.emnlp-main)

Copied to clipboard

Challenge: Large language models can perform a task by conditioning on task instructions and a few input-output examples without optimizing any parameters.
Approach: They propose a guideline learning framework for In-context IE which reflectively learns and follows guidelines.
Outcome: The proposed framework improves the performance of in-context IE by synthesizing and following guidelines.
On the In-context Generation of Language Models (2024.emnlp-main)

Copied to clipboard

Challenge: Large language models (LLMs) have the ability of in-context generation (ICG) when given an in-text prompt, they can implicitly recognize the pattern of the examples and complete the prompt in the desired way.
Approach: They propose a plausible latent variable model to model the distribution of pretrained corpora and formalize ICG as a problem of next topic prediction.
Outcome: The proposed model can model the distribution of pretrained corpora and then formalize ICG as a problem of next topic prediction.
In-Context Learning with Long-Context Models: An In-Depth Exploration (2025.naacl-long)

Copied to clipboard

Challenge: In-context learning is limited by context length, but it can be used for many tasks.
Approach: They study the behavior of in-context learning at an extreme context length . example retrieval shows excellent performance at low context lengths but has diminished gains .
Outcome: The proposed model can perform many tasks with reasonable accuracy when a few examples are provided in-context.
In-context Learning Generalizes, But Not Always Robustly: The Case of Syntax (2024.naacl-long)

Copied to clipboard

Challenge: In-context learning is a common method for teaching large language models new tasks . given labeled examples in the input context, the model learns to perform the task without weight updates.
Approach: They examine whether models guided via ICL infer the underlying structure of the task defined by the context or rely on superficial heuristics that only generalize to identically distributed examples.
Outcome: The proposed model generalizes syntactically or linearly on out-of-distribution examples . the proposed model is able to generalize better on pre-trained models .
Unveiling In-Context Learning: A Coordinate System to Understand Its Working Mechanism (2024.emnlp-main)

Copied to clipboard

Challenge: Large language models exhibit remarkable in-context learning (ICL) capabilities, but the underlying working mechanism of ICL remains unclear.
Approach: They propose a Two-Dimensional Coordinate System that unifies both views into a systematic framework that explains the behavior of ICL through two orthogonal variables: whether similar examples are presented in the demonstrations and whether LLMs can recognize the task.
Outcome: The proposed method can interpret ICL for generation tasks effectively.
Large Language Models Might Not Care What You Are Saying: Prompt Format Beats Descriptions (2025.findings-emnlp)

Copied to clipboard

Challenge: In-context learning has improved performance of large language models, but descriptive instructions are still under-explored.
Approach: They propose an ensemble prompt framework to describe selection criteria of multiple in-context examples. preliminary experiments on machine translation confirm that this framework boosts ICL performance.
Outcome: The proposed framework improves on commonsense, math, logical reasoning and hallucination tasks with three LLMs.
Fine-tuning vs. In-context Learning in Large Language Models: A Formal Language Learning Perspective (2026.acl-long)

Copied to clipboard

Challenge: Prior studies comparing FT and ICL have yielded mixed and inconclusive results due to inconsistent experimental setups.
Approach: They propose a formal language learning task with precise language boundaries, controlled string sampling, and no data contamination to enable a rigorous comparison.
Outcome: The proposed task offers precise language boundaries, controlled string sampling, and no data contamination.
ICLEval: Evaluating In-Context Learning Ability of Large Language Models (2025.coling-main)

Copied to clipboard

Challenge: Existing evaluation frameworks focus on language abilities and knowledge, often overlooking the assessment of ICL ability.
Approach: They propose to evaluate the ICL ability of Large Language Models (LLMs) using the ICLEval benchmark.
Outcome: The proposed benchmark demonstrates that ICL ability is universally present in different LLMs and model size is not the sole determinant of ICL efficacy.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations