C-ICL: Contrastive In-context Learning for Information Extraction (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for in-context learning with large language models focus on using correct or negative examples, ignoring the potential value of incorrect or negative samples. |
| Approach: | They propose a few-shot technique that leverages both correct and incorrect sample constructions to create in-context learning demonstrations. |
| Outcome: | The proposed technique outperforms previous few-shot in-context learning methods on a broad spectrum of related tasks. |
Similar Papers
Enhancing Input-Label Mapping in In-Context Learning with Contrastive Decoding (2025.acl-short)
Copied to clipboard
| Challenge: | Prior research has found that large language models overlook input-label mapping information in ICL, relying more on their pre-trained knowledge. |
| Approach: | They propose a novel method that contrasts input-label mappings between positive and negative in-context examples to improve model performance. |
| Outcome: | The proposed method improves performance on 7 natural language understanding tasks without additional training. |
LLMs Are Few-Shot In-Context Low-Resource Language Learners (2024.naacl-long)
Copied to clipboard
| Challenge: | In-context learning (ICL) empowers large language models to perform diverse tasks in underrepresented languages using only short in-contrast information. |
| Approach: | They extensively assess the effectiveness of in-context learning with LLMs in low-resource languages . they also identify the shortcomings of in context label alignment . |
| Outcome: | The proposed approach improves understanding quality of low-resource languages by closing the language gap in the target language. |
In-Context Learning with Iterative Demonstration Selection (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing literature has highlighted the importance of selecting examples that are diverse or semantically similar to the test sample . Existing studies have shown that the optimal selection dimension, i.e., diversity or similarity, is task-specific. |
| Approach: | They propose to use zero-shot chain-of-thought reasoning to iteratively select examples that are diverse but still strongly correlated with the test sample as ICL demonstrations. |
| Outcome: | The proposed method outperforms existing demonstration selection methods on reasoning, question answering, and topic classification tasks. |
Self-ICL: Zero-Shot In-Context Learning with Self-Generated Demonstrations (2023.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) have shown striking ability to adapt to target tasks with a few input-output demonstrations. |
| Approach: | They propose a framework which bootstraps LMs’ intrinsic capabilities to perform zero-shot ICL. |
| Outcome: | The proposed framework outperforms baselines on 23 BIG-Bench Hard tasks on average accuracy and head-to-head comparison. |
LA-UCL: LLM-Augmented Unsupervised Contrastive Learning Framework for Few-Shot Text Classification (2024.lrec-main)
Copied to clipboard
| Challenge: | Experimental results show that our model exceeds the baseline models due to the lack of cognitive ability. |
| Approach: | They propose a LLM-Augmented Unsupervised Contrastive Learning Framework which introduces a cognition-enabled Large Language Model (LLM) for efficient data augmentation and presents corresponding contrastive learning strategies. |
| Outcome: | The proposed model exceeds baseline models on six datasets. |
More Samples or More Prompts? Exploring Effective Few-Shot In-Context Learning for LLMs with In-Context Sampling (2024.findings-naacl)
Copied to clipboard
Bingsheng Yao, Guiming Chen, Ruishi Zou, Yuxuan Lu, Jiachen Li, Shao Zhang, Yisi Sang, Sijia Liu, James Hendler, Dakuo Wang
| Challenge: | Existing studies on LLM prompting focus on selecting a better set of data samples inside one single prompt input, but why not design and leverage multiple ICL prompts together to further improve the LLM’s performance? |
| Approach: | They propose a low-resource LLM prompting technique to optimize the construction of multiple ICL prompt inputs to produce confident predictions. |
| Outcome: | The proposed technique can produce confident predictions by optimizing the construction of multiple ICL prompt inputs on four NLI datasets and one QA dataset. |
Can Many-Shot In-Context Learning Help LLMs as Evaluators? A Preliminary Empirical Study (2025.coling-main)
Copied to clipboard
| Challenge: | Existing evaluation approaches to evaluate Large Language Models are affected by potential biases within LLMs. |
| Approach: | They propose two many-shot In-Context Learning (ICL) prompt templates to help LLM evaluators mitigate potential biases. |
| Outcome: | The proposed templates reduce biases by using in-context examples with model-generated rationales as references. |
Guideline Learning for In-Context Information Extraction (2023.emnlp-main)
Copied to clipboard
| Challenge: | Large language models can perform a task by conditioning on task instructions and a few input-output examples without optimizing any parameters. |
| Approach: | They propose a guideline learning framework for In-context IE which reflectively learns and follows guidelines. |
| Outcome: | The proposed framework improves the performance of in-context IE by synthesizing and following guidelines. |
On Many-Shot In-Context Learning for Long-Context Evaluation (2025.acl-long)
Copied to clipboard
| Challenge: | Existing benchmarks primarily evaluate long-context language models' retrieval capabilities. |
| Approach: | They propose a benchmark to evaluate long-context language models' retrieval capabilities by using MANYICLBENCH. |
| Outcome: | The proposed model performs better with additional demonstrations than translation and reasoning tasks. |
Scaling Performance and Low-Resource Annotation with Many-Shot In-Context Learning for Named Entity Recognition (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing studies on ICL for Named Entity Recognition (NER) have mainly explored few-shot settings, but the potential of scaling to hundreds of demonstrations has not been thoroughly investigated. |
| Approach: | They evaluate various LLMs across multiple domains using hundreds of ICL examples and then assess the feasibility of using many-shot ICL as a data annotation framework. |
| Outcome: | The proposed framework can be scaled to hundreds of examples and annotate and refining data for low-resource NER tasks. |