Papers with ICE
Teamwork Is Not Always Good: An Empirical Study of Classifier Drift in Class-incremental Information Extraction (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for learning incrementally do not address the problem of class-incremental learning. |
| Approach: | They propose a framework that can continuously learn new classes from a data stream without forgetting previously learned classes. |
| Outcome: | The proposed framework shows significant improvement over the state-of-the-art frameworks with up to 44.7% absolute F-score gain. |
Diverse In-Context Example Selection After Decomposing Programs and Aligned Utterances Improves Semantic Parsing (2025.naacl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) are well suited for seq2seq translation . a lack of pretraining corpora can hinder the use of LLMs for structured interpretation . |
| Approach: | They propose to decompose available ICE trees into fragments and use additional invocations to map them to corresponding utterances. |
| Outcome: | The proposed method shows visible gains on diverse parsing benchmarks on popular languages. |
NICE: To Optimize In-Context Examples or Not? (2024.acl-long)
Copied to clipboard
| Challenge: | Recent work shows that in-context learning and optimization of in-const examples (ICE) can improve the accuracy of large language models on a wide range of tasks. |
| Approach: | They propose a task-specific metric called Normalized Invariability to Choice of Examples (NICE) metric measures the learnability of tasks from a given instruction and provides a heuristic to decide whether to optimize ICE for a new task. |
| Outcome: | The proposed metric predicts the utility of optimizing ICE for a given task compared to random ICE. |
ALICE: Active Learning with Contrastive Natural Language Explanations (2020.emnlp-main)
Copied to clipboard
| Challenge: | Annotating a large dataset with annotations is costly and infeasible. |
| Approach: | They propose an expert-in-the-loop training framework that utilizes contrastive natural language explanations to improve data efficiency in learning. |
| Outcome: | The proposed framework outperforms baseline models trained with 40-100% more training data on bird species classification and social relationship classification tasks. |
Navigating the Infinite Dynamic Web Space: Effective In-Context Exploration via Cognitive Multi-Agent Collaboration (2026.eacl-long)
Copied to clipboard
Guozhao Mo, Yanjiang Liu, Yafei Shi, Jiawei Chen, Yang Li, Yaojie Lu, Hongyu Lin, Ben He, Le Sun, Bo Zheng, Xianpei Han
| Challenge: | Existing methods for dynamic web navigation rely on greedy strategies or value estimation, struggle to achieve effective backtracking and are heavily dependent on proprietary models. |
| Approach: | They propose a cognitive multi-agent collaboration framework that enhances cyberspace exploration capability through In-Context Exploration. |
| Outcome: | The proposed framework surpasses the proprietary model Claude-3.5 Sonnet on the WebArena benchmark. |
Event Causality Extraction via Implicit Cause-Effect Interactions (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies have not exploited the interactions between the cause and effect event that could provide crucial clues for causality reasoning. |
| Approach: | They propose an Implicit Cause-Effect interaction framework which captures the implicit intra- and inter-event interactions by incorporating the privileged information for reasoning. |
| Outcome: | The proposed framework captures the implicit intra- and inter-event interactions by incorporating the privileged information (ground truth event types and arguments) for reasoning. |
Towards Implicit Bias Detection and Mitigation in Multi-Agent LLM Interactions (2024.findings-emnlp)
Copied to clipboard
| Challenge: | a recent study shows that large language models are susceptible to societal biases due to their exposure to human-generated data. |
| Approach: | They propose two strategies to mitigate implicit gender biases in large language models . they create scenarios where implicit gender is present and develop a metric to assess the presence of biase . |
| Outcome: | The proposed methods mitigate implicit biases with self-reflection and fine-tuning. |
Adaptive Token Biaser: Knowledge Editing via Biasing Key Entities (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods to update parametric knowledge of large language models (LLMs) are outdated and incontext editing (KE) is not effective due to the substantial cost associated with retraining. |
| Approach: | They propose a new decoding technique that enhances in-context editing (ICE) they propose to use parametric knowledge to update the models' knowledge . |
| Outcome: | The proposed technique improves ICE performance while incurring only half the latency. |
Tuning Less, Prompting More: In-Context Preference Learning Pipeline for Natural Language Transformation (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to natural language transformation (NLT) tasks face significant challenges, such as the computational costs of leveraging large pre-trained models and the limited generalization ability of fine-tuned smaller models. |
| Approach: | They propose a framework that combines prompting with fine-tuning to enhance smaller models by integrating In-Context Examples from retrieval. |
| Outcome: | The proposed framework outperforms existing methods across MT and TST tasks. |
Decoding by Contrasting Knowledge: Enhancing Large Language Model Confidence on Edited Facts (2025.acl-long)
Copied to clipboard
| Challenge: | In-context knowledge editing (ICE) is currently the most effective method for knowledge editing, but it is constrained by the black-box modeling of LLMs and lacks interpretability. |
| Approach: | They propose a method to decode new knowledge by comparing logits with unedited knowledge to improve the accuracy of LLMs. |
| Outcome: | The proposed method improves the performance of LLaMA3-8B-instruct on MQuAKE by up to 219%. |
EAIR: Entity-aware Inference-Time Knowledge Routing for Multi-Hop Knowledge Editing (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing in-context knowledge editing methods suffer from paraphrase sensitivity . Existing methods interfere with the model's original knowledge and can degrade its inherent capabilities. |
| Approach: | They propose a novel entity-aware inference-time knowledge routing method to address paraphrase sensitivity. |
| Outcome: | The proposed method achieves highest strict case accuracy in 11 of 12 settings, significantly reducing paraphrase sensitivity. |
Exploring Jailbreak Attacks on LLMs through Intent Concealment and Diversion (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing jailbreak methods face an excessive number of iterative queries and poor generalization across models. |
| Approach: | They propose a jailbreak method that employs **I**ntent **C**oncealment and div**E**rsion to circumvent security constraints. |
| Outcome: | The proposed method outperforms existing jailbreak techniques in question-answering and text-generation tasks. |
Decoupling Reasoning and Knowledge Injection for In-Context Knowledge Editing (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing knowledge editing approaches directly edit model context without isolating target knowledge from the reasoning path of model inference, resulting in unreliable and low-quality outputs, especially in multi-hop tasks. |
| Approach: | They propose a framework that separates model reasoning from knowledge editing and propose 'DecKER' that allows users to modify specific factual associations without retraining the entire model. |
| Outcome: | The proposed framework significantly improves multi-hop reasoning performance by mitigating knowledge conflicts and preserving reasoning integrity. |