Sorting through the noise: Testing robustness of information processing in pre-trained language models (2021.emnlp-main)
Copied to clipboard
| Challenge: | Pre-trained language models have shown impressive performance on downstream NLP tasks, but we have yet to establish a clear understanding of their sophistication when it comes to processing, retaining, and applying information presented in their input. |
| Approach: | They examine how robustly pre-trained LMs retain and apply relevant context information in the face of distracting content. |
| Outcome: | The proposed models retain and use critical context information in the face of distracting content, while models are susceptible to factors of semantic similarity and word position. |
Similar Papers
Large Language Models with Controllable Working Memory (2023.findings-acl)
Copied to clipboard
Daliang Li, Ankit Singh Rawat, Manzil Zaheer, Xin Wang, Michal Lukasik, Andreas Veit, Felix Yu, Sanjiv Kumar
| Challenge: | Large language models (LLMs) have led to a series of breakthroughs in natural language processing due to the massive amounts of world knowledge they memorize during pretraining. |
| Approach: | They propose a method to inject counterfactual and irrelevant contexts into standard supervised datasets to strengthen both controllability and robustness. |
| Outcome: | The proposed method improves controllability and robustness across model architectures and sizes. |
Assessing “Implicit” Retrieval Robustness of Large Language Models (2024.emnlp-main)
Copied to clipboard
| Challenge: | Retrieval-augmented generation (RAG) is a framework to enhance large language models with external knowledge, but its effectiveness is constrained by the retrieval robustness of the model. |
| Approach: | They propose to use gold and distracting context to fine-tune models to handle relevant or irrelevant retrieved context in an end-to-end manner. |
| Outcome: | The proposed model performs better when gold and distracting context are used, while still extracting correct answers when retrieval is accurate. |
Sharp Nearby, Fuzzy Far Away: How Neural Language Models Use Context (P18-1)
Copied to clipboard
| Challenge: | Recent studies have shed light on the information encoded by long-term memory networks. |
| Approach: | They propose to use a neural caching model to model the role of context in an LSTM LM . they analyze the increase in perplexity when prior context words are shuffled, replaced, or dropped . |
| Outcome: | The proposed model is highly sensitive to the order of words within the most recent sentence, but ignores word order in the long-range context, suggesting the distant past is modeled only as a rough semantic field or topic. |
Robust and Scalable Model Editing for Large Language Models (2024.lrec-main)
Copied to clipboard
Yingfa Chen, Zhengyan Zhang, Xu Han, Chaojun Xiao, Zhiyuan Liu, Chen Chen, Kuai Li, Tao Yang, Maosong Sun
| Challenge: | Existing methods that ignore contextual knowledge fail to reliably fall back to parametric knowledge when presented with irrelevant context. |
| Approach: | They propose to use contextual knowledge to update and correct LLMs' knowledge by in-context editing instead of retraining. |
| Outcome: | The proposed method outperforms current state-of-the-art methods by a large margin on a dataset that contains irrelevant questions. |
How Is LLM Reasoning Distracted by Irrelevant Context? An Analysis Using a Controlled Benchmark (2025.emnlp-main)
Copied to clipboard
| Challenge: | Prior work has not explored the mechanisms underlying this sensitivity. |
| Approach: | They propose a synthetic benchmark to evaluate Large Language Models’ reasoning robustness against systematically controlled irrelevant context (IC). |
| Outcome: | The proposed model improves in-distribution and out-of-disttribution scenarios while training with strong distractors. |
Whispers of Doubt Amidst Echoes of Triumph in NLP Robustness (2024.naacl-long)
Copied to clipboard
| Challenge: | Existing approaches to measure robustness are problematic, and out-of-domain evaluations are no longer relevant. |
| Approach: | They examine models of different sizes spanning different architectural choices and pretraining objectives. |
| Outcome: | The results show that not all out-of-domain tests provide insight into robustness . merely scaling models does not make them adequately robust . |
Methods for Estimating and Improving Robustness of Language Models (2022.naacl-srw)
Copied to clipboard
| Challenge: | Large language models suffer from weak generalisation ability due to shallow textual relations over full semantic complexity of the problem. |
| Approach: | They propose to incorporate some of these measures into training objectives to enhance distributional robustness of LLMs. |
| Outcome: | The proposed models outperform human models on complex tasks and outperformed other models on deep networks. |
The Role of Context and Uncertainty in Shallow Discourse Parsing (2022.coling-1)
Copied to clipboard
| Challenge: | Discourse parsing has proven to be useful for a number of NLP tasks that require complex reasoning. |
| Approach: | They hypothesize that context plays an important role in accurate human annotation and add uncertainty measures can improve model accuracy and calibration. |
| Outcome: | The proposed model can be better calibrated by adding uncertainty measures to models with better accuracy and calibration. |
Using Natural Language Explanations to Improve Robustness of In-context Learning (2024.acl-long)
Copied to clipboard
| Challenge: | Recent studies show that large language models excel in many tasks via in-context learning (ICL). However, ICL struggles to execute complex tasks such as arithmetic, commonsense, and symbolic reasoning. |
| Approach: | They propose to augment ICL with natural language explanations (NLEs) to produce further NLEs on adversarial datasets. |
| Outcome: | The proposed approach yields more accurate results than zero-shot-ICL and using only human-generated NLEs on eight adversarial datasets. |
Noise-Robust Fine-Tuning of Pretrained Language Models via External Guidance (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Pretrained Language Models (PLMs) are advanced but data labels are noisy due to the complex annotation process. |
| Approach: | They propose a framework for fine-tuning PLMs using noisy labels that incorporates guidance from Large Language Models like ChatGPT. |
| Outcome: | Experiments on synthetic and real-world noisy datasets show that the proposed framework outperforms the state-of-the-art framework. |