Towards Teachable Reasoning Systems: Using a Dynamic Memory of User Feedback for Continual System Improvement (2022.emnlp-main)
Copied to clipboard
| Challenge: | Using simulated feedback, our system (called TeachMe) continually improves with time, and without model retraining. |
| Approach: | They propose to augment a QA model with a dynamic memory of user feedback, containing user-supplied corrections toerroneous model beliefs that users identify during interaction. |
| Outcome: | The proposed system improves with time and without model retraining, and with real users, by 15% on a hidden test set after teaching. |
Similar Papers
Continually Improving Extractive QA via Human Feedback (2023.emnlp-main)
Copied to clipboard
| Challenge: | a study of extractive question answering systems using human feedback shows promising potential for continual learning. |
| Approach: | They study extractive question answering system by using user feedback to improve it . they design and deploy an iterative approach where users ask questions and provide feedback . |
| Outcome: | The proposed model improves over time across different data regimes and domains . human user feedback is more affordable and abundant than annotations provided by trained experts . |
Using Interactive Feedback to Improve the Accuracy and Explainability of Question Answering Systems Post-Deployment (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing work on question answering focuses on the pre-deployment stage; building an accurate model for deployment. |
| Approach: | They collect feedback from users and train a neural model with the feedback data. |
| Outcome: | The proposed model can explain the correctness or incorrectness of an answer. |
Learning to repair: Repairing model output errors after deployment using a dynamic memory of feedback (2022.findings-naacl)
Copied to clipboard
| Challenge: | Our approach pairs an LM with a growing memory of cases where the user identified an output error and provided general feedback on how to correct it. |
| Approach: | They propose to use an existing script generator to train a model to repair output errors without retraining. |
| Outcome: | The proposed model learns to apply user feedback to repair output errors while avoiding similar past mistakes on new, unseen examples. |
Memory-assisted prompt editing to improve GPT-3 after deployment (2022.emnlp-main)
Copied to clipboard
| Challenge: | Large LMs such as GPT-3 can commit mistakes that are obvious to humans, such as interpreting “What word is similar to good?” to mean a homophone, while the user intended a synonym. |
| Approach: | They pair GPT-3 with a growing memory of cases where the model misunderstood the user’s intents, along with user feedback for clarification. |
| Outcome: | The proposed model can correct misunderstandings on four lexical tasks and two advanced ethical reasoning tasks without retraining. |
Augmenting Pre-trained Language Models with QA-Memory for Open-Domain Question Answering (2023.eacl-main)
Copied to clipboard
| Challenge: | Existing methods for open-domain question-answering use an open book approach . a recent alternative is to retrieve from a collection of previously-generated question-annwer pairs . |
| Approach: | They propose a new QA system that augments a text-to-text model with a large memory of question-answer pairs and a task for the latent step of question retrieval. |
| Outcome: | The proposed system outperforms closed-book QA and can answer multi-hop questions. |
Accurate Training of Web-based Question Answering Systems with Feedback from Ranked Users (2023.acl-industry)
Copied to clipboard
| Challenge: | Recent work shows that large-scale annotated datasets are essential for training state-of-the-art Question Answering (QA) models. |
| Approach: | They use large-scale annotated datasets to train question answering models . they use feedback data collected from deployed QA systems to provide cheaper supervision . |
| Outcome: | The proposed model improves on the large scale annotated datasets from QA systems . the proposed model can be easily supervised on large-scale unlabeled web data . |
AdapTime: Enabling Adaptive Temporal Reasoning in Large Language Models (2026.findings-acl)
Copied to clipboard
Yimin Deng, Yejing Wang, Zhenxi Lin, Zichuan Fu, Guoshuai Zhao, Derong Xu, Yefeng Zheng, Xiangyu Zhao, Xian Wu, Li Zhu, Xueming Qian
| Challenge: | Existing methods for temporal reasoning are limited and apply a fixed pipeline to all questions. |
| Approach: | They propose an adaptive temporal reasoning method that dynamically executes reasoning steps based on context and task requirements. |
| Outcome: | Experiments on two temporal QA benchmarks show the proposed method works. |
Can Generative Pre-trained Language Models Serve As Knowledge Bases for Closed-book QA? (2021.acl-long)
Copied to clipboard
| Challenge: | Existing work is limited in using small benchmarks with high test-train overlaps. |
| Approach: | They construct a dataset of closed-book QA using SQuAD and investigate the performance of BART. |
| Outcome: | Experiments show that pre-trained language models can achieve high performance on closed-book QA tasks. |
Simulating Bandit Learning from User Feedback for Extractive Question Answering (2022.acl-long)
Copied to clipboard
| Challenge: | Explicit feedback from users can be used to continually improve system performance. |
| Approach: | They study the potential of learning from user feedback for extractive question answering by simulating feedback using supervised data. |
| Outcome: | The proposed model improves on a few examples and can be deployed in new domains without any data annotation effort. |
Answer-Supervised Question Reformulation for Enhancing Conversational Machine Comprehension (D19-58)
Copied to clipboard
| Challenge: | Existing question reformulation models are based on supervised question labels without considering feedback information from answers. |
| Approach: | They propose a question reformulation model that integrates conversational history information with reinforcement learning. |
| Outcome: | The proposed model is more effective in conversational machine comprehension with reinforcement learning. |