| Challenge: | Prior work on training generative Visual Dialog models with reinforcement learning has shown that this improvement saturates and starts degrading after a few rounds of interaction, and does not lead to a better Visual Dialog model. |
| Approach: | They propose a Q-Bot-A-Bot image-guessing game that allows Q-BOT to ask diverse questions, thus reducing repetitions and enabling A-BOTT to explore a larger state space during RL. |
| Outcome: | The proposed approach improves Q-Bot-A-Bot image-guessing performance but degrades after a few rounds of interaction and does not lead to a better Visual Dialog model. |
Similar Papers
Enhancing Visual Dialog Questioner with Entity-based Strategy Learning and Augmented Guesser (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods to build a visual dialog (VD) Questioner do not provide explicit guidance for questioner to generate visually related and informative questions. |
| Approach: | They propose a Related entity enhanced Questioner that learns entity-based questioning strategy from human dialogs. |
| Outcome: | The proposed approach achieves state-of-the-art performance on image-guessing task and question diversity. |
Ask No More: Deciding when to guess in referential visual dialogue (C18-1)
Copied to clipboard
| Challenge: | Using a task-oriented visual dialogue model, we add a decision-making component that decides whether to ask a follow-up question to identify a target referent in an image, or to stop the conversation to make a guess. |
| Approach: | They augment a task-oriented visual dialogue model with a decision-making component that decides whether to ask a follow-up question to identify a target referent in an image, or to stop the conversation to make a guess. |
| Outcome: | The proposed model can be enhanced with a decision-making component that decides whether to ask a follow-up question to identify a target referent in an image, or to stop the conversation to make a guess. |
Building Task-Oriented Visual Dialog Systems Through Alternative Optimization Between Dialog Policy and Language Generation (D19-1)
Copied to clipboard
| Challenge: | Current approaches to visual dialog learning involve an end-to-end framework that maps the multi-modal context to a deep vector and in order to decode a natural dialog response. |
| Approach: | They propose a framework that trains a RL policy for image guessing and a seq2seq model to improve dialog quality. |
| Outcome: | The proposed framework achieves state-of-the-art performance on a guessWhich task . it can be applied to a wide range of tasks including assisting blind people . |
What Should I Ask? Using Conversationally Informative Rewards for Goal-oriented Visual Dialog. (P19-1)
Copied to clipboard
| Challenge: | a new study challenges the ability of artificial agents to engage in goal-oriented conversations . goal-orientated visual dialogue is a challenging task since it requires a strategy and contextual information to achieve a goal. |
| Approach: | They propose a goal-oriented visual dialogue system that combines reinforcement learning with regularized information gain. |
| Outcome: | The proposed system outperforms current state-of-the-art models on the GuessWhat?! dataset. |
SMRT Chatbots: Improving Non-Task-Oriented Dialog with Simulated Multiple Reference Training (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Simulated Multiple Reference Training (SMRT) improves non-task-oriented dialog models by reducing the need for related-domain dialog data. |
| Approach: | They apply Simulated Multiple Reference Training (SMRT) to chatbots to overcome sparse dialog data. |
| Outcome: | The proposed model outperforms pretraining on human evaluation quality and lexical diversity without requiring related-domain dialog data. |
Learning Improvised Chatbots from Adversarial Modifications of Natural Language Feedback (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Currently, user feedback contains extraneous sequences hindering their usefulness as a training sample. |
| Approach: | They propose a generative adversarial model that converts noisy feedback into a plausible natural response in a conversation and fools the discriminator which distinguishes feedback from natural responses. |
| Outcome: | The proposed model improves the original chatbot performance from 69.94%to 75.96% in ranking correct responses on the PERSONACHATdataset. |
Automatically Exposing Problems with Neural Dialog Models (2021.emnlp-main)
Copied to clipboard
| Challenge: | Recent work suggests crowdworkers goad dialog models into generating unsafe and inconsistent responses, but humans leverage superficial clues such as hate speech, while leaving systematic problems undercover. |
| Approach: | They propose two methods to automatically trigger a dialog model into generating problematic responses by reinforcement learning. |
| Outcome: | The proposed methods expose safety and contradiction issues with state-of-the-art dialog models. |
The World in My Mind: Visual Dialog with Adversarial Multi-modal Feature Encoding (N19-1)
Copied to clipboard
| Challenge: | Visual Dialog is a multi-modal task that requires a model to participate in a dialog grounded on an image and generate correct, human-like responses. |
| Approach: | They propose a framework for effective and robust auxiliary training of visual dialog systems using multi-modal encoding. |
| Outcome: | The proposed framework outperforms supervised learning baselines and fine-tuning methods on most metrics of VisDial v0.5/v0.9 generative tasks. |
DiffusionDialog: A Diffusion Model for Diverse Dialog Generation with Latent Space (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing studies have tried to introduce discrete or Gaussian-based latent variables to address the one-to-many problem, but the diversity is limited. |
| Approach: | They propose a diffusion model to enhance the diversity of dialogue generation by using continuous latent variables instead of discrete ones. |
| Outcome: | The proposed model greatly enhances diversity of dialog response while keeping the coherence. |
Multi-Modal Open-Domain Dialogue (2021.emnlp-main)
Copied to clipboard
| Challenge: | Recent work in open-domain conversational agents has demonstrated that significant improvements in humanness and user preference can be achieved via massive scaling in both pre-training data and model size. |
| Approach: | They combine open-domain dialogue agents with vision models to investigate human preferences and humanness. |
| Outcome: | The proposed model outperforms existing models in multi-modal dialogue while performing as well as its predecessor (text-only) BlenderBot. |