Papers by Prithvijit Chattopadhyay
Do explanations make VQA models more predictable to a human? (D18-1)
Copied to clipboard
| Challenge: | Existing explanations of a model's behavior are not used in interactive tasks like Visual Question Answering (VQA). |
| Approach: | They analyze existing explanations and their role in making a VQA model more predictable to a human by using human-in-the-loop approaches that treat the model as a black-box. |
| Outcome: | The proposed explanations make a model more predictable to humans, whereas human-in-the-loop approaches treat it as a black-box do. |
Improving Generative Visual Dialog by Answering Diverse Questions (D19-1)
Copied to clipboard
| Challenge: | Prior work on training generative Visual Dialog models with reinforcement learning has shown that this improvement saturates and starts degrading after a few rounds of interaction, and does not lead to a better Visual Dialog model. |
| Approach: | They propose a Q-Bot-A-Bot image-guessing game that allows Q-BOT to ask diverse questions, thus reducing repetitions and enabling A-BOTT to explore a larger state space during RL. |
| Outcome: | The proposed approach improves Q-Bot-A-Bot image-guessing performance but degrades after a few rounds of interaction and does not lead to a better Visual Dialog model. |