Papers with VQG
Multi-VQG: Generating Engaging Questions for Multiple Images (2022.emnlp-main)
Copied to clipboard
| Challenge: | Traditional visual question generation (VQG) focuses on single images, resulting in a limited ability to comprehend time-series information of the underlying event. |
| Approach: | They propose to generate engaging questions from multiple images using a visual question generation dataset and establish a series of baselines. |
| Outcome: | The proposed model builds stories behind the image sequence to allow for creativity and experience sharing and hence draw attention to downstream applications. |
Guiding Visual Question Generation (2022.naacl-main)
Copied to clipboard
| Challenge: | Existing approaches to Visual Question Generation (VQG) are trained to mimic an arbitrary choice of concept but only one or a few are captured by the human references. |
| Approach: | They propose a variant of Visual Question Generation which conditions the question generator on categorical information based on expectations on the type of question and the objects it should explore. |
| Outcome: | The proposed model improves on the current state of the art on an answer-category augmented VQA dataset and human evaluation validates that guidance helps the generation of questions that are grammatically coherent and relevant to the given image and objects. |
A Reinforcement Learning Framework for Natural Question Generation using Bi-discriminators (C18-1)
Copied to clipboard
| Challenge: | Existing research on visual question generation is focused on training models to fit the annotated data set that makes them indifferent from other language generation tasks. |
| Approach: | They propose to use two discriminators to enhance the training of a visual question generator to ask natural questions about an image. |
| Outcome: | The proposed model outperforms state-of-the-art models in terms of automatic and human evaluation metrics. |
Learning to Ask: Multi-Decoder Fine-Tuning for Multi-Hop Visual Question Generation with External Knowledge (2026.findings-eacl)
Copied to clipboard
| Challenge: | Traditional supervised QG methods rely on tokenlevel alignment with fixed gold labels struggle to capture diverse valid question formulations. |
| Approach: | They propose a model-agnostic framework that integrates multimodal inputs with a multi-decoder architecture to optimize for multiple labels per sample. |
| Outcome: | The proposed framework improves fluency, reasoning depth, and relevance of visual questions. |
Diagram-Driven Course Questions Generation (2025.emnlp-main)
Copied to clipboard
Xinyu Zhang, Lingling Zhang, Yanrui Wu, Muye Huang, Wenjun Wu, Bo Li, Shaowei Wang, Basura Fernando, Jun Liu
| Challenge: | Visual Question Generation (VQG) research focuses on natural images while neglecting diagrams, a critical component of educational materials. |
| Approach: | They propose a diagram-driven course questions generation task to generate diagram-relevant questions for specific courses. |
| Outcome: | The proposed framework outperforms existing models on DiagramQG while maintaining strong generalizability across natural image datasets. |
Knowledge-Guided Cross-Topic Visual Question Generation (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods for visual question generation use answers or question types as constraints to generate questions. |
| Approach: | They propose a knowledge-guided cross-topic visual question generation task to generate unseen topics in cross-section scenarios. |
| Outcome: | The proposed model outperforms baselines and can generate unseen topic-related questions in cross-topic scenarios. |