Challenge: Existing research on visual question generation is focused on training models to fit the annotated data set that makes them indifferent from other language generation tasks.
Approach: They propose to use two discriminators to enhance the training of a visual question generator to ask natural questions about an image.
Outcome: The proposed model outperforms state-of-the-art models in terms of automatic and human evaluation metrics.

Similar Papers

Guiding Visual Question Generation (2022.naacl-main)

Copied to clipboard

Challenge: Existing approaches to Visual Question Generation (VQG) are trained to mimic an arbitrary choice of concept but only one or a few are captured by the human references.
Approach: They propose a variant of Visual Question Generation which conditions the question generator on categorical information based on expectations on the type of question and the objects it should explore.
Outcome: The proposed model improves on the current state of the art on an answer-category augmented VQA dataset and human evaluation validates that guidance helps the generation of questions that are grammatically coherent and relevant to the given image and objects.
Answer-driven Deep Question Generation based on Reinforcement Learning (2020.coling-main)

Copied to clipboard

Challenge: Existing methods for deep question generation focus on enhancing document representations, but little attention is paid to the answer information.
Approach: They propose a deep question generation model that makes better use of the target answer as a guidance to facilitate question generation.
Outcome: The proposed model outperforms state-of-the-art models in automatic and human evaluations on the hotpotQA dataset.
Evaluating Rewards for Question Generation Models (N19-1)

Copied to clipboard

Challenge: Recent approaches to question generation have used modifications to a Seq2Seq architecture inspired by advances in machine translation.
Approach: They propose to use a Seq2Seq architecture to train models to generate one-step-ahead predictions, but at test time, the model is asked to generate a whole sequence, causing errors to propagate through the generation process.
Outcome: The proposed model is trained to generate a plausible question, conditioned on an input document and answer span within that document.
Diversifying Question Generation over Knowledge Base via External Natural Questions (2024.lrec-main)

Copied to clipboard

Challenge: Existing methods on knowledge base question generation focus on refining the quality of a single generated question.
Approach: They propose a new diversity evaluation metric which measures the diversity among top-k generated questions for each instance while ensuring their relevance to the ground truth.
Outcome: The proposed model outperforms pre-trained language model baselines and text-davinci-003 in diversity while achieving comparable performance with ChatGPT.
SkillQG: Learning to Generate Question for Reading Comprehension Assessment (2023.findings-acl)

Copied to clipboard

Challenge: Existing question generation systems focus on the literal nature of questions and rarely consider comprehension types of the generated questions.
Approach: They propose a question generation framework with controllable comprehension types for machine reading comprehension models.
Outcome: Empirical results show that SkillQG outperforms baselines in quality, relevance, and skill-controllability while showing a performance boost in downstream question answering task.
Meta-CQG: A Meta-Learning Framework for Complex Question Generation over Knowledge Bases (2022.coling-1)

Copied to clipboard

Challenge: Existing methods train one encoder-decoder-based model to fit all questions . however, such a one-size-fits-all strategy may not perform well for complex questions involving multiple KB relations or functional constraints.
Approach: They propose a meta-learning framework for complex question generation over knowledge bases . they propose he meta-trained generator can acquire universal meta-knowledge .
Outcome: The proposed framework can acquire universal and transferable meta-knowledge and quickly adapt to long-tailed samples under different dimensions.
Exploring Question-Specific Rewards for Generating Deep Questions (2020.coling-main)

Copied to clipboard

Challenge: Recent question generation approaches use the sequence-to-sequence framework to optimize the log likelihood of ground-truth questions using teacher forcing.
Approach: They propose to optimize for QG-specific objectives via reinforcement learning to improve question quality.
Outcome: The proposed model improves the fluency, relevance, and answerability of generated questions.
Multi-VQG: Generating Engaging Questions for Multiple Images (2022.emnlp-main)

Copied to clipboard

Challenge: Traditional visual question generation (VQG) focuses on single images, resulting in a limited ability to comprehend time-series information of the underlying event.
Approach: They propose to generate engaging questions from multiple images using a visual question generation dataset and establish a series of baselines.
Outcome: The proposed model builds stories behind the image sequence to allow for creativity and experience sharing and hence draw attention to downstream applications.
Learning to Generate Question by Asking Question: A Primal-Dual Approach with Uncommon Word Generation (2022.emnlp-main)

Copied to clipboard

Challenge: Existing automatic question generation methods focus on encoding passage and answer to generate question.
Approach: They propose an automatic question generation approach which integrates question generation with its dual problem, question answering, into a unified primal-dual framework.
Outcome: The proposed approach outperforms existing methods on SQuAD and HotpotQA benchmarks.
Semantic Graphs for Generating Deep Questions (2020.acl-main)

Copied to clipboard

Challenge: Existing research has focused on generating factoid questions relevant to one fact obtainable from a single sentence.
Approach: They propose a framework that first constructs a semantic-level graph and then encodes it by introducing an attention-based GGNN.
Outcome: The proposed framework captures the global structure of the document and facilitates reasoning over multiple facts.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations