Challenge: Existing methods for question generation rely on supervised fine-tuning . scarcity of datasets with multiple fine-grained attributes limits ability of models to generalize or transfer control to new combinations of attributes.
Approach: They propose a framework to enhance attribute sensitivity in question generation models . they propose supervised fine-tuning with explicit attribute labels to produce questions that fit predefined characteristics.
Outcome: The proposed framework improves attribute sensitivity while maintaining quality of output.

Similar Papers

Exploring Question-Specific Rewards for Generating Deep Questions (2020.coling-main)

Copied to clipboard

Challenge: Recent question generation approaches use the sequence-to-sequence framework to optimize the log likelihood of ground-truth questions using teacher forcing.
Approach: They propose to optimize for QG-specific objectives via reinforcement learning to improve question quality.
Outcome: The proposed model improves the fluency, relevance, and answerability of generated questions.
CrossQG: Improving Difficulty-Controllable Question Generation through Consistency Enhancement (2025.findings-emnlp)

Copied to clipboard

Challenge: Large language models can generate questions with controlled difficulty, but they often fail to align with the given target difficulty.
Approach: They propose a question generation method that requires no tuning of generator parameters yet significantly improves difficulty consistency.
Outcome: The proposed method outperforms several mainstream methods on high-quality question answering datasets and achieves superior consistency with target difficulty.
Automatic Distractor Generation for Multiple Choice Questions in Standard Tests (2020.coling-main)

Copied to clipboard

Challenge: Existing methods to generate distractors for multiple choice questions are expensive and time-consuming.
Approach: They propose a question and answer guided distractor generation framework to automate distractors generated by domain experts.
Outcome: The proposed model outperforms existing models and achieves state-of-the-art on a large-scale dataset.
Guiding the Growth: Difficulty-Controllable Question Generation through Step-by-Step Rewriting (2021.acl-long)

Copied to clipboard

Challenge: Existing QG systems perform substantially worse in answering multi-hop questions than single-hop ones.
Approach: They propose a framework that progressively increases question difficulty through step-by-step rewriting under the guidance of an extracted reasoning chain.
Outcome: The proposed framework increases question difficulty through step-by-step rewriting under the guidance of an extracted reasoning chain.
Contrastive Multi-document Question Generation (2021.eacl-main)

Copied to clipboard

Challenge: Multi-document question generation focuses on generating a question that covers the common aspect of multiple documents, but a naive model trained only using the targeted document set may generate too generic questions that cover a larger scope than delineated by the document set.
Approach: They propose a contrastive learning strategy where given ‘positive’ and ‘negative’ sets of documents, generate a question that is closely related to the ‘positive' set but far away from the ‘negative' set.
Outcome: The proposed model significantly outperforms several strong baselines, as measured by automatic metrics and human evaluation.
Synthetic Question Value Estimation for Domain Adaptation of Question Answering (2022.acl-long)

Copied to clipboard

Challenge: Existing work adapts QA scores to select high-quality questions, but these scores do not improve QA performance on the target domain.
Approach: They propose to synthesize QA pairs with a question generator on the target domain . they propose to train a Question Value Estimator that estimates usefulness of synthetic questions .
Outcome: The proposed method improves the performance of the target domain QA model by using synthetic questions and only 15% of the human annotations on the targetdomain.
Quiz Design Task: Helping Teachers Create Quizzes with Automated Question Generation (2022.findings-naacl)

Copied to clipboard

Challenge: Question generation models are often evaluated with standardized NLG metrics that are based on n-gram overlap.
Approach: They propose to use QGen to help teachers automate the generation of reading comprehension quizzes by comparing n-gram overlap with BLEU to compare system-generated questions with heldout human-written references.
Outcome: The best model had only 68.4% of its questions accepted by the ten teachers who participated in the study.
Tailor: A Soft-Prompt-Based Approach to Attribute-Based Controlled Text Generation (2023.acl-long)

Copied to clipboard

Challenge: Existing work focuses on generating sentences satisfying pre-specified attributes such as topic and sentiment, yet suffers from increases in storage and inference time.
Approach: They propose a method that uses a pre-trained continuous vector to generate a fixed pre-trainable language model to satisfy a specified attribute.
Outcome: The proposed model can achieve improvements on eleven attribute-specific generation tasks with 0.08% extra training parameters.
Question Generation for Adaptive Education (2021.acl-short)

Copied to clipboard

Challenge: Existing systems depend on a pool of hand-made questions, limiting how fine-grained and open-ended they can be in adapting to individual students.
Approach: They propose to fine-tune pre-trained language models for deep knowledge tracing to generate reversetranslation questions conditioned on the student and target difficulty.
Outcome: The proposed model can generate well-calibrated language translation questions for second language learners from a real online education platform.
CONSISTENT: Open-Ended Question Generation From News Articles (2022.findings-emnlp)

Copied to clipboard

Challenge: Recent work on question generation has largely focused on factoid questions such as who, what, where, when about basic facts.
Approach: They propose an end-to-end system for generating openended questions that are answerable from and faithful to the input text.
Outcome: The proposed model outperforms existing models and can be used in news media organizations.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations