Beyond the Textual: Generating Coherent Visual Options for MCQs (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Multiple choice questions (MCQs) are crucial for deep thinking and knowledge integration in education. |
| Approach: | They propose a cross-modal options synthesis framework for generating MCQs with visual options. |
| Outcome: | The proposed framework produces a plausible and visually similar answer and distractor . it also includes a discrimination module to identify content suitable for visual options . |
Similar Papers
Chain-of-Exemplar: Enhancing Distractor Generation for Multimodal Educational Question Generation (2024.acl-long)
Copied to clipboard
| Challenge: | Existing methods for multiple choice questions focus on text inputs and lack visual information. |
| Approach: | They propose a framework to generate subject-specific educational questions with plausible distractors based on multimodal content. |
| Outcome: | The proposed framework improves question generation and distractor generation over existing methods across subjects and educational levels. |
Exploring Automated Distractor Generation for Math Multiple-choice Questions via Large Language Models (2024.findings-naacl)
Copied to clipboard
Wanyong Feng, Jaewook Lee, Hunter McNichols, Alexander Scarlatos, Digory Smith, Simon Woodhead, Nancy Ornelas, Andrew Lan
| Challenge: | Multiple-choice questions (MCQs) are easy to administer and grade . but crafting high-quality distractors remains labor-intensive and limited scalability . |
| Approach: | They propose to automate the generation of distractors in math MCQs by using large language models to generate distractors. |
| Outcome: | The proposed methods can generate valid distractors, but they are less adept at anticipating common errors or misconceptions among real students. |
Seeing Beyond: Enhancing Visual Question Answering with Multi-Modal Retrieval (2025.coling-industry)
Copied to clipboard
| Challenge: | Multi-modal Large language models still suffer from model hallucination and lack of specific knowledge when answering challenging questions. |
| Approach: | They propose to use a multi-modal retrieval augmented generation method to integrate knowledge from all modalities into a model to enable alignment between query and knowledge. |
| Outcome: | The proposed method achieves significant performance improvement on the VQA dataset. |
DisGeM: Distractor Generation for Multiple Choice Questions with Span Masking (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Multiple-choice cloze tests are a prevalent form of assessment that evaluates students' comprehension and inference abilities. |
| Approach: | They propose a framework for distractor generation using readily available pre-trained language models . human evaluations confirm that their approach produces more effective distractors . |
| Outcome: | The proposed framework outperforms existing methods without training or fine-tuning human evaluations confirm it. |
Distractor Generation Using Generative and Discriminative Capabilities of Transformer-based Models (2024.lrec-main)
Copied to clipboard
| Challenge: | Multiple Choice Questions (MCQs) are used to test language learners' comprehension and knowledge. |
| Approach: | They propose an automatic distractor generation approach which generates correct and incorrect answer options and then discriminates potential correct options from distractors. |
| Outcome: | The proposed approach outperforms previous models on multiple choice questions and reading comprehension questions. |
Exploring Union and Intersection of Visual Regions for Generating Questions, Answers, and Distractors (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing efforts to generate image-related questions, correct answers, or challenge distractors are limited. |
| Approach: | They propose to put the spotlight on different image regions to diversify QADs . they propose a framework that generates each QAD based on a recurrent multimodal encoder . |
| Outcome: | The proposed framework puts the spotlight on different image regions to diversify QADs. |
From Generation to Selection: Findings of Converting Analogical Problem-Solving into Multiple-Choice Questions (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Abstract and Reasoning Corpus (ARC) is a benchmark designed to evaluate reasoning abilities alone by reducing the amount of prior knowledge and data required to solve the tasks. |
| Approach: | They propose a multiple-choice format suitable for assessing stages like Understand and Apply in Large Language Models (LLMs). |
| Outcome: | The proposed model supports analogical reasoning and evidence analysis, but LLMs use shortcuts in the MC-LARC format. |
Zero-shot Multimodal Document Retrieval via Cross-modal Question Generation (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing multimodal large language models struggle when faced with unseen domains or languages. |
| Approach: | They propose a framework that leverages the broad knowledge of an MLLM to generate cross-modal pre-questions (preQs) before retrieval. |
| Outcome: | Experiments show that PREMIR outperforms existing retrievers on out-of-distribution benchmarks, including closed-domain and multilingual settings, outperforming strong baselines across all metrics. |
Can We Learn Question, Answer, and Distractors All from an Image? A New Task for Multiple-choice Visual Question Answering (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing studies focus on generating QADs from image and question, but a novel task is needed to generate meaningful questions, correct answers, and challenging distractors. |
| Approach: | They propose a task to generate QADs from images and encode images together . they use contrastive learning to ensure consistency of QAD generated and tested . |
| Outcome: | Empirical evaluations on the benchmark dataset validate the performance of the proposed task. |
Think Both Ways: Teacher-Student Bidirectional Reasoning Enhances MCQ Generation and Distractor Quality (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for generating high-quality MCQs struggle with contextual relevance and plausible distractors. |
| Approach: | They propose a framework that integrates bidirectional reasoning perspectives to generate contextually relevant questions and plausible distractors while student reasoning evaluates question clarity and the misleading nature of distractors. |
| Outcome: | The proposed framework outperforms existing methods in generating text-grounded questions and high-quality distractors for narrative contexts. |