Challenge: Existing tasks and datasets specifically designed for generating language learner explanations for cloze questions are lacking . clozing questions are used to assess language proficiency and enhance language learning .
Approach: They propose a task ClozEx to generate explanations for cloze questions in LA . they use a curated dataset of clozing questions paired with explanations .
Outcome: The proposed task generates fluent explanations for cloze questions in English as a second language learners.

Similar Papers

CLIX: Cross-Lingual Explanations of Idiomatic Expressions (2025.findings-acl)

Copied to clipboard

Challenge: Existing definition generation systems are difficult to use in second language learning due to the presence of unfamiliar words and grammar.
Approach: They propose to use cross-lingual explanations of idiomatic expressions to support vocabulary expansion for language learners.
Outcome: The proposed system is able to explain idiomatic expressions in non-standard language.
Pedagogically Aligned Objectives Create Reliable Automatic Cloze Tests (2024.naacl-long)

Copied to clipboard

Challenge: a recent study has focused on the cloze training objective of Masked Language Models . distractors must be distinct and incorrect, and can be biased if the test creator is testing two versions of a text .
Approach: They propose a method that jointly optimizes sets of distractors from Masked Language Models.
Outcome: The proposed method has stronger correlation with teacher-created comprehension tests than state-of-the-art neural method and is more internally consistent.
GMEG-EXP: A Dataset of Human- and LLM-Generated Explanations of Grammatical and Fluency Edits (2024.lrec-main)

Copied to clipboard

Challenge: Recent work has explored the ability of large language models (LLMs) to generate explanations of existing labeled data.
Approach: They propose a dataset to examine the ability of large language models to explain revisions in sentences by comparing human- and LLM-generated explanations of grammatical and fluency edits to a human evaluation criteria.
Outcome: The proposed explanations address grammatical and fluency edits and are compared with a dataset built from the GMEG (Grammarly Multi-domain Evaluation for GEC) dataset.
Exploiting Cloze-Questions for Few-Shot Text Classification and Natural Language Inference (2021.eacl-main)

Copied to clipboard

Challenge: Existing approaches to learning from examples are limited due to the vast number of languages, domains and tasks.
Approach: They propose a semi-supervised training procedure that reformulates input examples as cloze-style phrases to help language models understand a given task.
Outcome: The proposed approach outperforms supervised training and strong semi-supervised approaches in low-resource settings by a large margin.
Explain-then-translate: an analysis on improving program translation with self-generated explanations (2023.findings-emnlp)

Copied to clipboard

Challenge: Using self-generated natural language explanations improves zero-shot performance by 12% on average.
Approach: They propose to use self-generated natural language explanations as an intermediate step for code-to-code translation with language models.
Outcome: The proposed approach improves zero-shot performance by 12% on average . the proposed approach is not evaluated on a broader set of languages including low-resource languages.
Explain Yourself! Leveraging Language Models for Commonsense Reasoning (P19-1)

Copied to clipboard

Challenge: Empirical results indicate that we can effectively leverage language models for commonsense reasoning.
Approach: They propose to use commonsense auto-generated explanations to train language models to generate explanations that can be used during training and inference in a commonsensense Auto-Generated Explanation framework.
Outcome: Empirical results show that the proposed framework improves on the commonsenseQA task by 10%.
Data-Efficient Concept Extraction from Pre-trained Language Models for Commonsense Explanation Generation (2022.findings-emnlp)

Copied to clipboard

Challenge: Existing methods to extract concepts from pre-trained language models are not suitable for commonsense explanation generation.
Approach: They propose a method to extract the key explanation concept from pre-trained language models by fine-tuning it with 20% training data and using a metric to evaluate the retrieved concepts.
Outcome: The proposed method improves evaluation metrics over pre-trained language models and the existing models.
Explaining novel senses using definition generation with open language models (2025.findings-emnlp)

Copied to clipboard

Challenge: We apply definition generators based on open-weights large language models to create explanations of novel senses.
Approach: They apply open-weights large language models to create explanations of novel senses using target word usages as input.
Outcome: The proposed definition generators perform on par with decoder-only models.
GEE! Grammar Error Explanation with Large Language Models (2024.findings-naacl)

Copied to clipboard

Challenge: Existing grammatical error correction tools do not provide natural language explanations of errors . a system needs to provide one-sentence explanations for each grammamatical errors in a pair of erroneous and corrected sentences.
Approach: They propose a grammar error explanation task that uses one-sentence explanations for each grammatical error in a pair of erroneous and corrected sentences.
Outcome: The proposed pipeline identifies grammar errors in German, Chinese, and English . human evaluation reveals that 93.9% of German errors, 96.4% of Chinese errors, and 92.20% of English errors are correctly detected and explained.
FiD-Ex: Improving Sequence-to-Sequence Models for Extractive Rationale Generation (2021.emnlp-main)

Copied to clipboard

Challenge: Pre-trained sequence to sequence models are effective in making and generating NL explanations, but they have many shortcomings.
Approach: They propose a model that uses sentence markers to eliminate explanation fabrication . they use fusion-in-decoder architecture to handle long input contexts .
Outcome: The proposed model significantly improves on the ERASER explainability benchmark.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations