Explain-then-translate: an analysis on improving program translation with self-generated explanations (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Using self-generated natural language explanations improves zero-shot performance by 12% on average. |
| Approach: | They propose to use self-generated natural language explanations as an intermediate step for code-to-code translation with language models. |
| Outcome: | The proposed approach improves zero-shot performance by 12% on average . the proposed approach is not evaluated on a broader set of languages including low-resource languages. |
Similar Papers
CLIX: Cross-Lingual Explanations of Idiomatic Expressions (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing definition generation systems are difficult to use in second language learning due to the presence of unfamiliar words and grammar. |
| Approach: | They propose to use cross-lingual explanations of idiomatic expressions to support vocabulary expansion for language learners. |
| Outcome: | The proposed system is able to explain idiomatic expressions in non-standard language. |
GEE! Grammar Error Explanation with Large Language Models (2024.findings-naacl)
Copied to clipboard
| Challenge: | Existing grammatical error correction tools do not provide natural language explanations of errors . a system needs to provide one-sentence explanations for each grammamatical errors in a pair of erroneous and corrected sentences. |
| Approach: | They propose a grammar error explanation task that uses one-sentence explanations for each grammatical error in a pair of erroneous and corrected sentences. |
| Outcome: | The proposed pipeline identifies grammar errors in German, Chinese, and English . human evaluation reveals that 93.9% of German errors, 96.4% of Chinese errors, and 92.20% of English errors are correctly detected and explained. |
FLamE: Few-shot Learning from Natural Language Explanations (2023.acl-long)
Copied to clipboard
| Challenge: | Recent work has shown limited utility of natural language explanations in improving classification. |
| Approach: | They propose a two-stage few-shot learning framework that generates explanations and fine-tunes a smaller model with generated explanations. |
| Outcome: | The proposed framework increases inference accuracy over strong baselines, but human evaluation reveals that the majority of generated explanations does not adequately justify classification decisions. |
Counterfactual Explanations for Natural Language Interfaces (2022.acl-short)
Copied to clipboard
| Challenge: | Semantic parsing is a promising technique for enabling natural language interfaces, but human language can encode concepts that do not exist in the underlying system or are encoded using different language. |
| Approach: | They propose a novel approach for generating explanations of a natural language interface based on semantic parsing by providing a user with an utterance and a demonstration of their desired goal. |
| Outcome: | The proposed approach significantly improves user performance and generates explanations that more closely match the user’s intent compared to two ablations. |
Exploring Data Augmentation for Code Generation Tasks (2023.findings-eacl)
Copied to clipboard
| Challenge: | Recent advances in natural language processing have impacted how models are trained for programming language tasks. |
| Approach: | They propose to use augmentation methods that yield consistent improvements in code translation and summarization by up to 6.9% and 7.5% respectively. |
| Outcome: | The proposed methods improve translation and summarization by 6.9% and 7.5% respectively. |
Can language models learn from explanations in context? (2022.findings-emnlp)
Copied to clipboard
Andrew Lampinen, Ishita Dasgupta, Stephanie Chan, Kory Mathewson, Mh Tessler, Antonia Creswell, James McClelland, Jane Wang, Felix Hill
| Challenge: | Language Models can adapt to a few in-context examples, but without training. |
| Approach: | They examine how explanations of few-shot examples can help Language Models (LMs) explanations can improve performance even without tuning, they find . |
| Outcome: | The proposed explanations outperform hand-tuned explanations on small validation sets. |
Multi-Level Explanations for Generative Language Models (2025.acl-long)
Copied to clipboard
Lucas Monteiro Paes, Dennis Wei, Hyo Jin Do, Hendrik Strobelt, Ronny Luss, Amit Dhurandhar, Manish Nagireddy, Karthikeyan Natesan Ramamurthy, Prasanna Sattigeri, Werner Geyer, Soumya Ghosh
| Challenge: | Large language models (LLMs) are being used for context-grounded tasks like summarizing meetings and answering doctors' questions. |
| Approach: | They propose a technique to provide explanations for context-grounded text generation by assigning scores to parts of the context to quantify their influence on the model output. |
| Outcome: | The proposed framework can provide more faithful explanations of generated output than available alternatives, including LLM self-explanations. |
Reframing Human-AI Collaboration for Generating Free-Text Explanations (2022.naacl-main)
Copied to clipboard
| Challenge: | Large language models are capable of generating fluent-appearing text with little task-specific supervision. |
| Approach: | They propose a pipeline that combines GPT-3 with a supervised filter that incorporates binary acceptability judgments from humans in the loop. |
| Outcome: | The proposed model can generate freetext explanations in a fewshot setting with human-written examples. |
TextGenSHAP: Scalable Post-Hoc Explanations in Text Generation with Long Documents (2024.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) are difficult to explain and understand due to long input contexts and autoregressive output generation. |
| Approach: | They propose a post-hoc explanation method which incorporates LLM-specific techniques. |
| Outcome: | The proposed method improves retrieval recall and prediction accuracy significantly on open-domain question answering benchmarks. |
Cross-Refine: Improving Natural Language Explanation Generation by Learning in Tandem (2025.coling-main)
Copied to clipboard
| Challenge: | Natural language explanations (NLEs) are vital for elucidating the reasoning behind large language model (LLM) decisions. |
| Approach: | They propose a role-modeling approach that employs two LLMs as generator and critic to generate and refine NLEs. |
| Outcome: | The proposed model outperforms self-refine and can perform with less powerful LLMs. |