Papers with self-refinement
LTRAG: Enhancing Autoformalization and Self-refinement for Logical Reasoning with Thought-Guided RAG (2025.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) have shown promise in natural language reasoning, especially with techniques like chain-of-thought prompting. |
| Approach: | They propose a framework to enhance autoformalization and self-refinement for logical reasoning with Retrieval-Augmented Generation (RAG) by building knowledge bases of thought-guided examples. |
| Outcome: | The proposed framework outperforms Logic-LM and LINC on FOLIO and AR-LSAT, and achieves an accuracy gain of 13% over Logic LM and the proposed methods on GPT-4 and AR LSAT. |
TEaR: Improving LLM-based Machine Translation with Systematic Self-Refinement (2025.findings-naacl)
Copied to clipboard
Zhaopeng Feng, Yan Zhang, Hao Li, Bei Wu, Jiayu Liao, Wenqiang Liu, Jun Lang, Yang Feng, Jian Wu, Zuozhu Liu
| Challenge: | Large Language Models (LLMs) have achieved impressive results in Machine Translation (MT). human evaluations reveal that LLM-generated translations still contain various errors. |
| Approach: | They propose a LLM-based self-refinement framework that feeds error information back into LLMs to facilitate self-finement, leading to enhanced translation quality. |
| Outcome: | The proposed framework outperforms internal refinement and feedback methods while ensuring a robust translation quality baseline. |
Calibrating LLM-Based Evaluator (2024.lrec-main)
Copied to clipboard
Yuxuan Liu, Tianchi Yang, Shaohan Huang, Zihan Zhang, Haizhen Huang, Furu Wei, Weiwei Deng, Feng Sun, Qi Zhang
| Challenge: | Existing models for large language models lack the ability to calibrate their outputs towards human preference. |
| Approach: | They propose a multi-stage, gradient-free approach to calibrate an LLM-based evaluator toward human preference. |
| Outcome: | The proposed approach improves correlation with expert evaluation on multiple text quality evaluation datasets. |
LR²Bench: Evaluating Long-chain Reflective Reasoning Capabilities of Large Language Models via Constraint Satisfaction Problems (2025.findings-acl)
Copied to clipboard
| Challenge: | Recent advances in o1-like models have significantly enhanced the reasoning abilities of Large Language Models (LLMs). |
| Approach: | They propose a benchmark to evaluate the Long-chain Reflective Reasoning capabilities of Large Language Models. |
| Outcome: | The proposed benchmark evaluates the Long-chain Reflective Reasoning capabilities of Large Language Models (LLMs) it consists of 850 samples across six Constraint Satisfaction Problems (CSPs) |
VideoPro: Adaptive Program Reasoning for Long Video Understanding (2026.acl-long)
Copied to clipboard
Chenglin Li, Feng Han, Yikun Wang, Ruilin Li, Shuai Dong, Haowen Hou, Haitao Li, Qianglong Chen, Feng Tao, Jingqi Tong, Yin Zhang, Jiaqi Wang
| Challenge: | Existing methods for understanding long videos are limited due to the sparsity of visual evidence relevant to a given query. |
| Approach: | They propose a framework that enables VideoLLMs to reason over long videos and refine their predictions through executable programs. |
| Outcome: | The proposed framework outperforms existing methods across long-video understanding benchmarks. |
ULTRA: Unleash LLMs’ Potential for Event Argument Extraction through Hierarchical Modeling and Pair-wise Self-Refinement (2024.findings-acl)
Copied to clipboard
| Challenge: | Structural extraction of events within discourse is critical for event-centric understanding . document-level EAE focuses on arguments that are scattered across an entire document . ULTRA is a hierarchical framework that extracts event arguments more cost-effectively . |
| Approach: | They propose a hierarchical framework that extracts event arguments more cost-effectively . ULTRA sequentially reads text chunks of a document to generate a candidate argument set . they propose to use a supervised model to find the exact boundary of an argument . |
| Outcome: | The proposed framework outperforms strong models and ChatGPT by 9.8% when evaluated by Exact Match (EM). |
Two Intermediate Translations Are Better Than One: Fine-tuning LLMs for Document-level Translation Refinement (2025.acl-long)
Copied to clipboard
| Challenge: | Recent research has shown that large language models (LLMs) can enhance translation quality through self-refinement. |
| Approach: | They propose to extend translation refinement from sentence-level to document-level by using document-to-document (Doc2Doc) translations. |
| Outcome: | The proposed method improves translation quality across ten translation tasks with LLaMA-3-8B-Instruct and Mistral-Nemo-Instru. |
From Generic Empathy to Personalized Emotional Support: A Self-Evolution Framework for User Preference Alignment (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) show great potential for expressing empathy, but often deliver generic responses that fail to address users’ specific needs. |
| Approach: | They propose a self-evolution framework to help LLMs improve their responses to better align with users’ implicit preferences concerning personality, emotional state, and specific context. |
| Outcome: | The proposed model significantly improves the model's performance in emotional support, reducing unhelpful responses and minimizing discrepancies between user preferences and model outputs. |
FormalScience: Scalable Human-in-the-Loop Autoformalisation of Science with Agentic Code Generation in Lean (2026.acl-long)
Copied to clipboard
| Challenge: | Formalising informal mathematical reasoning into formally verifiable code is a significant challenge for large language models. |
| Approach: | They propose a domain-agnostic human-in-the-loop agentic pipeline to aid autoformalisation in scientific domains. |
| Outcome: | The proposed system produces syntactically correct and semantically aligned proofs for low cost. |
DR-HM: Distill-then-Reinforce Training with Cognition-Aware Data Synthesis for Harmful Meme Detection (2026.findings-acl)
Copied to clipboard
Zihan Cheng, Jianxiang Ma, Xiaocui Yang, Peidong Wang, Wen Zhang, Shi Feng, Daling Wang, Yifei Zhang, Mingfu Zhang
| Challenge: | Current methods for harmful meme detection lack the knowledge required to identify such hate . current methods lack the ability to identify cultural stereotypes and visual metaphors . |
| Approach: | They propose a framework that decomposes meme analysis into a human-inspired reasoning process . they propose DR-HM to transfer knowledge from closed-source models while mitigating biases . |
| Outcome: | The proposed framework outperforms existing methods on three benchmark datasets. |