Papers by Jian Wu

89 papers
C2DLM: Causal Concept-Guided Diffusion Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Autoregressive (AR) and diffusion language models (DLMs) suffer from insufficient reasoning capabilities.
Approach: They propose a fully connected Diffusion Language Model that uses a concept-level causal graph to guide attention to learn causal relationships between concepts.
Outcome: The proposed model achieves a 12% improvement and 3.2 training speedup on the COT-OrderPerturb task, along with an average gain of 1.31% across six downstream reasoning tasks.
From the Least to the Most: Building a Plug-and-Play Visual Reasoner via Data Synthesis (2024.emnlp-main)

Copied to clipboard

Challenge: Existing models consisting of multiple steps of visual and language processing are limited in the visual and visual processing community . a visual reasoner is a plug-and-play approach that can be used to improve VLMs' reasoning abilities.
Approach: They propose a least-to-most visual reasoning paradigm that divides a question into sub-questions and invokes external tools for resolving sub-questions.
Outcome: The proposed method can improve four VLMs on four VQA benchmarks.
Beyond Online Sampling: Bridging Offline-to-Online Alignment via Dynamic Data Transformation for LLMs (2025.emnlp-main)

Copied to clipboard

Challenge: Direct Preference Optimization (DPO) eliminates complex reward modeling in aligning large language models with human preferences, but its online variant faces significant efficiency bottlenecks due to costly real-time preference sampling and the reward model annotation.
Approach: They propose a framework that transforms static datasets into dynamically adaptive equivalents without the need for an explicit reward model.
Outcome: The proposed approach matches or exceeds the performance of a fully online DPO.
Text is All You Need: LLM-enhanced Incremental Social Event Detection (2025.acl-long)

Copied to clipboard

Challenge: Existing state-of-the-art (SOTA) SED models rely on graph neural networks (GNNs) Existing SED frameworks rely heavily on GNNs, which require complex graph construction and time-consuming training processes.
Approach: They propose a framework that leverages the rich background knowledge of large language models to formalize and disambiguate short texts by completing abbreviations and summarizing informal expressions.
Outcome: The proposed framework outperforms existing models on two challenging real-world datasets.
FOREVER: Forgetting Curve-Inspired Memory Replay for Language Model Continual Learning (2026.acl-long)

Copied to clipboard

Challenge: Continual learning (CL) for large language models (LLMs) aims to enable sequential knowledge acquisition without catastrophic forgetting.
Approach: They propose a framework that aligns replay schedules with a model-centric notion of time.
Outcome: Experiments on three benchmarks show that FOREVER consistently mitigates catastrophic forgetting.
LoopCoder: Scaling Code Intelligence via Looped Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Large language models have mastered syntax-level code generation, but complex algorithmic reasoning remains a challenge.
Approach: They propose a recurrent inductive bias that aligns with the recursive nature of programming logic.
Outcome: The proposed model achieves comparable performance to standard dense models with more parameters.
A Slot Is Not Built in One Utterance: Spoken Language Dialogs with Sub-Slots (2022.findings-acl)

Copied to clipboard

Challenge: Sub-Slot based task-oriented dialogs provide slot values segment by segment over multiple turns.
Approach: They define a task called Sub-Slot based Task-Oriented Dialog (SSTOD) they build a Chinese dialog dataset SSD for boosting research on SSTOD.
Outcome: The proposed task is called Sub-Slot based Task-Oriented Dialog (SSTOD) it includes 40K dialogs and 500K utterances from Chinese names, phone numbers, ID numbers and license plate numbers . the dataset is well annotated with sub-slot values, slot values, dialog states and actions .
MT3: A Synergistic Multi-Task RL Framework for Specializing MLLMs in Text Image Machine Translation (2026.acl-long)

Copied to clipboard

Challenge: Text Image Machine Translation (TIMT) is a critical subfield of machine translation . it requires accurate optical character recognition, robust visual-text reasoning, and high-quality translation a challenge .
Approach: They propose a multi-task optimization framework to specialize MLLMs into expert TIMT models.
Outcome: The proposed model outperforms baselines on the latest in-domain MIT-10M benchmark.
Tailoring Diagnostic Modeling to Individual Learners: Personalized Distractor Generation via MCTS-Guided Reasoning Reconstruction (2026.acl-long)

Copied to clipboard

Challenge: Current distractor generation methods produce shared distractors for all students, ignoring individual variations in reasoning, which limits their diagnostic effectiveness.
Approach: They propose a method which tailors distractors to each student’s specific cognitive flaws, inferred from their past question-answering (QA) history.
Outcome: The proposed framework outperforms existing methods in generating plausible distractors and adapts to group-level settings.
Towards Reliable Large Audio Language Model (2025.findings-acl)

Copied to clipboard

Challenge: Recent advances in large audio language models (LALMs) have demonstrated impressive results and promising prospects in universal understanding and reasoning across speech, music, and general sound.
Approach: They propose to use training-free and training-based methods to enhance LALM reliability to different extents.
Outcome: The proposed methods improve the reliability of large audio language models to different extents.
On Fake News Detection with LLM Enhanced Semantics Mining (2024.emnlp-main)

Copied to clipboard

Challenge: Existing methods for detecting fake news use only news embeddings to capture the lexical semantics between tokens.
Approach: They propose a topic-based model with prompts to extract news embeddings from LLMs and a generalized page-rank model to extract local and global semantics.
Outcome: The proposed model shows superior performance on five benchmark datasets over seven baseline methods.
TEaR: Improving LLM-based Machine Translation with Systematic Self-Refinement (2025.findings-naacl)

Copied to clipboard

Challenge: Large Language Models (LLMs) have achieved impressive results in Machine Translation (MT). human evaluations reveal that LLM-generated translations still contain various errors.
Approach: They propose a LLM-based self-refinement framework that feeds error information back into LLMs to facilitate self-finement, leading to enhanced translation quality.
Outcome: The proposed framework outperforms internal refinement and feedback methods while ensuring a robust translation quality baseline.
AGSC: Adaptive Granularity and Semantic Clustering for Uncertainty Quantification in Long-text Generation (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for aggregating large-form outputs overlook the nuance of neutral information and suffer from the high computational cost of fine-grained decomposition.
Approach: They propose a UQ framework that uses NLI neutral probabilities as triggers to distinguish irrelevance from uncertainty, reducing computation costs.
Outcome: Experiments on BIO and LongFact show that the proposed framework reduces inference time by 60% compared to full atomic decomposition.
LLM-Driven Completeness and Consistency Evaluation for Cultural Heritage Data Augmentation in Cross-Modal Retrieval (2025.emnlp-main)

Copied to clipboard

Challenge: Cross-modal retrieval is essential for interpreting cultural heritage data, but its effectiveness is limited by incomplete or inconsistent textual descriptions.
Approach: They propose a data augmentation framework that enhances cross-modal retrieval performance by improving the completeness and consistency of LLM-generated descriptions.
Outcome: The proposed framework improves cross-modal retrieval performance by improving completeness and consistency of LLM-generated descriptions.
Mixture-of-Modules: Reinventing Transformers as Dynamic Assemblies of Modules (2024.emnlp-main)

Copied to clipboard

Challenge: Empirical results show that MoMs consistently outperform vanilla transformers .
Approach: They propose an architecture that allows for a mixture-of-modules computation that uses a finite set of modules defined by multi-head attention and feed-forward networks.
Outcome: The proposed architecture outperforms vanilla Transformers and their variants in multiple ways.
BacktrackAgent: Enhancing GUI Agent with Error Detection and Backtracking Mechanism (2025.emnlp-main)

Copied to clipboard

Challenge: Existing GUI agents focus on enhancing the accuracy of individual actions and lack effective mechanisms for detecting and recovering from errors.
Approach: They propose a framework that incorporates a backtracking mechanism to enhance the task completion capabilities of GUI agents by verifier, judger, and reflector components.
Outcome: The proposed framework improves task success rate and step accuracy on Mobile3M and Auto-UI benchmarks.
VPL: Visual Proxy Learning Framework for Zero-Shot Medical Image Diagnosis (2024.findings-emnlp)

Copied to clipboard

Challenge: Insufficient medical text precision and the modal disparity between text and vision spaces pose challenges for vision-language models like CLIP.
Approach: They propose a visual proxy learning framework that combines a text refinement module and a stable Sinkhorn algorithm to enhance the diagnostic performance.
Outcome: The proposed model outperforms the state-of-the-art CLIP inference by 1.69% to 15.31% on five datasets covering various diseases.
DialMed: A Dataset for Dialogue-based Medication Recommendation (2022.coling-1)

Copied to clipboard

Challenge: Existing studies on medication recommendation mainly rely on EHRs, but some details of interactions between doctors and patients may be ignored or omitted in EHR.
Approach: They propose to use medical dialogues to recommend medications with medical dialogue data . they propose to model dialogue structure and disease knowledge aware network .
Outcome: The proposed method is a promising solution to recommend medications with medical dialogues.
HSCR: Hierarchical Self-Contrastive Rewarding for Aligning Medical Vision Language Models (2025.acl-long)

Copied to clipboard

Challenge: Existing methods for medical vision-language models overlook modality misalignment . HSCR generates high-quality preference data with higher sampling probability .
Approach: They propose a hierarchical self-contrastive reward approach that addresses two challenges in alignment . they leverage the inherent capability of Med-VLMs to generate dispreferred responses .
Outcome: The proposed approach improves accuracy and trustworthiness of medical vision-label models with 2,000 training entries.
Unraveling Babel: Exploring Multilingual Activation Patterns of LLMs and Their Applications (2024.emnlp-main)

Copied to clipboard

Challenge: Recent studies have focused on how large language models process multiple languages, but internal mechanisms of LLMs remain insufficiently explored.
Approach: They propose to convert dense LLMs into fine-grained MoE architectures and analyze their activation patterns using expert activation frequency heatmaps.
Outcome: The proposed method outperforms random expert pruning and exceeds models in some languages.
Context-Fidelity Boosting: Enhancing Faithful Generation through Watermark-Inspired Decoding (2026.findings-acl)

Copied to clipboard

Challenge: Large language models produce content that contradicts or overlooks information provided in the input context, a phenomenon known as faithfulness hallucination.
Approach: They propose a lightweight framework that boosts the generation probability of context-relevant tokens by boosting the generation of tokens.
Outcome: The proposed framework improves faithfulness metrics with minimal generation overhead.
From Misleading Queries to Accurate Answers: A Three-Stage Fine-Tuning Method for LLMs (2025.findings-acl)

Copied to clipboard

Challenge: Existing methods focus on correcting the output but overlook the ability of LLMs to detect and correct misleading content in the input itself.
Approach: They propose a three-stage fine-tuning method that improves LLMs' ability to detect and correct misleading information in input queries.
Outcome: The proposed method improves accuracy and factuality of LLM responses while also reducing hallucinations.
MUR: Momentum Uncertainty guided Reasoning for Large Language Models (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for optimizing reasoning quality are limited by overthinking.
Approach: They propose a method that allocates thinking budgets to critical reasoning steps by tracking and aggregating step-wise uncertainty over time.
Outcome: The proposed method reduces computation by over 45% on average while improving accuracy by 0.33–3.46%.
Template-Based Named Entity Recognition Using BART (2021.findings-acl)

Copied to clipboard

Challenge: Existing methods for fewshot NER do not make full use of knowledge transfer in NER model parameters.
Approach: They propose a template-based method for NER that treats NER as a language model ranking problem in a sequence-to-sequence framework.
Outcome: The proposed method achieves 92.55% F1 score on the CoNLL03 task and significantly better than fine-tuning BERT 10.88%, 15.34%, and 11.73% F1 scores on the MIT Movie, the ATIS, and the MATLAB task.
A Survey on Personalized Alignment—The Missing Piece for Large Language Models in Real-World Applications (2025.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) have demonstrated remarkable capabilities, yet their transition to real-world applications reveals a critical limitation: the inability to adapt to individual preferences while maintaining alignment with universal human values.
Approach: They propose a framework that enables LLMs to adapt their behavior within ethical boundaries based on individual preferences.
Outcome: The proposed framework analyzes implementation approaches and evaluates their effectiveness across various scenarios.
DTCRS: Dynamic Tree Construction for Recursive Summarization (2025.acl-long)

Copied to clipboard

Challenge: Recursive summarization (RAG) is an important method for mitigating large model hallucinations and enhancing answer interpretability.
Approach: They propose a method that dynamically generates summary trees based on document structure and query semantics.
Outcome: The proposed method significantly reduces summary tree construction time and achieves substantial improvements across three QA tasks.
Lexicon-Enhanced Self-Supervised Training for Multilingual Dense Retrieval (2022.findings-emnlp)

Copied to clipboard

Challenge: Recent multilingual pre-trained models perform poorly on multilingual retrieval tasks due to lack of multilingual training data.
Approach: They propose to mine and generate self-supervised training data based on large-scale unlabeled corpus and introduce query generator to generate more queries in target languages for unlabed passages.
Outcome: The proposed method performs better than baselines on a Mr. TYDI dataset and an industrial dataset from a commercial search engine.
Text2Tree: Aligning Text Representation to the Label Tree Hierarchy for Imbalanced Medical Classification (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing approaches to medical text classification are struggling with imbalanced data distribution and rare labels.
Approach: They propose a framework-agnostic algorithm that only utilizes internal label hierarchy in training deep learning models.
Outcome: The proposed approach performs better on public datasets and real-world medical records than existing methods.
TACR: A Table Alignment-based Cell Selection Method for HybridQA (2023.findings-acl)

Copied to clipboard

Challenge: Hybrid Question-Answering datasets lack a robust reasoning model for text-based QA.
Approach: They propose a table-question-alignment-based cell-selection and reasoning model for hybrid text and table QA.
Outcome: The proposed model outperforms baselines on HybridQA and WikiTableQuestions datasets on cell selection and argumentation.
Table-R1: Region-based Reinforcement Learning for Table Understanding (2026.findings-acl)

Copied to clipboard

Challenge: Tables are a widely used data format that poses unique challenges for language models due to their structured row-column interactions.
Approach: They propose a region-based reinforcement learning approach that integrates region evidence into reasoning steps.
Outcome: The proposed method outperforms baseline models on three benchmark datasets and significantly reduces the reasoning token consumption by 67.5%.
XFormParser: A Simple and Effective Multimodal Multilingual Semi-structured Form Parser (2025.coling-main)

Copied to clipboard

Challenge: Document AI parsing semi-structured image form is a key information extraction task.
Approach: They propose a multimodal and multilingual semi-structured FORM PARSER which integrates SER and relation extraction into a unified framework.
Outcome: The proposed framework achieves up to 1.79% improvement on RE tasks in multilingual and zero-shot settings.
MT-R1-Zero: Advancing LLM-based Machine Translation via R1-Zero-like Reinforcement Learning (2025.findings-emnlp)

Copied to clipboard

Challenge: Large-scale reinforcement learning (RL) methods have proven effective in enhancing the reasoning abilities of large language models.
Approach: They propose an open-source adaptation of the R1-Zero RL framework for machine translation (MT) their code is available at https://github.com/fzp0424/MT-R1-zero.
Outcome: The proposed framework surpasses towerinstruct-7B-v0.2 on the english-chinese benchmark by 1.26 points.
Reason from Future: Reverse Thought Chain Enhances LLM Reasoning (2025.findings-acl)

Copied to clipboard

Challenge: Existing reasoning paradigms that focus on local optimum reasoning lack global perspective.
Approach: They propose a bidirectional reasoning paradigm that generates reasoning paths by bidirectional planning and bottom-up reasoning accumulation.
Outcome: The proposed reasoning paradigm outperforms conventional paradigms with higher accuracy and less searching space to solve complex tasks.
Can Large Language Models Discern Evidence for Scientific Hypotheses? Case Studies in the Social Sciences (2024.lrec-main)

Copied to clipboard

Challenge: scholarly databases fail to aggregate, compare, contrast, and contextualize existing studies in service to a targeted research question.
Approach: They propose to use large language models to discern evidence in support or refute of specific hypotheses based on abstracts.
Outcome: The proposed method outperforms state-of-the-art methods and highlights opportunities for future research.
Select2Reason: Efficient Instruction-Tuning Data Selection for Long-CoT Reasoning (2026.findings-acl)

Copied to clipboard

Challenge: Large reasoning models exhibit human-like behaviors such as exploration, verification, reflection, and correction.
Approach: They propose a supervised fine-tuning framework for long chain-of-thoughts reasoning . they leverage a difficulty-aware reward model to estimate the learning value of questions .
Outcome: The proposed framework performs fine-tuning on large reasoning models on 10% of the data selected.
AGCL: Aspect Graph Construction and Learning for Aspect-level Sentiment Classification (2025.coling-main)

Copied to clipboard

Challenge: Aspect-level Sentiment Classification (ALSC) is a fine-grained sentiment analysis task that aims to identify the sentiment polarity of a review text toward each corresponding aspect.
Approach: They propose a novel Aspect Graph Construction and Learning method that harnesses aspect connections to construct a domain aspect graph and iteratively updates it to enhance its domain expertise.
Outcome: The proposed method can bridge unseen aspects with seen aspects, enhancing the model's generalization capability.
GCoT-Decoding: Unlocking Deep Reasoning Paths for Universal Question Answering (2026.findings-acl)

Copied to clipboard

Challenge: Recent work on Chain-of-Thought reasoning requires manual prompts to guide the model.
Approach: They propose a general decoding strategy that generates CoT-style reasoning paths without prompts.
Outcome: The proposed method maintains strong performance on fixed and free QA tasks and achieves significant improvements on free qa.
ReachAgent: Enhancing Mobile Agent via Page Reaching and Operation (2025.naacl-long)

Copied to clipboard

Challenge: Existing mobile AI agents focus on most task-relevant elements at each step, leading to local optimal solutions and ignoring the overall GUI flow.
Approach: They propose a mobile AI agent that breaks tasks into page reaching and operation subtasks and a framework that focuses on improving its task-completion abilities.
Outcome: The proposed framework improves IoU accuracy and text accuracy by 7.12% and 7.69% on step-level and 4.72% and 4.63% on task-level compared to the SOTA agent.
Improving Semantic Matching through Dependency-Enhanced Pre-trained Model with Adaptive Fusion (2022.findings-emnlp)

Copied to clipboard

Challenge: Existing work on dependency prior structure integration into pre-trained models is still unclear.
Approach: They propose a dependency-based fusion attention paradigm which explicitly introduces dependency prior structure into pre-trained models and adaptively fuses it with semantic information.
Outcome: The proposed model achieves state-of-the-art or competitive performance on 10 public datasets, demonstrating the benefits of adaptively fusing dependency structure in semantic matching task.
SlotRefine: A Fast Non-Autoregressive Model for Joint Intent Detection and Slot Filling (2020.emnlp-main)

Copied to clipboard

Challenge: Slot filling and intent detection are two main tasks in spoken language understanding systems.
Approach: They propose a non-autoregressive slot filling model with two-pass iteration mechanism to handle uncoordinated slots problem.
Outcome: The proposed model significantly outperforms previous models in slot filling task while speeding up decoding.
MobileVLM: A Vision-Language Model for Better Intra- and Inter-UI Understanding (2024.findings-emnlp)

Copied to clipboard

Challenge: Recent mobile AI agents based on VLMs lack basic mobile capabilities due to their pre-trained nature.
Approach: They propose a mobile AI agent based on VLMs that includes additional pre-training stages to enhance both intra- and inter-UI understanding.
Outcome: The proposed model outperforms existing VLMs on the Chinese mobile dataset Mobile3M .
V-GameGym: Visual Game Generation for Code Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Existing code-related benchmarks focus on single modality rather than visual game development.
Approach: They propose a multimodal benchmark for evaluating code large language models in visual game generation that integrates a clustering-based curation methodology and a pipeline for visual code synthesis.
Outcome: The proposed framework assesses code generation and visual game generation using a sandbox environment.
LongWeave: A Long-Form Generation Benchmark Bridging Real-World Relevance and Verifiability (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing benchmarks for long-form generation assess real-world queries with hard-to-verify metrics or use synthetic setups that overlook real-life intricacies.
Approach: They propose a new approach that balances verifiable and real-world assessment with Target-Anchored Evaluation.
Outcome: The proposed model balances real-world and verifiable assessment with Target-Anchored Evaluation (TAE) it generates queries, textual materials, and anchors based on verifier targets within real-life scenarios .
GLGE: A New General Language Generation Evaluation Benchmark (2021.findings-acl)

Copied to clipboard

Challenge: Multi-task benchmarks focus on a range of Natural Language Understanding (NLU) tasks without considering the Natural Language Generation (NLG) models.
Approach: They propose a multi-task benchmark for evaluating the generalization capabilities of NLG models across eight language generation tasks.
Outcome: The proposed benchmarks are based on GLUE and Su-perGLUE for English and several other languages.
Act as you think: Reinforcing Consistent Reasoning in Medical Visual Question Answering (2026.acl-long)

Copied to clipboard

Challenge: Recent advances have improved the accuracy of medical visual question answering (Med-VQA) however, the high stakes nature of the medical domain has precipitated a shift towards interpretability and transparency of reasoning processes.
Approach: They propose a reinforcement learning from verifiable rewards framework that rewards internal consistency and logical coherence.
Outcome: The proposed framework rewards internal consistency and logical coherence, and is highly versatile, the authors show.
SAME: Safety-Aware Model Editing Guided by Safety Transformation (2026.acl-long)

Copied to clipboard

Challenge: Existing models that update or insert new knowledge require sequential parameter updates while maintaining model capability.
Approach: They propose a model editing approach that estimates safety transforms and identifies corresponding safety direction in the neural activation space and aligns neural activations and network parameter updates under the safety constraints.
Outcome: The proposed approach reduces unsafe responses to malicious queries while preserving the effectiveness of model editing.
Learning What Matters: Dynamic Dimension Selection and Aggregation for Interpretable Vision-Language Reward Modeling (2026.acl-long)

Copied to clipboard

Challenge: Existing multimodal reward models are interpretable but slow, while discriminative ones are opaque "black boxes."
Approach: They propose a framework that dynamically decomposes evaluation into granular, interpretable dimensions.
Outcome: The proposed framework outperforms open-source reward models on benchmarks like VL-RewardBench.
Which Reasoning Trajectories Teach Students to Reason Better? A Simple Metric of Informative Alignment (2026.acl-long)

Copied to clipboard

Challenge: Existing methods assess suitability primarily through student likelihood, favoring trajectories that align closely with the student model’s current behavior but overlooking more informative ones.
Approach: They propose a Rank–Surprisal Ratio metric that captures both alignment and informativeness to assess the suitability of a reasoning trajectory.
Outcome: The proposed metric captures both alignment and informativeness to assess the suitability of a reasoning trajectory.
CGoDial: A Large-Scale Benchmark for Chinese Goal-oriented Dialog Evaluation (2022.emnlp-main)

Copied to clipboard

Challenge: a new benchmark for goal-oriented dialog evaluation is needed to address the problem of knowledge sources, noisy user expressions, and the shortage of annotated data.
Approach: They propose a Chinese benchmark for goal-oriented dialog evaluation that uses dialog sessions and 574,949 dialog turns to bridge the gap between academic benchmarks and spoken dialog scenarios.
Outcome: The proposed benchmark contains 96,763 dialog sessions and 574,949 dialog turns totally.
Low-Resource Response Generation with Template Prior (D19-1)

Copied to clipboard

Challenge: Existing open domain response generation models are limited to paired data, but are less explored in real-world applications.
Approach: They propose to train a neural response generation model with unpaired data and paired data as prior.
Outcome: The proposed model outperforms state-of-the-art models in both automatic and human evaluation when only a few pairs are available.
SPO: Self Preference Optimization with Self Regularization (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing reference-free preference optimization methods exhibit higher training efficiency but are prone to overoptimization, leading to performance degradation.
Approach: They propose a reference-free preference optimization method that replaces the logsigmoid loss function with a SiLU function to improve the model's performance.
Outcome: The proposed method achieves 7% improvement over SimPO on AlpacaEval 2 and MT-Bench.
M3TQA: Massively Multilingual Multitask Table Question Answering (2026.findings-acl)

Copied to clipboard

Challenge: Existing multilingual table benchmarks suffer from geolinguistic imbalance - overrepresenting certain languages and lacking sufficient scale for rigorous cross-lingual analysis.
Approach: They propose a framework for massively multilingual table question answering that includes tables expanded to 97 languages from Chinese and English sources.
Outcome: Experiments on state-of-the-art LLMs show that synthetically generated training data significantly boosts performance, especially for low-resource languages.
COIG-P: A High-Quality and Large-Scale Chinese Preference Dataset for Alignment with Human Values (2026.findings-eacl)

Copied to clipboard

Challenge: Existing Chinese preference datasets suffer from limited scale, restricted domain coverage, and insufficiently rigorous data validation.
Approach: They propose an LLM-based data annotation pipeline with no human intervention to annotate Chinese preference datasets.
Outcome: The proposed pipeline outperforms existing Chinese preference datasets on AlignBench and Chinese Reward Benchmark.
PromptCoT: Synthesizing Olympiad-level Problems for Mathematical Reasoning in Large Language Models (2025.findings-acl)

Copied to clipboard

Challenge: PromptCoT is a novel approach for synthesizing Olympiad-level math problems . it integrates rationale generation and mathematical concepts to generate complex problems based on concepts and rationale behind problem construction.
Approach: They propose a method for automatically generating high-quality Olympiad-level math problems . they use mathematical concepts and the rationale behind problem construction to synthesize complex problems based on mathematical concepts .
Outcome: The proposed method outperforms existing problem generation methods on benchmarks including GSM8K, MATH-500, and AIME2024.
Qwen2.5-xCoder: Multi-Agent Collaboration for Multilingual Code Instruction Tuning (2025.acl-long)

Copied to clipboard

Challenge: Existing methods to train code LLMs view each programming language in isolation . experimental results show that Qwen2.5-xCoder can bridge the gap between different programming languages .
Approach: They propose a framework that allows agents to collaborate to enhance multilingual instruction tuning for code LLMs.
Outcome: Experimental results show that Qwen2.5-xCoder can transfer knowledge efficiently and effectively between languages.
Mind’s Mirror: Distilling Self-Evaluation Capability and Comprehensive Thinking from Large Language Models (2024.naacl-long)

Copied to clipboard

Challenge: Large language models (LLMs) have achieved significant advances in natural language processing, but their scale and computational demands pose challenges to their practical application.
Approach: They propose a method for distilling the self-evaluation capability from LLMs into SLMs and advocate for more comprehensive thinking by incorporating multiple distinct CoTs and self-estimation outputs.
Outcome: The proposed method significantly improves the performance of distilled SLMs on three NLP benchmarks.
Adversarial Attacks Against Automated Fact-Checking: A Survey (2025.emnlp-main)

Copied to clipboard

Challenge: Existing fact-checking systems are vulnerable to adversarial attacks that manipulate or generate claims, evidence, or claim-evidence pairs.
Approach: They examine the impact of adversarial attacks on existing AFC systems and examine their impact on existing ones.
Outcome: The findings highlight the need for resilient fact-checking frameworks in limiting misinformation spread and supporting public trust.
LLMs Can Simulate Standardized Patients via Agent Coevolution (2025.acl-long)

Copied to clipboard

Challenge: Training medical personnel using standardized patients (SPs) remains a complex challenge, necessitating extensive domain expertise and role-specific practice.
Approach: They propose a simulated patient framework that allows patient agents to simulate diagnostic process through multi-turn dialogues.
Outcome: The proposed framework improves over existing reasoning methods by more than 10% in requirement alignment and better human preference after evolving over 200 cases for 10 hours with excellent generalizability.
ToolPlanner: A Tool Augmented LLM for Multi Granularity Instructions with Path Planning and Feedback (2024.emnlp-main)

Copied to clipboard

Challenge: Recent studies have shown that tool-augmented large language models can interact with external tools in multiple rounds and provide a final answer.
Approach: They propose a tool-augmented large language model that can interact with external tools in multiple rounds and provide a final answer to an instruction.
Outcome: The proposed framework significantly improves Match Rate, Pass Rate and Win Rate by 26.8%, 20.2%, and 5.6% compared to the SOTA model.
Large Language Models Badly Generalize across Option Length, Problem Types, and Irrelevant Noun Replacements (2025.emnlp-main)

Copied to clipboard

Challenge: Existing benchmarks have exposed patterns and may not truly assess generalization ability of Large Language Models (LLMs).
Approach: They propose a “Generalization Stress Test” to assess Large Language Models’ generalization ability under slight and controlled perturbations, including option length, problem types, and irrelevant noun replacements.
Outcome: The proposed test shows that LLMs exhibit severe accuracy drops and unexpected biases when faced with minor but content-preserving modifications.
Debate-of-Thoughts: Resolving Knowledge Conflicts in LLMs Through Internal Deliberation (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for retrieval augmented generation are based on a simplistic binary choice of relying on external contexts or memory.
Approach: They propose a framework that transforms conflict resolution into an active deliberation process by incorporating contradictions as opportunities for deeper reasoning.
Outcome: Experiments show that DoT outperforms state-of-the-art methods while generating transparent debate transcripts that explain its decisions.
Identifying and Mitigating Social Bias Knowledge in Language Models (2025.findings-naacl)

Copied to clipboard

Challenge: Existing methods for debiasing may generate incorrect or nonsensical predictions but leave aside individual commonsense facts, resulting in modified knowledge that elicits unreasonable or undesired predictions.
Approach: They propose a framework that identifies encoding locations of biases within language models and then applies the Fairness-Stamp (FAST) they also propose 'BiaScope' to evaluate the retention of commonsense knowledge and generalization across paraphrased social biase.
Outcome: The proposed framework surpasses state-of-the-art baselines with superior debiasing performance while not compromising the overall model capability for knowledge retention and prediction.
Explicit and Implicit Data Augmentation for Social Event Detection (2025.acl-long)

Copied to clipboard

Challenge: Social event detection relies on labeled data, but annotation is costly and labor-intensive.
Approach: They propose a plug-and-play dual augmentation framework that combines explicit text-based and implicit feature-space augmentation to enhance data diversity and model robustness.
Outcome: The proposed framework outperforms the best baseline model by 17.67% on the Twitter2012 dataset and 15.57% on the twitter2018 dataset in terms of the average F1 score.
RoleLLM: Benchmarking, Eliciting, and Enhancing Role-Playing Abilities of Large Language Models (2024.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) have paved the way for complex tasks such as role-playing.
Approach: They propose a framework to benchmark, elicit, and enhance role-playing abilities in Large Language Models.
Outcome: The proposed framework improves role-playing abilities with 168,093 samples.
Dunhuang-Bench: How Well Do MLLMs Understand Cultural Heritage? (2026.findings-acl)

Copied to clipboard

Challenge: Recent advances in Multimodal Large Language Models (MLLMs) have led to extensive evaluations on Chinese cultural benchmarks.
Approach: They construct a large-scale benchmark comprising 486 images and 22,970 QA pairs to evaluate MLLMs' cultural understanding.
Outcome: The proposed benchmark incorporates three task formats to evaluate MLLMs’ cultural understanding: Question Answering with Text Description, Multi-turn Dialogue, and Question Answers with Choices.
Benchmarking for Domain-Specific LLMs: A Case Study on Academia and Beyond (2025.findings-emnlp)

Copied to clipboard

Challenge: Comp-Comp is an iterative benchmarking framework grounded in the principles of comprehensiveness and compactness.
Approach: They propose a benchmark framework that incorporates the principle of comprehensiveness and compactness.
Outcome: The proposed framework is domain-agnostic and adaptable to a wide range of specialized fields.
Guiding Large Language Models for Biomedical Entity Linking via Restrictive and Contrastive Decoding (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing attempts to apply large language models to BioEL have revealed difficulties .
Approach: They propose a framework that enables large language models to adapt well to BioEL . they employ restrictive decoding to ensure the generation of valid entities .
Outcome: Extensive experiments show that the framework outperforms existing LLMs.
Learning from Multiple Noisy Augmented Data Sets for Better Cross-Lingual Spoken Language Understanding (2021.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to scale out spoken language understanding to low-resource languages are noisy.
Approach: They propose a method for mitigating noise in augmented data by training models with augmented datasets.
Outcome: The proposed method outperforms state-of-the-art methods on two benchmark datasets.
Icon2: Aligning Large Language Models Using Self-Synthetic Preference Data via Inherent Regulation (2025.emnlp-main)

Copied to clipboard

Challenge: Large Language Models (LLMs) require high quality preference datasets to align with human preferences.
Approach: They propose a framework that leverages inherent regulation of LLMs’ representation space for efficient and tailored preference dataset construction, named Icon2.
Outcome: The proposed framework improves performance on benchmarks like AlpacaEval 2.0 and Arena-Hard while reducing computational costs by up to 48.1%.
DABERT: Dual Attention Enhanced BERT for Semantic Matching (2022.coling-1)

Copied to clipboard

Challenge: Existing models for semantic sentence matching lack the ability to capture subtle differences.
Approach: They propose to use a Transformer-based pre-trained language model to capture fine-grained differences in sentence pairs by introducing a dual attention module and a fusion module to learn the aggregation of difference and affinity features.
Outcome: The proposed method is able to capture fine-grained differences in sentence pairs.
T2R-BENCH: A Benchmark for Real World Table-to-Report Task (2025.emnlp-main)

Copied to clipboard

Challenge: Existing table benchmarks lack the capacity to adequately assess the practical application of table reasoning in industrial applications.
Approach: They propose a bilingual table-to-report task and a table-based benchmark to assess the quality of table reasoning.
Outcome: The proposed task is based on a bilingual benchmark with 457 industrial tables and evaluation criteria to measure the quality of report generation.
GUI Agents: A Survey (2025.findings-acl)

Copied to clipboard

Challenge: Large Foundation Models (LFMs) have transformed the landscape of AI research and day-to-day life.
Approach: They propose a framework that delineates GUI agents' perception, reasoning, planning, and acting capabilities.
Outcome: The proposed framework delineates their perception, reasoning, planning, and acting capabilities.
UCS-SQL: Uniting Content and Structure for Enhanced Semantic Bridging In Text-to-SQL (2025.findings-acl)

Copied to clipboard

Challenge: Existing methods overlook the challenge of effectively transforming structure information from NL to SQL.
Approach: They propose a text-to-SQL framework that unites content and structure pipes to bridge the gap between NL and SQL.
Outcome: The proposed framework bridges the gap between natural language questions and SQL by combining content and structure pipes.
Training LLMs for Optimization Modeling via Iterative Data Synthesis and Structured Validation (2025.findings-emnlp)

Copied to clipboard

Challenge: Large Language Models (LLMs) are a promising tool for OR, but they face challenges when dealing with complex problems.
Approach: They propose a framework that augments existing datasets and generates high-quality fine-tuning data tailored to OR.
Outcome: The proposed framework augments existing datasets and generates high-quality fine-tuning data . it prevents error propagation and ensures the quality of the generated dataset .
EmoTrans: Emotional Transition-based Model for Emotion Recognition in Conversation (2024.lrec-main)

Copied to clipboard

Challenge: Emotions are causally transmitted among communication participants, facilitating comprehension of intricate changes in emotional states during the conversation.
Approach: They propose an Emotional Transition-based Emotion Recognizer that captures ET features in an emotional conversation by concatenating the most recent utterances with their corresponding speakers.
Outcome: The proposed model is sensitive to emotions and captures ET features in the sample.
M2RC-EVAL: Massively Multilingual Repository-level Code Completion Evaluation (2025.acl-long)

Copied to clipboard

Challenge: Existing repository-level code completion benchmarks focus on a limited number of languages . existing benchmarks report overall average scores of different languages ignoring fine-grained abilities .
Approach: They propose to use repository-level code completion benchmarks to evaluate general code intelligence abilities across languages for existing code Large Language Models.
Outcome: The proposed benchmarks improve the code completion abilities of existing LLMs by using two types of annotations on the parsed syntax tree.
UCoder: Unsupervised Code Generation by Internal Probing of Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Large language models (LLMs) have demonstrated remarkable capabilities in code generation tasks, but their effectiveness relies on supervised training with extensive labeled data and computational resources.
Approach: They propose an unsupervised method that leverages Internal Probing of Large language models for Code generation without any external corpus, even unlabeled code snippets.
Outcome: The proposed method can achieve competitive performance compared to supervised approaches while reducing the dependency on labeled data and computational resources.
AIMMerging: Adaptive Iterative Model Merging Using Training Trajectories for Language Model Continual Learning (2025.emnlp-main)

Copied to clipboard

Challenge: Recent model merging-based methods struggle to effectively manage the trade-off between learning new knowledge and preventing catastrophic forgetting.
Approach: They propose a model merging framework that utilizes learning and forgetting signals from the training trajectory to dynamically monitor the model’s training status.
Outcome: The proposed framework achieves significant performance improvements over existing state-of-the-art methods on three CL benchmarks with various model sizes (from 770M to 13B).
Golden Touchstone: A Comprehensive Bilingual Benchmark for Evaluating Financial Large Language Models (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing financial benchmarks suffer from limited language and task coverage, low-quality datasets, and inadequate adaptability for LLM evaluation.
Approach: They propose a bilingual benchmark for financial LLMs that assesses models’ language understanding and generation capabilities.
Outcome: The proposed bilingual benchmark assesses models’ language understanding and generation capabilities.
LIME: Less Is More for MLLM Evaluation (2025.findings-acl)

Copied to clipboard

Challenge: Existing MLLM benchmarks and unified evaluation frameworks cannot accurately and efficiently reflect the ability of MLMLs.
Approach: They propose a semi-automated benchmark curated using a pipeline that filters out uninformative samples and eliminates answer leakage by focusing on tasks that require image-based understanding.
Outcome: The proposed benchmark reduces the number of samples by 76% and evaluation time by 77% while it can more effectively distinguish different models’ abilities.
Natural Language Processing Meets Quantum Physics: A Survey and Categorization (2021.emnlp-main)

Copied to clipboard

Challenge: Recent research has focused on quantum-inspired algorithms for NLP and quantum-based algorithms for cognition.
Approach: They propose to categorize quantum-inspired algorithms according to quantum theory, linguistic targets that are modeled, and the downstream application.
Outcome: The proposed methods are categorized according to the use of quantum theory, the linguistic targets that are modeled, and the downstream application.
From 1,000,000 Users to Every User: Scaling Up Personalized Preference for User-level Alignment (2026.acl-long)

Copied to clipboard

Challenge: Current approaches to align large language models assume uniform human preferences, overlooking the diversity inherent in human populations.
Approach: They propose a framework for scalable personalized alignment of large language models . they establish a preference space characterizing psychological and behavioral dimensions .
Outcome: The proposed framework improves on existing methods with an average of 17.06% accuracy gain across four benchmarks and a strong adaptation capability to novel preferences.
DataArc-SynData-Toolkit: A Unified Closed-Loop Framework for Multi-Path, Multimodal, and Multilingual Data Synthesis (2026.acl-demo)

Copied to clipboard

Challenge: Existing synthetic data tools are limited by convoluted workflows, fragmented data standards, and limited scalability across modalities.
Approach: They develop an open-source framework that aims to reduce the technical barrier to synthetic data generation and subsequent model training.
Outcome: The proposed framework achieves an optimal balance between generation efficiency and data quality.
OpenRLHF: A Ray-based Easy-to-use, Scalable and High-performance RLHF Framework (2025.emnlp-demos)

Copied to clipboard

Challenge: Existing RLHF frameworks face inference bottlenecks and complexity barriers restricting their accessibility for newcomers.
Approach: They propose an open-source RLHF framework that can be used to train large language models.
Outcome: The proposed framework achieves superior training efficiency with speedups ranging from 1.22 to 1.68 across different model sizes compared to state-of-the-art frameworks, while requiring significantly fewer lines of code for implementation.
MedThink: A Rationale-Guided Framework for Explaining Medical Visual Question Answering (2025.findings-naacl)

Copied to clipboard

Challenge: Existing models for medical visual question answering are limited in their interpretation and interpretation . a semi-automated annotation process is used to streamline data preparation and build new benchmark datasets .
Approach: They propose a semi-automated annotation process to streamline data preparation and build new benchmark Med-VQA datasets.
Outcome: The proposed method achieves an accuracy of 83.5% on R-RAD, 86.3% on RSLAKE and 87.2% on RPath.
M-MAD: Multidimensional Multi-Agent Debate for Advanced Machine Translation Evaluation (2025.acl-long)

Copied to clipboard

Challenge: Recent advances in large language models (LLMs) have shown their potential to deliver human-like judgments.
Approach: They propose a systematic LLM-based multi-agent framework for advanced LLM as-a-judge MT evaluation that integrates dimension-specific results into a final evaluation judgment.
Outcome: The proposed framework outperforms existing LLM-as-a-judge methods and competes with state-of-the-art automatic metrics even when powered by a suboptimal model like GPT-4o mini.
MobileBench-OL: A Comprehensive Chinese Benchmark for Evaluating Mobile GUI Agents in Real-World Environment (2026.findings-acl)

Copied to clipboard

Challenge: Recent advances in mobile Graphical User Interface (GUI) agents highlight the growing need for comprehensive evaluation benchmarks.
Approach: They propose an online benchmark with 1080 tasks from 80 Chinese apps that measures task execution, complex reasoning, noise robustness and auto-eval framework with a reset mechanism.
Outcome: The proposed benchmark measures task execution, complex reasoning, and noise robustness of agents by including 5 subsets, which set multiple evaluation dimensions.
WECA: A WordNet-Encoded Collocation-Attention Network for Homographic Pun Recognition (D18-1)

Copied to clipboard

Challenge: Homographic puns have a long history in human writing, widely used in written and spoken literature, which intended as jokes.
Approach: They propose a WordNet-encoded model to settle polysemy of homographic puns and a word weighted model for recognizing them.
Outcome: The proposed model can distinguish between homographic pun and non-homographic pun texts.
Look Again, Think Slowly: Enhancing Visual Reflection in Vision-Language Models (2025.emnlp-main)

Copied to clipboard

Challenge: Recent advances in text-only "slow thinking" reasoning have prompted efforts to transfer this capability to vision-language models (VLMs).
Approach: They propose a VRM Reflection-V which enhances visual reflection based on reasoning data for cold-start and reward design for reinforcement learning.
Outcome: The proposed model improves visual reflection for cold-start and reward design for reinforcement learning (RL) it maintains a stronger and more consistent reliance on visual information during visual reasoning, indicating effective enhancement in visual reflection capabilities.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations