Papers by Wentao Chen

37 papers
TC–RAG: Turing–Complete RAG’s Case study on Medical LLM Systems (2025.acl-long)

Copied to clipboard

Challenge: Existing approaches to RAG neglect system state variables, resulting in poor performance and erroneous knowledge accumulation.
Approach: They propose a framework that incorporates a Turing Complete System to manage state variables and manage retrieval halting.
Outcome: The proposed framework improves on seven real-world healthcare datasets and shows that it is more accurate than existing methods.
FB-Bench: A Fine-Grained Multi-Task Benchmark for Evaluating LLMs’ Responsiveness to Human Feedback (2025.emnlp-main)

Copied to clipboard

Challenge: Existing research focuses on benchmarking LLMs in single-turn dialogues, neglecting the nuanced nature of human feedback within real-world usage scenarios.
Approach: They propose a fine-grained, multi-task benchmark designed to evaluate LLMs’ responsiveness to human feedback under real-world usage scenarios in Chinese.
Outcome: The proposed benchmarks show that human feedback can significantly impact LLMs’ responsiveness in real-world usage scenarios.
Timeline-based Sentence Decomposition with In Context Learning for Temporal Fact Extraction (2024.acl-long)

Copied to clipboard

Challenge: Recent research on temporal fact extraction fails to establish time-to-fact correspondences in complex sentences.
Approach: They propose a timeline-based sentence decomposition strategy using large language models with in-context learning to extract temporal facts from natural language text.
Outcome: The proposed method achieves state-of-the-art on a complex temporal fact extraction dataset.
Syllogistic Reasoning for Legal Judgment Analysis (2023.emnlp-main)

Copied to clipboard

Challenge: Legal judgment assistants are developing fast due to impressive progress of large language models.
Approach: They construct and manually correct a syllogistic reasoning dataset for legal judgment analysis using large language models as benchmarks.
Outcome: The proposed dataset contains 11,239 criminal cases covering 4 criminal elements, 80 charges and 124 articles.
MathMixup: Boosting LLM Mathematical Reasoning with Difficulty-Controllable Data Synthesis and Curriculum Learning (2026.findings-acl)

Copied to clipboard

Challenge: Existing data synthesis methods suffer from limited diversity and lack precise control over problem difficulty, making them insufficient for efficient training paradigms such as curriculum learning.
Approach: They propose a data synthesis paradigm that generates high-quality, difficulty-controllable mathematical reasoning problems through hybrid and decomposed strategies.
Outcome: The proposed paradigm outperforms existing methods and improves mathematical reasoning abilities.
Intent-calibrated Self-training for Answer Selection in Open-domain Dialogues (2023.tacl-1)

Copied to clipboard

Challenge: Existing answer selection models require large amounts of labeled data to produce accurate answers.
Approach: They propose intent-calibrated self-training to calibrate answer labels using labeled data . they propose intentcalibration to improve quality of pseudo answer labels .
Outcome: The proposed intent-calibrated answer selection paradigm outperforms baselines with 1%, 5%, and 10% labeled data on two benchmark datasets.
Improving Multi-label Malevolence Detection in Dialogues through Multi-faceted Label Correlation Enhancement (2022.acl-long)

Copied to clipboard

Challenge: Current methods for detecting dialogue malevolence neglect label correlation.
Approach: They propose to crowdsource a multi-label dataset for detecting malevolent dialogue responses and a model with label correlation enhanced CRF to measure the correlation between malevolence and negative emotions.
Outcome: The proposed model outperforms the best performing baseline method on precision, recall, F1, and Jaccard score by 16.1%, 11.9%, 12.0%, and 6.1% on malevolence.
Automatic rule generation for time expression normalization (2021.findings-emnlp)

Copied to clipboard

Challenge: Existing SOTA methods for normalization rely on expert-designed rules or grammars . current methods are domain sensitive and not sufficient on emerging corpora .
Approach: They propose a method that generates normalization rules from annotated data without expert intervention.
Outcome: The proposed method surpasses existing rule-based methods on the Tweets benchmark and on the TempEval-3 benchmark.
Leveraging Unpaired Feedback for Long-Term LLM-based Recommendation Tuning (2025.findings-emnlp)

Copied to clipboard

Challenge: a recent study highlights unpaired feedback as a key challenge for long-term LLM-based recommenders . unpaired user feedback is crucial for improving LLMs in dynamic user environments, authors say .
Approach: They propose a framework that incorporates unpaired feedback into LLMs to improve long-term recommendation performance.
Outcome: The proposed framework improves long-term recommendation performance by incorporating unpaired feedback without requiring paired supervision.
Semantic Framework based Query Generation for Temporal Question Answering over Knowledge Graphs (2022.emnlp-main)

Copied to clipboard

Challenge: Existing methods for temporal question answering ignore intrinsic connections between events that can make them temporally related.
Approach: They propose a temporal question answering method that generates query graphs by exploring relevant facts of mentioned entities.
Outcome: The proposed method outperforms existing methods on two benchmarks over different knowledge graphs.
Hallucinations as Orthogonal Noise: Inference-Time Manifold Alignment via Dynamic Contextual Orthogonalization (2026.findings-acl)

Copied to clipboard

Challenge: Hallucinations in Large Language Models persist in critical domains where generated content diverges from contextual facts or logical constraints.
Approach: They propose to generate hallucinations as orthogonal noise relative to the semantic manifold of the residual stream.
Outcome: The proposed method achieves superior contextual faithfulness compared to state-of-the-art methods.
One Pair Suffices: Unlocking Universal Zero-Shot Translation via Cross-Architecture Alignment (2026.acl-long)

Copied to clipboard

Challenge: Current paradigms for empowering Large Language Models with multilingual capabilities rely heavily on massive instruction tuning.
Approach: They propose a hybrid cross-alignment approach that fuses a frozen NLLB encoder with a Qwen decoder via a closed-loop dual-adapter architecture.
Outcome: The proposed model outperforms towerPlus-9B and Aya-101 on language-agnostic projection protocols.
Do LLMs Behave as Claimed? Investigating How LLMs Follow Their Own Claims using Counterfactual Questions (2025.emnlp-main)

Copied to clipboard

Challenge: Existing evaluation frameworks rely on curated datasets that, once public, may be accessed by newer LLMs.
Approach: They propose a framework that generates counterfactual questions and answers from existing evaluation datasets and uses them to evaluate LLMs.
Outcome: The proposed evaluation framework reduces the risk of data leakage by allowing the LLMs to respond to counterfactual questions and verify their claims.
Dataset for the First Evaluation on Chinese Machine Reading Comprehension (L18-1)

Copied to clipboard

Challenge: Existing reading comprehension datasets are mostly in English .
Approach: They propose a Chinese reading comprehension dataset to add diversity to existing reading comprehension data . proposed dataset contains cloze-style reading comprehension and user query reading comprehension .
Outcome: The proposed dataset is based on a Chinese reading comprehension dataset . it includes two types of cloze-style and user query reading comprehension . the proposed dataset hosted the 1st Evaluation on Chinese Machine Reading Comprehension (CMRC-2017)
A Sentence Cloze Dataset for Chinese Machine Reading Comprehension (2020.coling-main)

Copied to clipboard

Challenge: Using cloze-style reading comprehension, Chinese machine reading comprehension datasets are becoming more and more popular . a new task is proposed to fill the right candidate sentence into the passage with several blanks .
Approach: They propose a Chinese task to fill the right candidate sentence into a passage with blanks . they build a dataset to evaluate the difficulty of the task and make fake candidates .
Outcome: The proposed task fills the right candidate sentence into the passage with blanks . the proposed dataset contains over 100K blanks within over 10K passages based on Chinese narrative stories .
InfiMM: Advancing Multimodal Understanding with an Open-Sourced Visual Language Model (2024.findings-acl)

Copied to clipboard

Challenge: InfiMM is a multimodal large language model that adapts to complex vision-language tasks.
Approach: They present a Multimodal Large Language Model that adapts to intricate vision-language tasks using large-scale training data and comprehensive training strategies.
Outcome: Empirical evaluations across a variety of benchmarks underscore InfiMM’s remarkable capability in multimodal understanding.
Can LLMs be Good Graph Judge for Knowledge Graph Construction? (2025.emnlp-main)

Copied to clipboard

Challenge: Existing methods for converting unstructured text into structured Knowledge Graphs (KGs) have limitations such as large amount of noise, inaccurate knowledge, and hallucination .
Approach: They propose a GraphJudge framework to reduce noise in real-world documents . they propose Graphjudge to fine-tune a LLM as a graph judge to enhance quality .
Outcome: The proposed framework eliminates noise in real-world documents and improves the quality of generated KGs.
Dynamic Model-Bank Test-Time Adaptation for Automatic Speech Recognition (2025.emnlp-main)

Copied to clipboard

Challenge: Existing ASR TTA methods struggle with instability under continual and long-term distribution shifts.
Approach: They propose a continuous adaptive model-bank framework that adapts to domain shifts in ASR test-time scenarios.
Outcome: Experiments on diverse, continuously shifting ASR benchmarks show that DMSUTA outperforms existing continual TTA baselines.
MorphoBench: A Benchmark with Difficulty Adaptive to Model Reasoning (2026.findings-acl)

Copied to clipboard

Challenge: Existing benchmarks designed to evaluate the reasoning capabilities of large models are limited in scope and lack flexibility to adapt difficulty according to evolving reasoning capacities of models.
Approach: They propose a benchmark that incorporates multidisciplinary questions to evaluate the reasoning capabilities of large models and can adjust and update question difficulty based on the reasoning abilities of advanced models.
Outcome: The proposed benchmark incorporates multidisciplinary questions to evaluate the reasoning capabilities of large models and can adjust and update question difficulty based on the reasoning abilities of advanced models.
Data Contamination Calibration for Black-box LLMs (2024.findings-acl)

Copied to clipboard

Challenge: Despite the rapid advancements of Large Language Models, the unchecked ultra-large-scale training sets introduce a series of potential risks like data contamination.
Approach: They propose a method to detect contaminated training data and diminish the contamination effect by using a to-be-released dataset.
Outcome: The proposed method outperforms existing methods by at least 4.5% on more 4 dataset formats, with more than 10 base LLMs.
A Span-Extraction Dataset for Chinese Machine Reading Comprehension (D19-1)

Copied to clipboard

Challenge: Existing reading comprehension datasets are mostly in English . MRC is a new field of research that aims to comprehend the context of articles and answer the questions based on them.
Approach: They propose a Span-Extraction dataset for Chinese machine reading comprehension to add language diversities to existing reading comprehension datasets.
Outcome: The proposed dataset is composed of 20,000 real questions annotated on Wikipedia paragraphs by human experts.
MLLM-Bench: Evaluating Multimodal LLMs with Per-sample Criteria (2025.naacl-long)

Copied to clipboard

Challenge: Existing evaluation methodologies for multimodal large language models are limited in evaluating objective queries without considering real-world user experiences.
Approach: They propose to evaluate multimodal large language models with per-sample criteria using potent MLLM as the judge.
Outcome: The proposed evaluation paradigm shows that it can be used to evaluate multimodal large language models with per-sample criteria.
LongInsightBench: A Comprehensive Benchmark for Evaluating Omni-Modal Models on Human-Centric Long-Video Understanding. (2026.findings-acl)

Copied to clipboard

Challenge: LongInsightBench is the first benchmark designed to assess models’ ability to understand long videos, with a focus on human language, viewpoints, actions, and other contextual elements.
Approach: They propose a benchmark to assess models’ ability to understand long videos with a focus on human language, viewpoints, actions, and other contextual elements.
Outcome: The proposed model excels in three key areas: a) long-duration, human-centric videos; b) diversifying and challenging task scenarios; c) quality assurance pipeline; and d) reliability.
Multimodal Chemical Structure-Text Coreference in Intellectual Property via Rule-guided Reinforcement Learning (2026.findings-acl)

Copied to clipboard

Challenge: Existing tools for identifying chemical structures and textual referents are inadequate for this multimodal task.
Approach: They propose a RULE-guided multimodal Reinforcement learning framework for chemical structure-text coreference . RULER is a rule-driven reinforcement learning framework that uses rule-based reward functions to obtain the correct domain knowledge.
Outcome: The proposed framework improves on the baseline framework and shows superior efficacy.
AJ-Bench: Benchmarking Agent-as-a-Judge for Environment-Aware Evaluation (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches to verify agent behaviors in complex environments rely on rule-based verifiers or LLM-as-a-Judge models.
Approach: They propose a benchmark to evaluate Agent-as-a-Judge across three domains . the benchmark covers search, data systems, and graphical user interfaces - with 155 tasks and 516 trajectories .
Outcome: The proposed benchmark outperforms existing benchmarks in search, data systems, and GUI domains while revealing open challenges in agent-based verification.
Training Verifier to Assessing Complex Real-World Tool-Use Trajectories (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods for training effective AI agents often resort to synthetic data generation.
Approach: They propose a plug-and-play framework for data quality control in tool-use scenarios . they construct a tool-verify dataset and release a benchmark to assess its performance .
Outcome: The proposed framework surpasses Qwen2.5-72B-Instruct on Tool-V-Bench and the previous APIGen-MT dataset.
CFBench: A Comprehensive Constraints-Following Benchmark for LLMs (2025.acl-long)

Copied to clipboard

Challenge: Existing evaluations of Large Language Models (LLMs) focus on fragmented constraints or narrow scenarios, but they overlook the comprehensiveness and authenticity of constraints from the user’s perspective.
Approach: They propose a Chinese Comprehensive Constraints Following Benchmark for LLMs that compiles constraints from real-world instructions and constructs a systematic framework for constraint types.
Outcome: The proposed framework integrates multi-dimensional assessment criteria with requirement prioritization, covering various perspectives of constraints, instructions, and requirement fulfillment.
CoMave: Contrastive Pre-training with Multi-scale Masking for Attribute Value Extraction (2023.findings-acl)

Copied to clipboard

Challenge: Existing methods to extract product features from unstructured text still suffer from problems . e-commerce platforms are focusing on multi-scale values, which can be confusing .
Approach: They propose a pre-training technique to automatically obtain attribute value pairs from product descriptions to aid e-commerce.
Outcome: The proposed method improves on the existing token-level masking strategy and achieves state-of-the-art on four benchmarks.
CRAB: A Benchmark for Evaluating Curation of Retrieval-Augmented LLMs in Biomedicine (2025.emnlp-industry)

Copied to clipboard

Challenge: Recent development in Retrieval-Augmented Large Language Models (LLMs) have shown great promise in biomedical applications.
Approach: They propose a multilingual benchmark to evaluate retrieval-augmented large language models' curation ability.
Outcome: The proposed benchmark is available in English, French, German and Chinese.
UniDataBench: Evaluating Data Analytics Agents Across Structured and Unstructured Data (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks do not assess agents’ capabilities across data types . Existing tools only evaluate agents' ability to extract reasonable insights across data formats.
Approach: They propose a multi-source benchmark to evaluate the performance of data analytics agents in handling diverse data sources.
Outcome: The proposed agent performs end-to-end analysis over diverse data sources by automatically discovering cross-source linkages, decomposing goals, and generating robust, self-correcting code to extract actionable insights.
The Dominance of Text Space: Unveiling the Asymmetric Nature of Cross-Modal Alignment in Large Language Models (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for cross-modal alignment assume a symmetric interaction between visual and textual modalities, implying that both spaces adapt to each other.
Approach: They propose a method that regularizes the projector to maintain the geometric structure of the text embedding space via spectral filtering.
Outcome: The proposed method preserves the LLM’s inherent linguistic capabilities and reduces object hallucination significantly better than standard fine-tuning methods.
Resonant Context Anchoring: Decoupling Attention Routing and Signal Gain at Inference Time (2026.findings-acl)

Copied to clipboard

Challenge: Existing mitigation strategies rely on suppressing specific neuron activations or employing computationally expensive contrastive decoding mechanisms, which often result in increased perplexity or significantly elevated inference latency.
Approach: They propose a lightweight inference-time intervention method grounded in the perspective of residual stream signal dynamics to resolve the signal attenuation of external evidence during its propagation through deep networks.
Outcome: The proposed method improves contextual faithfulness across multiple factual consistency and strong knowledge-conflict tasks while maintaining the model’s general language understanding capabilities.
SciFlow-Bench: Evaluating Structure-Aware Scientific Diagram Generation via Inverse Parsing (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks for scientific diagram generation rely on image-centric metrics or evaluation of intermediate symbolic representations rather than final rendered images.
Approach: They propose a structure-first benchmark for evaluating scientific diagram generation from pixel-level outputs.
Outcome: The proposed benchmark evaluates scientific diagram generation directly from pixel-level outputs.
HopRAG: Multi-Hop Reasoning for Logic-Aware Retrieval-Augmented Generation (2025.findings-acl)

Copied to clipboard

Challenge: Traditional retrieval systems focus on lexical or semantic similarity rather than logical relevance.
Approach: They propose a new RAG framework that augments retrieval with logical reasoning . hopRAG uses a retrieve-reason-prune mechanism to explore multi-hop neighbors .
Outcome: The proposed framework outperforms conventional retrieval systems and state-of-the-art benchmarks on multi-hop QA tasks.
LongTableBench: Benchmarking Long-Context Table Reasoning across Real-World Formats and Domains (2025.findings-emnlp)

Copied to clipboard

Challenge: Evaluating 52 LLMs reveals that only the strongest models maintain robust performance under increasing context lengths and format diversity.
Approach: They propose a benchmark for evaluating long-context reasoning over semi-structured tables across diverse formats, tasks, and domains.
Outcome: The proposed model outperforms compression-based approaches on tasks requiring semantic integration.
CYCLE-INSTRUCT: Fully Seed-Free Instruction Tuning via Dual Self-Training and Cycle Consistency (2025.emnlp-main)

Copied to clipboard

Challenge: Existing methods for instruction tuning rely on expensive human-annotated seed data or powerful external teacher models.
Approach: They propose a framework that achieves fully seed-free instruction tuning by employing a dual self-training loop where two models are bootstrapped solely from raw, unlabeled text.
Outcome: The proposed framework outperforms seed-driven back-translation baselines and achieves comparable performance to strongly supervised methods.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations