Papers by Jian He

37 papers
Beyond Online Sampling: Bridging Offline-to-Online Alignment via Dynamic Data Transformation for LLMs (2025.emnlp-main)

Copied to clipboard

Challenge: Direct Preference Optimization (DPO) eliminates complex reward modeling in aligning large language models with human preferences, but its online variant faces significant efficiency bottlenecks due to costly real-time preference sampling and the reward model annotation.
Approach: They propose a framework that transforms static datasets into dynamically adaptive equivalents without the need for an explicit reward model.
Outcome: The proposed approach matches or exceeds the performance of a fully online DPO.
RWKV: Reinventing RNNs for the Transformer Era (2023.findings-emnlp)

Copied to clipboard

Challenge: recurrent neural networks struggle to match the performance of Transformers due to limitations in parallelization and scalability.
Approach: They propose a model architecture that combines the efficient parallelizable training of transformers with the efficient inference of RNNs.
Outcome: The proposed model performs on par with similarly sized RNNs, suggesting future work can leverage this architecture to create more efficient models.
LOT: A Story-Centric Benchmark for Evaluating Chinese Long Text Understanding and Generation (2022.tacl-1)

Copied to clipboard

Challenge: Existing benchmarks for natural language processing focus on understanding or generating short texts . lack of standardized benchmarks makes it difficult to assess and compare models .
Approach: They propose a story-centric benchmark for Chinese long text modeling that aggregates two understanding tasks and two generation tasks.
Outcome: The proposed model outperforms similar-sized models on understanding and generation tasks.
Noisy Pair Corrector for Dense Retrieval (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing dense retrieval models assume that query-document pairs are exactly matched, resulting in mismatched-pair noise.
Approach: They propose a novel approach to train an effective model with mismatched-pair noise.
Outcome: The proposed model performs well on natural question and triviaQA, code-search benchmarks and SO-DS.
Progressive Re-ranking for Multimodal Retrieval-Augmented Generation via Curriculum Learning (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches to improve retrieval performance of large language models are limited by static knowledge.
Approach: They propose a multimodal re-ranking framework that combines curriculum learning with fine-grained reranking and multimodal section reassessment to improve CLIP-based visual coarse-grain retrieval.
Outcome: The proposed framework achieves state-of-the-art answer accuracy and competitive retrieval performance on InfoSeek and Enc-VQA.
TransS-Driven Joint Learning Architecture for Implicit Discourse Relation Recognition (2020.acl-main)

Copied to clipboard

Challenge: Existing approaches to implicit discourse relation recognition lack connectives as strong linguistic clues.
Approach: They propose a transS-driven joint learning architecture to translate discourse relations in low-dimensional embedding space and exploit the semantic features of arguments to assist discourse understanding.
Outcome: The proposed model outperforms existing systems on the Penn Discourse TreeBank.
From Pseudo-Balancing to True Specialization: Memory-Aware Routing for Mixture-of-Experts (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods to optimize expert-centered load balancing fail to account for pseudo-balance phenomenon . severe knowledge overlap among experts leads to redundant representations and inefficient parameter utilization .
Approach: They propose a method that prioritizes expert utilization over semantic alignment . they use memory-aware routing to ensure expert load balancing is consistent .
Outcome: Experimental results show that MAR improves expert specialization by 35% and accuracy by 2%-25% . MAR matches baseline performance with only half the experts .
MedForge: Interpretable Medical Deepfake Detection via Forgery-aware Reasoning (2026.acl-long)

Copied to clipboard

Challenge: Existing defenses against forgery are inadequate for healthcare.
Approach: They propose a large-scale benchmark for pre-hoc, evidence-grounded medical forgery detection using a doctor inspection guideline and gold edit locations.
Outcome: Experiments show that the proposed solution can detect and explain medical scans with high fidelity and accuracy.
HeteroCache: A Dynamic Retrieval Approach to Heterogeneous KV Cache Compression for Long-Context LLM Inference (2026.acl-long)

Copied to clipboard

Challenge: Existing static compression methods suffer from coarse-grained caching and high I/O overhead.
Approach: They propose a training-free dynamic compression framework that uses a sparse attention mechanism to categorize attention heads based on stability and similarity.
Outcome: The proposed framework achieves state-of-the-art performance on long-context benchmarks and accelerates decoding by up to 3 compared to the original model with a 224K context.
Enhancing Character-Level Understanding in LLMs through Token Internal Structure Learning (2025.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) use tokenization methods but often obscure internal character structures within tokens.
Approach: They propose a method that improves models’ ability to capture character positions within tokens by training them on reverse character prediction tasks using the tokenizer’s vocabulary.
Outcome: Experiments show that the proposed method improves position prediction accuracy in large language models, enabling more precise identification of target characters in original text.
DialMed: A Dataset for Dialogue-based Medication Recommendation (2022.coling-1)

Copied to clipboard

Challenge: Existing studies on medication recommendation mainly rely on EHRs, but some details of interactions between doctors and patients may be ignored or omitted in EHR.
Approach: They propose to use medical dialogues to recommend medications with medical dialogue data . they propose to model dialogue structure and disease knowledge aware network .
Outcome: The proposed method is a promising solution to recommend medications with medical dialogues.
PRP-Graph: Pairwise Ranking Prompting to LLMs with Graph Aggregation for Effective Text Re-ranking (2024.acl-long)

Copied to clipboard

Challenge: Existing methods for pairing ranking prompting only output the same label for comparison results of different confidence intervals without considering the uncertainty of pairwise comparison.
Approach: They propose a pairwise ranking prompting approach that exploits the output probabilities of target labels to capture the degree of certainty of comparison results.
Outcome: The proposed method shows strong robustness and acceptable efficiency on the BEIR benchmark.
What If Consensus Lies? Selective-Complementary Reinforcement Learning at Test Time (2026.acl-long)

Copied to clipboard

Challenge: Existing TTRL methods rely on positive pseudo-labeling strategies to enhance reasoning capabilities.
Approach: They propose a test-time reinforcement learning framework that mitigates label noise amplification by deriving pseudo-rewards from majority voting consensus.
Outcome: The proposed framework mitigates label noise amplification by implementing selective positive pseudo-labeling and entropy-gated negative p-labeled pruning.
Table-R1: Region-based Reinforcement Learning for Table Understanding (2026.findings-acl)

Copied to clipboard

Challenge: Tables are a widely used data format that poses unique challenges for language models due to their structured row-column interactions.
Approach: They propose a region-based reinforcement learning approach that integrates region evidence into reasoning steps.
Outcome: The proposed method outperforms baseline models on three benchmark datasets and significantly reduces the reasoning token consumption by 67.5%.
InfiMM: Advancing Multimodal Understanding with an Open-Sourced Visual Language Model (2024.findings-acl)

Copied to clipboard

Challenge: InfiMM is a multimodal large language model that adapts to complex vision-language tasks.
Approach: They present a Multimodal Large Language Model that adapts to intricate vision-language tasks using large-scale training data and comprehensive training strategies.
Outcome: Empirical evaluations across a variety of benchmarks underscore InfiMM’s remarkable capability in multimodal understanding.
MdEval: Massively Multilingual Code Debugging (2026.findings-acl)

Copied to clipboard

Challenge: Existing benchmarks primarily focus on Python and are limited in terms of language diversity.
Approach: They propose a multilingual debugging benchmark that includes 3.9K test samples of 20 programming languages and introduces the debug instruction corpora MdEval-Instruct by injecting bugs into the correct multilingual queries and solutions.
Outcome: The proposed benchmark includes 3.9K test samples of 20 programming languages and covers the automated program repair task, bug localization task, and bug identification task.
MCGA: A Multi-task Classical Chinese Literary Genre Audio Corpus (2026.findings-acl)

Copied to clipboard

Challenge: Multimodal Large Language Models (MLLMs) have advanced Chinese Classical Studies (CCS) but the audio dimension of CCS remains underexplored due to a lack of high-quality, domain-specific audio corpora.
Approach: They propose a 119-hour audio corpus comprising 22,000 audio samples to bridge this gap . it encompasses a diverse range of literary genres across six tasks .
Outcome: The proposed corpus encompasses a diverse range of literary genres across six tasks: Automatic Speech Recognition (ASR), Speech-to-Text Translation (S2TT), Speech Emotion Captioning (SEC), Spoken Question Answering ( SQA), Speech Understanding (SU), and Speech Reasoning (SR).
SEEK: Segmented Embedding of Knowledge Graphs (2020.acl-main)

Copied to clipboard

Challenge: Existing methods for knowledge graph embedding can not make a proper trade-off between the model complexity and the model expressiveness, which makes them far from satisfactory.
Approach: They propose a lightweight modeling framework that can achieve highly competitive relational expressiveness without increasing the model complexity.
Outcome: The proposed framework can achieve highly competitive relational expressiveness without increasing model complexity.
Generating Informative Conversational Response using Recurrent Knowledge-Interaction and Knowledge-Copy (2020.acl-main)

Copied to clipboard

Challenge: Knowledge-driven conversation approaches have attracted considerable research attention in recent years.
Approach: They propose a method that integrates recurrent knowledge interaction among response decoding steps to incorporate appropriate knowledge.
Outcome: The proposed method improves on two datasets Wizard-of-Wikipedia and DuConv with different knowledge formats and different languages.
Dual Dynamic Memory Network for End-to-End Multi-turn Task-oriented Dialog Systems (2020.coling-main)

Copied to clipboard

Challenge: Existing task-oriented dialog systems struggle to dynamically model long dialog context for interactions and effectively incorporate knowledge base (KB) information into dialog generation.
Approach: They propose a dual dynamic memory network for multi-turn dialog generation . the model dynamically expands the dialog memory turn by turn and keeps track of dialog history .
Outcome: The proposed model outperforms baseline models on three benchmark datasets on human evaluation and automatic evaluation.
CGoDial: A Large-Scale Benchmark for Chinese Goal-oriented Dialog Evaluation (2022.emnlp-main)

Copied to clipboard

Challenge: a new benchmark for goal-oriented dialog evaluation is needed to address the problem of knowledge sources, noisy user expressions, and the shortage of annotated data.
Approach: They propose a Chinese benchmark for goal-oriented dialog evaluation that uses dialog sessions and 574,949 dialog turns to bridge the gap between academic benchmarks and spoken dialog scenarios.
Outcome: The proposed benchmark contains 96,763 dialog sessions and 574,949 dialog turns totally.
InfiMM-WebMath-40B: Advancing Multimodal Pre-Training for Enhanced Mathematical Reasoning (2025.findings-emnlp)

Copied to clipboard

Challenge: InfiMM-WebMath-40B is a dataset of interleaved image-text documents . it consists of 24 million web pages, 85 million image URLs, and 40 billion text tokens .
Approach: InfiMM-WebMath-40B is a high-quality dataset of interleaved image-text documents . it contains 24 million web pages, 85 million image URLs, and 40 billion text tokens .
Outcome: InfiMM-WebMath-40B is a high-quality dataset of interleaved image-text documents . it consists of 24 million web pages, 85 million image URLs, and 40 billion text tokens .
Knowledge Enhanced Pre-training for Cross-lingual Dense Retrieval (2024.lrec-main)

Copied to clipboard

Challenge: Existing mPLMs neglect the importance of knowledge in cross-lingual dense retrieval.
Approach: They propose a novel mPLM that leverages knowledge to learn language-agnostic semantic representations from a multilingual knowledge base and an annotation of Wiki.
Outcome: The proposed model achieves strong multilingual and cross-lingual retrieval performance with significant improvements over existing mPLMs.
Metric-guided Distillation: Distilling Knowledge from the Metric to Ranker and Retriever for Generative Commonsense Reasoning (2022.emnlp-main)

Copied to clipboard

Challenge: Existing work on commonsense generation requires models to have relational reasoning and compositional generalization capabilities.
Approach: They propose a metric distillation rule to distill knowledge from a standard metric to a ranker and transfer it to re-ranking a retriever.
Outcome: The proposed method surpasses the previous SOTA.
Taming Text-to-Image Synthesis for Novices: User-centric Prompt Generation via Multi-turn Guidance (2025.emnlp-main)

Copied to clipboard

Challenge: Existing solutions for text-to-image synthesis are sensitive on textual prompts, posing a challenge for novice users.
Approach: They propose a dialogue-based TIS prompt generation model that emphasizes user experience for novice users.
Outcome: The proposed model emphasizes user experience for novice users . it improves user-centricity score while maintaining a competitive quality of synthesized images.
CAPSTONE: Curriculum Sampling for Dense Retrieval with Document Expansion (2023.emnlp-main)

Copied to clipboard

Challenge: Experimental results show that dense retrieval models are better at obtaining query-informed representations.
Approach: They propose a dual-encoder approach that computes latent representations of query and document independently, but inference replaces the real query with a generated one.
Outcome: The proposed approach outperforms previous dense retrieval models on in-domain and out-of-domain datasets.
UCS-SQL: Uniting Content and Structure for Enhanced Semantic Bridging In Text-to-SQL (2025.findings-acl)

Copied to clipboard

Challenge: Existing methods overlook the challenge of effectively transforming structure information from NL to SQL.
Approach: They propose a text-to-SQL framework that unites content and structure pipes to bridge the gap between NL and SQL.
Outcome: The proposed framework bridges the gap between natural language questions and SQL by combining content and structure pipes.
Understanding and Mitigating Spurious Signal Amplification in Test-Time Reinforcement Learning for Math Reasoning (2026.findings-acl)

Copied to clipboard

Challenge: a framework to mitigate spurious optimization signals is proposed for test-time reinforcement learning (TTRL) Reinforcement learning with verifiable rewards (RLVR) is an effective paradigm for improving large language models on structured challenging reasoning tasks.
Approach: They propose a framework to mitigate spurious optimization signals from label noise . they propose to use a frequency-based sampling strategy to exclude ambiguous samples .
Outcome: The proposed framework outperforms existing TTRL baselines on three large language models across multiple mathematical reasoning benchmarks.
LaoBench: A Large-Scale Multidimensional Lao Benchmark for Large Language Models (2026.acl-long)

Copied to clipboard

Challenge: Existing SEA-focused benchmarks miss Lao-specific cultural grounding and linguistic properties.
Approach: They propose a multi-dimensional benchmark for assessing large language models in Lao . they use open-source and held-out subsets to evaluate languages with a hybrid pipeline .
Outcome: LaoBench is the first large-scale, high-quality, and multidimensional benchmark for assessing LLM language understanding and reasoning in Lao.
OAgents: An Empirical Study of Building Effective Agents (2025.findings-emnlp)

Copied to clipboard

Challenge: a recent study shows that agent research practices are far from standard, rigorous . lack of a standard evaluation protocol makes previous works not reproducible, authors say .
Approach: They conduct an empirical study on the GAIA benchmark to investigate agent design choices . they find that lack of a standard evaluation protocol makes previous works not reproducible .
Outcome: The proposed framework achieves state-of-the-art performance among open-source projects.
MAXS: Meta-Adaptive Exploration with LLM Agents (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods for inference are often myopic and have divergent reasoning paths . a meta-adaptive reasoning framework is proposed to improve the efficiency of LLM agents .
Approach: They propose a meta-adaptive reasoning framework that integrates tool execution and reasoning planning.
Outcome: The proposed framework outperforms existing methods in performance and inference efficiency.
M2RC-EVAL: Massively Multilingual Repository-level Code Completion Evaluation (2025.acl-long)

Copied to clipboard

Challenge: Existing repository-level code completion benchmarks focus on a limited number of languages . existing benchmarks report overall average scores of different languages ignoring fine-grained abilities .
Approach: They propose to use repository-level code completion benchmarks to evaluate general code intelligence abilities across languages for existing code Large Language Models.
Outcome: The proposed benchmarks improve the code completion abilities of existing LLMs by using two types of annotations on the parsed syntax tree.
Are LLMs Rational Investors? A Study on the Financial Bias in LLMs (2025.findings-acl)

Copied to clipboard

Challenge: Existing studies on biases within specific domains, such as finance, remain limited.
Approach: They propose a framework to detect, detect, analyze and mitigate financial biases in large language models.
Outcome: The proposed framework reduces bias by 68% for the most biased model, according to key metrics.
Analyzing Uncertainty of LLM-as-a-Judge: Interval Evaluations with Conformal Prediction (2025.emnlp-main)

Copied to clipboard

Challenge: Large language models (LLMs) are powerful automatic evaluators for natural language generation (NLG) tasks, but their uncertainty may limit their deployment in many applications.
Approach: They propose a conformal prediction framework that provides a prediction interval with coverage guarantees and a midpoint-based score as a low-bias alternative to raw model score and weighted average.
Outcome: The proposed framework provides a prediction interval with coverage guarantees and a midpoint-based score as a low-bias alternative to raw model score and weighted average.
Learning Neural Templates for Recommender Dialogue System (2021.emnlp-main)

Copied to clipboard

Challenge: Recent advances in neural models have shown promising progress on this task, but key challenges remain .
Approach: They propose a framework that can decouple dialogue generation from item recommendation . they use a response template generator and item selector to generate a responses template .
Outcome: The proposed framework outperforms the state-of-the-art methods on the benchmark ReDial.
A Novel Negative Sample Generation Method for Contrastive Learning in Hierarchical Text Classification (2025.coling-main)

Copied to clipboard

Challenge: Existing methods for hierarchical text classification struggle with fine-grained labels, leading to difficulties in accurate classification.
Approach: They propose a hierarchical sequence ranking method for generating diverse negative samples using hierarchically structured hierarchic labels.
Outcome: The proposed method achieves state-of-art (SOTA) on two datasets showing that it can distinguish between fine-grained labels and discriminate.
Relation Extraction with Temporal Reasoning Based on Memory Augmented Distant Supervision (N19-1)

Copied to clipboard

Challenge: Distant supervision is an important paradigm for automatically extracting relations . but the examples collected can be noisy and pose significant challenge for labeling .
Approach: They propose a method to predict whether two entities participate in a relation at a given time spot.
Outcome: The proposed model performs better in WIKI-TIME and NYT-10 datasets compared with the best existing models . the proposed model is based on a dataset with a valid period of a certain relation of two entities in the knowledge base .

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations