Papers by Zhenyang Li

7 papers
DentalGPT: Incentivizing Multimodal Reasoning in Dentistry (2026.findings-acl)

Copied to clipboard

Challenge: Current multimodal large language models (MLLMs) show limited understanding of dental images.
Approach: They propose a dental-specialized multimodal large language model trained via staged multimodal alignment and reinforcement learning.
Outcome: The proposed model outperforms state-of-the-art models on disease classification and dental VQA tasks.
Task Knowledge Injection via Interpolations and Reinstatement for Large Language Model Generalization (2025.findings-acl)

Copied to clipboard

Challenge: Pre-trained large language models have been widely adopted to elicit their superior performance on downstream tasks, but instruction tuning may overfit them to specific task formats, compromising their generalization on unseen tasks.
Approach: They propose to inject latent task adaptation and knowledge reinstatement into large language models to mitigate spurious correlations between inputs and targets.
Outcome: The proposed method improves generalization on in-domain and out-of-domain unseen tasks.
LICHEE: Improving Language Model Pre-training with Multi-grained Tokenization (2021.findings-acl)

Copied to clipboard

Challenge: Pre-trained language models are trained based on single-grained tokenization, making it hard to learn the precise meaning of coarse-grain words and phrases.
Approach: They propose a language model pretraining method that incorporates multi-grained information of input text into pre-trained language models.
Outcome: The proposed method improves performance on CLUE and SuperGLUE in Chinese and English with little extra inference cost.
LLM-as-a-Coauthor: Can Mixed Human-Written and Machine-Generated Text Be Detected? (2024.findings-naacl)

Copied to clipboard

Challenge: Current research focuses on purely MGT detection without adequately addressing mixed scenarios including AI-revised Human-Written Text (HWT) and human-revealed MGT.
Approach: They define mixtext, a form of mixed text involving both AI and human-generated content, and then use a MixSet dataset to assess their effectiveness.
Outcome: The proposed detectors struggle to identify mixtext, particularly in dealing with subtle modifications and style adaptability.
DORA: A Dual-Objective Reinforcement Learning Framework for Effective and Efficient Multimodal Agentic Search (2026.acl-long)

Copied to clipboard

Challenge: Existing methods to train large language models overlook quality of intermediate search results . existing methods often invoke search calls during reasoning, making inference inefficient .
Approach: They propose a dual-objective reinforcement learning framework to improve search strategies of MLLMs . DORA outperforms state-of-the-art methods, achieving up to 8.4% higher accuracy .
Outcome: The proposed model outperforms state-of-the-art methods while reducing search calls by 9.7%.
From Past To Path: Masked History Learning for Next-Item Prediction in Generative Recommendation (2026.acl-long)

Copied to clipboard

Challenge: Generative recommendation models inherently bias towards local contexts, failing to capture deeper historical dependencies necessary for understanding complex user intents.
Approach: They propose a training framework that shifts the objective from simple next-step prediction to deep comprehension of history by entropy-guided masking policy and a curriculum learning scheduler to enhance the framework.
Outcome: The proposed framework outperforms state-of-the-art generative models on three public datasets and shows that it is more accurate than current models.
DiffER: Diffusion Entity-Relation Modeling for Reversal Curse in Diffusion Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Existing large language models exhibit unidirectional behavior when processing bidirectional relationships . authors propose a solution to alleviate the reversal curse in Diffusion LLMs .
Approach: They propose a model that addresses the "reversal curse" of bidirectional behavior in large language models . they propose 'entity-aware training' and balanced data construction to alleviate asymmetry and missing relations .
Outcome: The proposed model alleviates the "reversal curse" in Diffusion LLMs . the proposed model employs whole-entity masking to mitigate entity fragmentation .

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations