Papers by Dongyuan Li
A-TIP: Attribute-aware Text Infilling via Pre-trained Language Model (2022.coling-1)
Copied to clipboard
| Challenge: | Existing methods for text infilling focus on the infill length of blanks and attribute relevance, but attribute-aware content can be more useful. |
| Approach: | They propose an attribute-aware text infilling method via a Pre-trained language model which contains a text in filling component and a plug-and-play discriminator. |
| Outcome: | The proposed method improves attribute relevance without decreasing text fluency on three open-source datasets. |
Automating eHMI Action Design with LLMs for Automated Vehicle Communication (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Currently, eHMIs employ predefined text messages and manually designed actions to perform these messages . this limits the real-world deployment of ehMIs, where adaptability in dynamic scenarios is essential. |
| Approach: | They propose a pipeline that integrates large language models and 3D renderers to generate executable actions for controlling eHMIs and rendering action clips. |
| Outcome: | The proposed pipeline integrates large language models and 3D renderers to generate executable actions for controlling eHMIs and rendering action clips. |
LLM-Based Human-Agent Collaboration and Interaction Systems: A Survey (2026.findings-acl)
Copied to clipboard
Henry Peng Zou, Wei-Chieh Huang, Yaozu Wu, Jizhou Guo, Yankai Chen, Chunyu Miao, Hoang H Nguyen, Yue Zhou, Weizhi Zhang, Liancheng Fang, Hanrong Zhang, Fangxin Wang, Pengfei Zhang, Langzhou He, Yangning Li, Dongyuan Li, Renhe Jiang, Philip S. Yu
| Challenge: | Recent advances in large language models (LLMs) have sparked growing interest in building fully autonomous agents. |
| Approach: | They propose to integrate human-provided information, feedback, or control into the agent system to enhance system performance, reliability, and safety. |
| Outcome: | The proposed systems improve system performance, reliability, and safety by integrating human-provided information, feedback, or control into the agent system. |
A Survey of RAG-Reasoning Systems in Large Language Models (2025.findings-emnlp)
Copied to clipboard
Yangning Li, Weizhi Zhang, Yuyao Yang, Wei-Chieh Huang, Yaozu Wu, Junyu Luo, Yuanchen Bei, Henry Peng Zou, Xiao Luo, Yusheng Zhao, Chunkit Chan, Yankai Chen, Zhongfen Deng, Yinghui Li, Hai-Tao Zheng, Dongyuan Li, Renhe Jiang, Ming Zhang, Yangqiu Song, Philip S. Yu
| Challenge: | a survey of RAG-based reasoning-based approaches shows that it is not effective for multi-step inferences. |
| Approach: | They map how advanced reasoning optimizes each stage of RAG . they show how retrieved knowledge supply missing premises and expand context for complex inference . |
| Outcome: | The proposed frameworks achieve state-of-the-art across knowledge-intensive benchmarks. |
Joyful: Joint Modality Fusion and Graph Contrastive Learning for Multimoda Emotion Recognition (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing graph-based methods fail to depict global contextual features and local diverse unimodal features in a dialogue. |
| Approach: | They propose a method for joint modality fusion and graph contrastive learning for multimodal emotion recognition using a multimodal fusion mechanism and a graph contrastative learning framework. |
| Outcome: | The proposed method improves multimodal emotion recognition on unbalanced and small-scale emotional datasets. |
Active Learning for Abstractive Text Summarization via LLM-Determined Curriculum and Certainty Gain Maximization (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Abstractive text summarization (ATS) requires laborious data annotation and time-consuming model training. |
| Approach: | They propose a novel active learning framework that asks large language models to rate difficulty of instances and then uses certainty gain maximization to select instances with a distribution that aligns well with the overall distribution. |
| Outcome: | The proposed framework improves stability, effectiveness, and efficiency of abstractive text summarization backbones. |
See2Refine: Vision-Language Feedback Improves LLM-Based eHMI Action Designers (2026.acl-long)
Copied to clipboard
| Challenge: | External Human-Machine Interfaces (eHMIs) are emerging as promising solutions to address this communication gap. |
| Approach: | They propose a framework that uses vision-language models (VLMs) for perceptual evaluation as automated visual feedback to improve an LLM-based eHMI action designer. |
| Outcome: | The proposed framework outperforms prompt-only LLM designers and manually specified baselines in three eHMI modalities and multiple LLM model sizes. |
JPG - Jointly Learn to Align: Automated Disease Prediction and Radiology Report Generation (2022.coling-1)
Copied to clipboard
| Challenge: | Existing methods rarely consider cross-modal alignment between textual and visual features and ignore disease tags as auxiliary for report generation. |
| Approach: | They propose a "Jointly learning framework for automated disease Prediction and radiology report Generation" the framework integrates cross-modal alignment between textual and visual features and disease tags to improve the quality of reports. |
| Outcome: | The proposed framework improves the quality of radiology reports by combining the main task and auxiliary tasks. |
Joint Learning-based Heterogeneous Graph Attention Network for Timeline Summarization (2022.naacl-main)
Copied to clipboard
| Challenge: | Existing studies on timeline summarization ignore the information interaction between sentences and dates, and combine them as two separate tasks. |
| Approach: | They propose a joint learning-based heterogeneous graph attention network for timeline summarization (HeterTls) they combine date selection and event detection into a unified framework to improve extraction accuracy . |
| Outcome: | The proposed model outperforms state-of-the-art models on four datasets . it significantly outperformed the baseline models on ROUGE scores and date selection metrics . |
LAMBDA: Large Language Model-Based Data Augmentation for Multi-Modal Machine Translation (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Multi-modal machine translation methods are underperforming compared to pre-trained models due to lack of triplet training data. |
| Approach: | They propose a multi-modal machine translation method that integrates images and visual modality to enhance language understanding. |
| Outcome: | The proposed method can enrich the original samples and expand the dataset without requiring external images and text. |
Deep Research with Open-Domain Evaluation and Multi-Stage Guardrails for Safety (2026.acl-long)
Copied to clipboard
Wei-Chieh Huang, Henry Peng Zou, Yaozu Wu, Dongyuan Li, Yankai Chen, Weizhi Zhang, Yangning Li, Angelo Zangari, Jizhou Guo, Chunyu Miao, Liancheng Fang, Langzhou He, Yinghui Li, Renhe Jiang, Philip S. Yu
| Challenge: | Existing deep research frameworks lack adequate evaluation procedures and stage-specific protections. |
| Approach: | They propose a framework with open-domain evaluation and a stage-wise safety benchmark to address this oversight. |
| Outcome: | The proposed framework improves defense success rates by 16.53% while reducing over-refusal rates to approximately 6%. |
Multi-Agent Autonomous Driving Systems with Large Language Models: A Survey of Recent Advances, Resources, and Future Directions (2025.findings-emnlp)
Copied to clipboard
Yaozu Wu, Dongyuan Li, Yankai Chen, Renhe Jiang, Henry Peng Zou, Wei-Chieh Huang, Yangning Li, Liancheng Fang, Zhen Wang, Philip S. Yu
| Challenge: | Large Language Models (LLMs) are used to assist with driving decisions, but they face limitations in perception and computational demands. |
| Approach: | They propose a survey of LLM-based multi-agent ADSs and their applications . they analyze agent-human interactions in scenarios where LLM agents engage with humans . |
| Outcome: | The proposed approach reduces human intervention and improves safety and efficiency. |