Papers by Lei Duan
Hashing based Efficient Inference for Image-Text Matching (2021.findings-acl)
Copied to clipboard
| Challenge: | Recent work on image-text matching has focused on exploring interactions between images and sentences to improve performance without considering inference efficiency. |
| Approach: | They propose a hashing-based efficient inference module which can be plugged into existing frameworks to speed up inference step without reducing retrieval performance. |
| Outcome: | The proposed module can be plugged into existing framework to speed up inference step without reducing retrieval performance. |
GEM: A General Evaluation Benchmark for Multimodal Tasks (2021.findings-acl)
Copied to clipboard
Lin Su, Nan Duan, Edward Cui, Lei Ji, Chenfei Wu, Huaishao Luo, Yongfei Liu, Ming Zhong, Taroon Bharti, Arun Sacheti
| Challenge: | Existing datasets that focus on natural language tasks are not considered as a general evaluation benchmark for multimodal tasks. |
| Approach: | They present a general evaluation benchmark for multimodal tasks, GEM 1 . they compare it with existing multimodal vision-language datasets . |
| Outcome: | The proposed model is compared with existing vision-language datasets focusing on natural language tasks . it is the largest vision-linguistic dataset covering image-language tasks and video-language task at the same time . |
CONE: An Efficient COarse-to-fiNE Alignment Framework for Long Video Temporal Grounding (2023.acl-long)
Copied to clipboard
Zhijian Hou, Wanjun Zhong, Lei Ji, Difei Gao, Kun Yan, W.k. Chan, Chong-Wah Ngo, Mike Zheng Shou, Nan Duan
| Challenge: | Existing work on video temporal grounding for long videos is limited by existing datasets. |
| Approach: | They propose a query-guided window selection strategy and a coarse-to-fine mechanism to speed up inference for long videos. |
| Outcome: | The proposed framework accelerates inference time by 2x on Ego4D-NLQ and 15x on MAD while keeping SOTA results. |
Control Image Captioning Spatially and Temporally (2021.acl-long)
Copied to clipboard
| Challenge: | Existing methods to generate image captions with user intention are still under exploration. |
| Approach: | They propose a model that connects Contrastive constraints and Attention Guidance in a loop manner and engages explicit spatial and temporal constraints to the generating process. |
| Outcome: | The proposed model improves performance on a trace-controlled image captioning task. |
Tuning Less, Prompting More: In-Context Preference Learning Pipeline for Natural Language Transformation (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to natural language transformation (NLT) tasks face significant challenges, such as the computational costs of leveraging large pre-trained models and the limited generalization ability of fine-tuned smaller models. |
| Approach: | They propose a framework that combines prompting with fine-tuning to enhance smaller models by integrating In-Context Examples from retrieval. |
| Outcome: | The proposed framework outperforms existing methods across MT and TST tasks. |
BloomEval: A Bloom’s Cognitive Taxonomy-Based Benchmark for Evaluating LRMs via Cognitive Hierarchy Trace (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing benchmarks for Large Reasoning Models rely on answer correctness, but fail to assess the structural coherence and cognitive soundness of the reasoning process itself. |
| Approach: | They propose a framework that maps a model's reasoning trajectory onto hierarchical cognitive levels and an annotation pipeline to ensure a scalable yet reliable annotation pipeline. |
| Outcome: | The proposed framework detects hierarchy jumps, breaks, and overthinking errors and enables scalable yet reliable annotation. |
R3: End-to-End Reasoning-based Planning for Multi-step Retrosynthesis via Reinforcement Learning (2026.acl-long)
Copied to clipboard
YiFei Wang, Qizhi Pei, Jiangtao Feng, Yuntian Shi, Yi Duan, Lihao Wang, Lei Bai, Lijun Wu, Wei-Ying Ma, Hao Zhou
| Challenge: | Experimental results show that R3 is a superior alternative to traditional search algorithms for multistep retrosynthesis planning. |
| Approach: | They propose a framework that reformulates multistep retrosynthetic planning as a generative reasoning task. |
| Outcome: | The proposed framework achieves state-of-the-art Top-1 accuracy of 43.7% on retrobench . it leverages Large Language Models to reformulate multistep retrosynthesis as a generative reasoning task. |
Typos Correction Training against Misspellings from Text-to-Text Transformers (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing dense retrieval systems suffer from typoed queries due to mistyping or phonetic typing errors. |
| Approach: | They propose a method that incorporates the spelling correction objective into the DR model and a prompt-based augmentation technique to enhance the alignment of the typoed query and its original query. |
| Outcome: | The proposed model outperforms existing typos-aware training approaches and sophisticated training advanced retrievers. |
GRACE: Gradient Harmonized and Cascaded Labeling for Aspect-based Sentiment Analysis (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies ignore aspect terms interaction when labeling polarities . aspect terms extraction and aspect sentiment classification are two fundamental tasks . |
| Approach: | They propose a GRadient hArmonized and CascadEd labeling model to solve the imbalance issue . they extend the gradient harmonized mechanism used in object detection to aspect-based sentiment analysis . |
| Outcome: | The proposed model achieves consistency improvement on multiple benchmark datasets and generates state-of-the-art results. |
Dense Procedure Captioning in Narrated Instructional Videos (P19-1)
Copied to clipboard
| Challenge: | Existing models for video dense captioning learn video segments and generate captions without considering transcripts. |
| Approach: | They propose a model to generate procedure captions from narrated instructional videos . they extract procedures by a cross-modality module and generate captions by encoding video frames and transcripts within each extracted procedure. |
| Outcome: | The proposed model can extract procedures from narrated instructional videos and generate procedure captions by encoding video frames and transcripts. |
WenetSpeech-Wu: Datasets, Benchmarks, and Models for a Unified Chinese Wu Dialect Speech Processing Ecosystem (2026.findings-acl)
Copied to clipboard
Chengyou Wang, Mingchen Shao, Jingbin Hu, Zeyu Zhu, Hongfei Xue, Bingshen Mu, Xin Xu, Xingyi Duan, Binbin Zhang, Zhu Pengcheng, Chuang Ding, Xiaojun Zhang, Hui Bu, Lei Xie
| Challenge: | despite its linguistic significance, the Wu dialect of Chinese has long been hindered by the lack of large-scale speech data, standardized evaluation benchmarks, and publicly available models. |
| Approach: | They propose to use WenetSpeech-Wu as a large-scale, multi-dimensionally annotated open-source speech corpus for the Wu dialect of Chinese. |
| Outcome: | The proposed dataset includes 8,000 hours of speech data and strong open-source models . the proposed dataset is competitive and empirically validated . |
Competition-Level Problems are Effective LLM Evaluators (2024.findings-acl)
Copied to clipboard
Yiming Huang, Zhenghao Lin, Xiao Liu, Yeyun Gong, Shuai Lu, Fangyu Lei, Yaobo Liang, Yelong Shen, Chen Lin, Nan Duan, Weizhu Chen
| Challenge: | Large language models (LLMs) have demonstrated impressive reasoning capabilities, yet there is ongoing debate about their capabilities and the potential data contamination problem. |
| Approach: | They propose to evaluate the reasoning capabilities of large language models in solving recent competition-level programming problems in Codeforces. |
| Outcome: | The proposed model has experienced a cliff-like decline in problems after September 2021, which shows the potential data contamination and the challenges for any existing LLM to solve unseen complex reasoning problems. |
A.S.E: A Repository-Level Benchmark for Evaluating Security in AI-Generated Code (2026.findings-acl)
Copied to clipboard
Keke Lian, Wang Bin, Lei Zhang, Libo Chen, Junjie Wang, Ziming Zhao, Yujiu Yang, Miaoqian Lin, Haotong Duan, Haoran Zhao, Shuang Liao, Mingda Guo, Quan Jiazheng, Yilu Zhong, Chenhao He, Chen Zichuan, Jie Wu, Haoling Li, Zhaoxuan Li, Jiongchi Yu, Hui LI, Dong Zhang
| Challenge: | Existing security evaluation benchmarks lack relevance to real-world AI programming tasks . current LLMs struggle with secure coding, research shows . |
| Approach: | They propose a repository-level evaluation benchmark to assess security of AI-generated code. |
| Outcome: | The proposed framework mirrors real-world AI programming tasks and offers valuable insights into the state of AI code generation. |