Papers by Yulong Wang
DocLLM: A Layout-Aware Generative Language Model for Multimodal Document Understanding (2024.acl-long)
Copied to clipboard
Dongsheng Wang, Natraj Raman, Mathieu Sibue, Zhiqiang Ma, Petr Babkin, Simerjot Kaur, Yulong Pei, Armineh Nourbakhsh, Xiaomo Liu
| Challenge: | Documents with rich layouts are a significant portion of enterprise corpora and document AI is still a challenge. |
| Approach: | They propose a lightweight extension to traditional large language models for reasoning over visual documents that takes into account both textual semantics and spatial layout. |
| Outcome: | The proposed model outperforms existing large language models on 14 out of 16 datasets and generalizes well to 4 out of 5 previously unseen datasets. |
TARE: Lightweight Token-Aware Representation Editing for Fine-tuning Transformer-like Models (2026.acl-long)
Copied to clipboard
| Challenge: | Existing PEFT methods can be costly and underfit token-level contexts. |
| Approach: | They propose a PEFT method that performs fine-grained, token-specific edits with a small additional inference overhead and minimal tuning. |
| Outcome: | The proposed method outperforms state-of-the-art methods in 8 tasks and GLUE with a minimal tuning overhead and inference overhead. |
Reference Attack: A New Cross-Modal Jailbreaking Attack against Multimodal Large Language Models (2026.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have raised significant safety concerns about generated content, drawing attention from both academia and industry. |
| Approach: | They propose a reference-guided cross-modal jailbreak method that enhances existing prompt-to-image injection attacks by exploiting MLLMs’ semantic reconstruction capabilities. |
| Outcome: | The proposed method achieves an attack success rate of over 93% on leading MLLMs including ChatGPT, Gemini, Claude, and the widely used open-source LLaMA model. |
DisLoRA: Task-specific Low-Rank Adaptation via Orthogonal Basis from Singular Value Decomposition (2025.emnlp-main)
Copied to clipboard
| Challenge: | Extensive experiments on GLUE and Commonsense Reasoning benchmarks demonstrate that DisLoRA surpasses established PEFT methods, including LoRA, PiSSA, DoRA, LoRA-Dash, and SORSA. |
| Approach: | They propose a framework that leverages singular value decomposition to decompose pretrained weight matrices into orthogonal backbone and task-specific subspaces. |
| Outcome: | Extensive experiments on GLUE and Commonsense Reasoning benchmarks show that DisLoRA surpasses established PEFT methods, including LoRA, PiSSA, DoRA, LoRA-Dash, and SORSA. |
Lexical Diversity-aware Relevance Assessment for Retrieval-Augmented Generation (2025.acl-long)
Copied to clipboard
| Challenge: | Extensive experiments on widely used benchmarks demonstrate the efficacy of our approach, yielding a 10.6% accuracy improvement on HotpotQA. |
| Approach: | They propose a Lexical Diversity-aware RAG method to address the biases in relevant information retrieval and utilization induced by lexical diversity. |
| Outcome: | Extensive experiments on widely used benchmarks show the proposed method yields a 10.6% accuracy improvement on HotpotQA. |
RAV: Retrieval-Augmented Voting for Tactile Descriptions Without Training (2025.emnlp-main)
Copied to clipboard
| Challenge: | Conventional approaches relying on extensive parameter learning for multimodal perception are rigid and computationally inefficient. |
| Approach: | They propose a parameter-free method that constructs visual-tactile cross-modal knowledge directly by retrieving similar visual-touch data for given visual and tactile inputs and generating tactile descriptions through a voting mechanism. |
| Outcome: | The proposed method achieves comparable performance to large-scale cross-modal models without training across a wide range of datasets. |
SR-LLM: Rethinking the Structured Representation in Large Language Model (2025.acl-long)
Copied to clipboard
Jiahuan Zhang, Tianheng Wang, Ziyi Huang, Yulong Wu, Hanqing Wu, DongbaiChen DongbaiChen, Linfeng Song, Yue Zhang, Guozheng Rao, Kaicheng Yu
| Challenge: | Structured representations have long been pivotal in computational linguistics, but their role remains ambiguous in the Large Language Models (LLMs) era. |
| Approach: | They propose a framework that integrates structured representations into LLMs from training-free and training-dependent perspectives. |
| Outcome: | The proposed framework integrates structured representations through natural language descriptions in LLM prompts while augmenting the model’s inference capability through fine-tuning on linguistically described structured representation. |
On the Robustness of Editing Large Language Models (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies have exhibited impressive success and significant potential. |
| Approach: | They propose to modify the knowledge memory with minimum computational cost while preserving the performance on the retained knowledge. |
| Outcome: | The proposed methods avoid retraining to update the model parameters and have demonstrated promising performance and efficiency. |
AdaPrompt: Adaptive Model Training for Prompt-based NLP (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Prompt-based learning can tackle zero-shot and few-shot NLP tasks . authors propose a method that makes use of pre-trained language models . |
| Approach: | They propose to map NLP tasks into natural language prompts, which are then filled by pre-trained language models. |
| Outcome: | The proposed method outperforms standard prompt-based methods in few-shot settings. |
Revisiting Cross-Lingual Summarization: A Corpus-based Study and A New Benchmark with Improved Annotation (2023.acl-long)
Copied to clipboard
Yulong Chen, Huajian Zhang, Yijie Zhou, Xuefeng Bai, Yueguan Wang, Ming Zhong, Jianhao Yan, Yafu Li, Judy Li, Xianchao Zhu, Yue Zhang
| Challenge: | Existing work on cross-lingual summarization (CLS) does not consider crosslingual sources for summarizing. |
| Approach: | They propose a cross-lingual conversation summarization benchmark that explicitly considers source context. |
| Outcome: | The proposed method surpasses baselines on ConvSumX and 3 widely-used manual annotations. |