Papers by Jiaang Li
Copyright Violations and Large Language Models (2023.emnlp-main)
Copied to clipboard
| Challenge: | a recent study examines the extent to which language models can memorize training data . a fair use exemption to copyright laws allows for limited use of copyrighted material . |
| Approach: | They examine the extent to which language models can redistribute copyrighted text . they use a range of popular books and coding problems to study copyright violations . |
| Outcome: | This study examines the extent to which language models can redistribute copyrighted text . it shows that language models may memorize entire chunks of training data . |
SELECting over Tokens: Curating Pre-training Data at Scale via Token Classification (2026.acl-long)
Copied to clipboard
Xin Tong, Weidong Zhang, Jiaang Li, Haibin Chen, Shilei Liu, Langming Liu, Kangtao Lv, Yujin Yuan, Wenbo Su, Bo Zheng
| Challenge: | Existing pipelines rely on expert-crafted heuristic rules, which lack content-aware, fine-grained noise detection. |
| Approach: | They propose a framework that reframes data refinement as a highly efficient token classification task. |
| Outcome: | The proposed framework outperforms existing pipelines on benchmarks and is 2.5x faster at inference. |
What if Othello-Playing Language Models Could See? (2025.findings-emnlp)
Copied to clipboard
| Challenge: | a multi-modal model trained on move sequences and board images is a popular testbed for language models . |
| Approach: | They propose a multi-modal model trained jointly on move sequences and board images. |
| Outcome: | The proposed multi-modal model trains on move sequences and board images. |
Random Entity Quantization for Parameter-Efficient Compositional Knowledge Graph Representation (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to learning on Knowledge Graphs (KGs) are not critical for learning on KGs. |
| Approach: | They propose an alternative approach to represent entities by composing entity-corresponding codewords matched from predefined small-scale codebooks. |
| Outcome: | The proposed approach achieves similar results to existing methods. |
Align Documents to Questions: Question-Oriented Document Rewriting for Retrieval-Augmented Generation (2026.findings-acl)
Copied to clipboard
| Challenge: | Retrieval-Augmented Generation (RAG) enhances the factuality of Large Language Models (LLMs) however, LLMs exhibit a stylistic bias when presented with mixed contexts, revealing a bottleneck in their utility. |
| Approach: | They propose a style-controlled rewriter that aligns retrieved documents with a question-oriented style while preserving facts. |
| Outcome: | The proposed model improves RAG pipelines by 8% with negligible latency overhead. |
FoodieQA: A Multimodal Dataset for Fine-Grained Understanding of Chinese Food Culture (2024.emnlp-main)
Copied to clipboard
Wenyan Li, Crystina Zhang, Jiaang Li, Qiwei Peng, Raphael Tang, Li Zhou, Weijia Zhang, Guimin Hu, Yifei Yuan, Anders Søgaard, Daniel Hershcovich, Desmond Elliott
| Challenge: | FoodieQA is a manually curated, fine-grained image-text dataset capturing the intricate features of food cultures across various regions in China. |
| Approach: | They evaluate vision–language Models and large language models on unseen food images and corresponding questions. |
| Outcome: | The proposed dataset evaluates vision–language Models and large language models on unseen food images and corresponding questions. |
Understanding Retrieval Robustness for Retrieval-augmented Image Captioning (2024.acl-long)
Copied to clipboard
| Challenge: | Recent retrieval-augmented models for image captioning are not perfect in practice. |
| Approach: | They propose to train a retrieval-augmented captioning model SmallCap by sampling retrieved captions from more diverse sets. |
| Outcome: | The proposed model is sensitive to tokens that appear in the majority of retrieved captions . the proposed model improves both in-domain and cross-domain performance . |