Papers by Yifeng Lu
Symbol tuning improves in-context learning in language models (2023.emnlp-main)
Copied to clipboard
Jerry Wei, Le Hou, Andrew Lampinen, Xiangning Chen, Da Huang, Yi Tay, Xinyun Chen, Yifeng Lu, Denny Zhou, Tengyu Ma, Quoc Le
| Challenge: | Language models are sensitive to the way that prompts are given, indicating that they are not reasoning in a robust manner. |
| Approach: | They propose to fine tune language models on in-context input-label pairs where natural language labels are replaced with arbitrary symbols. |
| Outcome: | The proposed model is much stronger at reasoning tasks and more robust to underspecified prompts than the standard model. |
NOVA: An Iterative Planning Framework for Enhancing Scientific Innovation with Large Language Models (2025.findings-acl)
Copied to clipboard
Xiang Hu, Hongyu Fu, Jinge Wang, Yifeng Wang, Zhikun Li, Renjun Xu, Yu Lu, Yaochu Jin, Lili Pan, Zhenzhong Lan
| Challenge: | Existing approaches to generate research ideas rely on retrieval or prompt engineering to generate ideas. |
| Approach: | They propose a method that uses iterative planning and search to boost creative potential of LLMs by integrating external knowledge with broader and deeper insights. |
| Outcome: | The proposed method outperforms the current state-of-the-art in generating 2.5 times more top-rated ideas based on 170 seed papers in a Swiss Tournament evaluation. |
Wukong-Reader: Multi-modal Pre-training for Fine-grained Visual Document Understanding (2023.acl-long)
Copied to clipboard
Haoli Bai, Zhiguang Liu, Xiaojun Meng, Li Wentao, Shuang Liu, Yifeng Luo, Nian Xie, Rongfu Zheng, Liangwei Wang, Lu Hou, Jiansheng Wei, Xin Jiang, Qun Liu
| Challenge: | Existing solutions for visual document understanding lack granularity of document textlines. |
| Approach: | They propose a supervised pre-training program to leverage structural knowledge nested in document textlines to achieve fine-grained alignment between visual regions and texts. |
| Outcome: | The proposed system performs better on various VDU tasks in English and Chinese. |
MMErroR: A Benchmark for Erroneous Reasoning in Vision-Language Models (2026.acl-long)
Copied to clipboard
Yang Shi, Yifeng Xie, Minzhe Guo, Liangsi Lu, Mingxuan Huang, Jingchao Wang, Zhihong Zhu, Boyan Xu, Zhiqi Huang
| Challenge: | Recent advances in vision-language models have improved performance in multi-modal learning. |
| Approach: | They propose a multi-modal benchmark that embeds a single coherent reasoning error in 1997 samples. |
| Outcome: | The proposed benchmark is based on a set of 1997 samples embedding a single coherent reasoning error. |
InfoEnh: Towards Multimodal Sentiment Analysis via Information Bottleneck Filter and Optimal Transport Alignment (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods for multi-modal sentiment analysis have been developed to overcome these challenges. |
| Approach: | They propose a method that utilizes a masking technique as the bottleneck for information filtering and integrates all modalities into a common feature space via domain adaptation. |
| Outcome: | Extensive experiments on two benchmark MSA datasets show the proposed method performs better than baselines. |
Intra-Correlation Encoding for Chinese Sentence Intention Matching (2020.coling-main)
Copied to clipboard
| Challenge: | Existing methods to improve sentence intention matching for Chinese text are limited due to the particularity of the text. |
| Approach: | They propose a method that combines character-granularity and word-granulularity features to perform sentence intention matching. |
| Outcome: | The proposed method can capture sentence feature information from multiple perspectives and correlation information between different levels of sentences. |
Membership and Memorization in LLM Knowledge Distillation (2025.emnlp-main)
Copied to clipboard
| Challenge: | Recent advances in Knowledge Distillation (KD) aim to mitigate the high computational demands of Large Language Models (LLMs). |
| Approach: | They characterize and investigate membership privacy risks inherent in six LLM KD techniques . they use instruction-tuning settings that span seven NLP tasks and three teacher model families and various size student models to examine the extent of privacy risks. |
| Outcome: | The proposed methods carry membership and memorization privacy risks from the teacher to students, but differ across different techniques. |