Papers by Liming Yang
Mitigating the Inconsistency Between Word Saliency and Model Confidence with Pathological Contrastive Training (2022.findings-acl)
Copied to clipboard
| Challenge: | Neural networks are used for various NLP tasks, but their complexity makes them difficult to interpret. |
| Approach: | They propose a framework to mitigate the model pathology and obtain more interpretable models by using contrastive learning and saliency-based samples augmentation to calibrate the sentences representation. |
| Outcome: | The proposed framework can mitigate the model pathology and generate more interpretable models while keeping the model performance. |
Multimodal Fusion with Co-Attention Networks for Fake News Detection (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to detect fake news with textual and visual contents are ineffective because they concatenate unimodal features without considering inter-modality relations. |
| Approach: | They propose to fuse textual and visual features for fake news detection using multimodal co-attention networks to learn inter-dependencies between multimodal features. |
| Outcome: | Extensive experiments on two realworld datasets show that the proposed network outperforms state-of-the-art methods and learns inter-dependencies among multimodal features. |
Similarizing the Influence of Words with Contrastive Learning to Defend Word-level Adversarial Text Attack (2023.findings-acl)
Copied to clipboard
| Challenge: | Neural language models are vulnerable to word-level adversarial text attacks . previous word-based search methods assume important words influence prediction . |
| Approach: | They propose a method for similarizing the influence of words with contrast learning that encourages model to learn sentence representations in which words of varying importance have a more uniform influence on prediction. |
| Outcome: | The proposed method is compatible with various training methods and improves model robustness against various adversarial attacks. |
ReLearn: Unlearning via Learning for Large Language Models (2025.acl-long)
Copied to clipboard
Haoming Xu, Ningyuan Zhao, Liming Yang, Sendong Zhao, Shumin Deng, Mengru Wang, Bryan Hooi, Nay Oo, Huajun Chen, Ningyu Zhang
| Challenge: | Existing methods for unlearning large language models often rely on reverse optimization to reduce target token probabilities. |
| Approach: | They propose a data augmentation and fine-tuning pipeline for effective unlearning . they propose augmentation, evaluation frameworks to measure contextual forgetting . |
| Outcome: | The proposed framework achieves targeted forgetting while preserving high-quality outputs. |
PARSE: An Efficient Search Method for Black-box Adversarial Text Attacks (2022.coling-1)
Copied to clipboard
| Challenge: | Neural networks are vulnerable to adversarial examples, i.e., under a black-box scenario. |
| Approach: | They propose a word-level search algorithm that searches for subareas under dynamic search space following the subarea importance. |
| Outcome: | The proposed algorithm can achieve comparable success rates to complex search methods while saving numerous queries and time. |
ATRI: Mitigating Multilingual Audio Text Retrieval Inconsistencies by Reducing Data Distribution Errors (2025.acl-long)
Copied to clipboard
Yuguo Yin, Yuxin Xie, Wenyuan Yang, Dongchao Yang, Jinghan Ru, Xianwei Zhuang, Liming Liang, Yuexian Zou
| Challenge: | Existing multilingual audio-text retrieval schemes suffer from inconsistencies for instance similarity matching across languages. |
| Approach: | They propose a multilingual audio-text retrieval scheme that mitigates the impact of data distribution error on recall and consistency. |
| Outcome: | The proposed scheme achieves state-of-the-art performance on recall and consistency metrics for eight mainstream languages, including English. |
Rethinking Word-level Adversarial Attack: The Trade-off between Efficiency, Effectiveness, and Imperceptibility (2024.lrec-main)
Copied to clipboard
| Challenge: | Neural language models have demonstrated impressive performance but remain vulnerable to word-level adversarial attacks. |
| Approach: | They propose two standardized search spaces to address the problem of word-level adversarial attacks. |
| Outcome: | The proposed search spaces improve performance and trade-offs in different scenarios. |
Voice Query Auto Completion (2021.emnlp-main)
Copied to clipboard
Raphael Tang, Karun Kumar, Kendra Chalkley, Ji Xin, Liming Zhang, Wenyan Li, Gefei Yang, Yajie Mao, Junho Shin, Geoffrey Craig Murray, Jimmy Lin
| Challenge: | Existing methods fail to complete voice queries from incomplete prefixes because they use orthographic prefix and substrings instead of the true phonetic prefix. |
| Approach: | They propose to condition QAC approaches on intermediate transcriptions to complete voice queries. |
| Outcome: | The proposed method obtains an 18% relative improvement over previous methods on a speech-enabled smart television with real-life voice search traffic. |
FinMME: Benchmark Dataset for Financial Multi-Modal Reasoning Evaluation (2025.acl-long)
Copied to clipboard
Junyu Luo, Zhizhuo Kou, Liming Yang, Xiao Luo, Jinsheng Huang, Zhiping Xiao, Jingshu Peng, Chengzhong Liu, Jiaming Ji, Xuanzhe Liu, Sirui Han, Ming Zhang, Yike Guo
| Challenge: | Multimodal Large Language Models (MLLMs) have experienced rapid development in recent years, but there is a notable lack of effective and specialized multimodal evaluation datasets in the financial domain. |
| Approach: | They introduce FinMME, a multimodal large language model with 11,000 financial research samples and 20 annotators. |
| Outcome: | The proposed model performs better than state-of-the-art models, highlighting its challenging nature. |
Contrastive Learning with Adversarial Examples for Alleviating Pathology of Language Model (2023.acl-long)
Copied to clipboard
| Challenge: | Existing interpretation methods fail to obtain faithful attributions on these models, thereby failing to reveal potential flaws and biases. |
| Approach: | They propose a Contrastive learning regularization method which calibrates the sentence representation of out-of-distribution examples and utilizes adversarial examples to introduce direction information in regularization. |
| Outcome: | The proposed method alleviates the model pathology while impacting generalization ability on in-distribution examples and thus helps interpretation methods obtain more faithful results. |