Papers by Xiyan Liu
How Reliable is Multilingual LLM-as-a-Judge? (2025.findings-emnlp)
Copied to clipboard
| Challenge: | LLMs are a popular evaluation strategy, but their reliability in multilingual evaluation remains uncertain. |
| Approach: | They evaluate five models from different model families across five diverse tasks involving 25 languages. |
| Outcome: | The models perform poorly across languages and average Fleiss’ Kappa is 0.3 . |
MMAC: A Multilingual, Multimodal Alignment Framework for Cultural Grounding Evaluation (2026.acl-long)
Copied to clipboard
Weihua Zheng, Zhengyuan Liu, Tanmoy Chakraborty, Weiwen Xu, Xiaoxue Gao, Bryan Chen Zhengyu Tan, Bowei Zou, Chang Liu, Yujia Hu, Xing Xie, Xiaoyuan Yi, Jing Yao, Chaojun Wang, Long Li, Rui Liu, Huiyao Liu, Koji Inoue, Ryuichi Sumida, Tatsuya Kawahara, Fan Xu, Lingyu Ye, Wei Tian, Dongjun Kim, Jimin Jung, Jaehyung Seo, Nadya Yuki Wangsajaya, Pham Minh Duc, Ojasva Saxena, Palash Nandi, Xiyan Tao, Wiwik Karlina, Tuan Luong, Keertana Arun Vasan, Roy Ka-Wei Lee, Nancy F. Chen
| Challenge: | Existing models lack cultural alignment across modalities and languages . a new framework to assess cultural awareness across linguistics and languages is needed . |
| Approach: | They propose a framework that integrates tri-modally aligned cultural benchmarks and a five-dimensional evaluation protocol to assess cross-country awareness disparities. |
| Outcome: | The proposed framework assesses cultural awareness disparities across modalities and languages . it is the first dataset aligned at the input level across text, image, and speech . |
Always the Best Fit: Adaptive Domain Gap Filling from Causal Perspective for Few-Shot Relation Extraction (2023.findings-emnlp)
Copied to clipboard
Ge Bai, Chenji Lu, Jiaxiang Geng, Shilong Li, Yidong Shi, Xiyan Liu, Ying Liu, Zhang Zhang, Ruifang Liu
| Challenge: | Existing approaches to cross-domain relation extraction have been limited by domains . data bias between domains can be difficult to fill, especially in few-shot scenarios . |
| Approach: | They propose a framework to bridge the semantic gap caused by data bias between domains . they use syntactic structure, label distribution, and entities to calculate causal effects . |
| Outcome: | The proposed framework fills the domain gap and yields better results on the few-shot task. |
RepSum: Unsupervised Dialogue Summarization based on Replacement Strategy (2021.acl-long)
Copied to clipboard
| Challenge: | Existing methods to learn vital information from dialogue context with limited data are limited due to limited words in utterances and huge gap between dialogue and its summary. |
| Approach: | They propose an unsupervised strategy to learn vital information from dialogue context . the proposed model uses a hypothetical foundation that a superior summary approximates a replacement of the original dialogue . |
| Outcome: | The proposed model outperforms existing models on a number of datasets. |
Lexicon Enhanced Chinese Sequence Labeling Using BERT Adapter (2021.acl-long)
Copied to clipboard
| Challenge: | Existing methods for Chinese sequence labelling only fuse lexicon features via a shallow and random initialized sequence layer and do not integrate them into the bottom layers of BERT. |
| Approach: | They propose a Lexicon Enhanced BERT model which integrates external lexicon knowledge into BERT layers directly by a lexiccon Adapter layer. |
| Outcome: | The proposed model integrates external lexicon knowledge into BERT layers directly by a Lexicon Adapter layer. |
Modeling Structural Similarities between Documents for Coherence Assessment with Graph Convolutional Networks (2023.acl-long)
Copied to clipboard
| Challenge: | Existing methods focus on a single document’s coherence patterns, ignoring the underlying correlation between documents. |
| Approach: | They propose a GCN-based coherence model that captures structural similarities between documents by mining subgraph patterns and a heterogeneous graph for the training corpus. |
| Outcome: | The proposed model outperforms baseline models on discourse coherence and automated essay scoring tasks. |
Free your mouse! Command Large Language Models to Generate Code to Format Word Documents (2024.emnlp-main)
Copied to clipboard
| Challenge: | Recent LLMs have significantly improved code generation, making it increasingly accessible to users. |
| Approach: | They propose an automatic document formatting method, Text-to-Format, driven by various prompting strategies and a high-quality dataset DocFormEval data. |
| Outcome: | The proposed method improves the efficiency and experience of users in formatting the document and improves document formatting task. |