Papers by Liwei Wang
C2LEVA: Toward Comprehensive and Contamination-Free Language Model Evaluation (2025.findings-acl)
Copied to clipboard
Yanyang Li, Wong Tin Long, Cheung To Hung, Jianqiao Zhao, Duo Zheng, Liu Ka Wai, Michael R. Lyu, Liwei Wang
| Challenge: | Recent advances in large language models (LLMs) have shown significant promise, yet their evaluation raises concerns regarding data contamination due to the lack of access to proprietary training data. |
| Approach: | They propose a bilingual benchmark that offers a holistic evaluation and systematic contamination prevention. |
| Outcome: | The proposed evaluations of 15 open-source and proprietary models show that they are reliable and free of data contamination. |
Probing Structured Pruning on Multilingual Pre-trained Models: Settings, Algorithms, and Efficiency (2022.acl-long)
Copied to clipboard
| Challenge: | Structured pruning has been extensively studied on monolingual pre-trained models . but little attention has been paid to evaluating the effectiveness of structured pruning on multilingual models. |
| Approach: | They investigate settings, algorithms, and efficiency of structured pruning on multilingual models . authors propose a simple approach that allows training the model once and adapting to different model sizes at inference . |
| Outcome: | The proposed approach allows training the model once and adapting to different model sizes at inference. |
Learning Language Specific Sub-network for Multilingual Machine Translation (2021.acl-long)
Copied to clipboard
| Challenge: | Multilingual neural machine translation models suffer from performance degradation when learning multiple languages. |
| Approach: | They propose to use LaSS to jointly train a single unified multilingual MT model. |
| Outcome: | The proposed model gains on 36 language pairs by up to 1.2 BLEU and zero-shot translation with 8.3 BLUE on 30 language pairs. |
Beyond Triplet: Leveraging the Most Data for Multimodal Machine Translation (2023.findings-acl)
Copied to clipboard
| Challenge: | Multimodal machine translation (MMT) aims to improve translation quality by incorporating information from other modalities, such as vision. |
| Approach: | They propose a framework for multimodal machine translation that utilizes large-scale non-triple data and a multimodal translation dataset. |
| Outcome: | The proposed method can significantly improve translation performance with more non-triple data. |
Semi-Supervised Learning for Video Captioning (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing video captioning algorithms are heavily dependent on supervised training data. |
| Approach: | They propose to train the video captioning model on labeled and unlabeled data jointly in a semi-supervised learning manner. |
| Outcome: | The proposed model outperforms state-of-the-art semi-supervised learning approaches on VATEX, MSR-VTT and MSVD datasets. |
MART: Memory-Augmented Recurrent Transformer for Coherent Video Paragraph Captioning (2020.acl-main)
Copied to clipboard
| Challenge: | Existing methods for generating paragraph descriptions for videos require a coherent paragraph and a higher level of coherence. |
| Approach: | They propose a new method that generates a summarized memory state from video segments and sentence history to help better predict the next sentence. |
| Outcome: | The proposed method generates more coherent and less repetitive paragraph captions while maintaining relevance to the input video events. |
Learning Preference Model for LLMs via Automatic Preference Data Generation (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing training methods for large language models rely on human-annotated data. |
| Approach: | They propose to learn the preference model for LLMs via automatic preference data generation (AutoPM) using HHH-guided preference data, they show reliability and potential . |
| Outcome: | The proposed approach enables LLMs to learn human preferences and align with human values. |
Language Tags Matter for Zero-Shot Neural Machine Translation (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing studies on multilingual machine translation have ignored the importance of LTs. |
| Approach: | They propose to use language tag (LT) strategies to indicate translation directions in MNMT to enhance consistency and alleviate off-target issues in zero-shot directions. |
| Outcome: | The proposed model could translate between unsupervised languages and achieve a +8 BLEU score difference over other LT strategies in translation tasks. |
Learning to Reason from Feedback at Test-Time (2025.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to utilizing feedback are expensive and lack the time to perform iterative interactions with the environment. |
| Approach: | They propose a novel paradigm that formulates feedback utilization as an optimization problem at test time and a learnable test-time optimizer to effectively exploit feedback. |
| Outcome: | The proposed paradigm improves scalability and performance on two large language models across four reasoning datasets. |
Beyond Embeddings: The Promise of Visual Table in Visual Reasoning (2024.emnlp-main)
Copied to clipboard
| Challenge: | Visual representation learning has been a cornerstone in computer vision for decades. |
| Approach: | They propose a visual representation tailored for visual reasoning that provides instance-level world knowledge and detailed attributes that are essential for visual reason. |
| Outcome: | The proposed visual tables outperform existing models on 11 visual reasoning benchmarks. |
DAGN: Discourse-Aware Graph Network for Logical Reasoning (2021.naacl-main)
Copied to clipboard
| Challenge: | Recent QA with logical reasoning questions requires passage-level relations among the sentences. |
| Approach: | They propose a discourse-aware graph network that aggregates passage-level clues for QA by using discourse-based information. |
| Outcome: | The proposed model achieves competitive results on two logical reasoning QA datasets. |
KBGAN: Adversarial Learning for Knowledge Graph Embeddings (N18-1)
Copied to clipboard
| Challenge: | Existing knowledge graph embedding techniques lack the capability to access similarities between entities and relations. |
| Approach: | They propose an adversarial learning framework to improve knowledge graph embedding models . they use one knowledge graph embedded model as a negative sample generator . |
| Outcome: | The proposed framework improves the performance of knowledge graph embedding models on a link prediction task. |
JointGT: Graph-Text Joint Representation Learning for Text Generation from Knowledge Graphs (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing pre-trained models for knowledgegraph-to-text generation ignore graph structure during encoding and lack elaborate pre-training tasks to explicitly model graph-text alignments. |
| Approach: | They propose a graph-text joint representation learning model called JointGT which incorporates a structure-aware semantic aggregation module into each Transformer layer to preserve the graph structure. |
| Outcome: | The proposed model achieves state-of-the-art performance on various KG-to-text datasets. |
Enhancing Temporal Modeling of Video LLMs via Time Gating (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing Video Large Language Models neglect temporal information in video data, leading to struggles with temporal-aware video understanding. |
| Approach: | They propose a Time Gating Video LLM (TG-Vid) that employs a time gating module to enhance temporal modeling. |
| Outcome: | The proposed model outperforms existing Large Language Models on video-and-language tasks and ablation studies show that the model outpersforms the existing models. |
When Phrases Meet Probabilities: Enabling Open Relation Extraction with Cooperating Large Language Models (2024.acl-long)
Copied to clipboard
| Challenge: | Existing clustering-based open relation extraction methods use pre-trained language models . embeddings from language models are high-dimensional and anisotropic, so there is a gap . |
| Approach: | They propose a framework that makes two LLMs work collaboratively to achieve clustering. |
| Outcome: | The proposed framework outperforms existing methods by 1.4%3.13% on different datasets. |
Hint-Based Training for Non-Autoregressive Machine Translation (D19-1)
Copied to clipboard
| Challenge: | AutoRegressive Translation models have to generate tokens sequentially during decoding and thus suffer from high inference latency. |
| Approach: | They propose to use hidden states and word alignments to help train NART models. |
| Outcome: | The proposed model improves on the WMT14 En-De and De-En datasets but is faster in inference than the current models. |
FlowEval: A Consensus-Based Dialogue Evaluation Framework Using Segment Act Flows (2022.emnlp-main)
Copied to clipboard
| Challenge: | Despite recent progress in dialogue evaluation, how to develop automatic metrics remains an open problem. |
| Approach: | They propose a consensus-based framework for dialog evaluation using segment act flows . they propose to crowdsource a large-scale dataset for it to be evaluated . |
| Outcome: | The proposed framework can reach the best or comparable correlation with human evaluation. |
Making Long-Context Language Models Better Multi-Hop Reasoners (2024.acl-long)
Copied to clipboard
| Challenge: | Recent advances in long-context modeling have enhanced language models for complex tasks, but they struggle with multi-hop reasoning and noisy contexts. |
| Approach: | They propose an approach that prompts LMs to supply attributions for each assertion during reasoning. |
| Outcome: | The proposed model achieves competitive performance on multi-hop reasoning benchmarks, closely paralleling proprietary LMs such as ChatGPT and Claude-instant. |
RAST: Domain-Robust Dialogue Rewriting as Sequence Tagging (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing models for dialogue rewriting suffer from the robustness issue, i.e., performances drop dramatically when testing on a different dataset. |
| Approach: | They propose a sequence-tagging-based approach that reduces the search space while preserving the core of the task. |
| Outcome: | The proposed model significantly reduces the search space while still covering the core of the task. |
From Short Video to Clickable Search: RLVR-Enabled Listwise Query Suggestion with Retrieval-Augmented Context (2026.acl-industry)
Copied to clipboard
| Challenge: | Existing methods to generate short-video bottom-bar queries are largely retrieval-based. |
| Approach: | They propose to reformulate the task as one-shot list generation, producing multiple queries per video . they also build multi-query ground truth from exposure and CTR logs, and redesign offline evaluation . |
| Outcome: | The proposed system yields strong offline and online improvements . it is deployed on Kuaishou to serve hundreds of millions of users daily . |
Exploiting Rich Syntactic Information for Semantic Parsing with Graph-to-Sequence Model (D18-1)
Copied to clipboard
| Challenge: | Existing neural semantic parsers extract word order features while neglecting other valuable syntactic information. |
| Approach: | They propose to use syntactic graph to represent three types of syntaktic information . they then employ a graph-to-sequence model to encode the syntastic graph and decode a logical form . |
| Outcome: | The proposed model is comparable to the state-of-the-art on Jobs640, ATIS, and Geo880. |
Eliciting Knowledge from Large Pre-Trained Models for Unsupervised Knowledge-Grounded Conversation (2022.emnlp-main)
Copied to clipboard
| Challenge: | Recent advances in large-scale pre-training provide large models with the potential to learn knowledge from the raw text. |
| Approach: | They propose a posterior-based reweighing and noisy training strategy to exploit generated knowledge in dialogue generation. |
| Outcome: | Empirical results show that the proposed methods outperform the state-of-the-art methods in unsupervised knowledge-grounded conversation. |
Contrastive Learning for Many-to-many Multilingual Neural Machine Translation (2021.acl-long)
Copied to clipboard
| Challenge: | Existing multilingual machine translation approaches focus on English-centric directions, while non-English directions lag behind. |
| Approach: | They propose a multilingual machine translation system with an emphasis on non-English directions. |
| Outcome: | The proposed model outperforms existing models on English-centric and non-English directions on multilingual translation benchmarks. |
Cross-lingual Knowledge Graph Alignment via Graph Matching Neural Network (P19-1)
Copied to clipboard
| Challenge: | Existing approaches to cross-lingual knowledge graph (KG) alignment rely on entity embeddings derived from monolingual KG structural information. |
| Approach: | They propose a topic entity graph to represent entities with contextual information in KGs. |
| Outcome: | The proposed model outperforms state-of-the-art methods by a large margin. |
How Numerical Precision Affects Arithmetical Reasoning Capabilities of LLMs (2025.findings-acl)
Copied to clipboard
Guhao Feng, Kai Yang, Yuntian Gu, Xinyue Ai, Shengjie Luo, Jiacheng Sun, Di He, Zhenguo Li, Liwei Wang
| Challenge: | Despite the success of transformer-based large language models, understanding and enhancing their mathematical capabilities remains a significant challenge. |
| Approach: | They propose to use numerical precision as a key factor that influences LLMs' effectiveness in arithmetical tasks to determine their effectiveness. |
| Outcome: | The proposed models perform better in arithmetic tasks than transformer-based models with standard numerical precision. |
MVP-Tuning: Multi-View Knowledge Retrieval with Prompt Tuning for Commonsense Reasoning (2023.acl-long)
Copied to clipboard
| Challenge: | Existing methods for commonsense reasoning rely on multi-hop knowledge retrieval and suffer low accuracy due toembedded noise in the acquired knowledge. |
| Approach: | They propose to use multi-hop knowledge retrieval to model knowledge and input text together. |
| Outcome: | The proposed method outperforms baselines on 5 commonsense reasoning datasets and is number one on theleaderboard. |
CLEVA: Chinese Language Models EVAluation Platform (2023.emnlp-demo)
Copied to clipboard
Yanyang Li, Jianqiao Zhao, Duo Zheng, Zi-Yuan Hu, Zhi Chen, Xiaohui Su, Yongfeng Huang, Shijia Huang, Dahua Lin, Michael Lyu, Liwei Wang
| Challenge: | Large language models (LLMs) have revolutionized natural language processing. |
| Approach: | They propose a Chinese-based platform that assesses Chinese LLMs using a standardized workflow and a unique sampling strategy. |
| Outcome: | CLEVA evaluates Chinese LLMs on a standardized workflow and a competitive leaderboard with minimal coding. |