Papers by Liqun Li

18 papers
Thread: A Logic-Based Data Organization Paradigm for How-To Question Answering with Retrieval Augmented Generation (2025.emnlp-main)

Copied to clipboard

Challenge: Recent advances in retrieval-augmented generation (RAG) have substantially improved question-answering systems, particularly for factoid ‘5Ws’ questions.
Approach: They propose a data organization paradigm where large language models transform documents into more structured and loosely interconnected LUs.
Outcome: Experiments in open-domain and industrial settings show that the proposed paradigm outperforms existing paradigms and shows high adaptability across diverse document formats.
Contextualized Perturbation for Textual Adversarial Attack (2021.naacl-main)

Copied to clipboard

Challenge: Existing techniques for generating adversarial examples are driven by local heuristic rules that are agnostic to the context, resulting in unnatural and ungrammatical outputs.
Approach: They propose a ContextuaLized AdversaRial Example generation model that generates fluent and grammatical outputs through a mask-then-infill procedure.
Outcome: The proposed model outperforms baseline models in terms of attack success rate, textual similarity, fluency and grammaticality.
CodeArena: Evaluating and Aligning CodeLLMs on Human Preference (2025.emnlp-main)

Copied to clipboard

Challenge: Code large language models (codeLLMs) focus on synthesizing the correct code snippet, ignoring the alignment with human preferences.
Approach: They propose a benchmark code-based on 40 categories and 44 programming languages to emulate real-world coding tasks.
Outcome: The proposed benchmarks show that open-source code LLMs perform better than open-sourced ones.
UFO: A UI-Focused Agent for Windows OS Interaction (2025.naacl-long)

Copied to clipboard

Challenge: UFO is a UI-Fcused agent designed to fulfill user requests tailored to Windows OS applications . it decomposes user requests using divide-and-conquer approach, enabling seamless navigation and addressing sub-tasks across multiple applications.
Approach: They propose a UI-Fcused Windows OS agent that decomposes user requests using a divide-and-conquer approach and incorporates a control interaction module tailored for Windows OS.
Outcome: The proposed agent decomposes user requests using divide-and-conquer approach, enabling seamless navigation and addressing sub-tasks across multiple applications.
GanLM: Encoder-Decoder Pre-training with an Auxiliary Discriminator (2023.acl-long)

Copied to clipboard

Challenge: Existing pre-training methods underutilize the benefits of language understanding for generation.
Approach: They propose a GAN-style model for encoder-decoder pre-training with an auxiliary discriminator.
Outcome: The proposed model outperforms existing pre-trained models and achieves state-of-the-art performance.
TencentPretrain: A Scalable and Flexible Toolkit for Pre-training Models of Different Modalities (2023.acl-demo)

Copied to clipboard

Challenge: Several pre-training models of different modalities are showing a rising trend of homogeneity in their model structures.
Approach: They propose a toolkit that supports pre-training models of different modalities.
Outcome: The proposed toolkit can match the performance of the original implementations on text, vision, and audio benchmarks.
SCALAR: Scientific Citation-based Live Assessment of Long-context Academic Reasoning (2026.eacl-long)

Copied to clipboard

Challenge: Long-context understanding is a critical capability for large language models . evaluating this capability requires extensive human annotation, which is time-consuming and costly.
Approach: They propose a benchmark to assess citation-grounded long-context reasoning in academic writing.
Outcome: The proposed benchmark compares state-of-the-art models with human experts on two tasks . human experts achieve 90% accuracy, but most models struggle with the cloze-style task .
MdEval: Massively Multilingual Code Debugging (2026.findings-acl)

Copied to clipboard

Challenge: Existing benchmarks primarily focus on Python and are limited in terms of language diversity.
Approach: They propose a multilingual debugging benchmark that includes 3.9K test samples of 20 programming languages and introduces the debug instruction corpora MdEval-Instruct by injecting bugs into the correct multilingual queries and solutions.
Outcome: The proposed benchmark includes 3.9K test samples of 20 programming languages and covers the automated program repair task, bug localization task, and bug identification task.
Enhancing Reinforcement Learning with Label-Sensitive Reward for Natural Language Understanding (2024.acl-long)

Copied to clipboard

Challenge: Recent advances in large language models (LLMs) have yielded remarkable performance, but objective mismatch issues hinder RLHF learning.
Approach: They propose a Reinforcement Learning framework enhanced with Label-sensitive reward to enhance LLMs' alignment and generation capabilities.
Outcome: The proposed framework improves performance on five diverse models across eight tasks.
NeuralClassifier: An Open-source Neural Hierarchical Multi-label Text Classification Toolkit (P19-3)

Copied to clipboard

Challenge: NeuralClassifier is a toolkit for hierarchical multi-label text classification.
Approach: They propose a toolkit for neural hierarchical multi-label text classification . they use a variety of text encoders to implement the model .
Outcome: The proposed model achieves comparable performance with reported results in the literature.
Towards Faithful Industrial RAG: A Reinforced Co-adaptation Framework for Advertising QA (2026.acl-industry)

Copied to clipboard

Challenge: Existing methods for QA in industrial environments are inherently relational and often updated.
Approach: They propose a framework that optimizes retrieval and generation through two components: Graph-aware Retrieval and evidence-constrained reinforcement learning.
Outcome: Experiments on an internal advertising QA dataset show consistent gains across expert-judged dimensions including accuracy, completeness, safety, and URL validity.
m3P: Towards Multimodal Multilingual Translation with Multimodal Prompt (2024.lrec-main)

Copied to clipboard

Challenge: Existing multimodal neural machine translation models focus on bilingual translation, but experimental results show that they outperform the text-only baselines and multilingual multimodal methods by a large margin.
Approach: They propose a framework to leverage the multimodal prompt to guide the Multimodal Multilingual Neural Machine Translation (m3P) this framework aligns the representations of different languages with the same meaning and generates the conditional vision-language memory for translation.
Outcome: The proposed framework outperforms previous text-only baselines and multilingual multimodal methods by a large margin.
UniCoder: Scaling Code Large Language Model via Universal Code (2024.acl-long)

Copied to clipboard

Challenge: Experimental results show that UniCoder with the universal code significantly outperforms the previous prompting methods by a large margin.
Approach: They introduce the universal code (UniCode) as the intermediate representation of algorithm steps using conventions of programming languages.
Outcome: The proposed model outperforms previous prompting methods by a large margin . the proposed model is based on a dataset of natural-language questions and code solutions .
Strengthened Symbol Binding Makes Large Language Models Reliable Multiple-Choice Selectors (2024.acl-long)

Copied to clipboard

Challenge: Multiple-Choice Questions (MCQs) are a critical area of research in the study of Large Language models (LLMs).
Approach: They propose an efficient SFT algorithm for MCQs, termed Point-wise Intelligent Feedback, which constructs negative instances by randomly combing the incorrect option contents with all candidate symbols.
Outcome: The proposed algorithm significantly reduces the model’s selection bias by improving its MCSB capability.
Search-P1: Path-Centric Reward Shaping for Stable and Efficient Agentic RAG Training (2026.acl-industry)

Copied to clipboard

Challenge: Retrieval-Augmented Generation (RAG) enhances large language models by incorporating external knowledge, yet traditional singleround retrieval struggles with complex multistep reasoning.
Approach: They propose a framework that introduces path-centric reward shaping for agentic RAG training.
Outcome: The proposed framework improves on existing methods with an average accuracy gain of 7.7 points.
The GaoYao Benchmark: A Comprehensive Framework for Evaluating Multilingual and Multicultural Abilities of Large Language Models (2026.acl-long)

Copied to clipboard

Challenge: Existing multilingual evaluation benchmarks neglect cultural nuances and lack language coverage in subjective tasks.
Approach: They propose a framework that categorizes evaluation tasks into three cultural layers and nine cognitive sub-layers.
Outcome: The proposed framework surpasses prior coverage by up to 111% on 20+ LLMs.
Improving Text Generation with Student-Forcing Optimal Transport (2020.emnlp-main)

Copied to clipboard

Challenge: Maximum likelihood estimation (MLE) is used to train models, but during testing, the model is conditioned on previously generated tokens, resulting in exposure bias.
Approach: They propose to use optimal transport to match the sequences generated in MLE and test modes to reduce exposure bias.
Outcome: The proposed method is validated on machine translation, text summarization, and text generation tasks.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations