Papers by Junjie Liu
Copied to clipboard
| Challenge: | Text-to-Image Diffusion models generate high-quality images from textual descriptions, but they often produce images that do not fully align with the input prompts, resulting in semantic inconsistencies. |
| Approach: | They propose an automated repair approach to address catastrophic-neglect in T2I DMs. |
| Outcome: | The proposed model achieves 10.1%-16.3% higher Correct Rate in image generation compared to baselines. |
Copied to clipboard
| Challenge: | Existing benchmarks evaluate agents in simplified, idealized settings, relying on pre-packaged tool interfaces, overlooking critical steps, and assume inputs are clean and fully specified. |
| Approach: | They propose a framework that evaluates language agents in simplified, idealized settings . they show that even SOTA systems like Gemini and GPT-5 struggle on AgentGym2 . |
| Outcome: | Experiments on 15 proprietary and open-source models show that even SOTA systems like Gemini and GPT-5 struggle on AgentGym2 . |
Copied to clipboard
| Challenge: | Currently, tool-augmented large language models (LLMs) only achieve total scores of 45.3 and 37.0, respectively, on a scale of 100. |
| Approach: | They propose a multi-level diagnostic process to assess the LLM's hallucinations through two perspectives: depth and breadth. |
| Outcome: | The proposed diagnostic process assesses the hallucinations of large language models through two perspectives: depth and breadth. |
Copied to clipboard
| Challenge: | Recent studies have attempted to enhance the performance of large language models (LLMs) in complex question-answering (QA) tasks by combining step-wise planning with external retrieval. |
| Approach: | They propose a framework for enhancing LLMs’ planning capabilities by using planning data derived from knowledge graphs (KGs). |
| Outcome: | The proposed framework improves LLMs’ planning capabilities by using knowledge graphs (KGs) the proposed framework is compared with existing frameworks on multiple datasets and shows that it is effective for large language models. |
Copied to clipboard
| Challenge: | Formal verification typically requires developers to write detailed formal specifications . a formal verification system that generates candidate specifications is costly and error-prone . |
| Approach: | They propose an LLM-driven neuro-symbolic demonstration system that reframes specification writing as constrained structured synthesis. |
| Outcome: | The proposed system reduces hallucinations and produces proof-ready annotations. |
Copied to clipboard
| Challenge: | Existing methods for training reward models are vulnerable to context neglect and degraded accuracy. |
| Approach: | They propose distribution-aware reward modeling that augments the RM objective with a conditional mutual information regularizer that maximizes context and the predicted reward conditioned on the response. |
| Outcome: | The proposed model improves performance in RLHF and improves accuracy in other settings. |
Copied to clipboard
| Challenge: | Current datasets cater to user-led systems and are limited to predefined specific scenarios and slots. |
| Approach: | They propose to use a Chinese dialogue dataset to train a model that authentically simulates human-computer dialogues in 30 popular life service scenarios. |
| Outcome: | The proposed model achieves a joint accuracy of 75.09% in out-of-domain evaluations . it also achieves notable abilities in slot filling and questioning . |
Copied to clipboard
| Challenge: | Large language models (LLMs) have been used to mitigate misuse and to align with human values. |
| Approach: | They propose to use large-scale evaluations of various jailbreak attacks to identify key patterns and test them under eight advanced defenses. |
| Outcome: | The proposed attacks achieve high success rates but are easy to mitigate by defenses. |
Copied to clipboard
| Challenge: | drafting method statements is labor-intensive and time-consuming . traditional methods involve using static templates filled in manually by engineers . |
| Approach: | They propose a framework that automates method statement generation by using multi-agent collaboration. |
| Outcome: | The proposed framework achieves 4.38 ContentScore, excelling in specialization, completeness, organization, and clarity. |
Copied to clipboard
| Challenge: | Large language models (LLMs) have demonstrated proficiency in understanding and generating human natural languages. |
| Approach: | They propose a framework for scaling large language models using supervised fine-tuning, RLxF and test-time compute methodologies. |
| Outcome: | The proposed model can be used to understand and generate human natural languages. |
Copied to clipboard
| Challenge: | despite the growing demand for multimodal retrieval, there is a lack of training data. |
| Approach: | They propose a data synthesis method that leverages vision language models and open-domain images to generate high-quality data. |
| Outcome: | The proposed method outperforms baseline models on 70 more datasets and can scale up. |
Copied to clipboard
| Challenge: | Existing methods for multimodal retrieval are mostly text-oriented, which lack the capability to process visual information. |
| Approach: | They propose a multi-modal multi-text embedding model VISTA which extends a powerful text encoder with the image understanding capability by introducing visual token embedds. |
| Outcome: | The proposed model achieves superior performance across a variety of multi-modal retrieval tasks in zero-shot and supervised settings. |
Copied to clipboard
| Challenge: | Existing jailbreak attacks primarily utilize scenario camouflage techniques, however their explicit mention of malicious intent will be easily recognized and defended by LLMs. |
| Approach: | They propose an indirect jailbreak attack approach, Puzzler, which can bypass LLM’s defensive strategies and obtain malicious response by implicitly providing LLMs with some clues about the original malicious query. |
| Outcome: | The proposed approach can bypass the LLM’s defensive strategies and obtain malicious response by implicitly providing LLMs with some clues about the original malicious query. |
Copied to clipboard
| Challenge: | Existing trading systems rely on fragmented and task-specific APIs, resulting in inconsistent schemas and limited reproducibility. |
| Approach: | They propose a unified trading environment for large language model (LLM) agents that standardizes three core capabilities . they argue that such a standardized trading environment is essential for scalable research on LLM-based financial agents. |
| Outcome: | The proposed trading environment reduces engineering overhead and supports reproducible evaluation through comprehensive logging and deterministic replay. |
Copied to clipboard
| Challenge: | Existing methods for question matching only transmit one kind of information while failing to utilize both kinds of information simultaneously. |
| Approach: | They propose a question matching network that can transmit both representation and interactive information together in a simultaneous fashion. |
| Outcome: | The proposed approach outperforms strong baseline models on two standard benchmarks. |
Copied to clipboard
| Challenge: | Existing approaches to reduce label noise rely on heuristics and sample losses. |
| Approach: | They propose a method that transfers the noise distribution to a clean set and trains a model to distinguish noisy labels from clean ones using model-based features. |
| Outcome: | Empirically, the proposed approach improves over strong baselines on a wide range of tasks including text classification and speech recognition. |
Copied to clipboard
| Challenge: | Empirical evaluations of large language models demonstrate that they improve performance in a wide range of tasks. |
| Approach: | They propose a label-free method for mitigating selection bias during inference by reformulating debiasing as an optimization task. |
| Outcome: | The proposed method mitigates selection bias and improves performance compared to existing methods. |
Copied to clipboard
| Challenge: | Existing studies have found that when LLMs are given criminal facts and legal rules, then asked whether cases constitute a certain charge, they struggle to understand legal theories and perform basic legal reasoning tasks. |
| Approach: | They propose a task to assess LLMs' understanding of legal theories and reasoning capabilities by using a novel framework: Multi-Agent framework for improving complex legal reasoning capability. |
| Outcome: | The proposed framework improves LLMs' understanding of legal theories and reasoning abilities in real-world scenarios. |
Copied to clipboard
| Challenge: | E-commerce search relevance is a critical component of retrieval systems. |
| Approach: | They propose a large-generative model for search relevance that trains reasoning knowledge, multi-modal understanding and rule awareness into three core competencies. |
| Outcome: | The proposed model outperforms GPT-5 in Macro-F1 and achieves 27% online gain. |
Copied to clipboard
| Challenge: | Recent years have witnessed remarkable advancements in large language models (LLMs) many researchers argue that LLMs may not * Equal contribution. |
| Approach: | They propose a task that summarises the memorization issue by using grid inputs that abstractly describe physical phenomena. |
| Outcome: | The proposed task alleviates the memorization issue by using grid-format inputs that abstractly describe physical phenomena. |
Copied to clipboard
| Challenge: | Graphical User Interfaces (GUIs) are a pivotal medium for human-computer interaction. |
| Approach: | They propose a series of datasets for training visual-based GUI agents using general VLMs. |
| Outcome: | The proposed GUICourse datasets show that even a small-sized GUI agent performs better on GUI tasks. |
Copied to clipboard
| Challenge: | Existing general-domain benchmarks do not capture complexity of real-world judicial cognition and decision-making. |
| Approach: | They propose a benchmark specifically designed to evaluate LLM Agents in the legal domain. |
| Outcome: | The proposed benchmark includes 17 corpora from real-world legal scenarios and provides 37 tools for interacting with external knowledge. |
Copied to clipboard
| Challenge: | Recent research on fluid intelligence assessments has highlighted significant deficiencies in LLMs’ abilities. |
| Approach: | They analyze the challenges LLMs face in demonstrating fluid intelligence through controlled experiments using the most representative ARC task as an example. |
| Outcome: | The proposed model shows that it lacks the ability to combine skill composition and abstract input formats and lacks left-to-right decoding. |
Copied to clipboard
| Challenge: | Recent advances in multilingual natural language processing have improved performance on benchmarks such as XTREME and XGLUE by 13 points . however, improvements have been easier to achieve in some tasks than others . |
| Approach: | They extend XTREME to XTRAME-R, which includes ten natural language understanding tasks and covers 50 typologically diverse languages. |
| Outcome: | The proposed framework improves the performance on the XTREME multilingual benchmark by 13 points compared to human-level performance on English transfer learning. |
Copied to clipboard
| Challenge: | Existing rankers excel in lexical-matching scenarios, while they struggle with complex queries requiring deep reasoning. |
| Approach: | They propose a new paradigm that balances flexibility and context awareness to unlock the full potential of groupwise reranking. |
| Outcome: | The proposed approach achieves a state-of-the-art 65.2 NDCG@10 on BRIGHT and surpasses baselines by 2.1 points on R2MED while delivering a 6.4 inference speedup. |
Copied to clipboard
| Challenge: | Existing methods for ERC lack interpretability and shallow semantics capture deep semantics. |
| Approach: | They propose a Fast-Slow thinking framework for Emotion Recognition in Conversation . they use fine-grained emotion reasoning chains to capture deep semantics . |
| Outcome: | The proposed framework achieves state-of-the-art in explanation and judgment on a benchmark dataset. |
Copied to clipboard
| Challenge: | Recent advances in vision-language-action models prioritize robotic action mastery . however, models trained on visual-text pairs struggle to interpret multimodal data . |
| Approach: | They propose a framework that integrates multimodal data after initial control mastery and a Mixture-of-Experts architecture to minimize task interference. |
| Outcome: | The proposed framework surpasses state-of-the-art vision-language-action (VLA) methods on multimodal understanding benchmarks and achieves six times higher performance on visual question-answering datasets. |
Copied to clipboard
| Challenge: | Existing benchmarks rely on partially observable traces that capture only agent outputs . lack of full execution traces obscures many failure causes, authors argue . |
| Approach: | They propose a benchmark that allows attribution under full execution observability . they find full traces improve attribution accuracy by up to 76.5% over a partial-observation counterpart . |
| Outcome: | The proposed benchmark improves attribution accuracy by up to 76.5% over a partial-observation counterpart. |
Copied to clipboard
| Challenge: | Current systems for legal consultation are insufficient to handle the knowledge-intensive nature of real-world consultations. |
| Approach: | They propose a multi-turn benchmark dataset to evaluate LLMs in legal consultation settings. |
| Outcome: | The proposed framework assesses LLMs’ consultation capabilities in terms of (1) clarification capability and (2) professional advice quality. |
Copied to clipboard
| Challenge: | Existing knowledge poisoning attacks against RAG systems require multiple poisoned documents or can only function effectively on simplistic queries. |
| Approach: | They propose a more realistic knowledge poisoning attack that poisons only a single document while remaining effective for complex multi-hop questions involving complex relationships between multiple elements. |
| Outcome: | The proposed attack achieves success by poisoning only a single document while remaining effective for complex multi-hop questions involving complex relationships between multiple elements. |
Copied to clipboard
| Challenge: | Traditional fine-tuning ignores one-to-many nature of language, leading to overfitting . authors propose a method to fine- tune LLMs by leveraging tokens. |
| Approach: | They propose a method to fine-tune Large Language Models by leveraging tokens to mask low-probability tokens. |
| Outcome: | The proposed method outperforms baselines on general reasoning and mathematical benchmarks. |
Copied to clipboard
| Challenge: | Recent advances in Large Language Models (LLMs) have demonstrated remarkable success across diverse tasks such as instruction following, code generation, and medical diagnosis. |
| Approach: | They propose a supervised fine-tuning-based auxiliary loss for Q-value estimations during supervised refinement. |
| Outcome: | The proposed method outperforms beam search on GSM8K, MATH, and GAOKAO on reasoning benchmarks. |
Copied to clipboard
| Challenge: | Existing behavioral testing approaches only evaluate translation quality without references, restricting diagnosis to specific types of errors. |
| Approach: | They propose a bilingual translation pair generation based behavior testing framework that auto-generates test cases and pseudo-references to facilitate general error diagnosis. |
| Outcome: | The proposed framework can provide comprehensive and accurate behavioral testing results for general error diagnosis on machine translation systems. |
Copied to clipboard
| Challenge: | Large language models (LLMs) are increasingly deployed in user-facing applications, raising concerns that they reflect and amplify social biases. |
| Approach: | They propose a Mandarin-specific evaluation framework to examine social identity biases in Chinese LLMs using Mandarin-based prompts. |
| Outcome: | The proposed framework compares ingroup (“We”) and outgroup (“They”) framings across 240 social groups salient in the Chinese context, using a two-tiered measurement framework that assesses both sentiment and toxicity. |
Copied to clipboard
| Challenge: | Existing work integrates reinforcement learning with compiler feedback to enhance code generation quality but the long code generated by LLMs makes RL exploration ineffective. |
| Approach: | They propose a framework that integrates reinforcement learning and compiler feedback to enhance code generation quality. |
| Outcome: | The proposed framework outperforms state-of-the-art approaches in corresponding benchmarks and integrates reinforcement learning with compiler feedback to improve code generation quality. |
Copied to clipboard
| Challenge: | Advanced GUI agents suffer from prohibitive deployment costs on resource-constrained devices. |
| Approach: | They propose a lightweight GUI agent with GUI-specific knowledge and task scalability . LAMO-3B supports monolithic execution and MAS-style orchestration . |
| Outcome: | The proposed GUI agent LAMO-3B supports monolithic execution and MAS-style orchestration. |
Copied to clipboard
| Challenge: | Emotion recognition in conversation (ERC) is a task of discerning human emotions for each utterance within a conversation. |
| Approach: | They propose a framework that uses large language models to analyze speaker characteristics . they use two-stage learning to make the models reason speaker characteristics and track emotion of the speaker . |
| Outcome: | The proposed framework outperforms existing methods on three benchmark datasets. |
Copied to clipboard
| Challenge: | Existing LLMs lack high-quality data sources and lack robust data filtration strategies. |
| Approach: | They develop a framework to enhance the capabilities of LLM-based agents under data scarcity. |
| Outcome: | The proposed framework improves the capabilities of LLM-based agents under data scarcity. |
Copied to clipboard
| Challenge: | Existing methods for ERC lack human-like emotion reasoning and discrimination between similar emotions. |
| Approach: | They propose a multi-dimension curriculum with long CoT fine-tuning to clone human-like emotion reasoning for conversational emotion recognition. |
| Outcome: | The proposed model outperforms existing methods on three widely used datasets and shows that it is more intuitive and more accurate. |
Copied to clipboard
| Challenge: | Existing approaches to deep search training lack high-quality training trajectories, prohibitive computational costs and lack of high-fidelity training data. |
| Approach: | They propose a framework that synthesizes high-quality training data by simulating real user interactions in live web search environments. |
| Outcome: | The proposed framework synthesizes high-quality training data by simulating user interactions in live web search environments. |
Copied to clipboard
| Challenge: | Small perturbations in the input can severely distort intermediate representations and thus impact translation quality of neural machine translation models. |
| Approach: | They propose adversarial stability training to make encoder and decoder robust to perturbations by enabling them to behave similarly for the original input and its perturbed counterpart. |
| Outcome: | The proposed approach improves translation quality and robustness over strong models on Chinese-English, English-German and English-French translation tasks. |
Copied to clipboard
| Challenge: | Existing methods to retrieve evidences from corpus are difficult due to table-text discrepancy and data sparsity problem. |
| Approach: | They propose an optimized OpenQA Table-Text Retriever to retrieve tabular and textual evidences from tabular resources. |
| Outcome: | The proposed OpenQA Table-Text Retriever significantly outperforms existing methods on QA tasks. |
Copied to clipboard
| Challenge: | Existing embedding models are not well-equipped to encode situated context effectively, i.e., situating a chunk’s meaning within its context. |
| Approach: | They propose to represent short chunks in a way that is conditioned on a broader context window to enhance retrieval performance. |
| Outcome: | The proposed model outperforms state-of-the-art embedding models on a book-plot retrieval dataset. |
Copied to clipboard
| Challenge: | Existing multimodal retrieval models are lacking in visual representations of multimodal data. |
| Approach: | They propose a visualized information retrieval paradigm where multimodal information is represented by a unified visual format called Screenshots for various retrieval applications. |
| Outcome: | The proposed model is based on a large dataset of screenshots from diverse sources . it is compared with existing models and lays a solid foundation for the new model . |
Copied to clipboard
| Challenge: | Extensive experimental results on several popular logical benchmarks (ProofWriter, PrOntoQA, PrONtoQA-OOD, and FOLIO) and mathematical benchmark (DI-GSM) show that COP significantly outperforms previous state-of-the-art methods. |
| Approach: | They propose a reasoning approach called Concise and Organized Perception (COP) that carefully analyzes the given statements to identify the most pertinent information while eliminating redundancy efficiently. |
| Outcome: | The proposed approach outperforms state-of-the-art methods on several popular logical benchmarks and mathematical benchmarks. |
Copied to clipboard
| Challenge: | Semantic compositionality (SC) is defined as the phenomenon that the meaning of a complex linguistic unit can be composed of the meanings of its constituents. |
| Approach: | They propose to incorporate sememes into SC models and employ them in learning multiword expressions. |
| Outcome: | The proposed models achieve significant performance boost compared to baseline methods without sememe knowledge. |
Copied to clipboard
| Challenge: | Existing approaches to large language models (LLMs) are limited by their ability to enforce environmental and behavioral admissibility. |
| Approach: | They propose an ontological framework to guard LLM agents by enforcing environmental and behavioral admissibility. |
| Outcome: | Experiments on ScienceWorld and VirtualHome show that OntoGuard can enforce environmental and behavioral admissibility while preventing invalid actions. |
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are increasingly equipped with capabilities of real-time web search and integrated with protocols like the Model Context Protocol (MCP). |
| Approach: | They investigate the vulnerability of Large Language Models to hidden adversarial prompts . they evaluate two critical attack scenarios: malicious content relay and sensitive data leakage . |
| Outcome: | The proposed extension could introduce new security vulnerabilities. |