Papers by Yifei Liu

Reasoning as Gradient: Scaling MLE Agents Beyond Tree Search (2026.findings-acl)

Challenge:	closed-ended question-based benchmarks struggle with saturation as newer models emerge . crowd-sourced leaderboards rely on costly and slow human judges .
Approach:	They propose a framework that leverages collective intelligence from all large language models to evaluate each other.
Outcome:	a new framework enables a democratic, pairwise evaluation of all large language models . it achieves 97% correlation with human judgements, while significantly reducing the cost.

Copied to clipboard

Yifei Zhang, Xu Yang, Xiao Yang, Bowen Xian, Qizheng Li, Shikai Fang, Jingyuan Li, Jian Wang, Minrui Xu, Yuge Zhang, Weiqing Liu, Jiang Bian

MulZDG: Multilingual Code-Switching Framework for Zero-shot Dialogue Generation (2022.coling-1)

Challenge:	LLM-based agents for machine learning engineering rely on tree search to rank candidates.
Approach:	They propose an LLM-based agent that operationalizes gradient-based optimization.
Outcome:	The proposed agent achieves a state-of-the-art 35.1% any-medal rate on MLE-Bench with a limited budget on a single GPU.

Copied to clipboard

Yongkang Liu, Shi Feng, Daling Wang, Yifei Zhang

Dialogue Systems & Conversational Agents

Challenge:	Existing zero-shot dialogue generation systems rely on large-scale pre-trained language models.
Approach:	They propose a multilingual learning framework for zero-shot dialogue generation that can transfer knowledge from an English corpus to a non-English corpus with zero samples.
Outcome:	The proposed framework can transfer knowledge from an English corpus to a non-English corpus with zero samples.

Topology Matters: Measuring Memory Leakage in Multi-Agent LLMs (2026.findings-acl)

Copied to clipboard

Jinbo Liu, Defu Cao, Yifei Wei, Tianyao Su, Yuan Liang, Yushun Dong, Yan Liu, Yue Zhao, Xiyang Hu

Robustness in NLP

Challenge:	Multi-agent LLMs are rapidly moving from prototype to real-world use . network topology is a first-order security parameter in multi-aggent systems .
Approach:	They propose a framework for comparing topology-conditioned memory leakage in multi-agent LLM systems.
Outcome:	The proposed framework evaluates topology-conditioned memory leakage in multi-agent LLM systems.

Locomo-Plus: Beyond-Factual Cognitive Memory Evaluation Framework for LLM Agents (2026.acl-long)

Copied to clipboard

Yifei Li, Weidong Guo, Lingling Zhang, Rongman Xu, Muye Huang, Hui Liu, Lijiao Xu, Yu Xu, Jun Liu

Challenge:	Existing benchmarks and evaluation protocols focus on surface-level factual recall.
Approach:	They propose a benchmark for assessing cognitive memory under cue–trigger semantic disconnect.
Outcome:	The proposed framework reveals failures not captured by existing benchmarks.

Enhancing Court View Generation with Knowledge Injection and Guidance (2024.lrec-main)

Copied to clipboard

Ang Li, Yiquan Wu, Yifei Liu, Kun Kuang, Fei Wu, Ming Cai

INTERS: Unlocking the Power of Large Language Models in Search with Instruction Tuning (2024.acl-long)

Challenge:	Existing methods of natural language generation (NLG) rely on the extensive parameters of pretrained language models (PLMs) but their effectiveness may be compromised by insufficient domain-specific knowledge.
Approach:	They propose a knowledge-injected prompt encoder to incorporate domain knowledge during the training stage, thereby reducing computational overhead.
Outcome:	The proposed approach outperforms established baselines on real-world data in responsivity of claims and in the ability to transfer domain knowledge.

Copied to clipboard

Yutao Zhu, Peitian Zhang, Chenghao Zhang, Yifei Chen, Binyu Xie, Zheng Liu, Ji-Rong Wen, Zhicheng Dou

EMRs2CSP : Mining Clinical Status Pathway from Electronic Medical Records (2025.findings-acl)

Challenge:	Large language models (LLMs) have demonstrated impressive capabilities in various natural language processing tasks, but their application to information retrieval tasks is still challenging due to the infrequent occurrence of many IR-specific concepts in natural language.
Approach:	They propose to use instruction tuning to enhance LLMs' proficiency in IR tasks by combining a dataset with manually written templates to analyze the effects of instruction design, template diversity, few-shot demonstrations, and the volume of instructions.
Outcome:	The proposed model can be used to perform query understanding, document understanding, and query-document relationship understanding tasks.

Copied to clipboard

Yifei Chen, Ruihui Hou, Jingping Liu, Tong Ruan

Information Extraction & Text Mining

Challenge:	Current studies focus on extracting tests or treatments when constructing clinical pathways, neglecting the patient's symptoms and diagnosis.
Approach:	They propose a novel clinical pathway representation: the clinical status pathway and a pipeline framework for extracting clinical status from electronic medical records.
Outcome:	The proposed framework improves extraction accuracy by modeling diagnostic and treatment processes and demonstrates significant improvements on medical question-answering and decision-support tasks.

MAGRET: Machine-generated Text Detection with Rewritten Texts (2025.coling-main)

Copied to clipboard

Yifei Huang, Jiuxin Cao, Hanyu Luo, Xin Guan, Bo Liu

Towards Interactivity and Interpretability: A Rationale-based Legal Judgment Prediction Framework (2022.emnlp-main)

Challenge:	Existing studies focus on detecting machine-generated text in open-source models, but their performance on closed-source large models is limited.
Approach:	They propose a method to detect rewritten text from large language models using a BERT encoder and propose to refine it to achieve semantic alignment.
Outcome:	The proposed method outperforms baseline methods on three text-generated datasets.

Copied to clipboard

Yiquan Wu, Yifei Liu, Weiming Lu, Yating Zhang, Jun Feng, Changlong Sun, Fei Wu, Kun Kuang

AgentThink: A Unified Framework for Tool-Augmented Chain-of-Thought Reasoning in Vision-Language Models for Autonomous Driving (2025.findings-emnlp)

Challenge:	Existing models lack interpretability due to the neglect of rationale in the prediction process.
Approach:	They propose a rationale-based legal judgment prediction framework that follows the judge's real trial logic and provides good interactivity and interpretability.
Outcome:	The proposed framework provides good interactivity and interpretability which enables practical use.

Copied to clipboard

Kangan Qian, Sicong Jiang, Yang Zhong, Ziang Luo, Zilin Huang, Tianze Zhu, Kun Jiang, Mengmeng Yang, Zheng Fu, Jinyu Miao, Yining Shi, He Zhe Lim, Li Liu, Tianbao Zhou, Hongyi Wang, Huang Yu, Yifei Hu, Guang Li, Guang Chen, Hao Ye, Lijun Sun, Diange Yang

MoLAN: A Unified Modality-Aware Noise Dynamic Editing Framework for Multimodal Sentiment Analysis (2026.findings-acl)

Challenge:	Vision-Language Models struggle with hallucinations, inefficient reasoning, and limited real-world validation hinders accurate perception and robust step-by-step reasoning.
Approach:	AgentThink integrates Chain-of-Thought reasoning with dynamic, agent-style tool invocation for autonomous driving tasks.
Outcome:	Experiments on the DriveLMM-o1 benchmark show AgentThink significantly boosts overall reasoning scores by 53.91% and enhances answer accuracy by 33.54% .

Copied to clipboard

Xingle Xu, YongKang Liu, Dexian Cai, Shi Feng, Xiaocui Yang, Daling Wang, Yifei Zhang

Towards Provably Secure Generative AI: Reliable Consensus Sampling (2026.findings-acl)

Challenge:	Existing approaches to multimodal sentiment analysis treat entire modality as an independent unit for feature enhancement or denoising, which often suppresses redundant noise at the cost of weakening critical information.
Approach:	They propose a ModaLity-aware noise dynAmic editiNg framework that performs modality-awful block partitioning by dividing features of each modality into multiple blocks.
Outcome:	Experiments on five models and four datasets show that MoLAN+ achieves the state-of-the-art performance.

Copied to clipboard

Yu Cui, Hang Fu, Sicheng Pan, Zhuoyu Sun, Yifei Liu, Yuhong Nie, Bo Ran, Baohan Huang, Xufeng Zhang, Haibin Zhang, Cong Zuo, Licheng Wang

Robustness in NLP

Challenge:	Existing research on generative AI security is driven by mutually reinforcing attack and defense methodologies grounded in empirical experience.
Approach:	They propose a new algorithm that uses a random sampling algorithm to control risk.
Outcome:	The proposed algorithm improves robustness and utility while maintaining latency comparable to existing algorithms.

UniLR: Unleashing the Power of LLMs on Multiple Legal Tasks with a Unified Legal Retriever (2025.acl-long)

Copied to clipboard

Ang Li, Yiquan Wu, Yifei Liu, Ming Cai, Lizhi Qing, Shihang Wang, Yangyang Kang, Chengyuan Liu, Fei Wu, Kun Kuang

HiFT: A Hierarchical Full Parameter Fine-Tuning Strategy (2024.emnlp-main)

Challenge:	Existing retrieval methods are designed for general domains, struggling with legal knowledge, or tailored for specific legal tasks, unable to handle diverse legal knowledge types.
Approach:	They propose a novel retrieval method that integrates specialized knowledge into LLMs.
Outcome:	The proposed method can perform multiple legal retrieval tasks for LLMs.

Copied to clipboard

YongKang Liu, Yiqun Zhang, Qian Li, Tong Liu, Shi Feng, Daling Wang, Yifei Zhang, Hinrich Schuetze

MUR: Momentum Uncertainty guided Reasoning for Large Language Models (2026.acl-long)

Challenge:	Existing approaches to fine-tuning language models use zeroth-order optimizers to conserve GPU memory.
Approach:	They propose a full-parameter fine-tuning strategy which updates a subset of parameters at each training step.
Outcome:	The proposed approach reduces the amount of gradients and optimizer state parameters residing in GPU memory at the same time, thereby reducing GPU memory usage.

Copied to clipboard

Hang Yan, Fangzhi Xu, Rongman Xu, Yifei Li, Jian Zhang, Haoran Luo, Xiaobao Wu, Anh Tuan Luu, Haiteng Zhao, Qika Lin, Jun Liu

MUSE: A Multimodal Conversational Recommendation Dataset with Scenario-Grounded User Profiles (2025.findings-acl)

Challenge:	Existing methods for optimizing reasoning quality are limited by overthinking.
Approach:	They propose a method that allocates thinking budgets to critical reasoning steps by tracking and aggregating step-wise uncertainty over time.
Outcome:	The proposed method reduces computation by over 45% on average while improving accuracy by 0.33–3.46%.

Copied to clipboard

Zihan Wang, Xiaocui Yang, YongKang Liu, Shi Feng, Daling Wang, Yifei Zhang

Dialogue Systems & Conversational Agents

Challenge:	Existing research focuses solely on text, leaving a gap with practical applications.
Approach:	They propose to synthesize a multimodal conversational recommendation dataset using multimodal large language models to automatically synthesized data from 7,000 conversations in the Clothing domain.
Outcome:	The proposed dataset contains 83,148 utterances from 7,000 conversations centered around the Clothing domain.

Unleashing the Power of LLMs in Court View Generation by Stimulating Internal Knowledge and Incorporating External Knowledge (2024.findings-naacl)

Copied to clipboard

Yifei Liu, Yiquan Wu, Ang Li, Yating Zhang, Changlong Sun, Weiming Lu, Fei Wu, Kun Kuang

Neural Parameter Search for Slimmer Fine-Tuned Models and Better Transfer (2025.acl-long)

Challenge:	Large Language Models (LLMs) have made remarkable strides in language generation, but they encounter difficulties in the knowledge-intensive legal domain.
Approach:	They propose to decompose court views into different parts, stimulate internal knowledge, and incorporate external information to unleash the power of LLMs in the task.
Outcome:	The proposed method generates more accurate and reliable court views on two real-world datasets LAIC2021 and CJO2022.

Copied to clipboard

Guodong Du, Zitao Fang, Jing Li, Junlin Li, Runhua Jiang, Shuyang Yu, Yifei Guo, Yangneng Chen, Sim Kuan Goh, Ho-Kin Tang, Daojing He, Honghai Liu, Min Zhang

Pixel-Level Reasoning Segmentation via Multi-turn Conversations (2025.acl-long)

Challenge:	Foundational models and their checkpoints have advanced deep learning, boosting performance across applications.
Approach:	They propose a method for pruning fine-tuned models by calculating differences between them and original model.
Outcome:	The proposed method can improve performance across vision, NLP, and multi-modal benchmarks.

Copied to clipboard

Dexian Cai, Xiaocui Yang, YongKang Liu, Daling Wang, Shi Feng, Yifei Zhang, Soujanya Poria

Natural Language Interfaces

Challenge:	Existing visual perception systems focus on region-level segmentation in single-turn dialogues . existing systems cannot reason at the pixel level and comprehend dynamic user intent .
Approach:	They propose a task that tracks evolving user intent via multi-turn interactions for fine-grained segmentation.
Outcome:	The proposed method outperforms existing baselines in segmentation and reasoning metrics.

DialogConv: A Lightweight Fully Convolutional Network for Multi-view Response Selection (2022.emnlp-main)

Copied to clipboard

Yongkang Liu, Shi Feng, Wei Gao, Daling Wang, Yifei Zhang

Natural Language Interfaces

Challenge:	Existing retrieval-based dialogue systems suffer from slow inference or huge number of parameters.
Approach:	They propose a lightweight fully convolutional architecture for response selection using convolution.
Outcome:	The proposed architecture extracts matching features of context and response from 3D views.

ParetoRAG: Leveraging Sentence-Context Attention for Robust and Efficient Retrieval-Augmented Generation (2025.findings-emnlp)

Copied to clipboard

Ruobing Yao, Yifei Zhang, Shuang Song, Yuhan Liu, Neng Gao, Chenyang Tu

Precedent-Enhanced Legal Judgment Prediction with LLM and Domain-Model Collaboration (2023.emnlp-main)

Challenge:	Retrieval-augmented generation systems face persistent challenges in retrieval inefficiency and the inability of LLMs to filter out irrelevant information.
Approach:	They propose an unsupervised framework that optimizes RAG systems through sentence-level refinement guided by the Pareto principle.
Outcome:	The proposed framework achieves dual improvements in retrieval precision and generation quality without additional training or API resources while using only 40% of the tokens compared to traditional approaches.

Copied to clipboard

Yiquan Wu, Siying Zhou, Yifei Liu, Weiming Lu, Xiaozhong Liu, Yating Zhang, Changlong Sun, Fei Wu, Kun Kuang

Green & Sustainable NLP

Challenge:	Recent advances in deep learning have enabled a variety of techniques to be used to solve the LJP task.
Approach:	They propose a framework that leverages the strength of both LLMs and domain-specific models in the context of precedents.
Outcome:	The proposed framework leverages the strength of both LLM and domain models in the context of precedents.

TOOLCAD: Exploring Tool-Using Large Language Models in Text-to-CAD Generation with Reinforcement Learning (2026.findings-acl)

Copied to clipboard

Yifei Gong, Xing Wu, Wenda Liu, null Tukang

VortexPIA: Indirect Prompt Injection Attack against LLMs for Efficient Extraction of User Privacy (2026.findings-eacl)

Challenge:	Large Language Models (LLMs) have shown remarkable advances in enabling language agents to tackle real-world tasks.
Approach:	They propose a tool-using agent-based CAD framework that automates text-to-CAD modeling . they propose an interactive CAD gym to roll out reasoning and tool-augmented interaction trajectories with the CAD engine .
Outcome:	The proposed framework can generalize across complex modeling tasks, supporting their open-source counterparts.

Copied to clipboard

Yu Cui, Sicheng Pan, Yifei Liu, Haibin Zhang, Cong Zuo

Can MLLMs Understand the Deep Implication Behind Chinese Images? (2025.acl-long)

Challenge:	Large language models (LLMs) have been widely deployed in Conversational AIs . however, the methods proposed in the study rely on a white-box setting .
Approach:	They propose an indirect prompt injection attack that induces privacy extraction in LLMs . they use token-efficient data containing false memories to inject LLM data .
Outcome:	The proposed method outperforms baselines and achieves state-of-the-art performance.

Copied to clipboard

Chenhao Zhang, Xi Feng, Yuelin Bai, Xeron Du, Jinchang Hou, Kaixin Deng, Guangzeng Han, Qinrui Li, Bingli Wang, Jiaheng Liu, Xingwei Qu, Yifei Zhang, Qixuan Zhao, Yiming Liang, Ziqiang Liu, Feiteng Fang, Min Yang, Wenhao Huang, Chenghua Lin, Ge Zhang, Shiwen Ni

Raw Pointer Rewriting with LLMs for Translating C to Safer Rust (2026.findings-acl)

Challenge:	MLLMs perform poorly on traditional culture images, indicating limitations in understanding high-level semantics and lacking a deep knowledge base of Chinese traditional culture.
Approach:	They propose to use Chinese images to assess MLLMs' higher-order perception and understanding of Chinese visual content.
Outcome:	The proposed model incorporates images that represent Chinese traditional culture, such as famous Chinese traditional paintings, to ensure the authenticity of the Chinese context.

Copied to clipboard

Yifei Gao, Chengpeng Wang, Pengxiang Huang, Xuwei Liu, Mingwei Zheng, Xiangyu Zhang

Text Generation

Challenge:	C2Rust is a system programming language that enforces strict memory and type safety guarantees.
Approach:	They propose a raw pointer rewriting technique that lifts raw pointers in individual functions to appropriate Rust data structures.
Outcome:	The proposed technique eliminates 18.57% of local raw pointers and improves memory safety on 28 real-world C projects.

Libra-VLA: Achieving Learning Equilibrium via Asynchronous Coarse-to-Fine Dual-System (2026.acl-long)

Copied to clipboard

Yifei Wei, Linqing Zhong, Yi Liu, Yuxiang Lu, Xindong He, Maoqing Yao, Guanghui Ren

Challenge:	Vision-Language-Action models ground high-level semantic instructions into executable physical actions.
Approach:	They propose a Coarse-to-Fine Dual-System VLA architecture that decouples learning complexity into a coarse-to fine hierarchy while leveraging structural modularity to implement an asynchronous execution strategy.
Outcome:	The proposed architecture decouples learning complexity into a coarse-to-fine hierarchy while leveraging structural modularity to implement an asynchronous execution strategy.

CogDual: Enhancing Dual Cognition of LLMs via Reinforcement Learning with Implicit Rule-Based Rewards (2025.emnlp-main)

Copied to clipboard

Cheng Liu, Yifei Lu, Fanghua Ye, Jian Li, Xingyu Chen, Feiliang Ren, Zhaopeng Tu, Xiaolong Li

Challenge:	Existing approaches to role-playing language models rely on prompt engineering or supervised fine-tuning to emulate character behaviors but neglect the underlying cognitive mechanisms driving these behaviors.
Approach:	They propose a novel RPLA adopting a cognize-then-respond reasoning paradigm that leverages dual cognition for more contextually grounded and psychologically coherent responses.
Outcome:	The proposed RPLA outperforms baselines and generalizes effectively across diverse role-playing tasks.

AlphaContext: An Evolutionary Tree-based Psychometric Context Generator for Creativity Assessment (2026.acl-long)

Copied to clipboard

Yixuan Wang, Yue Huang, Hong Qian, Yunzhao Wei, Yifei Ding, Wenkai Wang, Zhi Liu, Zhongjing Huang, Aimin Zhou, Jiajun Guo

Challenge:	Existing LLM-based tools struggle with insufficient assessment cues, weak narrative coherence, limited stylistic diversity, and poor support for creative thinking.
Approach:	They propose an evolutionary tree-based psychometric context generator that integrates rule-guided outline planning, sentence-level MCTS generation, MAP-Elites quality-diversity optimization and assessment-guide refiner simulation.
Outcome:	The proposed tool outperforms strong LLMs and structured frameworks on 7 evaluation dimensions and shows higher alignment with expert-designed contexts.

SHIELD: LLM-Driven Schema Induction for Predictive Analytics in EV Battery Supply Chain Disruptions (2024.emnlp-industry)

Copied to clipboard

Zhi-Qi Cheng, Yifei Dong, Aike Shi, Wei Liu, Yuzhi Hu, Jason O’Connor, Alexander Hauptmann, Kate Whitefoot

Chain-of-Quizzes: Pedagogy-inspired Example Selection in In-Context-Learning (2024.findings-acl)

Challenge:	EV battery supply chain is vulnerable to disruptions caused by natural disasters and geopolitical tensions.
Approach:	They propose a system integrating Large Language Models with domain expertise for EV supply chain risk assessment.
Outcome:	Evaluated on 12,070 paragraphs from 365 sources (2022-2023), SHIELD outperforms baseline GCNs and LLM+prompt methods in disruption prediction.

Copied to clipboard

Yiquan Wu, Anlai Zhou, Yuhang Liu, Yifei Liu, Adam Jatowt, Weiming Lu, Jun Xiao, Kun Kuang

Low-Resource NLP

Challenge:	In-context learning (ICL) is a powerful tool for enhancing large language models (LLMs) by mimicking the human learning process.
Approach:	They propose a Chain-of-Quizzes framework that uses LLMs to answer a quiz to sift 'good' examples, combine them iteratively with the increasing complexity, and utilize a final exam to gauge the combined example chains.
Outcome:	The proposed framework outperforms baseline models on diverse reasoning datasets and shows that it is scalable and can be used in future research.

Unleashing Spatial Reasoning in Multimodal Large Language Models via Textual Representation Guided Reasoning (2026.acl-long)

Copied to clipboard

Jiacheng Hua, Yishu Yin, Yuhang Wu, Tai Wang, Yifei Huang, Miao Liu

Latent Learningscape Guided In-context Learning (2024.findings-acl)

Challenge:	Existing Multimodal Large Language Models struggle with 3D spatial reasoning as they fail to construct structured abstractions of the 3D environment depicted in video inputs.
Approach:	They propose a prompting method that induces MLLMs to generate 3D representations as reasoning traces for more accurate spatial question answering.
Outcome:	Extensive experiments on VSI-Bench and OST-Bech show that TRACE improves over prior prompting strategies across a diverse range of MLLM backbones.

Copied to clipboard

Anlai Zhou, Sunshine Jiang, Yifei Liu, Yiquan Wu, Kun Kuang, Jun Xiao

PlaM: Training-Free Plateau-Guided Model Merging for Better Visual Grounding in MLLMs (2026.findings-acl)

Challenge:	Existing methods to select demonstrations based on surface-level semantic similarities fall short of identifying the most fitting ones.
Approach:	They propose a method that characterizes latent learningscape features of demonstrations and uses them to create more effective prompts.
Outcome:	The proposed method outperforms leading models in arithmetic, commonsense, and symbolic reasoning tasks showing an average increase in scores by 7.4 percentage points.

Copied to clipboard

Zijing Wang, YongKang Liu, Mingyang Wang, Ercong Nie, Deyuan Chen, Zhengjie Zhao, Shi Feng, Daling Wang, Xiaocui Yang, Yifei Zhang, Hinrich Schuetze

NEAT: Neuron-Based Early Exit for Large Reasoning Models (2026.findings-acl)

Challenge:	Multimodal instruction fine-tuning degrades textual reasoning capability, undermining multimodal performance.
Approach:	They propose a plateau-guided model merging method that selectively injects base language model parameters into MLLMs to mitigate this degradation.
Outcome:	The proposed framework reduces multimodal instruction fine-tuning degradation by incorporating a plateau-guided model merging method into MLLMs.

Copied to clipboard

Kang Liu, YongKang Liu, Xiaocui Yang, Peidong Wang, Wen Zhang, Shi Feng, Yifei Zhang, Daling Wang

Reasoning

Challenge:	Existing approaches to reduce overthinking require additional rollout computation or externally labeled datasets.
Approach:	They propose a Neuron-based Early reAsoning exiT framework that monitors neuron-level activation dynamics to enable training-free early exits.
Outcome:	The proposed framework reduces the amount of reasoning steps generated by LRMs while maintaining accuracy.

A Critical Analysis of Document Out-of-Distribution Detection (2023.findings-emnlp)

Copied to clipboard

Jiuxiang Gu, Yifei Ming, Yi Zhou, Jason Kuen, Vlad Morariu, Handong Zhao, Ruiyi Zhang, Nikolaos Barmpalios, Anqi Liu, Yixuan Li, Tong Sun, Ani Nenkova

PVGRU: Generating Diverse and Relevant Dialogue Responses via Pseudo-Variational Mechanism (2023.acl-long)

Challenge:	Existing document understanding models focus on single-modal inputs such as images or texts.
Approach:	They propose to use a spatial-aware adapter to adapt transformer-based language models to document domain to exploit multi-modal information.
Outcome:	The proposed model significantly improves the OOD detection performance compared to using a standard language model and to competitive baselines.

Copied to clipboard

Yongkang Liu, Shi Feng, Daling Wang, Yifei Zhang, Hinrich Schütze

Dialogue Systems & Conversational Agents

Challenge:	Existing generative models for dialogue use the last hidden state to summarize the history of the dialogue.
Approach:	They propose a Pseudo-Variational Gated Recurrent Unit (PVGRU) that summarises the accumulated distribution variations of subsequences and builds a model based on it.
Outcome:	The proposed model can improve diversity and relevance of responses on two benchmark datasets.

Efficiently Editing Mixture-of-Experts Models with Compressed Experts (2025.findings-emnlp)

Copied to clipboard

Yifei He, Yang Liu, Chen Liang, Hany Hassan Awadalla

Green & Sustainable NLP

Challenge:	Mixture-of-Experts models allow for efficient scaling of large language models . fewer experts reduce computational costs, while more experts improve performance .
Approach:	They propose to activate only a subset of experts during training and inference . they propose compressed experts that preserve the most important experts .
Outcome:	The proposed approach preserves the most important experts while replacing other auxiliary activated experts with compressed experts.

Knowledge Fusion By Evolving Weights of Language Models (2024.findings-acl)

Copied to clipboard

Guodong Du, Jing Li, Hanting Liu, Runhua Jiang, Shuyang Yu, Yifei Guo, Sim Kuan Goh, Ho-Kin Tang