Papers by Cong Liu

54 papers
Planning with Multi-Constraints via Collaborative Language Agents (2025.coling-main)

Copied to clipboard

Challenge: Recent advances in neural language models have sparked a new surge of intelligent agent research.
Approach: They propose a method for collaborative LLM-based multi-agent systems that simplifies complex task planning with constraints by decomposing it into a hierarchy of subordinate tasks.
Outcome: The proposed method achieves an average success rate of 42.68% on two constraint-intensive benchmarks, TravelPlanner and API-Bank.
CtrlA: Adaptive Retrieval-Augmented Generation via Inherent Control (2025.findings-acl)

Copied to clipboard

Challenge: Existing methods focus on detecting LLM’s confidence via statistical uncertainty.
Approach: They propose to use a representation perspective to solve adaptive RAG by enabling dynamic retrieval during generation and enabling retrieval only when the query exceeds LLM's internal knowledge.
Outcome: The proposed framework is superior to existing adaptive RAG methods on a diverse set of tasks.
Cool-Fusion: Fuse Large Language Models without Training (2025.acl-long)

Copied to clipboard

Challenge: Cool-Fusion is a simple yet effective approach to combine two or more heterogeneous large language models .
Approach: They propose a method that fuses the knowledge of two or more heterogeneous large language models to leverage complementary strengths.
Outcome: The proposed method increases accuracy from three strong source LLMs on GSM8K by 17.4%.
RepoAgent: An LLM-Powered Open-Source Framework for Repository-level Code Documentation Generation (2024.emnlp-demo)

Copied to clipboard

Challenge: Xia et al., 2018) demonstrate that a large language model can generate and maintain high-quality code documentation.
Approach: They propose a large language model powered open-source framework for generating, maintaining, and updating code documentation.
Outcome: The proposed framework generates high-quality documentation for the entire project.
CoBa: Convergence Balancer for Multitask Finetuning of Large Language Models (2024.emnlp-main)

Copied to clipboard

Challenge: Existing multi-task learning approaches for large language models fall short due to computational intensive or lack of simultaneous task convergence.
Approach: They propose a new multi-task learning approach that dynamically adjusts task weights during the training process, ensuring that the validation loss of all tasks progresses towards convergence at an even pace.
Outcome: The proposed approach improves the performance of large language models by up to 13% compared to the second-best approaches.
A Survey on LLMs for Story Generation (2025.findings-emnlp)

Copied to clipboard

Challenge: Methods for story generation with Large Language Models (LLMs) have come into the spotlight recently.
Approach: They propose a novel taxonomy of LLMs for story generation consisting of two major paradigms: independent story generation by an LLM, and author-assistance for story creation .
Outcome: The proposed taxonomy compares existing work on the topic with those of novel author-assistance models.
Bootstrapping meaning through listening: Unsupervised learning of spoken sentence embeddings (2022.findings-emnlp)

Copied to clipboard

Challenge: a new study addresses the challenge of learning semantic representations from speech signals . speech-based semantic representation can be used for speech mining and spoken language understanding .
Approach: They propose a multimodal sequential autoencoder that converts speech signals into hidden units . they propose s-HuBERT to induce meaning through knowledge distillation .
Outcome: The proposed model achieves a moderate correlation with human judgments without labels or transcriptions.
Formally Specifying the Intended Behavior of the Program: LLM-Driven Neuro-Symbolic Program Specification Synthesis (2026.acl-demo)

Copied to clipboard

Challenge: Formal verification typically requires developers to write detailed formal specifications . a formal verification system that generates candidate specifications is costly and error-prone .
Approach: They propose an LLM-driven neuro-symbolic demonstration system that reframes specification writing as constrained structured synthesis.
Outcome: The proposed system reduces hallucinations and produces proof-ready annotations.
Tell Me More! Towards Implicit User Intention Understanding of Language Model Driven Agents (2024.acl-long)

Copied to clipboard

Challenge: Current language model-driven agents lack mechanisms for effective user participation, which is crucial given the vagueness commonly found in user instructions.
Approach: They propose a benchmark to inspect users’ implicit intentions through explicit queries and a model expert as the upstream in agent design to enhance user-agent interaction.
Outcome: The proposed approach excels at identifying vague user tasks, recovering and summarizing critical missing information, setting precise and necessary agent execution goals, and minimizing redundant tool usage, thus boosting overall efficiency.
Distantly-Supervised Joint Extraction with Noise-Robust Learning (2024.findings-acl)

Copied to clipboard

Challenge: Existing approaches to identifying entity pairs and relations with a single model are noisy . Existing methods only consider one source of noise or make decisions using external knowledge .
Approach: They propose a framework that aligns entity mentions with corresponding tags for joint extraction . they propose DENRL, which employs a lightweight transformer backbone for joint tagging .
Outcome: The proposed framework outperforms baseline models on two benchmark datasets with better interpretability.
Uncertainty-Aware Bootstrap Learning for Joint Extraction on Distantly-Supervised Data (2023.acl-short)

Copied to clipboard

Challenge: Existing approaches to extract entity pairs and their relations from labeled data are noisy and expensive.
Approach: They propose a bootstrap learning approach that is motivated by intuition that the higher the uncertainty of an instance, the more likely the model confidence is inconsistent with the ground truths.
Outcome: The proposed method outperforms baselines and related methods on two large datasets.
Safety Alignment in NLP Tasks: Weakly Aligned Summarization as an In-Context Attack (2024.acl-long)

Copied to clipboard

Challenge: Recent developments in balancing usefulness and safety of large language models raise a critical question . current attacks, especially adversarial ones that manipulate malicious prompts, often aim to manipulate the input .
Approach: They show that LLMs can effectively summarize malicious long documents but often refuse to translate them.
Outcome: The findings highlight a vulnerability in LLMs that can't translate or summarize documents . the study focuses on LLM models, Gemini and GPT-4, which can' be exploited .
Emotion Transfer with Enhanced Prototype for Unseen Emotion Recognition in Conversation (2025.emnlp-main)

Copied to clipboard

Challenge: Existing research on emotion recognition in conversation does not reach a consensus on classification theories . despite this, there is no clear consensus on how to recognize previously unseen emotions in real-world applications.
Approach: They propose a prototype-based emotion transfer framework that can be used in real-world applications.
Outcome: The proposed framework shows promise but still faces key challenges in the field of emotion recognition in conversation.
AgentCPM-GUI: Building Mobile-Use Agents with Reinforcement Fine-Tuning (2025.emnlp-demos)

Copied to clipboard

Challenge: Large language model agents have enabled GUI-based automation, but their deployment is limited by noisy data, poor generalization, and lack of support for non-English GUIs.
Approach: They propose an 8B-parameter GUI agent built for robust and efficient on-device GUI interaction.
Outcome: The proposed GUI agent achieves promising performance on five public benchmarks and proposed Chinese benchmark CAGUI.
Two Streams, One Sarcasm: Orthogonal Expert Tuning for Holistic Multimodal Sarcasm Understanding (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks for multimodal satirical cognition hinder evaluation of multimodal Sarcasm Understanding . lack of a unified benchmark for holistic satire cognition hampers evaluation of MSU .
Approach: They propose a framework to decouple experts into orthogonal shared perception and private execution streams to physically block gradient interference between tasks.
Outcome: The proposed framework achieves superior performance on DocMSU-PLUS.
Thinking Before You Speak: A Proactive Test-time Scaling Approach (2025.findings-emnlp)

Copied to clipboard

Challenge: Large Language Models often exhibit deficiencies with complex reasoning tasks, such as maths, due to the discrepancy between human reasoning patterns and those presented in training data.
Approach: They propose to insert insights between consecutive reasoning steps to bridge this gap by generating insights between the next reasoning steps.
Outcome: Experiments on mathematical datasets confirm the effectiveness of the proposed reasoning framework on complex problems.
Mulan: A Multi-Level Alignment Model for Video Question Answering (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing methods focus on visual-language alignment at the video level, but they do not account for fine-grained semantic interaction between video and text.
Approach: They propose a multi-level Alignment Model for Video Question Answering that establishes alignment between visual and textual modalities at the object-level, frame-level and video-level.
Outcome: The proposed model outperforms state-of-the-art methods even with a small amount of extra visual-language pre-training data and a reduced number of trainable parameters.
Event Causality Extraction with Event Argument Correlations (2022.coling-1)

Copied to clipboard

Challenge: Event Causality Identification (ECI) ignores crucial event structure and cause-effect component information, making it struggle for downstream applications.
Approach: They propose a task to extract event causality pairs with their structured event information from plain text.
Outcome: The proposed method captures the intra- and inter-event argument correlations for ECE and provides several future directions.
CLUE: A Chinese Language Understanding Evaluation Benchmark (2020.coling-main)

Copied to clipboard

Challenge: Existing language evaluation benchmarks for English are limited to English . lack of such benchmarks makes it difficult to replicate success in other languages .
Approach: They introduce a large-scale Chinese language understanding evaluation benchmark . the benchmark uses a set of current state-of-the-art pre-trained Chinese models .
Outcome: The first large-scale Chinese Language Understanding Evaluation (CLUE) benchmark is released . the benchmark evaluates models across a wide range of tasks on original Chinese text . existing language evaluation benchmarks are mostly limited to English .
Towards Provably Secure Generative AI: Reliable Consensus Sampling (2026.findings-acl)

Copied to clipboard

Challenge: Existing research on generative AI security is driven by mutually reinforcing attack and defense methodologies grounded in empirical experience.
Approach: They propose a new algorithm that uses a random sampling algorithm to control risk.
Outcome: The proposed algorithm improves robustness and utility while maintaining latency comparable to existing algorithms.
Wider & Closer: Mixture of Short-channel Distillers for Zero-shot Cross-lingual Named Entity Recognition (2022.emnlp-main)

Copied to clipboard

Challenge: Existing mainstream methods for zero-shot cross-lingual named entity recognition ignore the rich and complementary information lying in the intermediate layers of pre-trained language models and domain-invariant information is easily lost during transfer.
Approach: They propose a mixture of short-channel distillers to fully interact the rich hierarchical information in the teacher model and to transfer knowledge to the student model sufficiently and efficiently.
Outcome: The proposed method shows great generalization and compatibility across languages and fields.
Open-World Authorship Attribution (2025.findings-acl)

Copied to clipboard

Challenge: Existing benchmarks for large language models do not evaluate their performance in academic research . authors aim to identify authors from anonymous text without additional information .
Approach: They propose a benchmark to quantitatively assess LLMs' ability to infer author from text . they propose 'open-world' authorship attribute' to be a two-stage framework .
Outcome: The proposed approach achieves 60.7% accuracy and 44.3% accuracy in two stages.
Enhancing Chinese Pre-trained Language Model via Heterogeneous Linguistics Graph (2022.acl-long)

Copied to clipboard

Challenge: Experimental results show that pre-trained Chinese language models ignore linguistics knowledge to learn representations.
Approach: They propose a task-free enhancement module to integrate linguistics knowledge into Chinese pre-trained language models.
Outcome: The proposed model improves Chinese pre-trained language models on 6 tasks with 10 benchmark datasets.
MatPlotAgent: Method and Evaluation for LLM-Based Agentic Scientific Data Visualization (2024.findings-acl)

Copied to clipboard

Challenge: Scientific data visualization is an essential process in research, but its use of large language models remains unexplored.
Approach: They propose a model-agnostic LLM agent framework to automate scientific data visualization tasks.
Outcome: The proposed framework improves performance of commercial and open-source models.
SimPBL: A Multi-Agent Framework for Project-Based Learning (2026.acl-long)

Copied to clipboard

Challenge: Existing LLMs provide partial assistance without modeling these roles, and overly comprehensive help can reduce learner autonomy.
Approach: They propose a multi-agent framework with an orchestrator agent that provides adaptive scaffolding from interaction logs and collaborator agents that support project work through boundary-aware collaboration.
Outcome: The proposed framework improves learner examination scores by 14% . it is based on a multi-agent framework with an orchestrator agent .
White-Box Multi-Objective Adversarial Attack on Dialogue Generation (2023.acl-long)

Copied to clipboard

Challenge: Pre-trained transformers are popular in state-of-the-art dialogue generation systems . however, they are vulnerable to adversarial samples crafted by small and imperceptible perturbations.
Approach: They propose a multi-objective attack method that balances two objectives: generation accuracy and length.
Outcome: The proposed method significantly degrades state-of-the-art DG models with a higher success rate than traditional accuracy-based methods.
Enhanced Language Representation with Label Knowledge for Span Extraction (2021.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to extract text spans from plain text do not fully exploit label knowledge.
Approach: They propose a model to integrate label knowledge into text representations by encoding texts and annotations independently and then integrating label knowledge with an elaborate-designed semantics fusion module.
Outcome: The proposed model achieves state-of-the-art performance on four benchmarks and reduces training time and inference time by 76% and 77% on average compared with the existing paradigm.
DeMAC: Enhancing Multi-Agent Coordination with Dynamic DAG and Manager-Player Feedback (2025.findings-emnlp)

Copied to clipboard

Challenge: Multi-agent systems (MAS) powered by large language models struggle to adapt to evolving task dependencies and to handle uncertainties.
Approach: They propose a Dynamic Environment-Aware Manager-Player Agents Coordination framework that enhances multi-agent coordination through long-term strategic planning.
Outcome: The proposed framework outperforms traditional reinforcement learning and human-agent collaboration in the Overcooked simulation.
Dynamic Transformers Provide a False Sense of Efficiency (2023.acl-long)

Copied to clipboard

Challenge: Pre-trained language models typically lead to high computational cost during inference.
Approach: They propose a slowdown attack framework that can reduce inference efficiency by 80% by leveraging existing adversarial attacks targeting model accuracy.
Outcome: The proposed framework can reduce the efficiency of multi-exit models by 80% on average, validating its effectiveness and generalization ability.
ChatMusician: Understanding and Generating Music Intrinsically with LLM (2024.findings-acl)

Copied to clipboard

Challenge: Despite LLMs' impressive capabilities in musical knowledge, music reasoning remains an unsolved task.
Approach: They propose an open-source large language model (LLM) that integrates intrinsic musical abilities into LLaMA2 and GPT-3.5.
Outcome: The proposed model can understand and generate music with a pure text tokenizer without external multi-modal neural structures or tokenizers.
VortexPIA: Indirect Prompt Injection Attack against LLMs for Efficient Extraction of User Privacy (2026.findings-eacl)

Copied to clipboard

Challenge: Large language models (LLMs) have been widely deployed in Conversational AIs . however, the methods proposed in the study rely on a white-box setting .
Approach: They propose an indirect prompt injection attack that induces privacy extraction in LLMs . they use token-efficient data containing false memories to inject LLM data .
Outcome: The proposed method outperforms baselines and achieves state-of-the-art performance.
Multi-View Incongruity Learning for Multimodal Sarcasm Detection (2025.coling-main)

Copied to clipboard

Challenge: Existing methods for multimodal sarcasm detection rely on spurious correlations, demonstrating poor generalizability beyond training environments.
Approach: They propose a method that integrates multimodal incongruities via contrastive learning for multimodal sarcasm detection by using three views to drive multi-view learning.
Outcome: The proposed method outperforms existing methods on benchmark datasets and shows that it is more generalizable than existing methods.
Double: Breaking the Acceleration Limit via Double Retrieval Speculative Parallelism (2026.acl-long)

Copied to clipboard

Challenge: Parallel Speculative Decoding (PSD) has limitations due to speedup limits and high computational waste . a novel synchronous mechanism solves the Retrieval Precision-Efficiency Dilemma .
Approach: They propose a framework that combines a draft-verification-based approach with a synchronous mechanism to solve the Retrieval Precision-Efficiency Dilemma.
Outcome: The proposed framework breaks speedup limits for Speculative Decoding by overlapping draft generation with verification.
AgentRM: Enhancing Agent Generalization with Reward Modeling (2025.acl-long)

Copied to clipboard

Challenge: Existing LLM-based agents have strong performance on held-in tasks, but their generalizability to unseen tasks remains poor.
Approach: They propose a reward-based generalizable reward model to guide the policy model for effective test-time search.
Outcome: The proposed agentRM outperforms existing agents on held-in tasks by 8.8 points on average.
UrbanLLM: Autonomous Urban Activity Planning and Management with Large Language Models (2024.findings-emnlp)

Copied to clipboard

Challenge: UrbanLLM is a fine-tuned large language model designed to tackle diverse urban problems.
Approach: They propose a fine-tuned large language model to tackle diverse urban problems . UrbanLLM decomposes urban-related queries into manageable sub-tasks .
Outcome: The proposed model outperforms existing models in urban planning and management tasks.
Distance between Relevant Information Pieces Causes Bias in Long-Context LLMs (2025.findings-acl)

Copied to clipboard

Challenge: Positional biases in large language models hinder their ability to process long inputs.
Approach: They propose a benchmark to assess positional bias in large language models involving multiple pieces of relevant information.
Outcome: The proposed benchmark assesses the performance of long-context language models by examining their models with different input lengths and tasks.
Universal Information Extraction with Meta-Pretrained Self-Retrieval (2023.findings-acl)

Copied to clipboard

Challenge: Existing methods for IE are task-specific, resulting in specialized and isolated approaches for different tasks.
Approach: They propose a method to retrieve task-specific knowledge from pretrained language models to enhance universal IE by using a Meta-Pretraining Algorithm.
Outcome: The proposed method achieves the new state-of-the-art on 4 IE tasks, 12 datasets under fully-supervised, low-resource and few-shot scenarios.
Training ELECTRA Augmented with Multi-word Selection (2021.findings-acl)

Copied to clipboard

Challenge: Existing pre-training methods for NLP tasks require massive computation resources.
Approach: They propose a method that trains a discriminator to detect replaced tokens and select original tokens from candidate sets.
Outcome: The proposed method improves ELECTRA based on multi-task learning on GLUE and SQUAD datasets.
MADNet: Maximizing Addressee Deduction Expectation for Multi-Party Conversation Generation (2023.emnlp-main)

Copied to clipboard

Challenge: Existing methods for multi-party conversations rely on addressee labels and can only be applied to an ideal setting where addresses are missing.
Approach: They propose a method that maximizes addressee deduction expectation in heterogeneous graph neural networks for MPC generation.
Outcome: The proposed method outperforms baseline models on Ubuntu IRC channel benchmarks on the task of MPC generation under a common and challenging setting where addressee labels are missing.
Few-Shot Event Detection with Prototypical Amortized Conditional Random Field (2021.findings-acl)

Copied to clipboard

Challenge: Existing approaches to event detection ignore the trigger discrepancy and cause errors.
Approach: They propose a unified model which converts a few-shot tagging problem into a single-shot model by using a Gaussian distribution.
Outcome: The proposed model performs better than existing identifythen-classify models on a few-shot tagging problem with a double-part taging scheme.
MC-indexing: Effective Long Document Retrieval via Multi-view Content-aware Indexing (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for document question answering do not consider content structures, resulting chunks exclude vital information or include irrelevant content.
Approach: They propose a method that segments document into content chunks and represents each content chunk in raw-text, keywords, and summary views.
Outcome: The proposed method significantly improves recall of long document question answering datasets compared to state-of-the-art chunking schemes.
Experiential Co-Learning of Software-Developing Agents (2024.acl-long)

Copied to clipboard

Challenge: Recent advances in large language models (LLMs) have brought significant changes to various domains, especially through autonomous agents.
Approach: They propose a framework that lets agents learn shortcuts from their past tasks and use them for future task execution.
Outcome: The proposed framework enables agents to tackle unseen software-developing tasks more effectively.
Can Reasoning Path still be Effective as Input? Bridging Post-Reasoning to Chain-of-Thought Compression (2026.acl-long)

Copied to clipboard

Challenge: Existing work on reducing CoT generation in reasoning impairs the necessary information for deriving the correct answer.
Approach: They propose a reasoning paradigm that takes CoT as a part of context to simplify the reasoning task for Large Language Models (LLMs).
Outcome: The proposed framework reduces the generation length of LLMs, but its effectiveness hinges on the efficiency and reliability of the contextual CoT generation.
Learning to Generate Structured Output with Schema Reinforcement Learning (2025.acl-long)

Copied to clipboard

Challenge: Recent advances in large language models have facilitated the development of intelligent applications like automatic web search (Qin et al., 2023) Several methods exist for generating JSON strings from LLMs, including Prompting but often miss certain schemas.
Approach: They propose to use 40K different JSON schemas to assess models' ability to generate valid JSON outputs.
Outcome: The proposed model improves both in generating JSON outputs and downstream tasks.
H-MAS: Hierarchical Multi-Agent Scheduling for Multi-Tenant LLM Serving (2026.findings-acl)

Copied to clipboard

Challenge: Multi-tenant Model-as-a-Service (MaaS) workloads exhibit non-stationarity across multiple time scales . existing request schedulers often rely on a fixed policy that remains unchanged at runtime .
Approach: They propose a hierarchical multi-agent scheduler that operates in a layered closed loop . they propose to maintain 1.2–3.0 higher Goodput than SGLang and vLLM .
Outcome: Experiments show that H-MAS achieves 1.2–3.0 higher Goodput than SGLang and vLLM . it maintains more stable QoS under diverse request lengths and heterogeneous SLO targets .
Adaptive Tool Use in Large Language Models with Meta-Cognition Trigger (2025.acl-long)

Copied to clipboard

Challenge: Existing research expands the tool arrays of large language models (LLMs), but the necessity of using these tools is often overlooked, leading to indiscriminate tool invocation.
Approach: They propose a meta-cognition proxy proxy for LLMs self-assessment of their capabilities, reflecting the model’s awareness of its own limitations.
Outcome: The proposed strategy is fine-tuned-free and costs minimal.
DebugBench: Evaluating Debugging Capability of Large Language Models (2024.findings-acl)

Copied to clipboard

Challenge: Large language models (LLMs) have demonstrated exceptional coding capabilities, but their debugging capabilities remain relatively unexplored.
Approach: They propose a debugging benchmark consisting of 4,253 LLMs with four major bug categories and 18 minor types in C++, Java, and Python.
Outcome: The proposed benchmark covers four major bug categories and 18 minor types in C++, Java, and Python.
Chain of Methodologies: Scaling Test Time Computation without Training (2025.findings-acl)

Copied to clipboard

Challenge: Existing prompts for complex reasoning tasks are limited to specific tasks with few-shot examples due to constraints like context length and information extraction accuracy.
Approach: They propose a method to build structured reasoning processes by injecting human insights into LLMs' training data.
Outcome: The proposed framework outperforms baselines in the analysis of large language models.
Conformal Event Prediction with Temporal Knowledge Graph (2026.findings-acl)

Copied to clipboard

Challenge: Current event prediction methods lack rigorous uncertainty quantification, which limits their reliability for decision-making.
Approach: They propose a conformal prediction framework that applies conformal predictions to event prediction to address this challenge.
Outcome: The proposed framework guarantees coverage while improving efficiency on three public datasets.
Multi-Modal Multi-Granularity Tokenizer for Chu Bamboo Slips (2025.coling-main)

Copied to clipboard

Challenge: Using a multi-modal multi-granularity tokenizer, we analyze ancient Chinese scripts . a large proportion of the characters in ancient Chinese are rare or undeciphered .
Approach: They propose a multi-modal multi-granularity tokenizer specifically designed for ancient Chinese scripts.
Outcome: The proposed tokenizer improves on the part-of-speech tagging task on the Chu bamboo slip script.
GIFT: Graph-Induced Fine-Tuning for Multi-Party Conversation Understanding (2023.acl-long)

Copied to clipboard

Challenge: Existing methods on understanding multi-party conversations typically embed interlocutors and utterances into sequential information flows or use superficial graph structures.
Approach: They propose a plug-and-play method which adapts Transformer-based pre-trained language models for universal MPC understanding.
Outcome: The proposed method can adapt Transformer-based pre-trained language models for universal MPC understanding.
Proximity-Based Multi-Turn Optimization: Practical Credit Assignment for LLM Agent Training (2026.acl-industry)

Copied to clipboard

Challenge: Existing group-based policy optimization methods rely on statistical deviation within discrete batches, misallocating credit when task difficulty fluctuates.
Approach: They propose a framework for multi-turn LLM agents that integrates global context . they propose GRPO, which integrates success-rate-aware modulation and proximity-based soft aggregation .
Outcome: The proposed framework yields performance gains over existing baselines with negligible computational cost.
Enhancing Open-Domain Task-Solving Capability of LLMs via Autonomous Tool Integration from GitHub (2025.acl-long)

Copied to clipboard

Challenge: Existing approaches lack flexibility to address diverse and ever-evolving user queries in open domains.
Approach: They propose to evaluate LLMs on open-domain knowledge that requires tools to solve diverse and ever-evolving user queries.
Outcome: The proposed system outperforms baselines in the open domain task-solving benchmark.
ModularMoE: Fast LLM Customization with Parameter-Sharing Mixture-of-Experts for Low-Resource Settings (2026.findings-acl)

Copied to clipboard

Challenge: Large Language Models impose significant computational and storage burdens on personal devices . existing customization approaches incur excessive computational costs or lead to suboptimal performance .
Approach: They propose a training framework that converts pre-trained LLMs into parameter-sharing MoE models for lightweight deployment.
Outcome: The proposed training framework outperforms state-of-the-art training frameworks at the same sparsity level while delivering up to 2.71 inference speedup.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations