Papers by Zhen Chen
Copied to clipboard
| Challenge: | Existing methods for multi-class unknown intent detection assume that each utterance has only one intent, which is not true because utterrances often contain multiple intents. |
| Approach: | They propose a task to detect whether an utterance contains the unknown intent by recognizing whether all intents contained in the utterant are known. |
| Outcome: | The proposed method significantly reduces the FPR95 on the MultiWOZ 2.3 dataset by 12.25% compared to the best baseline. |
Copied to clipboard
| Challenge: | Unsupervised neural machine translation (NMT) is a new approach for machine translation . the model uses only one shared encoder to map pairs of sentences from different languages to a shared-latent space . |
| Approach: | They propose an unsupervised approach which trains the model without labeling data . they propose two independent encoders but share some partial weights to extract high-level representations of input sentences. |
| Outcome: | The proposed approach achieves significant improvements on English-German, English-French and Chinese-to-English translation tasks. |
Copied to clipboard
| Challenge: | Recent advances in Large Language Models (LLMs) have transformed the paradigm in ocean science. |
| Approach: | They propose a framework to automatically obtain large volume of ocean domain instruction data, which generates instructions based on multi-agent collaboration. |
| Outcome: | The proposed framework shows a higher level of knowledge expertise for ocean science tasks and gains preliminary embodied intelligence capabilities in ocean technology. |
Copied to clipboard
| Challenge: | a number of tools are used to perform complex tasks, but the tool utilization process can cause errors. |
| Approach: | They propose a critique evaluation benchmark for tool learning that analyzes function-calling errors on tool evaluation benchmarks. |
| Outcome: | The proposed critique evaluation benchmark holds diverse tool-use errors with varying complexities, which better reflects real-world scenarios. |
Copied to clipboard
| Challenge: | Existing crowd annotation tools for named entity recognition (NER) focus on efficiency and don't consider consistency of datasets. |
| Approach: | They propose a crowd annotation platform for Chinese named entity recognition (NER) CroAno provides a systematic solution for improving label consistency of Chinese NER datasets. |
| Outcome: | The proposed platform improves label consistency of Chinese NER datasets. |
Copied to clipboard
| Challenge: | Existing methods for automating impression generation have limited the relationship between extra knowledge and the original findings. |
| Approach: | They propose a framework for automating impression generation that exploits extra knowledge and original findings . they propose combining key words and their relations to extract critical information . |
| Outcome: | The proposed framework exploits extra knowledge and the original findings in an integrated way . the state-of-the-art results on two datasets confirm the effectiveness of the proposed method . |
Copied to clipboard
| Challenge: | Bit-flip errors (BFEs) are hardware faults where individual bits in memory or processing units are unintentionally flipped. |
| Approach: | They propose a novel defense strategy to mitigate bit-flip errors (BFEs) they propose bfe protection and a self-correction mechanism to minimize performance degradation . |
| Outcome: | The proposed defense strategy minimizes performance degradation while significantly improving robustness against BFEs. |
Copied to clipboard
| Challenge: | Previous Sign Language Translation methods have relied on gloss annotations to improve performance, but labeling high-quality glosses is labor-intensive and inefficient. |
| Approach: | They propose to integrate Large Language Model (LLM) into SLT by factorizing learning into two stages to improve the learning curve. |
| Outcome: | The proposed approach improves on three SLT datasets conducted under the gloss-free setting. |
Copied to clipboard
| Challenge: | Content analysis is labor-intensive and time-consuming process that requires multiple rounds of manual annotation, domain expert discussion, and rule-based refinement. |
| Approach: | They propose a multi-agent framework that effectively Simulates Content Analysis via Large language model (LLM) ag Ents. |
| Outcome: | The proposed framework achieves human-approximated performance across various content analysis tasks. |
Copied to clipboard
| Challenge: | Scientific research relies on accurate information retrieval from literature to support analytical decisions. |
| Approach: | They propose a task that automates fine-grained information retrieval *faithfully* grounded in the provided content in response to research-driven queries. |
| Outcome: | The proposed agent achieves 13.2% higher cross-domain accuracy than state-of-the-art RAG and research-agent baselines across seven backbone LLMs. |
Copied to clipboard
| Challenge: | Recent advances in large language models have achieved promising performances across various applications, but the challenge of integrating long-tail knowledge continues to impede the seamless adoption of LLMs in specialized domains. |
| Approach: | They propose a dynamic co-augmentation framework for the refinement of large language models and knowledge graphs in the context of Alzheimer's Disease. |
| Outcome: | The proposed framework can be used to study Alzheimer's Disease (AD) using LLMs and KGs. |
Copied to clipboard
| Challenge: | Large language models face intrinsic limitations in coding with unseen APIs in training corpora. |
| Approach: | They propose a training-free framework that empowers LLMs to invoke multiple unseen APIs in code solution by planning a complex problem into several API invocation subtasks and experimenting with correct API usage at intermediate steps. |
| Outcome: | The proposed framework significantly improves performance for models lacking prior API knowledge, achieving 11.99% over retrieval-based approaches and 17.28% over pretraining-based methods in pass@10. |
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have shown remarkable progress in dialogue and reasoning, but they struggle to solve strictly constrained dialogue tasks. |
| Approach: | They construct a dataset that contains 12,705 high-quality Chinese dialogue instructions from 440 flowcharts containing 5,055 process nodes. |
| Outcome: | The proposed model outperforms GPT-4o models on backward transitions and outperformed GPT-42 models on the same dataset. |
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have advanced in recent years, scaling up in both parameter count and context length. |
| Approach: | They propose a method to compute attention over a subset of context tokens and to implement token selection in a blockwise manner. |
| Outcome: | The proposed method reduces end-to-end inference latency by up to 2.55x with minimal accuracy loss compared to full attention in long-context scenarios for very large models. |
Copied to clipboard
| Challenge: | Existing methods for prompt tuning for Large Language Models find backdoor attacks to be significant in data-rich scenarios. |
| Approach: | They propose a backdoor attacks through contrastive-enhanced machine unlearning in data-limited scenarios . they use a machine un learning method to capture precise backdoor patterns . |
| Outcome: | The proposed method captures precise backdoor patterns without association between triggers and backdoors, reducing side effects. |
Copied to clipboard
| Challenge: | Existing methods to determine sentiment polarity of opinion target are inconsistent and lack visual attention. |
| Approach: | They propose a framework which can exploit adjective-noun pairs extracted from images to improve visual attention and sentiment prediction capability of the TMSC task. |
| Outcome: | The proposed framework outperforms state-of-the-art on two public datasets. |
Copied to clipboard
| Challenge: | Existing adversarial attacks using imperceptible perturbations are challenging to simulate . e-commerce product restrictions and hate speech monitoring are examples of such attacks . |
| Approach: | They propose a black-box adversarial attack that leverages sparse perturbations to simulate adversarials exhibited by illegal merchants in the black- box scenario. |
| Outcome: | The proposed method outperforms existing attacks and unimodal attacks by treating images and text in discrete space and outperforming existing models. |
Copied to clipboard
| Challenge: | Large Language Model based multi-agent systems (MAS) excel at collaborative problem solving but remain brittle to cascading errors. |
| Approach: | They propose a metacognitive framework that enables step-level error detection and self-correction in Large Language Model based multi-agent systems (MAS) . |
| Outcome: | The proposed framework outperforms baselines on the Who When benchmark and delivers consistent gains on AgentErrorBench. |
Copied to clipboard
| Challenge: | Knowledge distillation (KD) compresses large language models into lightweight versions called student models. |
| Approach: | They propose to align the entire feature dynamics between teacher and student models by using two additional loss terms to achieve this. |
| Outcome: | The proposed method matches the entire feature dynamics between teacher and student models rather than just the final states. |
Copied to clipboard
| Challenge: | Existing models that assess mLLMs on harmful meme understanding are inaccurate and lack accuracy. |
| Approach: | They propose a framework that adaptively probes the reasoning capabilities of mLLMs . their framework systematically reveals the varying performance of different target mllms a . |
| Outcome: | The proposed framework systematically reveals the performance of different target mLLMs. |
Copied to clipboard
| Challenge: | Existing methods to improve content visibility are static heuristic rules or optimize for heterogeneous queries. |
| Approach: | They propose a "diverge-then-converge" framework that extracts optimization preferences from latent queries and synthesizes a global revision blueprint for guided editing. |
| Outcome: | The proposed framework achieves substantial performance gains while maintaining robustness across diverse retrieval scenarios. |
Copied to clipboard
| Challenge: | Existing approaches to long-term dialogue memory management fail to capture the natural semantic structure of conversations, leading to fragmented and incomplete representations. |
| Approach: | They propose a mechanism that integrates forward- and backward-looking reflections into a personalized memory bank for effective future retrieval. |
| Outcome: | The proposed mechanism outperforms state-of-the-art benchmarks on a long-term dialogue memory model. |
Copied to clipboard
| Challenge: | Continual relation extraction (CRE) aims to extract relations towards the continuous and iterative arrival of new data, of which the major challenge is the catastrophic forgetting of old tasks. |
| Approach: | They propose a Continual Relation Extraction framework with Contrastive Learning which is built with a classification network and a prototypical contrastive network to achieve incremental-class learning of CRE. |
| Outcome: | The proposed framework outperforms the state-of-the-art methods on two public datasets and proves its effectiveness on improving performance. |
Copied to clipboard
| Challenge: | Existing methods to eliminate hallucinations require expensive human annotation . hallucination in multimodal large language models poses unique challenges for current research . |
| Approach: | They propose a fine-grained unlearning framework that performs gradient ascent to eliminate hallucinations without paired data. |
| Outcome: | The proposed method reduces hallucinations while preserving quality with modest computational overhead. |
Copied to clipboard
| Challenge: | Chain-of-Thought (CoT) reasoning has improved the performance of large language models (LLMs) however, the detailed reasoning process in CoT often incurs long generation times and high computational costs due to the inclusion of unnecessary steps. |
| Approach: | They propose a method to identify critical reasoning steps using perplexity as a measure of their importance. |
| Outcome: | The proposed method achieves a better balance between reasoning accuracy and efficiency of CoT. |
Copied to clipboard
| Challenge: | Recent advances in large language models (LLMs) have focused on test-time scaling to improve reasoning quality but at the cost of efficiency. |
| Approach: | They propose a training-free framework that enhances reasoning accuracy and stability with minimal overhead. |
| Outcome: | The proposed framework yields consistent gains across general, coding, and STEM tasks while remaining highly efficient. |
Copied to clipboard
| Challenge: | Retrieval-augmented generation (RAG) is employed to tackle these challenges . a Knowledge Boundary Model (KBM) is used to express the known/unknown of a given question . |
| Approach: | They propose a Knowledge Boundary Model to express the known/unknown of a given question . they find that not all questions need to trigger RAG to improve performance . |
| Outcome: | The proposed model reduces time and computational costs by retrieving parts of unknown knowledge . the proposed model can express the known/unknown of a given question and determine whether a RAG needs to be triggered . |
Copied to clipboard
| Challenge: | Low-rank adaption (LoRA) is a low-level pruning method that can be expensive and slow to deploy. |
| Approach: | They propose a low-rank adaption pruning framework that provides an accurate structured pruned model in a memory-efficient manner. |
| Outcome: | The proposed pruning framework reduces perplexity and memory usage by 52.6% on LLaMA and T5 models while reducing memory usage. |
Copied to clipboard
| Challenge: | Existing approaches to adapt image-focused models for video understanding have not been successful in analyzing long video sequences. |
| Approach: | They propose a video instruction dataset that outperforms existing video instruction data for fine-tuning MLLMs by incrementally increasing input context length. |
| Outcome: | The proposed model outperforms existing models on video benchmarks and outperformed proprietary models on VideoMME even with a compact 7B model. |
Copied to clipboard
| Challenge: | Existing generic Reward Models are ill-equipped for dynamic and interactive domains. |
| Approach: | They propose a novel generative multimodal reward model specifically architected for EQA that provides interpretable, structured reward feedback. |
| Outcome: | The proposed model outperforms proprietary benchmarks, including Gemini-2.5-Flash, GPT-4o, Claude-3.5-Haiku, and open-sourced state-of-the-art models such as RoVRM and VisualPRM. |
Copied to clipboard
| Challenge: | Existing word alignment models capture few interactions between input sentence pairs, which severely degrades the word alignment quality. |
| Approach: | They propose to model deep interactions between input and target sentences using a two-stage training framework to train the model. |
| Outcome: | The proposed model achieves the state-of-the-art (SOTA) performance on four out of five language pairs. |
Copied to clipboard
| Challenge: | Conventional knowledge Graph Reasoning models learn the embeddings of KG components over the structure of a KG. |
| Approach: | They propose a pipeline to integrate knowledge from LLMs into KGs without fine-tuning . they propose knowledge alignment, KG reasoning and entity reranking to enhance conventional models . |
| Outcome: | The proposed pipeline can enhance the performance of conventional KGR models in incomplete and general situations. |
Copied to clipboard
| Challenge: | Large language models have achieved remarkable success across a wide range of tasks, yet their performance remains heavily biased toward high-resource languages. |
| Approach: | They propose a pipeline for advancing Tibetan language modeling through multilingual continual pre-training with Tibetan, Chinese, and English. |
| Outcome: | The proposed model outperforms open-source and Tibetan-focused models on diverse tasks. |
Copied to clipboard
| Challenge: | Tool-Integrated Reasoning (TIR) is a tool that can be used to solve complex tasks. |
| Approach: | They propose a hardware-aware TIR-efficiency metric that unifies internal reasoning and external tool-use costs while explicitly accounting for non-reusable KV-Cache and long-tool-response scenarios. |
| Outcome: | The proposed metric explains wall-clock latency significantly better than token-count metric in a simulated high-concurrency industrial setting. |
Copied to clipboard
| Challenge: | Existing visual large language models pre-assume a fixed resolution for downstream tasks, leading to sub-optimal performance. |
| Approach: | They propose a formula to determine the optimal resolution for a given vision-language task . they then propose 'parameter-efficient' fine-tuning technique to extend the visual input resolution . |
| Outcome: | The proposed method is based on rigorous experiments on vision-language tasks. |
Copied to clipboard
| Challenge: | Existing knowledge graph completion models lack textual information, which limits their performance . a plug-in-and-play approach is needed to train small models in descriptive context . |
| Approach: | They propose a plug-in-and-play approach to knowledge graph completion that prompts LLMs to generate descriptive context. |
| Outcome: | The proposed method improves performance on Wikipedia articles and synset definitions. |
Copied to clipboard
| Challenge: | naively fine-tuning an omni-model on speech recognition and external sound understanding tasks often degrades performance . Xie and Wu's framework, Speech-Hands, recasts the problem as an explicit self-reflection decision. |
| Approach: | They propose a voice-agentic framework that learns one critical omni-understanding skill: trusting itself versus external audio perception. |
| Outcome: | The proposed framework outperforms baseline models on the OpenASR leaderboard by 12.1% WER and high F1 on audio QA decisions. |
Copied to clipboard
| Challenge: | SIQ quantifies voice understanding abilities and provides unified comparisons between cascaded methods and end-to-end models. |
| Approach: | They propose a human cognition-inspired evaluation pipeline for voice understanding large language models (LLM_Voice) that quantifies voice understanding abilities and provides unified comparisons between cascaded methods and end-to-end models. |
| Outcome: | The proposed framework quantifies voice understanding abilities and provides unified comparisons between cascaded methods and end-to-end models, identifies annotation errors in existing benchmarks, and detects hallucinations in LLM_Voice. |
Copied to clipboard
| Challenge: | Existing approaches to generate adversarial examples for NMT use the meaning-preserving restriction. |
| Approach: | They propose a new definition for adversarial examples based on the Doubly Round-Trip Translation (DRTT) they introduce masked language models to construct bilingual adversarials based upon DRTT . |
| Outcome: | The proposed approach significantly improves the robustness of the NMT model on clean and noisy test sets. |
Copied to clipboard
| Challenge: | Recent studies suggest that the reasoning abilities of large language models (LLMs) grows with model size and pre-training data. |
| Approach: | They propose to combine quality filtering, conditional routing, and cooperative peer teaching to transfer knowledge from powerful teacher models to compact and transparent students. |
| Outcome: | Experiments show that QR-Distill is superior to traditional methods. |
Copied to clipboard
| Challenge: | Existing embedding approaches for temporal knowledge graphs typically learn entity representations and their dynamic evolution in the Euclidean space. |
| Approach: | They propose a non-Euclidean embedding approach that learns evolving entity representations in a product of Riemannian manifolds. |
| Outcome: | The proposed model improves on three real-world datasets showing that the embeddings on Riemannian manifolds can capture the evolution of temporal KGs. |
Copied to clipboard
| Challenge: | Recent advances in Large Language Models (LLMs) inspire the "LLM-as-a-judge" paradigm . traditional methods of assessment and evaluation fail in dynamic and open-ended scenarios . |
| Approach: | They propose a paradigm where LLMs are leveraged to perform scoring, ranking, or selection for machine learning evaluation scenarios. |
| Outcome: | The proposed model-based judgment and evaluation paradigms are based on large language models and are compared to the current model-driven evaluation paradigm. |
Copied to clipboard
| Challenge: | Large language model (LLM) routing assigns each query to the best suitable model from an ensemble. |
| Approach: | They introduce a large-scale benchmark and unified framework for LLM routing . they find that many routing methods exhibit similar performance under unified evaluation . |
| Outcome: | The proposed benchmark provides comprehensive metrics for both performance-oriented and performance-cost trade-off routing. |
Copied to clipboard
| Challenge: | Experimental results validate the benefit of the proposed model over the state-of-the-art baselines for rhetoric and emotion identification tasks. |
| Approach: | They propose a multi-task learning framework that can encode categorical correlation between tasks to improve rhetoric and emotion identification problem. |
| Outcome: | The proposed model can encode the categorical correlation between tasks to improve rhetoric and emotion identification problem. |
Copied to clipboard
| Challenge: | Existing black-box attacks require thousands of queries on the target model, making them expensive in real-world applications. |
| Approach: | They propose a new approach that guides word substitutions using prior knowledge from the training set to improve the attack efficiency. |
| Outcome: | The proposed approach reduces query-free attack and guided search attacks by a factor of 10 500 . it improves transferability and generalization by the ensemble of the ABPens in NLP . |
Copied to clipboard
| Challenge: | Existing ASTE datasets are limited in their ability to represent real-world scenarios, hindering progress in this area. |
| Approach: | They propose a new ASTE dataset that is manually annotated to better fit real-world scenarios by providing more diverse and realistic reviews. |
| Outcome: | The proposed dataset is manually annotated to better fit real-world scenarios. |
Copied to clipboard
| Challenge: | Various machine learning methods for tabular data lack accurate confidence estimation, which is needed for high-risk sensitive applications such as credit modeling and financial fraud detection. |
| Approach: | They propose a general post-training confidence calibration framework to calibrate the confidence of current machine learning models by employing graph neural networks to model the relationships between different samples. |
| Outcome: | The proposed framework improves the confidence estimation on tabular datasets by using graph neural networks to model the relationships between different samples. |
Copied to clipboard
| Challenge: | Existing methods for question decomposition focus on unimodal language models, but question decomposing capability of Multimodal Large Language Models (MLLMs) has yet to be explored. |
| Approach: | They propose a finetuning dataset and a training objective for selective decomposition to enhance the model's question decomposing capability. |
| Outcome: | The proposed dataset shows that existing models struggle to produce high-quality sub-questions. |
Copied to clipboard
| Challenge: | Retrieval-Augmented Generative (RAG) models enhance Large Language Models (LLMs) by integrating external knowledge bases. |
| Approach: | They propose to exploit openness of RAG models by injecting deceptive content into the retrieval database, intentionally changing the model’s behavior. |
| Outcome: | The proposed model can be exploited through crafted content uploads with access to the retriever. |
Copied to clipboard
| Challenge: | Existing methods to detect the knowledge boundary of Vision Large Language Models (VLLMs) are expensive and require indiscriminate retrieval to address questions that require real-time information or are knowledge-intensive. |
| Approach: | They propose a method that fine-tunes a VLLM on an automatically constructed dataset for boundary identification. |
| Outcome: | The proposed method reduces indiscriminate retrieval while maintaining or improving the performance of a VLLM on an automatically constructed dataset. |
Copied to clipboard
| Challenge: | Existing methods for lifelong TKG reasoning only address part of the challenges. |
| Approach: | They propose a temporal-path-based reinforcement learning framework for lifelong TKG reasoning . they add temporal displacement into the action space of RL to extrapolate for the future . |
| Outcome: | The proposed model outperforms existing models against well-adapted baselines on three lifelong TKG reasoning benchmarks. |
Copied to clipboard
| Challenge: | e-commerce has become a research hotspot for review helpfulness prediction . a new approach to help predict helpfulness of multimodal product reviews is proposed . |
| Approach: | They propose a machine learning task to identify helpfulness of multimodal product reviews . they use a probe-based strategy to enforce high attention weights on regions of greater significance . |
| Outcome: | The proposed model achieves state-of-the-art performance with lower memory consumption on two benchmark datasets with three categories. |
Copied to clipboard
| Challenge: | Multi-agent LLMs are prone to adversarial attacks because of constraints such as limited token bandwidth and latency between message delivery. |
| Approach: | They propose a permutation-invariant adversarial attack that optimizes prompt distribution across latency and bandwidth constraints to bypass distributed safety mechanisms within the system. |
| Outcome: | The proposed method outperforms conventional attacks by up to 7 on multiple models. |
Copied to clipboard
| Challenge: | Experimental results show that the proposed model consistently outperforms the traditional RNNSearch and the newly emerged state-of-the-art Transformer on English-German and Chinese-English translation tasks. |
| Approach: | They propose an approach for applying GANs to NMT by building a conditional sequence generative adversarial net with two adversarials. |
| Outcome: | The proposed model outperforms the existing RNNSearch and Transformer on English-German and Chinese-English translation tasks. |
Copied to clipboard
| Challenge: | Existing methods to perform implicit knowledge transfer from machine translation to ST model are difficult because of the task complexity and data scarcity. |
| Approach: | They recommend a method which conducts explicit knowledge transfer from MT to ST model by fine and coarse granularity contrastive learning. |
| Outcome: | The proposed method improves the performance of the end-to-end speech translation model on all 8 languages. |
Copied to clipboard
| Challenge: | Unified Multimodal Models have achieved remarkable success in cross-modal comprehension, but a gap persists in their ability to translate internal knowledge into faithful and controllable synthesis. |
| Approach: | They propose a self-improvement framework that partitions a single UMM into three collaborative roles: Proposer, Solver, and Judge. |
| Outcome: | The proposed framework improves on TIIF, DPG, CompBench and UniCycle benchmarks. |
Copied to clipboard
| Challenge: | Retrieval-Augmented Generation (RAG) combines the language understanding and reasoning capabilities of large language models (LLMs) with external retrieval to produce domain-grounded responses. |
| Approach: | They propose a scalable and modular data-centric framework for generating domain-grounded question–answer–context triples tailored to diverse RAG adaptation strategies. |
| Outcome: | The proposed framework generates domain-grounded question–answer–context triples for multiple RAG adaptation strategies. |
Copied to clipboard
| Challenge: | Existing approaches to generate long music are inefficient and lack of structured representation. |
| Approach: | They propose a hierarchical discrete representation of audio for long audio-domain music generation using residual vector quantization on different levels of features. |
| Outcome: | The proposed method achieves competitive performance in terms of reconstruction quality and token per second (TPS) the proposed method facilitates training a language model that can generate well-structured long-form music for up to 3 minutes. |
Copied to clipboard
| Challenge: | Recent advances in language models have demonstrated strong capabilities in semantic understanding and contextual modeling. |
| Approach: | They propose a LLaMA-based language model that incentivizes generalization capabilities for speech enhancement. |
| Outcome: | The proposed language model outperforms prior task-specific discriminative and generative models in acoustic enhancement tasks. |
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have improved performance across tasks and domains . instruction tuning is a crucial technique to enhance the capabilities of LLMs - but there is no standard open-source instruction processing framework available for the community . |
| Approach: | They propose an open-source instruction tuning framework for Large Language Models that modularizes instruction generation, selection, prompting and their combination and interaction. |
| Outcome: | The proposed framework is open-source and available on Github. |
Copied to clipboard
| Challenge: | Recent large language models (LLMs) have significantly improved Text-to-SQL generation, but a gap remains between AI systems and human experts on challenging benchmarks such as BIRD-Sql. |
| Approach: | They propose a multi-turn reinforcement learning agentic framework for Text-to-SQL that uses execution feedback to iteratively refine its predictions. |
| Outcome: | The proposed framework outperforms proprietary systems on 7B and 14B models by **5% on average, underscoring the effectiveness of interactive, agentic workflows for robust Text-to-SQL generation. |
Copied to clipboard
| Challenge: | Existing LLMs rely on surface-level similarity or manual heuristics to evaluate personalization . Existing evaluation protocols for personalization are lacking sufficient data-driven validation. |
| Approach: | They propose a benchmark to assess personalization by mining CIPDs to quantify individual preferences. |
| Outcome: | The proposed benchmark provides a more comprehensive and discriminative standard than generic metrics. |
Copied to clipboard
| Challenge: | Detecting disfluency can be difficult because of the flexible nature of reparandum structure and the lack of a nested structure. |
| Approach: | They propose a semi-supervised approach which extracts hidden features from self-attention without any Recurrent Neural Network (RNN) or Convolutional Neural Net (CNN). |
| Outcome: | The proposed approach improves over baselines by using unlabelled data . identifying and removing non-fluent factors would help to improve spontaneous speech quality . |
Copied to clipboard
| Challenge: | Existing methods for multi-agent collaboration rely on static or graph-based topologies lacking flexibility and adaptability. |
| Approach: | They propose a new framework that rethinks multi-agent coordination through a sequential structure rather than a graph structure. |
| Outcome: | The proposed method achieves superior performance while significantly reducing communication overhead. |
Copied to clipboard
| Challenge: | Existing human-machine dialogue systems are not able to provide diagnostic information for depression diagnosis due to stigma associated with mental illness. |
| Approach: | They propose to construct a Chinese Dialogue Dataset for depression-diagnosis-oriented chat based on clinical depression diagnostic criteria. |
| Outcome: | The proposed system can be used to diagnose depression using a Chinese Dialogue Dataset. |
Copied to clipboard
| Challenge: | Existing knowledge base question answering methods are limited by syntactic constraints and are prone to structural deviations that render queries unexecutable. |
| Approach: | They propose a framework that reframes semantic parsing as an iterative reasoning process driven by execution feedback. |
| Outcome: | The proposed method achieves significant improvements in query executability and answer accuracy on the WebQSP and CWQ datasets. |
Copied to clipboard
| Challenge: | Opinion target extraction and opinion words extraction are two fundamental subtasks in Aspect Based Sentiment Analysis (ABSA). |
| Approach: | They propose a new subtask for Aspect Based Sentiment Analysis to extract opinion words as pairs from a given opinion target. |
| Outcome: | The proposed model outperforms existing methods significantly on several popular ABSA benchmarks. |
Copied to clipboard
| Challenge: | Existing methods for related work generation use human-annotated references as information sources. |
| Approach: | They propose a model which combines reference retrieval and related work generation processes in a unified framework based on the large language model. |
| Outcome: | The proposed model outperforms the state-of-the-art models on two wide-applied datasets. |
Copied to clipboard
| Challenge: | a large number of natural language processing tasks focus on token-level or sentence-level understandings. |
| Approach: | They propose an open-source and extensible toolkit for various extraction tasks . they deploy an online demo with restful APIs to support real-time extraction . |
| Outcome: | The proposed model can be used to extract information from text without training and deployment. |
Copied to clipboard
| Challenge: | Existing benchmarks focus on well-structured tables and fail to reflect irregular structures and complex reasoning commonly encountered in real-world scenarios. |
| Approach: | They propose a benchmark to evaluate TableQA under complex reasoning and irregular table conditions. |
| Outcome: | The proposed framework improves generalization and realism of large language models under complex and irregular table conditions. |
Copied to clipboard
| Challenge: | a new benchmark for biomedical language understanding is being developed in Chinese . most benchmarks are limited to English, which makes it difficult to replicate success in other languages. |
| Approach: | They propose to use Chinese biomedical language understanding evaluation benchmarks to evaluate Chinese models. |
| Outcome: | The proposed benchmarks show that the current models perform worse than the human ceiling. |
Copied to clipboard
| Challenge: | Open Domain Multi-Hop Question Answering (ODMHQA) is one of the most challenging tasks in Natural Language Processing (NLP) |
| Approach: | They propose a mechanism that leverages the intrinsic capabilities of Large Language Models to judge whether the generated answers are off-topic. |
| Outcome: | The proposed method reduces the occurrence of off-topic answers by nearly 13%, improving the performance in Exact Match (EM) by nearly 3% compared to the baseline method without the Dr3 mechanism. |
Copied to clipboard
| Challenge: | Existing methods for large language models adopt query-driven iterative reasoning from a local perspective, limiting efficiency and accuracy for complex multi-hop tasks. |
| Approach: | They propose a multi-view instructed adaptive reasoning of LLM on Knowledge Graphs that allows LLMs to plan, evaluate, and adapt reasoning paths from a global perspective. |
| Outcome: | The proposed model overcomes the limitations of local exploration by enabling LLMs to plan, evaluate, and adapt reasoning paths from a global perspective. |
Copied to clipboard
| Challenge: | Named Entity Recognition (CNER) is a burgeoning area of research . a new paradigm has ushered NER into a non-entity type at the current step t . |
| Approach: | They propose a pooled feature distillation loss that skillfully navigates the trade-off between retaining knowledge of old entity types and acquiring new ones. |
| Outcome: | The proposed method outperforms state-of-the-art approaches on ten CNER settings using three datasets. |
Copied to clipboard
| Challenge: | Existing data-centric paradigms equate quality with factuality or diversity and ignore the internal logical complexity of training samples. |
| Approach: | They propose a density-aware re-cognizing optimization strategy that prioritizes high-density logical samples to align training with the model's reasoning boundary. |
| Outcome: | The proposed metric outperforms existing methods and improves reasoning performance without increasing total data volume. |
Copied to clipboard
| Challenge: | Large language models (LLMs) lack robustness in knowledge-intensive tasks due to noisy or irrelevant retrieved data. |
| Approach: | They propose a multi-agent debate-based RAG framework that integrates external knowledge sources into large language models to improve their accuracy. |
| Outcome: | The proposed framework is unsupervised and leverages pretrained LLMs without fine-tuning, making it easily adaptable to various tasks. |
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are used to assist with driving decisions, but they face limitations in perception and computational demands. |
| Approach: | They propose a survey of LLM-based multi-agent ADSs and their applications . they analyze agent-human interactions in scenarios where LLM agents engage with humans . |
| Outcome: | The proposed approach reduces human intervention and improves safety and efficiency. |
Copied to clipboard
| Challenge: | State-of-the-art neural models typically encode document-query pairs using cross-attention for re-ranking. |
| Approach: | They propose to fine tune a pretrained encoder-decoder model using document to query generation. |
| Outcome: | The proposed model achieves comparable results to more expensive approaches while being 6.8X faster. |
Copied to clipboard
| Challenge: | Existing studies on EAC focus on Emotion Recognition in Conversations (ERC), i.e., recognizing emotion labels of utterances. |
| Approach: | They propose a two-stream attention model to capture correlations between utterances in a global view and classify multiple utterrances synchronously to capture emotion and speaker information in parallel. |
| Outcome: | The proposed model outperforms baselines and achieves new State-Of-The-Art (SOTA) performance. |
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have been focused on single-agent, white-box environments, but multi-agend systems (MAS) have a critical blind spot: supply chain vulnerabilities. |
| Approach: | They propose a black-box auditing framework that leverages an Evolutionary Algorithm to autonomously expose hidden threats. |
| Outcome: | The proposed framework achieves superior detection rates (up to 100% in specific configurations) and robustness across diverse architectures. |
Copied to clipboard
| Challenge: | Existing methods to train a model on a mixture of domain datasets require separate correction language models. |
| Approach: | They propose a multi-task correction MoE that trains experts to become an "expert" of speech-to-text, language-totext and vision-to text datasets by learning to route each dataset’s tokens to its mapped expert. |
| Outcome: | The proposed model outperforms GPT-3.5 and Claude-3.5-Sonnet on the Open ASR Leaderboard and reaches an average relative 5.0% WER reduction and substantial improvements in BLEU scores. |