Papers by Yang Tian
Copied to clipboard
| Challenge: | Existing data selection techniques are designed for small data pools, a study finds . filtering data by token length is an efficient method for improving results . |
| Approach: | They use self-scoring methods that do not rely on external help to perform fine-tuning . they also find that filtering data by token length offers a stable and efficient method . |
| Outcome: | The proposed methods outperform random selection on large datasets on large data pools. |
Copied to clipboard
| Challenge: | Topic modeling (TM) is a classic unsupervised learning task in the field of natural language processing. |
| Approach: | They propose a new taxonomy that emphasizes the role of LLMs and the design of end-to-end workflows. |
| Outcome: | The proposed taxonomy emphasizes the role of LLMs and the design of end-to-end workflows. |
Copied to clipboard
| Challenge: | Large language models are trained on static corpora but deployed in a dynamic world . a foundational tension remains between time and the ability to understand it . |
| Approach: | They formalize temporal queries in an information-theoretic framework based on parametric reachability of temporal premises and answers. |
| Outcome: | The proposed framework formalizes temporal queries in an information-theoretic framework based on parametric reachability of temporal premises and answers . the framework induces four temporal information regimes corresponding to internal reasoning, answer recency, premise anchoring, and genuine world indeterminacy . |
Copied to clipboard
| Challenge: | CriticBench is a benchmark designed to assess LLMs’ abilities to critique and refine their reasoning across a variety of tasks. |
| Approach: | They propose a benchmark to assess LLMs' ability to critique and correct reasoning across a variety of tasks. |
| Outcome: | The proposed benchmark examines the performance of 17 large language models in generation, critique, and correction reasoning. |
Copied to clipboard
| Challenge: | Existing automated review systems struggle with factual accuracy, rating consistency, and analytical depth. |
| Approach: | They propose a framework for generating comprehensive and factually grounded scientific paper reviews using supervised fine-tuning and reinforcement learning. |
| Outcome: | The proposed framework outperforms existing methods on ICLR 2025 papers. |
Copied to clipboard
| Challenge: | Traditional evaluation metrics rely heavily on lexical similarity with human-written references, showing poor correlation with human judgments and failing to account for alignment with the diversity of human preferences. |
| Approach: | They propose an interpretable evaluation framework that evaluates alignment with specific human preferences by providing detailed comments and fine-grained scoring. |
| Outcome: | The proposed framework outperforms GPT-4 in Kendall correlation and accuracy with zero-shot reviewers. |
Copied to clipboard
| Challenge: | Large language models (LLMs) have been used for general-purpose interfaces across multiple tasks and languages. |
| Approach: | They propose to use large language models as a general-purpose interface across multiple tasks and languages. |
| Outcome: | The proposed model performs better on 200K hours of 6-language data for voice generation applications. |
Copied to clipboard
| Challenge: | Currently, tool-augmented large language models (LLMs) only achieve total scores of 45.3 and 37.0, respectively, on a scale of 100. |
| Approach: | They propose a multi-level diagnostic process to assess the LLM's hallucinations through two perspectives: depth and breadth. |
| Outcome: | The proposed diagnostic process assesses the hallucinations of large language models through two perspectives: depth and breadth. |
Copied to clipboard
| Challenge: | Existing defense methods rely on fine-tuning or inefficient post-hoc interventions, limiting their ability to address novel attacks. |
| Approach: | They propose a decoding-level defense mechanism that employs a lightweight discriminator to iteratively steer the decoding process toward safety. |
| Outcome: | The proposed method improves safety performance by up to 33.40% without fine-tuning on multiple MLLMs. |
Copied to clipboard
| Challenge: | Existing data selection methods do not work well for multiple domains . multiple aspects need to be considered for training a multi-domain model . |
| Approach: | They propose a dynamic data selection method to multi-domain NMT that incorporates instance-level domain-relevance features and a curriculum to gradually focus on multi- domain relevant data batches. |
| Outcome: | The proposed model outperforms no-curriculum training on multiple domains and reaches or outperformed individual performance. |
Copied to clipboard
| Challenge: | LVLMs have shown impressive progress by integrating visual perception with linguistic understanding to produce contextually grounded outputs. |
| Approach: | They propose a visual evidence prompting method to mitigate hallucinations in large vision-language models by using small visual models to complement them. |
| Outcome: | The proposed method reduces hallucinations by reducing false activation and enhancing correct ones. |
Copied to clipboard
| Challenge: | Visually rich documents (VRDs) combine text, tables, and figures within complex, semantically structured layouts. |
| Approach: | They propose a multi-turn reinforcement learning framework that fine-tunes VLMs as interactive agents capable of actively navigating long, visually rich documents. |
| Outcome: | The proposed framework achieves state-of-the-art on five long-document benchmarks. |
Copied to clipboard
| Challenge: | Emotion recognition in conversations (ERC) is a task that aims to recognize the emotion of each utterance in conversations. |
| Approach: | They propose an iterative emotion interaction network which uses iterativly predicted emotion labels instead of gold emotion labels to explicitly model the emotion interaction. |
| Outcome: | The proposed method retains state-of-the-art performance on two datasets and achieves high accuracy. |
Copied to clipboard
| Challenge: | Large language model agents have enabled GUI-based automation, but their deployment is limited by noisy data, poor generalization, and lack of support for non-English GUIs. |
| Approach: | They propose an 8B-parameter GUI agent built for robust and efficient on-device GUI interaction. |
| Outcome: | The proposed GUI agent achieves promising performance on five public benchmarks and proposed Chinese benchmark CAGUI. |
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have significantly impacted various domains, especially through organized LLM-driven autonomous agents. |
| Approach: | They propose a framework that enables orchestrated teams to jointly propose various task-oriented solutions and interact with their insights in a self-independence while cross-team collaboration environment for superior solutions generation. |
| Outcome: | Experiments show that the framework can generate better software quality compared to state-of-the-art frameworks. |
Copied to clipboard
| Challenge: | Existing methods such as Medusa lack adequate information interaction between different drafting heads. |
| Approach: | They propose an enhanced speculative decoding framework that builds upon Medusa and integrates a drafting block capable of parallel inference. |
| Outcome: | The proposed framework outperforms Medusa in terms of head accuracy and latency. |
Copied to clipboard
| Challenge: | Existing metrics for evaluating functional correctness of SQL queries are prone to false positives due to inadequately prepared test databases. |
| Approach: | They propose a graph-based metric that uses a relational operator tree to extract rich semantic information from the logical execution plan of SQL queries and embed it into a diagram. |
| Outcome: | The proposed method eliminates the need for extensive test database preparation and performs graph matching on unseen SQL queries. |
Copied to clipboard
| Challenge: | Low-rank decomposition methods suffer from accuracy degradation and expensive calibration procedures. |
| Approach: | They propose a fast and accurate, training-free structural compression method based on fine-grained low-rank transformations in the activation space. |
| Outcome: | The proposed method outperforms pruning baselines in generalization and downstream performance while delivering inference speedups. |
Copied to clipboard
| Challenge: | Mathematical reasoning has long been a key benchmark for evaluating large language models. |
| Approach: | They propose a framework that transforms math word problems into scalable tabular reasoning tasks. |
| Outcome: | The proposed framework transforms math word problems into scalable and verified tabular reasoning tasks. |
Copied to clipboard
| Challenge: | Pre-trained language models have achieved remarkable knowledge graph completion (KGC) success. |
| Approach: | They propose a path-enhanced pre-trained language model-based knowledge graph completion method which uses multi-view generation to infer missing facts in triple-level and path-level simultaneously. |
| Outcome: | The proposed method significantly improves the performance of the knowledge graph completion task. |
Copied to clipboard
| Challenge: | Recent advances in Multimodal Large Language Models have significantly improved reasoning and generation tasks by leveraging joint vision-language representations. |
| Approach: | They propose a framework that reconciles inconsistencies across knowledge sources . they use a four-stage pipeline to generate an internal response from parametric knowledge . |
| Outcome: | Experiments on KB-VQA show that CoRe-MMRAG achieves performance gains of 5.6% and 9.3% over baseline methods. |
Copied to clipboard
| Challenge: | Existing methods to enhance LLMs with knowledge graphs have limited results . knowledge graph question answering (KGQA) provides interpretable reasoning for large language models . |
| Approach: | They propose a framework for KG-enhanced LLM based on question decomposition and atomic retrieval . they propose question decomposing tree as framework for LLM reasoning . |
| Outcome: | The proposed framework outperforms existing reasoning-based baselines on KGQA datasets. |
Copied to clipboard
| Challenge: | Existing knowledge editing methods rely on unidirectional, feed-forward pipelines . a minor retrieval error or logical mismatch at an early hop can become a silent failure . |
| Approach: | They propose a framework for closed-loop post-edit reasoning that uses a Critic agent to verify coherence and step-wise correctness. |
| Outcome: | Experiments on MQuAKE-2002 and MQuADE-hard show that CARE effectively mitigates error propagation . a minor retrieval error or logical mismatch at an early hop can become a silent failure . |
Copied to clipboard
| Challenge: | Using data and data, self-improvement for Large Language Models has improved model capabilities without significantly increasing costs. |
| Approach: | This survey provides a comprehensive overview of self-improvement for Large Language Models . it includes commonly used evaluations and downstream applications . |
| Outcome: | The authors provide a comprehensive overview of self-improvement in Multimodal LLMs. |
Copied to clipboard
| Challenge: | Existing language evaluation benchmarks for English are limited to English . lack of such benchmarks makes it difficult to replicate success in other languages . |
| Approach: | They introduce a large-scale Chinese language understanding evaluation benchmark . the benchmark uses a set of current state-of-the-art pre-trained Chinese models . |
| Outcome: | The first large-scale Chinese Language Understanding Evaluation (CLUE) benchmark is released . the benchmark evaluates models across a wide range of tasks on original Chinese text . existing language evaluation benchmarks are mostly limited to English . |
Copied to clipboard
| Challenge: | Using a novel approach, we can evaluate an agent’s bargaining abilities as an asymmetric incomplete information game. |
| Approach: | They propose an approach that integrates a deterministic Offer Generator and an LLM Narrator to create natural language sentences for generated offers. |
| Outcome: | The proposed approach improves the buyer’s deal rates from 26.67% to 88.88% and brings a ten times multiplication of profits on all baselines, even a model that has not been aligned. |
Copied to clipboard
| Challenge: | Existing methods for automating vulnerability repair suffer from syntactic overfitting . nvd published 49,230 Common Vulnerabilities and Exposures (CVE) records in 2025 alone . |
| Approach: | They propose a semantic-aware reward framework that optimizes for code semantic equivalence rather than lexical mimicry. |
| Outcome: | The proposed framework outperforms state-of-the-art frameworks on repository-level splits . it incorporates expert-aligned reasoning mechanism that grounds patch generation in structured diagnosis. |
Copied to clipboard
| Challenge: | Existing approaches to image paragraph captioning ignore the past alignment information, resulting in repetitive captioning and incomplete captioning. |
| Approach: | They propose an Interactive key-value Memory-augmented Attention model for image paragraph captioning to keep track of attention history along with update-chain of decoder state. |
| Outcome: | Extensive experiments on a benchmark dataset demonstrate the effectiveness of the proposed model. |
Copied to clipboard
| Challenge: | naively fine-tuning an omni-model on speech recognition and external sound understanding tasks often degrades performance . Xie and Wu's framework, Speech-Hands, recasts the problem as an explicit self-reflection decision. |
| Approach: | They propose a voice-agentic framework that learns one critical omni-understanding skill: trusting itself versus external audio perception. |
| Outcome: | The proposed framework outperforms baseline models on the OpenASR leaderboard by 12.1% WER and high F1 on audio QA decisions. |
Copied to clipboard
| Challenge: | Existing document-level relation extraction methods do not distinguish between mention-level features and entity-level feature . document-based methods are more challenging because of multiple mentions of entities. |
| Approach: | They propose a method which selectively attentions different entity mentions with respect to candidate relations and performs relation-specific representations of entities. |
| Outcome: | The proposed method improves relation-specific representations of entities on two benchmark datasets. |
Copied to clipboard
| Challenge: | SIQ quantifies voice understanding abilities and provides unified comparisons between cascaded methods and end-to-end models. |
| Approach: | They propose a human cognition-inspired evaluation pipeline for voice understanding large language models (LLM_Voice) that quantifies voice understanding abilities and provides unified comparisons between cascaded methods and end-to-end models. |
| Outcome: | The proposed framework quantifies voice understanding abilities and provides unified comparisons between cascaded methods and end-to-end models, identifies annotation errors in existing benchmarks, and detects hallucinations in LLM_Voice. |
Copied to clipboard
| Challenge: | Current methods for editing personality traits in large language models can change personalities but reduce performance. |
| Approach: | They propose a novel paradigm for personality editing that locates and edits LLM neurons and enables competitive personality control at inference time. |
| Outcome: | Experiments on LLaMA-3-8B-Instruct and Qwen2.5-7B-instruct show that the proposed approach can improve performance and improve performance. |
Copied to clipboard
| Challenge: | Existing jailbreak research exhibits limitations in universality, validity, and efficiency . Existing methods for jailbreaking LLMs have limited validity and effectiveness . |
| Approach: | They propose a black-box approach that uses wordplay-guided mapping rule sampling to create universal adversarial prompts. |
| Outcome: | The proposed method efficiently identifies security vulnerabilities across various LLMs, achieving an average success rate of over 80% with fewer than 10 queries. |
Copied to clipboard
| Challenge: | Named Entity Recognition (NER) is one of the first stages in deep language understanding yet current NER models heavily rely on human-annotated data. |
| Approach: | They propose a Local Additivity based Data Augmentation method for semi-supervised Named Entity Recognition (NER) that creates virtual samples by interpolating sequences close to each other. |
| Outcome: | The proposed method improves both entity and context learning by adding to training data and extending it to semi-supervised setting. |
Copied to clipboard
| Challenge: | Existing studies have evaluated LLMs under noise-free context but the dilemma for LLM to produce inaccurate results under noisy context has not been fully investigated. |
| Approach: | They propose a new method for CoT reasoning using Chain-of-Thought prompting that interacts with LLMs to perform key sentence extraction, variable declaration and answer prediction. |
| Outcome: | The proposed method outperforms existing CoT prompting methods on five reasoning tasks under noisy context. |
Copied to clipboard
| Challenge: | Existing word embeddings only consider contextual information, which is suboptimal when used in various tasks due to a lack of task-specific features. |
| Approach: | They propose a task-oriented word embedding method that regularizes the distribution of words to enable a clear classification boundary. |
| Outcome: | The proposed method outperforms the state-of-the-art methods on a text classification task. |
Copied to clipboard
| Challenge: | Embedding-based similarity metrics can be influenced by content dimensions and spurious attributes like the text’s source or language. |
| Approach: | They propose a debiasing algorithm that removes observed confounders from encoder representations and removes them from the encoder. |
| Outcome: | The proposed method improves on out-of-distribution benchmarks and on benchmarks, but performance is not affected. |
Copied to clipboard
| Challenge: | Existing research has focused on approximating model rankings, but such benchmarks fail to provide users and developers with a comprehensive and fine-grained understanding of a specific model’s capabilities. |
| Approach: | They propose a framework that enables detailed characterization of LLM capabilities through comprehensive and fine-grained evaluation. |
| Outcome: | The proposed framework enables detailed characterization of large language models through comprehensive and fine-grained evaluation. |
Copied to clipboard
| Challenge: | Existing LLM-based training approaches lack faithful responses to clinical errors and explainable feedback. |
| Approach: | They propose a neural-symbolic virtual standardized patient governed by an OBSERVE-THINK-BEHAVE architecture that embeds LLM reasoning into a symbolic system where experts implant causal associations between intervention logic and patient mental states. |
| Outcome: | The proposed model outperforms baselines in faithfulness and pedagogical value. |
Copied to clipboard
| Challenge: | Existing studies have shown that cross-lingual knowledge distillation can improve the performance of pre-trained models for cross-linguistic similarity matching tasks. |
| Approach: | They propose a multi-stage distillation framework for constructing a small-size but high-performance cross-lingual model using contrastive learning, bottleneck, and parameter recurrent strategies. |
| Outcome: | The proposed model can compress the size of XLM-R and MiniLM by more than 50% while the performance is only reduced by about 1%. |
Copied to clipboard
| Challenge: | Existing studies have improved the performance of Large language models on well-defined mathematical benchmarks, but they often overlook ill-defined problems. |
| Approach: | They develop a large-scale benchmark that contains over 5,000 ill-defined mathematical problems. |
| Outcome: | The proposed framework improves the accuracy of identifying unsolvable problems by at least 12% across different LLMs, thus achieving stronger robust mathematical reasoning ability. |
Copied to clipboard
| Challenge: | Multimodal in-context learning (ICL) is a key mechanism for harnessing the capabilities of large vision–language models. |
| Approach: | They propose a transformer-based model with task-aware attention that dynamically configures ICL sequences. |
| Outcome: | Experiments on five LVLMs and nine datasets show that TACO surpasses baselines across diverse ICL tasks. |
Copied to clipboard
| Challenge: | Existing general-domain visual language models lack ability of music notation understanding . Symbolic music is represented in two distinct forms: auditory music and symbolic music . |
| Approach: | They propose to train a multimodal music notation model using a large-scale dataset . they use cross-modal alignment to train the model for music notations analysis . |
| Outcome: | The proposed model improves on music understanding by training with a multimodal music notation model. |
Copied to clipboard
| Challenge: | Large Vision-Language Models (LVLMs) have achieved significant progress in tasks like visual question answering and document understanding. |
| Approach: | They introduce DivScene, a large-scale dataset with 4,614 houses across 81 scene types and 5,707 kinds of target objects. |
| Outcome: | The proposed dataset provides a much greater diversity of target objects and scene types than existing datasets, enabling a comprehensive task evaluation. |
Copied to clipboard
| Challenge: | Large Language Models (LLMs) sometimes produce untruthful responses despite knowing the correct knowledge. |
| Approach: | They propose an inference-time intervention method to activate the truthfulness of Large Language Models (LLMs) by editing the features within LLM’s internal representations that govern the truthful. |
| Outcome: | The proposed method improves the truthfulness of 13 advanced LLMs by an average of 20% on TruthfulQA benchmark. |
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are easily misled by untruthful contexts provided by users or knowledge augmentation tools, leading to hallucinations. |
| Approach: | They propose a lightweight method to adaptively recognize and mask untruthful context from the inputs and a new evaluation metric to further study the LLMs’ ability to accept truthful information and resist untrusted information. |
| Outcome: | The proposed method can detect and mask untruthful context from the inputs and significantly improve the quality of LLMs’ responses when presented with misleading information. |
Copied to clipboard
| Challenge: | Recent work uses Large Language Models (LLMs) for semantic parsing to address Knowledge Base Question Answering tasks. |
| Approach: | They propose a framework that augments reasoning capabilities of LLMs with Graph Structures in Knowledge Base Question Answering to retrieve question-related graph structures. |
| Outcome: | The proposed framework outperforms existing methods on GrailQA and WebQSP under the few-shot setting. |
Copied to clipboard
| Challenge: | Existing methods to protect privacy of sensitive data are differential privacy (DP) and DP is used to protect users from privacy leakage. |
| Approach: | They propose an LDP-based Dynamic Text sanitization for privacy-preserving LLM inference that dynamically constructs semantic-aware adjacency lists of sensitive tokens to sample non-sensitive tokens for perturbation. |
| Outcome: | The proposed model excels on three datasets. |
Copied to clipboard
| Challenge: | Existing methods to predict emotion label for a given utterance lack modeling of diverse dependency ranges and inconsistent treatment of contribution for various modalities. |
| Approach: | They propose a multimodal emotion recognition in conversation task that uses context and multiple modalities to predict emotion label for a given utterance. |
| Outcome: | The proposed method outperforms the state-of-the-art methods on three multimodal datasets. |
Copied to clipboard
| Challenge: | Abstractive summarization models require attention to reproduce the most salient information. |
| Approach: | They propose to use local and global variances to augment the vanilla attention model to reproduce the most salient information and avoid repetitions. |
| Outcome: | The proposed attention refinement unit can reproduce the most salient information and avoid repetitions on CNN/Daily Mail dataset. |
Copied to clipboard
| Challenge: | Existing approaches to domain adaptation only use reliable pseudo instances, i.e., pseudo instances with high prediction confidence, to retrain the model. |
| Approach: | They propose a domain adversarial learning enhanced self-training framework that uses meta-learning to estimate the importance of each pseudo instance and a meta constructor to construct the meta-validation set. |
| Outcome: | The proposed framework reduces label noise and preserves hard examples while maintaining accuracy. |
Copied to clipboard
| Challenge: | Existing methods for controlling the generation of pre-trained language models infuse domain bias into the generation process, making it difficult to generate out-of-domain texts. |
| Approach: | They propose a retrieval-augmented generation framework that uses retrieval to generate fluent sentences with high attribute relevance. |
| Outcome: | The proposed method can generate fluent sentences with high attribute relevance while keeping domain bias out of the model. |
Copied to clipboard
| Challenge: | Large Reasoning Models (LRMs) have emerged as a powerful advancement in multi-step reasoning tasks, but they introduce safety and reliability risks, such as CoT-hijacking and prompt-induced inefficiencies. |
| Approach: | They propose a unified benchmark to assess the trustworthiness of Large Reasoning Models. |
| Outcome: | The proposed benchmark evaluates truthfulness, safety and efficiency on 26 models. |
Copied to clipboard
| Challenge: | Neural Processing Units (NPUs) are critical for AI infrastructure, but their development remains a bottleneck due to vendor-specific Domain-Specific Languages (DSLs). |
| Approach: | They propose a framework for NPU kernel development that bridges the gap in hardware-specific coding . compiler success on complex Level-2 kernels improves from 0% to 95.5%, they say . |
| Outcome: | The proposed framework bridges the gap in hardware-specific coding, showing a near-zero success rate on complex kernels. |
Copied to clipboard
| Challenge: | Deciphering oracle bone scripts using AI technology is not an overnight task due to the evolution of written language over millennia. |
| Approach: | They propose a framework that utilizes Large Multi-modal Models (LMMs) for interpreting Oracle Bone Script (OBS). |
| Outcome: | The proposed framework provides quantitative analyses and superior deciphering capability. |
Copied to clipboard
| Challenge: | Existing retrieval-augmented approaches focus on ignoring the structural information of the Knowledge Base (KB) and the question. |
| Approach: | They propose a structure-aware subgraph retrieval stage that ranks candidate subgraphs by aligning them with the question’s structure, along with semantic relevance. |
| Outcome: | Experiments on GrailQA, WebQSP, and GraphQuestions show that the proposed framework achieves state-of-the-art performance. |
Copied to clipboard
| Challenge: | Concepts in knowledge graphs (KGs) are far from complete in existing knowledge graph models. |
| Approach: | They propose to equip a PLM-based extractor with a knowledge-guided prompt to alleviate concept bias by removing spurious co-occurrence correlations from existing knowledge. |
| Outcome: | The proposed prompt can alleviate concept bias and improve the performance of existing models. |
Copied to clipboard
| Challenge: | Existing methods for modifying parameters are unsystematic and rely on empirical experience. |
| Approach: | They propose a controllable alignment prompting for unlearning framework that decouples unlearning into a learnable prompt optimization process via reinforcement learning. |
| Outcome: | The proposed framework achieves precise, controllable unlearning without updating model parameters. |
Copied to clipboard
| Challenge: | Existing agent benchmarks neglect hierarchical rule application in real-world domains . a critical gap persists in numerous real-life professional domains where decision-making is governed by expert-written rules. |
| Approach: | They propose a benchmark requiring agents to assign a unique 10-digit Harmonized System (HS) Code to products by aligning their fuzzy attributes with strict tariff classification rules. |
| Outcome: | The proposed benchmarks lack hierarchical rule application capability in real-world domains . the proposed benchmark is based on e-commerce and is open-source . |
Copied to clipboard
| Challenge: | MU has gained significant attention as a means to remove the influence of specific data from a trained model without requiring full retraining. |
| Approach: | They propose a novel approach that disentangles and selectively forgets both visual and textual associations, ensuring that unlearning does not compromise model performance. |
| Outcome: | Experiments on CIFAR-100, Flickr30K, and Conceptual 12M show that CLIPErase effectively removes designated associations from multimodal samples in downstream tasks while preserving model performance on retain set. |
Copied to clipboard
| Challenge: | Extensive experiments on six real-world datasets show our approach outperforms the best baselines by 7.33% in NDCG@10, 4.65% in Recall@10 and 8.42% in MRR. |
| Approach: | They propose a framework for mapping sequential item texts to sequential item IDs that incorporates multi-query input and item linear projection to model conditional probability distribution of items. |
| Outcome: | The proposed framework outperforms baseline models on six real-world datasets by 7.33% and 4.65% respectively. |
Copied to clipboard
| Challenge: | Existing methods for Knowledge Base Question Answering generate non-executable queries and inefficiencies in query execution. |
| Approach: | a framework that decouples logical structure generation from semantic grounding is proposed . the framework explicitly enforces KB constraints to improve alignment between generated logical forms and KB structures. |
| Outcome: | GRV-KBQA decouples logical structure generation from semantic grounding and incorporates structure-aware validation to enhance accuracy. |
Copied to clipboard
| Challenge: | Large language models (LLMs) have prioritized expanding the context window from which they can incorporate more information. |
| Approach: | They propose a data augmentation strategy to enable large language models to gain long-context capabilities without the need to modify existing data mixture. |
| Outcome: | The proposed model outperforms existing models on 20 billion tokens and achieves 75% and 84.5% accuracy on RULER at 128K context length. |
Copied to clipboard
| Challenge: | Existing agent benchmarks fail to evaluate an agent's real-world capacity to handle CAPTCHA . Existing benchmarks ignore this practical challenge, failing to evaluate agents' ability to handle complex visual CAPTchas. |
| Approach: | They propose a benchmark annotated with Weighted Pass Rate and a new metric to measure agent's ability to handle CAPTCHA. |
| Outcome: | The proposed benchmark outperforms current state-of-the-art closed-source models on mirrorCAPTCHA and achieves 9.4% higher average weighted pass rate and 2.13% higher average Completion degree. |
Copied to clipboard
| Challenge: | Existing knowledge enhancement techniques for pre-trained language models (PLMs) introduce noisy entity representations. |
| Approach: | They propose a knowledge enhancement filter that integrates external knowledge bases to enhance PLMs' ability to capture entity knowledge. |
| Outcome: | The proposed method achieves the highest F1-score and accuracy while reducing the computational cost by 1.7-2.5x. |
Copied to clipboard
| Challenge: | Large Language Models (LLMs)-based agents have fundamentally reshaped artificial intelligence . however, the inherent statelessness of LLMs hinders their ability to maintain logical consistency across complex, multi-step tasks . |
| Approach: | They propose a framework for LLM agent memory mechanisms that formalizes the development process into three stages: storage, reflection, and experience. |
| Outcome: | The proposed framework breaks the development process into three stages . it analyzes the need for long-range consistency, challenges in dynamic environments, and the ultimate goal of continual learning. |
Copied to clipboard
| Challenge: | Xu and Peng, 2025) . . SPUR is a comprehensive benchmark for scientific experimental image perception, understanding, and reasoning, comprising 4,264 question-answering (QA) pairs derived from 1,084 expert-curated images. |
| Approach: | They propose to use 4,264 question-answering (QA) pairs derived from 1,084 expert-curated images to evaluate the visual perception of multimodal large language models (MLLMs) . they also propose to utilize cross-panel relation understanding to evaluate MLLM’s ability to decipher intricate cross-panel relations. |
| Outcome: | The proposed model is based on 4,264 question-answering pairs derived from 1,084 expert-curated images. |
Copied to clipboard
| Challenge: | Existing methods for generating stories with complex plots rely on detailed prompts, which inadvertently limit the creative potential of the generated stories. |
| Approach: | They propose a retrieval-auGmented stoRy generation framework with a fOrest of eVidEnce to enhance stories’ complexity. |
| Outcome: | The proposed framework enables generating more diverse plotlines from human-written stories. |
Copied to clipboard
| Challenge: | Recent work has generated short stories of several pages in length, but they are much shorter than typical short stories meant for human consumption. |
| Approach: | They propose a framework to generate long-range plot coherence and relevance by prompting a general-purpose language model and a language model. |
| Outcome: | The proposed framework generates stories of 2000-2500 words, compared to similar-length stories generated directly from the same model. |
Copied to clipboard
| Challenge: | Root cause analysis (RCA) in Micro-services architectures with escalating complexity is challenging due to fault propagation and circular dependencies among nodes. |
| Approach: | They propose a framework where multiple agents follow Agent Workflow and collaborate in blockchain-inspired voting to ensure the reliability of root cause analysis. |
| Outcome: | The proposed framework reduces the number of steps and standardizes task processing through Agent Workflow. |
Copied to clipboard
| Challenge: | Existing work on cross-lingual stance detection has ignored the inconsistency in the occurrences and distributions of targets between languages, which consequently degrades the performance of stance detector in low-resource languages. |
| Approach: | They propose a fine-grained method which considers both target-level associations and language-level alignments to learn the in-language and cross-language associations. |
| Outcome: | The proposed method is compared with competing methods under variant settings and shows that it performs better in low-resource languages. |
Copied to clipboard
| Challenge: | Recent advances in large language models (LLMs) have enabled social simulation through multi-agent systems. |
| Approach: | They propose a system for constructing and simulating book-based multi-agent societies that simulates established fictional worlds and characters. |
| Outcome: | The proposed system generates high-quality stories while maintaining fidelity to the source books, surpassing previous methods with a win rate of 75.36%. |
Copied to clipboard
| Challenge: | Existing approaches to training document conversion models with manual annotation are costly and time-consuming, and training student models by distilling outputs from teacher models can significantly limit their performance in real-world applications. |
| Approach: | They propose a fully automated framework for constructing high-quality document extraction datasets and models capable of handling diverse document formats and layouts. |
| Outcome: | The proposed model outperforms existing models and improves on annotated documents. |
Copied to clipboard
| Challenge: | Existing large language models exhibit unidirectional behavior when processing bidirectional relationships . authors propose a solution to alleviate the reversal curse in Diffusion LLMs . |
| Approach: | They propose a model that addresses the "reversal curse" of bidirectional behavior in large language models . they propose 'entity-aware training' and balanced data construction to alleviate asymmetry and missing relations . |
| Outcome: | The proposed model alleviates the "reversal curse" in Diffusion LLMs . the proposed model employs whole-entity masking to mitigate entity fragmentation . |
Copied to clipboard
| Challenge: | Existing methods for extracting chemical procedures from literature are insufficient and low-quality due to the inherent ambiguity of chemical language and the high cost of human annotation. |
| Approach: | They propose a fully fine-tuned large language model (LLM) as a chemical executor to convert between unstructured experimental procedures and structured action sequences. |
| Outcome: | The proposed model outperforms the baseline model on R2D and D2A tasks by 10%. |
Copied to clipboard
| Challenge: | Existing AVQA methods often fail to link sound-producing objects in the video with the audio-visual information. |
| Approach: | They introduce a source-aware semantic representation network for AVQA . they use source-wise learnable tokens to capture and align audio-visual elements with the question . |
| Outcome: | The proposed model outperforms state-of-the-art models on the Music-AVQA and AVQA-Yang datasets. |
Copied to clipboard
| Challenge: | Modern large language models (LLMs) have shown remarkable performance on general language tasks but struggle on complex reasoning tasks. |
| Approach: | They propose a multi-agent debate framework that encourages divergent thinking in LLMs . they propose to break debate and use a judge to obtain a final solution . |
| Outcome: | The proposed framework encourages divergent thinking in large language models . it is able to generate novel thoughts even if initial stance is incorrect . |
Copied to clipboard
| Challenge: | Existing work on federated learning for large language models (FL) addresses privacy and data-silo issues in the training of large language model training. |
| Approach: | They propose a probe-based defense framework for FedLLM that constructs defenses across three levels: Step-Level, Client-Level and Shadow-Level. |
| Outcome: | The proposed framework improves FedLLM's robustness against malicious clients while maintaining competitive performance on benign data. |
Copied to clipboard
| Challenge: | Detailed Outline Control (DOC) framework improves long-range plot coherence . human evaluations of DOC show it outperforms strong Re3 on plot cohesion, outline relevance and interestingness . |
| Approach: | They propose a Detailed Outline Control framework to improve long-range plot coherence . the detailed outliner creates a more detailed, hierarchically structured outline . they propose doc with a detailed controller to ensure the more detailed outline is respected . |
| Outcome: | The proposed framework outperforms Re3 on plot coherence, outline relevance and interestingness. |
Copied to clipboard
| Challenge: | Existing knowledge-grounded dialogue generation models struggle with dull and repetitive outputs, a problem commonly termed as text degeneration. |
| Approach: | They propose a framework that allows the model to "cheat" the objective by duplicating knowledge segments in a superficial pattern matching based on overlap. |
| Outcome: | The proposed framework can be applied to a WoW dataset and shows that it works across models and decoding strategies. |
Copied to clipboard
| Challenge: | Recent advances in large language models (LLMs) have improved text generation and reasoning. |
| Approach: | They propose a behavioral watermarking framework that embeds multi-bit identifiers into planning decisions while preserving utility. |
| Outcome: | The proposed framework embeds multi-bit provenance into planning decisions while preserving utility. |
Copied to clipboard
| Challenge: | Neural machine translation systems often produce inadequate translations for named entities. |
| Approach: | They propose a data augmentation strategy to enhance the accuracy of named entity translation by retraining the target named entity pair. |
| Outcome: | The proposed method improves translation accuracy across test sets and terminology tests. |
Copied to clipboard
| Challenge: | Generative AI has demonstrated unprecedented creativity in the field of computer vision, yet such phenomena have not been observed in the realm of literary creation. |
| Approach: | They propose a framework for unleashing the creativity of large language models (LLMs) they assign LLMs to different roles involved in real-world scenario, they write . |
| Outcome: | The proposed framework outperforms baselines in terms of coherence, relevance, interestingness and overall quality on automatically generated screenplays. |
Copied to clipboard
| Challenge: | Existing knowledge base question answering methods struggle with complex queries. |
| Approach: | They propose a framework that optimizes the process of fine-tuning a LLM for generating logical forms by enabling it to learn relevant sub-tasks like skeleton generation, topic entity generation, and relevant relations generation. |
| Outcome: | The proposed framework achieves state-of-the-art on two benchmark KBQA datasets, WebQSP and CWQ. |
Copied to clipboard
| Challenge: | Existing benchmarks fail to capture scenarios in which vulnerabilities are introduced by humans . we evaluate 5 popular code agents supported by 5 LLMs on SecureVibeBench . |
| Approach: | They propose a benchmarking tool that compares 105 C/C++ secure coding tasks . they use real-world open-source vulnerabilities and a comprehensive evaluation tool . |
| Outcome: | The proposed benchmarks show that code agents struggle to produce correct and secure code . the best performing agent produces merely 23.8% correct and secured solutions . |
Copied to clipboard
| Challenge: | Existing methods to learn multiple tasks in parallel often lead to catastrophic forgetting, resulting in overwriting knowledge. |
| Approach: | They propose a non-collision low-rank Adaptation approach that leverages low collision rates to enhance continual learning (CL) in large language models. |
| Outcome: | The proposed approach achieves better task orthogonality and higher task orthognality than existing SOTA methods. |
Copied to clipboard
| Challenge: | Existing pre-trained language models are difficult to apply to abstractive conversational summarization tasks. |
| Approach: | They propose a thread-aware Transformer-based network that incorporates contextual dependency into the conversational summarization model. |
| Outcome: | The proposed model can be applied to real conversations using a large-scale pretraining dataset. |