Papers by Jiang Guo
Copied to clipboard
| Challenge: | Retrieval-Augmented Generation (RAG) is widely used to ground large language models in external knowledge and improve factual accuracy. |
| Approach: | They propose a framework that integrates neuro-symbolic verification with reinforcement learning to optimize logical consistency. |
| Outcome: | The proposed framework outperforms strong RAG baselines on hotpotQA, ASQA, and TriviaQA. |
Copied to clipboard
| Challenge: | Existing knowledge graph embedding techniques suffer from high intra-group similarity, loss of semantic information, and insufficient inference capability, particularly in complex relation patterns such as 1-N and N-1 relations. |
| Approach: | They propose a knowledge graph embedding framework that leverages mutual information maximization to improve the semantic representation of entities and relations. |
| Outcome: | Extensive experiments on benchmark datasets demonstrate the effectiveness of the proposed method, with consistent performance improvements across various baseline models. |
Copied to clipboard
| Challenge: | Music information retrieval (MIR) is a field that aims at developing computational tools for processing, organizing, and accessing music data. |
| Approach: | They propose a framework that aligns music modalities with multilingual text in a shared representation space. |
| Outcome: | Experiments show CLaMP 3 performs state-of-the-art on multiple MIR tasks . it surpasses baselines and shows excellent generalization in multimodal and multilingual contexts . |
Copied to clipboard
| Challenge: | Existing approaches for inferential text generation ignore context that is not explicitly provided . Existing models ignore background knowledge that provides crucial evidence to generate inferences . |
| Approach: | They propose an approach that automatically finds evidence for an event from a large text corpus and leverages it to guide the generation of inferential texts. |
| Outcome: | The proposed model generates inferential texts from a large text corpus and uses evidence to guide it. |
Copied to clipboard
| Challenge: | acquiring domain-specific knowledge often requires professional expert manpower. |
| Approach: | They propose a generic framework for generating evaluation datasets for domain-specific LLMs. |
| Outcome: | The proposed framework reduces the reliance on expert manpower while ensuring that the collected data is uniformly distributed. |
Copied to clipboard
| Challenge: | Contract review is labor-intensive, time-consuming, and costly . a benchmark is proposed to detect potential legal conflicts . |
| Approach: | They propose a benchmark for legal provision recommendation and conflict detection for contract auto-reviewing which aims to recommend the legal provisions related to contract clauses and detect possible legal conflicts. |
| Outcome: | The proposed task recommends legal provisions related to contract clauses and detects legal conflicts. |
Copied to clipboard
| Challenge: | Recent methods focus on search accuracy while overlooking computational efficiency. |
| Approach: | They propose a parallelism framework that dynamically optimizes reasoning path in inference. |
| Outcome: | The proposed framework improves efficiency by 2-4 on average while maintaining or even surpassing existing reasoning algorithms in accuracy. |
Copied to clipboard
| Challenge: | Recent advances in vision-language models have unified perception and understanding tasks within Visual Question Answering paradigms. |
| Approach: | They propose to outline timeline, architecture, and pipeline of nearly all TIU MLLMs and review their performance on mainstream benchmarks. |
| Outcome: | The proposed models perform well on mainstream benchmarks and are compared with other models. |
Copied to clipboard
| Challenge: | Existing text-to-SQL parsers lack the data to perform well with augmented synthetic data. |
| Approach: | They propose a framework that imposes strong typing constraints and incorporates key relationships from schema. |
| Outcome: | The proposed framework improves on the high-quality synthesized SQL and natural language question (NLQ) models have significant accuracy boosts and achieve new state-of-the-art performance on spider. |
Copied to clipboard
| Challenge: | a significant drawback of Vision-language Models is their reliance on static training data, leading to outdated information and limited contextual awareness. |
| Approach: | They propose a framework with knowledge-enhanced reranking and noise-injected training to improve the VLM's ranking ability. |
| Outcome: | The proposed framework is based on a simple yet effective instruction template and is able to induce its ranking ability and serve it as a reranker to precisely filter the top-k retrieved images. |
Copied to clipboard
| Challenge: | Existing methods for idea generation either trivially prompt LLMs or expose LLM to extensive literature without indicating useful information. |
| Approach: | They propose a chain-of-ideas agent that organizes literature in a chains structure . they propose evaluating idea-generation methods from different perspectives . |
| Outcome: | The proposed agent outperforms existing methods and matches human quality in idea generation. |
Copied to clipboard
| Challenge: | Existing large language models rely on append-only context maintenance or passively triggered compression heuristics, leading to context explosion, semantic drift, and degraded reasoning in long-running interactions. |
| Approach: | They propose a new context management paradigm that elevates context maintenance to a callable tool . they propose 'cat' framework that injects context-management actions into complete interaction trajectories . |
| Outcome: | The proposed model outperforms ReAct-based agents and static compression baselines on SWE-Verified tests. |
Copied to clipboard
| Challenge: | Existing methods for domain adaptation from multiple sources are designed to transfer supervision from a single source domain. |
| Approach: | They propose to capture the relationship between a target example and different source domains by a point-to-set metric. |
| Outcome: | The proposed method outperforms baselines and can handle negative transfer. |
Copied to clipboard
| Challenge: | Existing methods for fine-tuning are resource-efficient, but performance often falls short . a new approach, TeamLoRA, integrates collaborative and competitive modules to improve performance. |
| Approach: | They propose to introduce task-specific LoRA as domain experts to improve learning efficiency . teamLoRA integrates collaborative and competition modules to improve model learning . |
| Outcome: | Experiments show that TeamLoRA improves performance in multi-task learning . teamLorea integrates collaborative and competitive modules to improve performance . |
Copied to clipboard
| Challenge: | Recent advances in large language models (LLMs) have sparked growing interest in building fully autonomous agents. |
| Approach: | They propose to integrate human-provided information, feedback, or control into the agent system to enhance system performance, reliability, and safety. |
| Outcome: | The proposed systems improve system performance, reliability, and safety by integrating human-provided information, feedback, or control into the agent system. |
Copied to clipboard
| Challenge: | Recent studies of Vision Language Models (VLMs) for UI understanding have focused primarily on static screenshots, leaving it unclear how well these models handle dynamic UI animations. |
| Approach: | They evaluate UI animation models' ability to perceive animation effects and interpret animation meaning . they use motion, context, and perceptual cues to probe factors affecting VLM performance . |
| Outcome: | The proposed model can detect primitive motion, but its interpretation is inconsistent . the proposed model is based on 300 annotated UI animation videos . |
Copied to clipboard
| Challenge: | drafting method statements is labor-intensive and time-consuming . traditional methods involve using static templates filled in manually by engineers . |
| Approach: | They propose a framework that automates method statement generation by using multi-agent collaboration. |
| Outcome: | The proposed framework achieves 4.38 ContentScore, excelling in specialization, completeness, organization, and clarity. |
Copied to clipboard
| Challenge: | Large language models (LLMs) are promising foundations to build generally-capable agents . however, the community lacks a unified interactive framework that covers diverse environments for comprehensive evaluation of agents. |
| Approach: | They propose a framework that features 7 real-world scenarios, 14 environments, and 89 tasks for unified, real-time, and concurrent agent interaction. |
| Outcome: | The proposed framework features 7 real-world scenarios, 14 environments, and 89 tasks for unified, real-time, and concurrent agent interaction. |
Copied to clipboard
| Challenge: | Existing methods to protect PII from training on small corpora are difficult to implement in real-world applications. |
| Approach: | They propose an entity-based framework that synthesizes encrypted training data to protect PII. |
| Outcome: | The proposed framework outperforms base models and ensures PII security on limited-scale datasets while exhibiting a modest performance gap compared to models trained on unencrypted synthetic data. |
Copied to clipboard
| Challenge: | Large language models demonstrate remarkable zero-shot generalization, but adapting to downstream tasks requires continual fine-tuning. |
| Approach: | They propose a method that incrementally constructs a pool of frozen, task-specific LoRA experts. |
| Outcome: | The proposed approach outperforms state-of-the-art methods in task-free and blurred-boundary settings. |
Copied to clipboard
| Challenge: | Existing text-to-SQL systems encode the same schema for every question, resulting in unnecessary high inference cost and missing crucial database knowledge. |
| Approach: | They propose a paradigm that directly internalizes database knowledge into the parametric knowledge of a text-to-SQL model during training and eliminates the need for schema encoding during inference. |
| Outcome: | The proposed paradigm significantly reduces the input token length by 66%-98% and outperforms traditional systems on three benchmarks. |
Copied to clipboard
| Challenge: | Long-context processing ability has emerged as a significant challenge for large language models. |
| Approach: | They propose a pipeline for synthesizing faithful long-context reasoning instruction datasets . they integrate ground truth and citation-based reasoning prompts integrating them . |
| Outcome: | The proposed pipeline eliminates distractions and improves reasoning chains. |
Copied to clipboard
| Challenge: | Existing work on cross-lingual transfer has not studied how to leverage knowledge of rich-resource languages without labels. |
| Approach: | They propose a 2-step knowledge distillation framework to achieve knowledge transfer from off-the-shelf models in rich-resource languages. |
| Outcome: | The proposed method reduces annotation cost and protects private labels. |
Copied to clipboard
| Challenge: | In a large fraction of the global traffic from smart digital assistants, frictions in dialogues may be attributed to incorrect understanding of the entities in a user's query due to factors including ambiguous mentions, mispronunciation, background noise and faulty on-device signal processing. |
| Approach: | They propose a parametric transformer-based language model to learn patterns from in-session customer-device interactions coupled with a non-parametric personalized entity index to compute the correct query. |
| Outcome: | The proposed system improves on the existing system and shows that it can learn the correct query from in-session customer-device interactions. |
Copied to clipboard
| Challenge: | Chinese Spelling Correction (CSC) is a model that detects and corrects spelling errors in given sentences. |
| Approach: | They propose a model-agnostic model with an evolving teacher model and dynamic distillation weights for knowledge transfer in each domain rather than focusing solely on new domain knowledge. |
| Outcome: | The proposed model-agnostic framework is based on an evolving teacher model and dynamic distillation weights for knowledge transfer in each domain, rather than focusing solely on new domain knowledge. |
Copied to clipboard
| Challenge: | Existing approaches to source planning fail to achieve this due to misalignment between the model’s expectation of the sources and their actual content. |
| Approach: | They propose a method to optimise large-scale medical knowledge models by combining multiple medical knowledge sources into one query. |
| Outcome: | The proposed method significantly improves multi-source planning performance while training a smaller model to learn source alignment. |
Copied to clipboard
| Challenge: | Recent studies have shown that Large Language Models’ performance as correctors on Chinese Grammatical Error Correction (CGEC) remains unsatisfactory due to the challenging nature of the task. |
| Approach: | They propose a training framework EXAM that uses LLMs as explainers to enhance CGEC small models and a novel evaluation method SEE that utilizes LLM as evaluators to bring more reasonable evaluations. |
| Outcome: | The proposed methods improve the performance of LLMs on Chinese Grammatical Error Correction (CGEC) task. |
Copied to clipboard
| Challenge: | Foundational models and their checkpoints have advanced deep learning, boosting performance across applications. |
| Approach: | They propose a method for pruning fine-tuned models by calculating differences between them and original model. |
| Outcome: | The proposed method can improve performance across vision, NLP, and multi-modal benchmarks. |
Copied to clipboard
| Challenge: | Empirical evidence indicates that Large Language Models exhibit spontaneous cross-lingual alignment in Information Extraction (IE) however, a significant imbalance across languages persists, highlighting an underlying deficiency. |
| Approach: | They propose a code LLM with advanced cross-lingual and multilingual capabilities for universal IE that standardizes the representation of multilingual schemas using Python classes and conducts IE alignment instruction tuning on translated instance prediction task. |
| Outcome: | The proposed model surpasses ChatGPT and SoTA by 30.17% without training in 29 unseen languages and significantly improves cross-lingual IE transferability. |
Copied to clipboard
| Challenge: | Recent approaches to handle large knowledge base decompose tasks into subtasks and solve them sequentially. |
| Approach: | They propose a multi-task learning framework that resolves coreference in conversations . they propose enabling shared supervisions and type-aware entity detection model . |
| Outcome: | The proposed framework improves overall F1 score from 67% to 79% on a large-scale conversational question answering dataset. |
Copied to clipboard
| Challenge: | Existing evaluation benchmarks for long-form speech are limited to limited domains, creating a significant gap with the diverse downstream applications. |
| Approach: | They propose a benchmark that decomposes "long-form speech quality" into specific, disentangled dimensions. |
| Outcome: | The proposed benchmark decomposes “long-form speech quality” into specific, disentangled dimensions. |
Copied to clipboard
| Challenge: | a framework that leverages the visual-language model to select key knowledge retrieved by DPR and answer questions improves performance of the baseline on the open-domain Knowledge-based VQA benchmark, OK-VQA. |
| Approach: | They propose a framework that leverages visual-language models to retrieve related knowledge . they use dense passage retrieval to retrieve knowledge related to visual-linguistics . |
| Outcome: | The proposed framework significantly improves the baseline on the open-domain Knowledge-based VQA benchmark, OK-VQA. |
Copied to clipboard
| Challenge: | Current outcome-centric verification paradigms neglect potential errors in the derivation process. |
| Approach: | They propose a process-aware RLVR training paradigm utilizing verifiers selected via **PRIME**. |
| Outcome: | The proposed approach outperforms the baseline verification paradigm on AIME24, AIME25, and Beyond-AIME models. |
Copied to clipboard
| Challenge: | Autoregressive (AR) language models are a dominant paradigm in the field of parallelism and non-causal modeling. |
| Approach: | They propose a blockwise discrete diffusion model that preserves AR-compatible serving while enabling parallel intra-block generation. |
| Outcome: | The proposed model achieves theoretical speedups over 5 and wall-clock speedup of 2.3 on H200 GPUs in latency-critical regimes. |
Copied to clipboard
| Challenge: | Large Reasoning Models have demonstrated outstanding capabilities in solving complex reasoning tasks by incorporating step-by-step chain-of-thought (CoT) reasoning. |
| Approach: | They evaluate three large reasoning models that perform explicit and coherent reasoning under conflicting objectives and use them to evaluate their performance. |
| Outcome: | The proposed models perform explicit and coherent reasoning before producing their outputs, improving problem-solving and multi-step decision making. |
Copied to clipboard
| Challenge: | Experimental results show that our approach can effectively improve the performance of both the policy model and the reward model. |
| Approach: | They propose to use Monte Carlo Tree Search for both policy model improvement and reward model improvement to bridge it to more subtle open-domain question answering. |
| Outcome: | The proposed approach surpasses existing methods for annotation and training data with fewer data points and achieves better performance in test-time scaling strategies. |
Copied to clipboard
| Challenge: | Existing methods assume that check-in data is complete, overlooking the subjective nature of user behavior, leading to inaccurate capture of user preferences. |
| Approach: | They propose a framework that uses spatial coordinates to augment location completion by transforming geographic coordinates into text. |
| Outcome: | The proposed framework outperforms state-of-the-art methods on three real-world datasets. |
Copied to clipboard
| Challenge: | Large reasoning models exhibit human-like behaviors such as exploration, verification, reflection, and correction. |
| Approach: | They propose a supervised fine-tuning framework for long chain-of-thoughts reasoning . they leverage a difficulty-aware reward model to estimate the learning value of questions . |
| Outcome: | The proposed framework performs fine-tuning on large reasoning models on 10% of the data selected. |
Copied to clipboard
| Challenge: | SciVerse is a multi-modal scientific evaluation benchmark to assess large multi-models . it examines the scientific knowledge comprehension, multi-mod content interpretation and Chain-of-Thought reasoning . authors examine the scientific proficiency of LMMs in scientific domains based on their work . |
| Approach: | They propose a multi-modal scientific evaluation benchmark to thoroughly assess Large Multi-modal Models across 5,735 test instances in five different versions. |
| Outcome: | The proposed evaluation reveals critical limitations in LMMs' scientific proficiency and provides new insights into future developments. |
Copied to clipboard
| Challenge: | Multi-task learning is a popular approach in natural language processing because of its commonalities and differences. |
| Approach: | They propose to summarize recent advances in multi-task learning methods based on their task relatedness into two general multi-step training methods. |
| Outcome: | The proposed methods summarize the tasks and discuss future directions. |
Copied to clipboard
| Challenge: | Despite LLMs' impressive capabilities in musical knowledge, music reasoning remains an unsolved task. |
| Approach: | They propose an open-source large language model (LLM) that integrates intrinsic musical abilities into LLaMA2 and GPT-3.5. |
| Outcome: | The proposed model can understand and generate music with a pure text tokenizer without external multi-modal neural structures or tokenizers. |
Copied to clipboard
| Challenge: | Pretraining and fine-tuning are the dominant paradigms in natural language processing. |
| Approach: | They propose a parameter-efficient multitask learning framework that takes trainable hyper-embeddings and visual modality as input and outputs weights for different modules in a pretrained language model. |
| Outcome: | The proposed framework adds fewer trainable parameters in multi-task learning while achieving superior performances and transfer ability compared to state-of-the-art methods. |
Copied to clipboard
| Challenge: | Existing methods for evaluating item labels fail to leverage scenario-specific information modalities, present redundant information that is visually inferable, and lack latent awareness of users' information needs. |
| Approach: | They propose a principled categorization of information needs into explicit intent satisfaction and proactive information needs and define evaluation metrics for item label selection. |
| Outcome: | The proposed evaluation framework is based on IR-, LLM-, and VLM-based methods across fashion, movie recommendation, and retail shopping scenarios. |
Copied to clipboard
| Challenge: | Existing word embedding methods do not learn numeral embedds well because numerals are limited in number and their appearances in training corpora are highly scarce. |
| Approach: | They propose two numeral embedding methods that can handle the out-of-vocabulary problem for numerals. |
| Outcome: | The proposed methods can handle the out-of-vocabulary problem for numerals. |
Copied to clipboard
| Challenge: | Existing methods for enhancing large language models (LLMs) have achieved some success, but their knowledge understanding and memory capacity significantly degrades after extensive editing. |
| Approach: | They propose a method that stores the basis vectors of the representation space of past edits in a knowledge cache and projects the gradient of the current edit onto a space orthogonal to previous knowledge for updating. |
| Outcome: | The proposed method improves question-answering ability and hallucination mitigation by 14% and 61% for large language models after 3,000 edits. |
Copied to clipboard
| Challenge: | Existing evaluations of LLMs in finance are text-only, monolingual, and largely saturated by current models. |
| Approach: | They propose a multilingual and multimodal benchmark for evaluating LLMs in real financial contexts. |
| Outcome: | The first expert-annotated multilingual and multimodal benchmark is released . it evaluates 21 leading LLMs and shows they perform better in multilingual settings . |
Copied to clipboard
| Challenge: | Recent advances in Vision-Language Models and the scarcity of high-quality multi-modal alignment data have inspired numerous researches on synthetic VLM data generation. |
| Approach: | They propose a multi-modal data construction pipeline that organizes the final output into a Python code format. |
| Outcome: | The proposed pipeline improves visual question answering and visual grounding benchmarks across different VLMs. |
Copied to clipboard
| Challenge: | Generative retrieval models can be used to generate ranked lists of potentially relevant document identifiers for a user query. |
| Approach: | They propose a synthetic data generation strategy for a two-stage training framework that focuses on learning to decode document identifiers from queries and a strategy for mining hard negatives based on initial model's predictions. |
| Outcome: | The proposed model can generate ranked lists of potentially relevant document identifiers for a user query and then refine ranking through preference learning. |
Copied to clipboard
| Challenge: | Multimodal Process Reward Models (MPRMs) have emerged as a pivotal framework for enhancing the reasoning capabilities of Multimodal Large Language Models. |
| Approach: | They propose a benchmark specifically designed to evaluate MPRMs’ proficiency in detecting erroneous reasoning steps across diverse error categories. |
| Outcome: | The proposed model achieves up to 4.8% performance improvement through test-time scaling. |
Copied to clipboard
| Challenge: | Existing retrieval methods divide reference documents into passages, treating them in isolation. Existing methods only use contiguous passages or keywords. |
| Approach: | They propose a retrieval method that leverages graph neural networks to exploit relatedness between passages to enhance retrieval. |
| Outcome: | The proposed method improves retrieval by exploiting the relatedness between passages. |
Copied to clipboard
| Challenge: | Existing embedding-based methods rely on triples in the KG, which is vulnerable to specious relation patterns and long-tail entities. |
| Approach: | They propose a context-enriched framework for KGC that uses a large language model to generate potential answers for each query triple. |
| Outcome: | The proposed framework improves on FB15k237 and WN18RR datasets. |
Copied to clipboard
| Challenge: | Existing models produce similar contents from homogenized contexts due to the fixed left-to-right sentence order. |
| Approach: | They propose a framework permuting sentence orders to improve content diversity of multi-sentence paragraphs by permutating the sentence orders. |
| Outcome: | The proposed framework produces more diverse outputs with higher quality than existing models. |
Copied to clipboard
| Challenge: | Large pre-trained models have improved performance on a variety of natural language processing tasks. |
| Approach: | They develop a bimodal pre-trained model for programming language (PL) and natural language (NL) it incorporates a hybrid objective function that detects replaced tokens from generators. |
| Outcome: | The proposed model performs better on two NL-PL applications by fine-tuning model parameters. |
Copied to clipboard
| Challenge: | Large language models (LLMs) have achieved impressive performance across diverse tasks, but suffer from the "reversal curse" this limitation poses a challenge to the advancement of artificial general intelligence (AGI) |
| Approach: | They propose to use training data to permute training sentences into entities and feed them into the model. |
| Outcome: | The proposed method improves the performance of large language models (LLMs) on reversed questions and improves existing models. |
Copied to clipboard
| Challenge: | Entity Alignment (EA) is a crucial step in unifying data from heterogeneous sources and plays a critical role in data-driven AI applications. |
| Approach: | They propose a framework that incorporates large language models to improve EA. |
| Outcome: | The proposed framework incorporates large language models (LLMs) to improve EA accuracy while preserving efficiency. |
Copied to clipboard
| Challenge: | Existing methods for song generation fail to generate vocals with prompt-based control and proper alignment. |
| Approach: | VersBand is a multi-task song generation framework for synthesizing high-quality songs with prompt-based control. |
| Outcome: | Experimental results show that VersBand performs better than baseline models across multiple song generation tasks. |
Copied to clipboard
| Challenge: | Existing zero-shot singing voice synthesis models depend on phoneme and note boundary annotations, limiting their robustness and producing poor transitions between phonemes and notes. |
| Approach: | They propose a multi-task multilingual zero-shot SVS model with style transfer and style control based on various prompts. |
| Outcome: | Experimental results show that TCSinger 2 outperforms baseline models in subjective and objective metrics across multiple related tasks. |
Copied to clipboard
| Challenge: | Existing Chinese preference datasets suffer from limited scale, restricted domain coverage, and insufficiently rigorous data validation. |
| Approach: | They propose an LLM-based data annotation pipeline with no human intervention to annotate Chinese preference datasets. |
| Outcome: | The proposed pipeline outperforms existing Chinese preference datasets on AlignBench and Chinese Reward Benchmark. |
Copied to clipboard
| Challenge: | XGLUE provides a benchmark dataset to train large-scale cross-lingual pre-trained models . XCLUE provides 11 diversified tasks that cover both understanding and generation scenarios . |
| Approach: | They introduce a new benchmark dataset to train large-scale cross-lingual pre-trained models using multilingual and bilingual corpora. |
| Outcome: | The proposed dataset is labeled in English and includes only natural language understanding tasks. |
Copied to clipboard
| Challenge: | Large Language Models are constrained by limited context windows and lack of persistent memory . recent efforts address these limitations via external memory architectures . |
| Approach: | They propose an end-to-end agentic memory framework for real-time updating and retrieval that integrates hierarchical and temporal indexing layers. |
| Outcome: | The proposed framework outperforms established benchmarks in temporal reasoning, multi-session consistency, and retrieval efficiency. |
Copied to clipboard
| Challenge: | Existing methods that use syntax of text in pre-training and fine-tuning suffer from discrepancy between the two stages. |
| Approach: | They propose a model that utilizes the syntactic structure of text in pre-training and fine-tuning stages. |
| Outcome: | The proposed model achieves state-of-the-art on six public benchmark datasets. |
Copied to clipboard
| Challenge: | Existing benchmarks for AI math tutoring largely overlook these skills. |
| Approach: | They evaluate 12 leading multimodal large language models and find clear performance gaps between them. |
| Outcome: | The proposed benchmarks show that they can solve 770 problems and provide diagnostics and guidance to students step by step. |
Copied to clipboard
| Challenge: | Recent work adapts diffusion models to textual data by diffusing on the embedding space. |
| Approach: | They propose an embedding diffusion model based on Transformer to solve the problem of embeddable space and denoising model. |
| Outcome: | The proposed model is more efficient than previous methods on seminal text generation tasks and is superior to existing models. |
Copied to clipboard
| Challenge: | representativeness and universality of calibration data remain a bottleneck in quantization accuracy. |
| Approach: | They propose a framework that leverages prior knowledge from LLMs to generate calibration samples . their framework reduces accuracy loss by up to 28.5% compared to baseline . |
| Outcome: | Experiments show that family-aware quantization reduces accuracy loss by up to 28.5% compared to baseline data. |
Copied to clipboard
| Challenge: | Existing knowledge editing methods struggle to effectively propagate updates to interconnected facts, limiting the performance of reasoning tasks based on these updated facts. |
| Approach: | They propose a reasoning-based benchmark, ReCoE, which covers six common reasoning schemes in the real world. |
| Outcome: | The proposed reasoning-based benchmark shows that current models struggle to propagate updated knowledge within reasoning schemes. |
Copied to clipboard
| Challenge: | Existing LLM planning benchmarks emphasize local, step-level reasoning rather than global constrained optimization. |
| Approach: | They propose a benchmark for practical long-horizon agent planning that uses local constrained reasoning and global constrained optimization. |
| Outcome: | The proposed benchmarks show that even frontier agentic LLMs struggle with these problems. |
Copied to clipboard
| Challenge: | Existing approaches to scale out spoken language understanding to low-resource languages are noisy. |
| Approach: | They propose a method for mitigating noise in augmented data by training models with augmented datasets. |
| Outcome: | The proposed method outperforms state-of-the-art methods on two benchmark datasets. |
Copied to clipboard
| Challenge: | Existing approaches to large language model (LLM) agents that follow the sequential "reason-then-act" paradigm suffer from limited exploration and incomplete environmental understanding as they interact with only a single environment per step. |
| Approach: | They propose a paradigm that enables an agent to interact with multiple environments simultaneously and share cross-trajectory experiences. |
| Outcome: | The proposed paradigm achieves state-of-the-art (SOTA) success rates while maintaining comparable efficiency to strong sequential baselines. |
Copied to clipboard
| Challenge: | Existing approaches to learn cross-lingual word embeddings in a contextual space are lacking. |
| Approach: | They propose a method to generate cross-lingual contextualized word embeddings using pre-trained BERT models by learning a linear transformation from contextual word alignments. |
| Outcome: | The proposed approach outperforms state-of-the-art models on zero-shot cross-lingual transfer parsing and is highly competitive with existing models. |
Copied to clipboard
| Challenge: | Existing methods for contrastive pre-training ignore the relevance between codes in large code corpus. |
| Approach: | They propose a Soft-labeled contrastive pre-training framework with positive sample construction methods to learn functional-level code representation. |
| Outcome: | The proposed framework can obtain fine-grained soft-labels through an iterative adversarial manner and use them to learn better code representation. |
Copied to clipboard
| Challenge: | Current evaluation methods for large language models rely on static benchmarks . limited knowledge coverage and fixed difficulties hinder the targeted optimizations resulting in superficial evaluations of LLMs - a problem that has been addressed by JudgeAgent . |
| Approach: | They propose a knowledge-driven and dynamic evaluation framework for large language models . judgeAgent leverages LLM agents equipped with context graphs to traverse knowledge structures . |
| Outcome: | The proposed framework can achieve comprehensive evaluations and facilitate effective model iterations. |
Copied to clipboard
| Challenge: | Most modern Information Extraction (IE) systems are implemented as sequential taggers and model local dependencies. |
| Approach: | They propose a framework that operates over a graph representing a broad set of dependencies between textual units. |
| Outcome: | The proposed framework outperforms the state-of-the-art sequence tagging model on three different tasks. |
Copied to clipboard
| Challenge: | Experimental results on mainstream language models show that Evolver outperforms previous state-of-the-art models by large margins due to the high training costs of large language models. |
| Approach: | They propose a method to integrate multiple models from diverse training scenarios into a unified model. |
| Outcome: | The proposed method outperforms state-of-the-art models on mainstream language models by large margins. |
Copied to clipboard
| Challenge: | Recent advances in Large Language Models (LLMs) allow repeatable experiments in which individual characteristics can be precisely defined. |
| Approach: | They propose a scalable experimental paradigm using Large Language Models to simulate multi-stage supply chain dynamics. |
| Outcome: | The proposed model systematically replicates and validates the results of a behavioral simulation on agents in multi-stage supply chain dynamics. |
Copied to clipboard
| Challenge: | Existing knowledge graph completion models only evaluated candidate triples from content information. |
| Approach: | They propose a multi-view classification model where multiple views are performed based on both content and context information for candidate triple evaluation. |
| Outcome: | The proposed model improves on two representative datasets and improves performance. |
Copied to clipboard
| Challenge: | Large language model (LLM) agents execute tasks through multi-step workflows that combine planning, memory, and tool use. |
| Approach: | They propose a modular framework that provides a unified view of backdoor threats in LLM agents. |
| Outcome: | The proposed framework provides a unified, agent-centric view of backdoor threats in LLM agents. |
Copied to clipboard
| Challenge: | Existing sentence ordering datasets for non-English languages are unavailable. |
| Approach: | They propose a parameter-free sentence ordering dataset that provides genuinely unordered sentences without artificial segmentation cues. |
| Outcome: | The proposed method outperforms existing methods on the sentence ordering task. |
Copied to clipboard
| Challenge: | Existing MMEA methods rely on knowledge representation learning (KRL) to measure the similarity of entity embeddings. |
| Approach: | They propose a framework that utilizes the visual reasoning abilities of MLLMs for multimodal entity alignment. |
| Outcome: | The proposed framework integrates the visual reasoning abilities of MLLMs for multimodal entity alignment. |
Copied to clipboard
| Challenge: | linguistic typology has shown great promise in pre-neural parsing, but results for neural architectures have been mixed. |
| Approach: | They explore the task of leveraging typology in the context of cross-lingual dependency parsing. |
| Outcome: | The proposed approach improves performance in the context of cross-lingual dependency parsing. |
Copied to clipboard
| Challenge: | Existing deep research frameworks lack adequate evaluation procedures and stage-specific protections. |
| Approach: | They propose a framework with open-domain evaluation and a stage-wise safety benchmark to address this oversight. |
| Outcome: | The proposed framework improves defense success rates by 16.53% while reducing over-refusal rates to approximately 6%. |
Copied to clipboard
| Challenge: | Existing synthetic data tools are limited by convoluted workflows, fragmented data standards, and limited scalability across modalities. |
| Approach: | They develop an open-source framework that aims to reduce the technical barrier to synthetic data generation and subsequent model training. |
| Outcome: | The proposed framework achieves an optimal balance between generation efficiency and data quality. |
Copied to clipboard
| Challenge: | Existing approaches to hierarchical multi-label text classification ignore vertical category correlations or exploit dependencies across levels without considering horizontal correlations . |
| Approach: | They propose a hierarchical multi-label text classification framework that considers both vertical and horizontal category correlations. |
| Outcome: | The proposed framework improves on real-world HMTC datasets with significant improvements over baselines. |
Copied to clipboard
| Challenge: | Existing approaches to augmented generation ignore the overlap in retrieval results . overlapping content is redundantly represented, affecting the overall efficiency. |
| Approach: | They propose a model-agnostic approach to re-augmented generation that speeds up prefilling and decoding . they propose an instruction-driven module to guide the model to more suitable ways for LLMs . |
| Outcome: | The proposed approach achieves 2.79 and 2.33 times significant acceleration on average for prefilling and decoding respectively while maintaining equal generation quality. |
Copied to clipboard
| Challenge: | Document Information Extraction (DIE) has attracted increasing attention due to its various advanced applications in the real world. |
| Approach: | They propose a multi-modal generation method without predefined label categories for real-world scenarios using a spatial encoder and modal-aware mask module. |
| Outcome: | The proposed method can deal with complex documents that are hard to serialize into sequential order. |
Copied to clipboard
| Challenge: | Large Audio-Language Models (LALMs) are increasingly being deployed in real-world applications, yet their robustness against malicious audio injection remains underexplored. |
| Approach: | They quantitatively assess their vulnerabilities and resilience using metrics: the Defense Success Rate, Context Robustness Score, and Judgment Robustic Index. |
| Outcome: | The proposed models demonstrate significant performance disparities across four attack scenarios. |
Copied to clipboard
| Challenge: | Recent studies show that pre-trained models do not provide all knowledge needed for fine-tuning tasks. |
| Approach: | They propose a framework to achieve graceful forgetting in generative language models by pre-training a model on large-scale correlating datasets. |
| Outcome: | The proposed framework improves the learning plasticity of the target task by selectively discarding irrelevant knowledge. |
Copied to clipboard
| Challenge: | Extensive research shows that noisy data significantly degrades the performance of table reasoning in real-world applications. |
| Approach: | They propose a dual denoising framework for complex questions and large-scale tables that uses Tree-guided table pruning to remove irrelevant data step by step. |
| Outcome: | The proposed framework achieves outstanding performance on TableQA tasks with complex questions and large-scale tables. |