Papers by Feng Jiang
Copied to clipboard
| Challenge: | Existing methods for large reasoning models have improved efficiency but still face limitations such as conflicting objectives and limited adaptability. |
| Approach: | They propose an adaptive reasoning framework that applies a uniform, computation-intensive deep reasoning strategy to all problems. |
| Outcome: | The proposed framework reduces the average response length of DeepSeek-R1-Distill-Qwen-7B by 54.9% while improving accuracy by up to 4.8% on five mathematical datasets. |
Copied to clipboard
| Challenge: | Recent neural models for data-to-text generation rely on parallel pairs of data and text to learn writing knowledge. |
| Approach: | They propose to enhance neural models with external knowledge to improve fidelity of generated text. |
| Outcome: | The proposed model improves on Wikipedia infobox-to-text datasets on 21 datasets. |
Copied to clipboard
| Challenge: | Existing benchmarks rely heavily on text-based evaluation and largely ignore paralinguistic cues such as prosody, emotion, and speaker traits. |
| Approach: | They propose a speech-native benchmark for evaluating instruction-following S2S models with explicit assessment of both semantic understanding and paralinguistic expression. |
| Outcome: | The proposed system enables more natural, robust, and human-aligned speech agents. |
Copied to clipboard
| Challenge: | Current multimodal large language models (MLLMs) show limited understanding of dental images. |
| Approach: | They propose a dental-specialized multimodal large language model trained via staged multimodal alignment and reinforcement learning. |
| Outcome: | The proposed model outperforms state-of-the-art models on disease classification and dental VQA tasks. |
Copied to clipboard
| Challenge: | Large language models (LLMs) are a powerful tool for high-performance inference serving. |
| Approach: | They focus on system-aware KV infrastructure for serving LLMs . they analyze cross-behavior co-design affinity and behavior-objective links . |
| Outcome: | The proposed key-value (KV) cache is crucial for low-latency, high-throughput LLM inference serving. |
Copied to clipboard
| Challenge: | Discourse structure analysis is an important research topic in natural language processing. |
| Approach: | They propose to construct a macro discourse structure framework and annotate 147 Newswire articles. |
| Outcome: | The proposed framework can lay the foundation for further analysis of macro discourse structure. |
Copied to clipboard
| Challenge: | Music information retrieval (MIR) is a field that aims at developing computational tools for processing, organizing, and accessing music data. |
| Approach: | They propose a framework that aligns music modalities with multilingual text in a shared representation space. |
| Outcome: | Experiments show CLaMP 3 performs state-of-the-art on multiple MIR tasks . it surpasses baselines and shows excellent generalization in multimodal and multilingual contexts . |
Copied to clipboard
| Challenge: | Existing user simulators lack authenticity and user-level diversity in interactions with large language models. |
| Approach: | They propose a user simulator with implicit user profiles that infers user profiles from human-machine interactions to simulate personalized and realistic dialogues. |
| Outcome: | The proposed framework outperforms baselines in authenticity and diversity while maintaining comparable consistency. |
Copied to clipboard
| Challenge: | extending grouping-based methods to agentic reasoning presents unique challenges . frequent environment interactions and tool invocations render intra-group advantage estimation unstable . |
| Approach: | They propose a grouping-based method that uses a single round of rollouts to stabilize advantage estimation. |
| Outcome: | a new RL framework outperforms grouping-based methods in retrieval tasks and advanced mathematical reasoning benchmarks. |
Copied to clipboard
| Challenge: | Current research on AES focuses on scoring the overall quality or single trait of prompt-specific essays. |
| Approach: | They propose a hierarchical multi-task trait scorer to evaluate quality of writing . they propose an inter-sequence attention mechanism to enhance information interaction . |
| Outcome: | The proposed model outperforms several strong models on ACEA and outperformed other models. |
Copied to clipboard
| Challenge: | TexSmart supports fine-grained named entity recognition (NER) Large-scale fine-granular entity types are expected to provide richer semantic information for downstream NLP applications. |
| Approach: | They introduce TexSmart, a text understanding system that supports fine-grained named entity recognition (NER) and enhanced semantic analysis functionalities. |
| Outcome: | The proposed system supports fine-grained named entity recognition (NER) and enhanced semantic analysis functions. |
Copied to clipboard
| Challenge: | Mainstream approaches to aligning large language models heavily rely on human preference data. |
| Approach: | They propose a framework that fine-tunes a policy model using pairwise feedback data automatically mined from its outputs. |
| Outcome: | The proposed framework outperforms the base model with an average win rate of 69.7% across seven conversational or instruction-following datasets. |
Copied to clipboard
| Challenge: | Existing methods to prune Pre-trained Language Models (PLMs) are overparameterized and require fine-tuning. |
| Approach: | They propose a pruning method that uses first-order pruning to prune PLMs while fine-tuning the remaining weights. |
| Outcome: | The proposed method outperforms first-order pruning and zero-order methods at sparsity levels. |
Copied to clipboard
| Challenge: | Existing methods for idea generation either trivially prompt LLMs or expose LLM to extensive literature without indicating useful information. |
| Approach: | They propose a chain-of-ideas agent that organizes literature in a chains structure . they propose evaluating idea-generation methods from different perspectives . |
| Outcome: | The proposed agent outperforms existing methods and matches human quality in idea generation. |
Copied to clipboard
| Challenge: | Existing methods on discourse parsing in English suffer from long discourse units and fewer explicit connectives. |
| Approach: | They propose to use two reading modes to construct Chinese paragraph level discourse trees. |
| Outcome: | The proposed model outperforms baselines on Chinese discourse trees. |
Copied to clipboard
| Challenge: | Existing studies focus on data selection but lack a clear, unified framework . variability in experimental settings complicates systematic comparisons . |
| Approach: | They propose a three-stage scheme to standardize data selection for fine-tuning large language models . they propose unified comparison approach that incorporates ratio-based efficiency and ranking-based feasibility metrics to address inconsistencies across experiments. |
| Outcome: | The proposed scheme outperforms existing methods in a dozen key studies and identifies key challenges. |
Copied to clipboard
| Challenge: | Pretrained large language models excel in a variety of natural language processing tasks . however, they pose significant security risks due to their tendency to memorize training data . |
| Approach: | They propose a method to estimate LLM memorization using dynamic, prefix-dependent soft prompts. |
| Outcome: | The proposed method can achieve maximum relative improvement of 135.3% and 39.8% over baseline compared to state-of-the-art methods. |
Copied to clipboard
| Challenge: | Existing taxonomies are mainly constructed by experts or through crowd-sourcing, making the process time-consuming, labor-intensive, and restricted in coverage. |
| Approach: | They propose a method that leverages large language models to capture taxonomic structure . existing taxonomies are mainly constructed by experts or through crowd-sourcing . |
| Outcome: | Experiments on five real-world domains show that CodeTaxo outperforms state-of-the-art methods. |
Copied to clipboard
| Challenge: | Existing approaches to understanding tables rely on textual inputs and table images are difficult to access in real-world scenarios. |
| Approach: | They propose a multimodal table understanding problem where the model needs to generate correct responses to various table-related requests based on the given table image. |
| Outcome: | The proposed model outperforms open-source MLLMs on 23 benchmarks under held-in and held-out settings. |
Copied to clipboard
| Challenge: | Existing concept reasoning related datasets suffer from modeledge leakage and context leakage. |
| Approach: | They propose a concept reasoning for large language models with modeledge leakage prevention and context leakage preventive methods to improve the models' conceptual reasoning abilities. |
| Outcome: | The proposed method significantly improves the existing models and reasoning methods, achieving a 7% increase in accuracy compared to CoT and showing better granularity. |
Copied to clipboard
| Challenge: | Existing methods for dialog routing are mostly heuristic and cannot achieve high-quality performance. |
| Approach: | They propose a multi-task learning framework with a dialog encoder and two tailored gated mechanism modules to solve this problem. |
| Outcome: | The proposed model can play the role of hierarchical information filtering and is non-invasive to existing dialog systems. |
Copied to clipboard
| Challenge: | a novel framework for automated legal interpretation is proposed to alleviate the burden on legal experts. |
| Approach: | They propose a framework for automated legal interpretation that uses large language models to extract concept-related information and interpret legal concepts. |
| Outcome: | The proposed framework eliminates the need for legal experts to interpret legal concepts . it uses large language models to extract concept-related information and interpret legal concept interpretations . |
Copied to clipboard
| Challenge: | Existing factuality-oriented abstractive summarization models only consider the integration of factual information and ignore the causes of factuual errors. |
| Approach: | They propose a factuality-oriented abstractive summarization model that can identify the causes of factual errors. |
| Outcome: | The proposed model outperforms state-of-the-art models in factual metrics. |
Copied to clipboard
| Challenge: | Existing methods for medical vision-language models overlook modality misalignment . HSCR generates high-quality preference data with higher sampling probability . |
| Approach: | They propose a hierarchical self-contrastive reward approach that addresses two challenges in alignment . they leverage the inherent capability of Med-VLMs to generate dispreferred responses . |
| Outcome: | The proposed approach improves accuracy and trustworthiness of medical vision-label models with 2,000 training entries. |
Copied to clipboard
| Challenge: | Recent language generative models are mostly trained on large-scale datasets, while in some real scenarios, the training datasets are often expensive and would be small-scale. |
| Approach: | They propose a novel duality fine-tuning method to capture more information from limited data and build connections between tasks. |
| Outcome: | The proposed method can capture more information from limited data, build connections between separate tasks, and is suitable for less-data constrained generation tasks. |
Copied to clipboard
| Challenge: | Existing metrics lack the granularity and interpretability to capture nuanced clinical differences between candidate and ground-truth radiology reports. |
| Approach: | They propose a tabular framework with E**xpert-curated labels and an attribute-level comparison for radiology report evaluation (**CLEAR) |
| Outcome: | The proposed framework can extract clinical attributes and provide automated metrics that are strongly aligned with clinical judgment. |
Copied to clipboard
| Challenge: | Modern pre-trained language models are mostly built upon stereotyped development sets . LV-BERT model obtained by our method outperforms BERT on various downstream tasks . |
| Approach: | They propose to exploit layer variety from the layer type set and the layer order to improve pre-trained models. |
| Outcome: | The proposed model outperforms BERT and its variants on various downstream tasks. |
Copied to clipboard
| Challenge: | Experimental results show that the distilled language model outperforms its teacher model (ChatGPT) in most cases. |
| Approach: | They propose a Large Language Model (LLM) that leverages both distilled data from **ChatGPT** and real-world data from**doctors** in the supervised fine-tuning stage. |
| Outcome: | The proposed model outperforms the teacher model in most cases by using additional real-world data and RLMF to align the language model with the merits of both sources. |
Copied to clipboard
| Challenge: | Information retrieval (IR) is an indispensable technique for locating relevant resources from vast amounts of data. |
| Approach: | They propose a framework that facilitates information refinement through synergy between RMs and LLMs. |
| Outcome: | The proposed framework improves the performance of large-scale retrieval benchmarks on web searches and low-resource retrieval tasks. |
Copied to clipboard
| Challenge: | Large Vision-Language Models (LVLMs) have impressive multimodal abilities but remain prone to multilingual object hallucination. |
| Approach: | They propose a cross-lingual attention intervention method to mitigate multilingual object hallucination in LVLMs by aligning attention patterns. |
| Outcome: | The proposed method improves 13.56% (up to 30%) on the POPE and 21.75% on the hallucination subsets across languages. |
Copied to clipboard
| Challenge: | Discourse analysis is becoming increasingly important in the field of natural language processing. |
| Approach: | They propose to annotate macro discourse information and additional discourse information to make annotation more objective and accurate. |
| Outcome: | The results show that the annotations are more objective and accurate than the previous ones. |
Copied to clipboard
| Challenge: | Recent work on neural machine translation (NMT) has demonstrated impressive performance improvements and became the de-facto standard. |
| Approach: | They propose a dynamic curriculum learning method to reorder training samples in training using a Transformer-based system. |
| Outcome: | The proposed method outperforms baselines on three low-resource machine translation benchmarks and different sized data of WMT’16 En-De. |
Copied to clipboard
| Challenge: | a frozen GPT can generate state-of-the-art performance on perfect pinyin, but performance drops when input includes abbreviated pinyan, which links to even larger number of Chinese characters. |
| Approach: | They propose to use Chinese GPT to generate fluent sentences using abbreviated pinyin. |
| Outcome: | The proposed approach improves on abbreviated pinyin across all domains. |
Copied to clipboard
| Challenge: | Existing Plan-and-Solve prompting methods are difficult to implement for complex questions. |
| Approach: | They propose a plan-and-solve prompting method based on Question Decomposition Meaning Representation (QDMR) it allows LLM to generate a QDMR graph to represent problem-solving logic . |
| Outcome: | The proposed method can represent and execute the problem-solving logic of complex questions more accurately than existing methods. |
Copied to clipboard
| Challenge: | Recent advances in large language models (LLMs) have shown an unprecedented ability across various language tasks. |
| Approach: | They propose to use prompts and LoRA fine-tuning to improve slot filling robustness . they propose a linearised knowledge injection scheme to integrate dynamic external knowledge into LLMs. |
| Outcome: | The proposed model improves slot filling with noisy ASR transcriptions with 6.7% and 17.6% absolute SLU-F1 improvements compared to a fully fine-tuned Flan-T5-XL model. |
Copied to clipboard
| Challenge: | Existing neural semantic parsing methods for knowledge base question answering are lacking . a generic and extensible framework is lacking for KBQA. |
| Approach: | They propose a neural semantic parsing framework for large scale knowledge base question answering . they propose 'retriever-transducer-checker' framework that provides a retriever and a transducer . |
| Outcome: | The proposed framework is ranked at top1 overall performance on the GrailQA leaderboard and achieves competitive performance on typical WebQuestionsSP benchmark. |
Copied to clipboard
| Challenge: | Existing methods to train retrieval-based dialogue systems are suboptimal . existing methods to optimize retrieval and rerank modules are sub-optimal, causing sub-optimum performance. |
| Approach: | They propose a retrieval-based dialogue system with a fast retriever and a smart response reranker that combine the best of both worlds. |
| Outcome: | The proposed method can learn from each other and evolve together . it can be used in industrial applications and has powered industrial applications. |
Copied to clipboard
| Challenge: | Existing solutions to supervise the reasoning process are prohibitively expensive. |
| Approach: | They propose a cost-effective reinforcement learning framework that enhances reasoning quality using a small, general-purpose LLM only. |
| Outcome: | Experiments show that CLARity improves reasoning quality by 16.5% over standard outcome-based reinforcement learning (RL) human evaluations confirm substantial gains in factual correctness and reasoning coherence, leading to more trustworthy model outputs. |
Copied to clipboard
| Challenge: | Existing approaches to Visual Question Answering (VQA) answer questions directly, but people usually decompose a complex question into a sequence of simple sub questions. |
| Approach: | They propose a conversation-based VQA framework that decomposes questions into sub questions and answers them one-by-one. |
| Outcome: | The proposed framework achieves state-of-the-art on VQA 2.0 and VQA-CP v2 datasets. |
Copied to clipboard
| Challenge: | Proprietary models such as GPT-4, Claude, Gemini-Pro and others are being democratized to improve evaluations of LLMs. |
| Approach: | They propose a framework that is free from referencing groundtruth annotations for investigating **Misinformation Oversight Bias**, **Gender Bia**,**Authority Bia* and **Beauty Bia's** on LLM and human judges. |
| Outcome: | The proposed framework investigates **Misinformation Oversight Bias**, **Gender Bia**,**Authority Bia* and **Beauty Bia' on LLM and human judges. |
Copied to clipboard
| Challenge: | Existing methods for integrating internal and external knowledge lack effective control mechanisms for generating hallucinations and dealing with outdated knowledge. |
| Approach: | They propose a framework that decouples, identifies, and purposefully optimizes parameter subspaces related to adherence and robustness. |
| Outcome: | The proposed framework decouples, identifies, and purposefully optimizes parameter subspaces related to adherence and robustness. |
Copied to clipboard
| Challenge: | Existing methods for integrating knowledge graphs with LLMs suffer from poor generalization or low reasoning efficiency. |
| Approach: | They propose a thought-action Graph (TAG) that decomposes LLM-KG interaction trajectories into fine-grained semantic operators and guides LLM to execute on them. |
| Outcome: | The proposed paradigm outperforms state-of-the-art methods on KGQA benchmarks while reducing the number of LLM calls and generated tokens. |
Copied to clipboard
| Challenge: | Recent efforts to democratize ChatGPT have focused on leveraging real user and ChatGPP dialogues, but the most direct human needs are often ignored. |
| Approach: | They propose a method to simulate human behavior better by using real human-like questions extracted from real human conversations as a learning goal and a user simulator called ‘Socratic’. |
| Outcome: | The proposed model achieves SoTA performance among LLaMA-based 7B models in MT-Bench. |
Copied to clipboard
| Challenge: | Contemporary document ranking methods focus on transforming documents into passages to handle long inputs, but intensive query-irrelevant content may lead to harmful distraction and high query latency. |
| Approach: | They propose a fine-grained attention alignment approach to jointly optimize a cascade document ranking model. |
| Outcome: | Experiments on MS MARCO and TREC DL show that the proposed method is effective in document ranking tasks. |
Copied to clipboard
| Challenge: | Existing models for charge prediction are sensitive, selective, and presumption of innocence . a recent study has shown that deep learning models can predict the charges accurately, but their reliability and interpretability are still underexplored. |
| Approach: | They propose that trustworthy charge prediction models should take legal theories into consideration . they propose three principles for trustworthy models to follow in this task . |
| Outcome: | The proposed framework evaluates whether existing models learn legal theories . it shows that models meet selective and presumption of innocence principles . |
Copied to clipboard
| Challenge: | Existing evaluations of LLMs in finance are text-only, monolingual, and largely saturated by current models. |
| Approach: | They propose a multilingual and multimodal benchmark for evaluating LLMs in real financial contexts. |
| Outcome: | The first expert-annotated multilingual and multimodal benchmark is released . it evaluates 21 leading LLMs and shows they perform better in multilingual settings . |
Copied to clipboard
| Challenge: | Existing reasoning-oriented LLMs lack a blind self-thinking paradigm . current models fail to recognize when their reasoning is underinformed or based on ambiguous user instructions . |
| Approach: | They propose a new reasoning paradigm that transforms LLMs into proactive inquirers that interleave reasoning with clarification. |
| Outcome: | The proposed model outperforms baseline models on mathematical reasoning, code generation, and document editing. |
Copied to clipboard
| Challenge: | Existing video QA models lack the capacity for deep video understanding and flexible multistep reasoning. |
| Approach: | They propose a video question answering model which performs dynamic multistep reasoning between questions and videos. |
| Outcome: | The proposed model improves on three widely used video QA datasets and displays better interpretability by backtracing along with the attention mechanisms to the video scene graphs. |
Copied to clipboard
| Challenge: | Existing RL-based search agents rely on stochastic exploration, leading to inefficient reasoning trajectories and unstable training. |
| Approach: | They propose a framework to enhance the performance and training stability of search agents by transforming raw reasoning trajectories into hierarchical experience knowledge. |
| Outcome: | The proposed framework exhibits strong cross-task and cross-algorithm generalizations on multiple complex agentic search and mathematical reasoning benchmarks. |
Copied to clipboard
| Challenge: | Large pre-trained models have improved performance on a variety of natural language processing tasks. |
| Approach: | They develop a bimodal pre-trained model for programming language (PL) and natural language (NL) it incorporates a hybrid objective function that detects replaced tokens from generators. |
| Outcome: | The proposed model performs better on two NL-PL applications by fine-tuning model parameters. |
Copied to clipboard
| Challenge: | Compared with sentence-level topic structure, paragraph-level topics can grasp and understand the context of a document from a higher level. |
| Approach: | They propose a hierarchical paragraph-level topic structure representation with three layers to guide corpus construction. |
| Outcome: | The proposed method achieves the largest Chinese paragraph-level topic structure corpus, achieving high quality. |
Copied to clipboard
| Challenge: | Existing methods for generating draft tokens rely on lightweight draft models or additional model structures to generate tokens and retrieve context from databases. |
| Approach: | They propose to use a pruning method to enhance model-based speculative decoding by combining the best-fit model with the best retrieval tree. |
| Outcome: | The proposed method achieves state-of-the-art inference acceleration across tasks such as DocQA, Summary, Code, and In-Domain QA. |
Copied to clipboard
| Challenge: | Existing evidence suggests that LLMs are not able to detect scientifically unsound work from malicious or poorly designed research agents. |
| Approach: | They develop a framework that evaluates whether fabrication-oriented paper generation agents can deceive multi-model LLM review systems. |
| Outcome: | The proposed framework shows that fabricated papers achieve acceptance rates up to 18% . the framework shows only marginal improvements, with detection accuracy barely exceeding random chance. |
Copied to clipboard
| Challenge: | Experimental results show the effectiveness of AirRAG on complex question-answering datasets. |
| Approach: | They propose a new thinking pattern that integrates autonomous strategic planning with efficient reasoning actions. |
| Outcome: | The proposed approach significantly activates intrinsic reasoning capabilities and expands the solution space of specific tasks via Monte Carlo Tree Search. |
Copied to clipboard
| Challenge: | Discourse parsing is a challenging task and plays a critical role in discourse analysis. |
| Approach: | They propose a macro discourse structure presentation schema to present the macro level discourse structure analysis. |
| Outcome: | The proposed corpus is based on two tasks of macro discourse structure analysis, including structure identification and nuclearity recognition. |
Copied to clipboard
| Challenge: | Existing large language model evaluation benchmarks focus on English, while current multilingual tasks lack parallel questions that specifically assess cross-lingual reasoning abilities. |
| Approach: | They propose a comprehensive benchmark covering 29 languages, built on an English benchmark. |
| Outcome: | The MMLU-ProX is a comprehensive benchmark covering 29 languages, built on an English benchmark. |
Copied to clipboard
| Challenge: | Existing Chinese preference datasets suffer from limited scale, restricted domain coverage, and insufficiently rigorous data validation. |
| Approach: | They propose an LLM-based data annotation pipeline with no human intervention to annotate Chinese preference datasets. |
| Outcome: | The proposed pipeline outperforms existing Chinese preference datasets on AlignBench and Chinese Reward Benchmark. |
Copied to clipboard
| Challenge: | Large Language Models (LLMs) provide a great breakthrough in medicine, says a new study . existing studies on LLMs leverage subjective evaluation, but evaluation in medicine is professional . |
| Approach: | They propose a localized medical benchmark in Chinese rooted in native Chinese . they propose to use traditional Chinese medicine to evaluate large-scale LLMs . |
| Outcome: | a new benchmark is developed to evaluate large-scale LLMs in china . the proposed model is rooted in the native Chinese linguistic and cultural framework . |
Copied to clipboard
| Challenge: | Existing efforts focus on activation within ongoing dialogues, while overlooking a key real-world bottleneck. |
| Approach: | They propose a conversation starter generation system that generates personalized starters to guide users into conversation without explicit user intent. |
| Outcome: | The proposed system improves user active days by +1.84 and click-through rate by +94.25 and has been deployed in production. |
Copied to clipboard
| Challenge: | Concept sememe tree is a hierarchical structure that represents lexical meaning by combining sememes and their relationships. |
| Approach: | They introduce a Neighbor Semantic Structure (NSS) and a Chain-of-Thought prompting method to evaluate the effectiveness of various Large Language Models (LLMs) in generating concept sememe trees. |
| Outcome: | The proposed method guides LLMs through an analysis of a term’s intrinsic core concepts, essential attributes, and semantic relationships, enabling the generation of concept sememe trees. |
Copied to clipboard
| Challenge: | Existing methods for reinforcement learning (RL)-based agents struggle with long-horizon planning and strategy coherence. |
| Approach: | They propose a reinforcement learning framework that decouples planning and execution. |
| Outcome: | The proposed framework outperforms baseline and first-step RL frameworks on four benchmarks. |
Copied to clipboard
| Challenge: | Diffusion large language models generate text through iterative denoising with bidirectional attention, enabling richer contextual dependencies. |
| Approach: | They propose a training-free parallel decoding method that fuses Trace Credit with current logits to boost the confidence of correct but underconfident tokens. |
| Outcome: | The proposed method achieves 5.48 times speedup with +0.48 accuracy on LLaDA-8B and is orthogonal to mainstream inference optimizations. |
Copied to clipboard
| Challenge: | Existing approaches to learn dialogue discourse parsing with related tasks require additional annotation, thus limiting their generality. |
| Approach: | They propose a multitasking framework that integrates dialogue discourse parsing with addressee recognition to reflect relation-based structure of dialogue. |
| Outcome: | The proposed framework outperforms baselines on the Molweni and STAC datasets. |
Copied to clipboard
| Challenge: | Large Language Models (LLMs) exhibit severe hallucinations, which undermine reliability of automated scientific document understanding systems. |
| Approach: | They propose a framework for mitigating scientific measurement hallucinations through enhanced reasoning and targeted optimization. |
| Outcome: | The proposed framework significantly reduces hallucination rates and improves overall accuracy on the MeasEval benchmark. |
Copied to clipboard
| Challenge: | Existing methods for agentic reinforcement learning rely on sparse outcome-based reward for training, leading to suboptimal results. |
| Approach: | They propose an agent-based reward model that produces structured feedback for agentic trajectories, including an explicit reasoning trace and a focused critique. |
| Outcome: | The proposed model produces structured feedback for agentic trajectories including an explicit reasoning trace, a focused critique, and an overall score that evaluates process performance. |
Copied to clipboard
| Challenge: | Existing methods for fact checking textual statements are not yet available. |
| Approach: | They propose a neural network approach capable of leveraging logical operations for fact checking . they use a textual statement and semi-structured tables to generate a program from it . |
| Outcome: | The proposed approach achieves state-of-the-art performance on TABFACT dataset . it derives a program (a.k.a. logical form) of the statement in semantic parsing manner . |
Copied to clipboard
| Challenge: | Existing self-play approaches to developing general reasoning in language models rely on terminal game outcomes. |
| Approach: | They propose a game-based reasoning transfer model that addresses two barriers to reasoning transfer. |
| Outcome: | The proposed model improves mathematical reasoning, general reasoning, and code generation benchmarks. |
Copied to clipboard
| Challenge: | Document-level Relation Extraction (DocRE) aims to identify the relations between entities in a given document. |
| Approach: | They propose a document-level relation extraction model with two modules to model mention-level relations. |
| Outcome: | The proposed model outperforms existing state-of-the-art models on two public DocRE datasets and outperformed existing models. |
Copied to clipboard
| Challenge: | Existing approaches to large language model (LLM) agents that follow the sequential "reason-then-act" paradigm suffer from limited exploration and incomplete environmental understanding as they interact with only a single environment per step. |
| Approach: | They propose a paradigm that enables an agent to interact with multiple environments simultaneously and share cross-trajectory experiences. |
| Outcome: | The proposed paradigm achieves state-of-the-art (SOTA) success rates while maintaining comparable efficiency to strong sequential baselines. |
Copied to clipboard
| Challenge: | Recent large-scale datasets specify that external knowledge is required to answer questions. |
| Approach: | They propose a model that leverages external knowledge to construct sub-graphs for entities in machine comprehension context. |
| Outcome: | The proposed model achieves state-of-the-art performance on the ReCoRD dataset. |
Copied to clipboard
| Challenge: | Large language models have shown remarkable capability in many downstream tasks, yet their ability to understand discourse structures of dialogues remains less explored. |
| Approach: | They aim to systematically inspect ChatGPT’s performance in two discourse analysis tasks: topic segmentation and discourse parsing. |
| Outcome: | The proposed model can give more reasonable topic structures than human annotations but only linearly parses the hierarchical rhetorical structures. |
Copied to clipboard
| Challenge: | Existing methods to detect and correct spelling errors in Chinese take external input or just heuristic rules. |
| Approach: | They propose to incorporate phonological and visual similarity knowledge into Chinese language models by using a specialized graph convolutional network. |
| Outcome: | The proposed method outperforms existing models on three human-annotated datasets. |
Copied to clipboard
| Challenge: | Existing approaches to augment large language models with external knowledge suffer from a lack of calibration regarding the model’s knowledge boundary. |
| Approach: | They propose a reinforcement learning framework that explicitly aligns retrieval decisions with quantified knowledge states. |
| Outcome: | The proposed framework outperforms strong baselines while exhibiting reduced hallucination rates. |
Copied to clipboard
| Challenge: | Existing approaches to combine HE and GC in RNNs suffer from long inference latency due to the slow activation functions. |
| Approach: | They propose a hybrid structure of HE and GC gated recurrent unit network, for low-latency secure inferences. |
| Outcome: | The proposed structure improves the secure inference latency by up to 138 over one of the state-of-the-art secure networks on the Penn Treebank dataset. |
Copied to clipboard
| Challenge: | Existing methods for aspect-based sentiment classification have focused on English text, but Chinese is a language derived from pictographs and different from other phonetic languages. |
| Approach: | They propose to use a logographic image to capture internal morphological structure from character sequence . they propose to explicitly incorporate a symbolic image with review text for sentiment classification . |
| Outcome: | The proposed method improves over baselines and improves on existing methods. |
Copied to clipboard
| Challenge: | Existing approaches to map construction and map repair are limited by context constraints and inconsistencies in text processing environments. |
| Approach: | They propose a framework for LLM-driven construction and map repair . it detects, localizes, and corrects structural inconsistencies in incremental navigation graphs . |
| Outcome: | The proposed method significantly improves map correctness and robustness in entangled or chained inconsistencies. |
Copied to clipboard
| Challenge: | Large language model (LLM) agents execute tasks through multi-step workflows that combine planning, memory, and tool use. |
| Approach: | They propose a modular framework that provides a unified view of backdoor threats in LLM agents. |
| Outcome: | The proposed framework provides a unified, agent-centric view of backdoor threats in LLM agents. |
Copied to clipboard
| Challenge: | examining the behaviors of Large Language Models as artificial social actors is underexplored, especially in unverifiable scenarios where conventional benchmarking has little to help improve their abilities. |
| Approach: | They propose a method to collect, compare, and reason about human and LLMs' decisions in an unverifiable scenario and use it to examine their behaviors. |
| Outcome: | The proposed method compared human and LLM decisions in an unverifiable scenario on GitHub and found that proprietary LLMs behave more like humans than open-source LLM systems. |
Copied to clipboard
| Challenge: | Existing large language models can perform abstract reasoning tasks but are they actually engaging in rule-based reasoning beyond mere memorization? |
| Approach: | They propose a method to examine whether large language models perform abstract reasoning . they fine-tune the model to learn those contradictory rules and assess its generalization ability . |
| Outcome: | The proposed approach examines whether large language models perform abstract reasoning by altering their original understanding of fundamental rules. |
Copied to clipboard
| Challenge: | Existing approaches to improve social intelligence of AI systems employ retrospective attributions and lack theoretical grounding. |
| Approach: | They propose a framework that uses Shapley values to ensure fair credit distribution with axiomatic guarantees of efficiency, symmetry, and marginality. |
| Outcome: | The proposed framework matches or exceeds proprietary models including GPT-4o and Claude-3.5-Sonnet. |
Copied to clipboard
| Challenge: | Existing methods for named entity disambiguation are weak for short text . performance of existing methods drops dramatically for short texts . |
| Approach: | They propose a knowledge-enhanced method for named entity disambiguation . they use factual knowledge graph and conceptual knowledge graph to provide additional knowledge . |
| Outcome: | The proposed method achieves significant improvement on a large manually annotated short-text dataset and the state-of-the-art on three standard datasets. |
Copied to clipboard
| Challenge: | Existing methods of implicit discourse relation recognition (IDRR) focus on three aspects: enhancing discourse units representation, enhancing semantic interaction, and joint learning with other tasks. |
| Approach: | They propose a joint model to recognize the relation label and generate the target sentence containing the meaning of relations simultaneously. |
| Outcome: | The proposed model achieves the best performance against several state-of-the-art systems on Chinese and English datasets. |
Copied to clipboard
| Challenge: | Concept Bottleneck Models (CBMs) map visual representations to a set of humanunderstandable textual concepts, which are then interpreted by a linear combination of these concept scores. |
| Approach: | They propose a dynamic, agent-based approach that adjusts the concept bank in response to environmental feedback, optimizing the number of concepts for sufficiency yet concise coverage. |
| Outcome: | The proposed model improves classification accuracy by 6% and interpretability assessments by 30%. |
Copied to clipboard
| Challenge: | Existing generative methods overlook grammatical structure or make factual mistakes in generated texts. |
| Approach: | They propose a template-based method to ensure the readability of generated type descriptions . they also propose measurable metrics to measure the readibility of the generated type description . |
| Outcome: | The proposed method improves substantially compared with baselines and achieves state-of-the-art performance on both datasets. |
Copied to clipboard
| Challenge: | Existing methods to generate adversarial examples for relation classification are vulnerable to adversarials. |
| Approach: | They propose a method that uses most important parts of speech to substitute words with synonyms or hyponyms to generate adversarial texts of high quality. |
| Outcome: | The proposed method can generate adversarial texts of high quality and most relationships can be correctly identified in the process of human evaluation. |