Papers by Jing Yang
Copied to clipboard
| Challenge: | Existing spreadsheet formulas often produce near-miss outputs due to an incorrect function, operator, or reference. |
| Approach: | They propose an abstract syntax tree-based error taxonomy that organizes common error modes by the kind of decision that goes wrong in the parse tree. |
| Outcome: | The proposed framework improves Exact Match (EM) by 6.4 points over supervised fine-tuning and matches self-consistency (SC@5) accuracy. |
Copied to clipboard
| Challenge: | Social media has become a fertile ground for nurturing rumors and misinformation due to its lack of systematic moderation. |
| Approach: | They propose a framework to enhance the joint predictive capabilities of LLMs for stance detection and rumor verification tasks. |
| Outcome: | The proposed framework outperforms state-of-the-art methods and generalizes to non-LLMs accommodated as task models. |
Copied to clipboard
| Challenge: | Diffusion Large Language Models (dLLMs) offer parallel decoding and bidirectional context modeling . aligning dLLms with reinforcement learning (RL) remains a challenge . |
| Approach: | They propose a variational framework that reformulates RL for dLLMs as a distribution matching problem. |
| Outcome: | The proposed framework reformulates RL for dLLMs as a distribution matching problem. |
Copied to clipboard
| Challenge: | Previous work shows that large language models generate hallucinations, yet the origins and mechanisms of these signals remain unclear. |
| Approach: | They propose to validate and disentangle two different pathways for truthfulness cues . they also propose to use the same mechanism to derive self-contained evidence from the generated answer . |
| Outcome: | The proposed applications improve hallucination detection performance by integrating two different inputs. |
Copied to clipboard
| Challenge: | a novel post-training pruning method relies on the Hessian matrix to perform pruning . current pruning methods are computationally intensive and lack performance due to second-order derivative calculations. |
| Approach: | They propose a Hessian-free weight pruning method that reduces computational burden . they use an Exponentially Weighted Moving Average technique to bypass weight sorting . |
| Outcome: | The proposed method achieves hardware-efficient model compression by eliminating computational intensive calculations. |
Copied to clipboard
| Challenge: | Existing safety benchmarks fail to provide reliable assessments due to limited risk coverage, insufficient scale and the oversight of complex modality combinations. |
| Approach: | They propose a framework that covers 61 risk categories across four modality interactions to address this gap. |
| Outcome: | The proposed framework covers 61 risk categories across four distinct modality interactions. |
Copied to clipboard
| Challenge: | Existing models that use knowledge distillation are memory-intensive and latency-prohibitive . Existing solutions that use this knowledge distilling framework are expensive . |
| Approach: | They propose a solution that uses weight pruning, matrix factorization and knowledge distillation to learn a smaller model. |
| Outcome: | The proposed model reduces the training overheads by an order of magnitude on public datasets while preserving state-of-the-art accuracy. |
Copied to clipboard
| Challenge: | a product-related community question answering platform is widely employed in many E-commerce sites . however, the misinformation in the answers on those platforms poses unprecedented challenges for users to obtain reliable and truthful product information. |
| Approach: | They propose a large scale fact checking dataset from product question answering forums to predict the answer veracity . each answer is accompanied by its veraity label and associated evidence sentences . |
| Outcome: | The proposed model outperforms baselines on the question veracity prediction task. |
Copied to clipboard
| Challenge: | Existing works of knowledge infusion depend on multi-task learning frameworks, which are inefficient and require large-scale retraining when new knowledge is considered. |
| Approach: | They propose a method which integrates knowledge-generated attention maps into the self-attention mechanism and integrates it into the model. |
| Outcome: | The proposed model outperforms existing methods on academic datasets and industry-scale ad relevance applications. |
Copied to clipboard
| Challenge: | Existing prototypical networks for named entity recognition suffer from label dependency and tightly distributed prototypes, thus causing misclassifications. |
| Approach: | They propose an Entity-level Prototypical Network enhanced by dispersedly distributed prototypes to build entity-level prototypes and distribute them dispersionally. |
| Outcome: | The proposed system outperforms the previous models on two evaluation tasks and the Few-NERD settings in terms of overall performance. |
Copied to clipboard
| Challenge: | Automated red teaming (ART) is effective but time-consuming, costly and lacks scalability. |
| Approach: | They propose an automated red teaming framework that generates adversarial prompts to expose LLM vulnerabilities. |
| Outcome: | The proposed framework explores and exploits LLM vulnerabilities through multi-round interactions. |
Copied to clipboard
| Challenge: | Emotion recognition in conversation (ERC) is a task arousing increasing interest in many fields. |
| Approach: | They propose a novel GNN-based ERC model that captures speaker and position information. |
| Outcome: | The proposed model captures speaker and position-aware conversation structure information. |
Copied to clipboard
| Challenge: | Existing models with long chain-of-thought reasoning lack reasoning depth and domain-specific utility. |
| Approach: | They propose a model merging framework that integrates reasoning with domain-specific task models. |
| Outcome: | The proposed model merging framework outperforms state-of-the-art models while maintaining robust reasoning performance. |
Copied to clipboard
| Challenge: | Currently, tool-augmented large language models (LLMs) only achieve total scores of 45.3 and 37.0, respectively, on a scale of 100. |
| Approach: | They propose a multi-level diagnostic process to assess the LLM's hallucinations through two perspectives: depth and breadth. |
| Outcome: | The proposed diagnostic process assesses the hallucinations of large language models through two perspectives: depth and breadth. |
Copied to clipboard
| Challenge: | Multimodal large language models often exhibit hallucinations that compromise reliability . despite promising performance, these models often display systematic localization errors . |
| Approach: | They propose a framework that categorizes model predictions into four distinct types . they propose metric that evaluates alignment between semantic continuity and logits distribution . |
| Outcome: | The proposed framework categorizes model predictions into four different types . it reveals nuanced failure modes beyond traditional accuracy metrics . |
Copied to clipboard
| Challenge: | Puns add the challenge of fusing commonsense and world knowledge with the ability to interpret lexical-semantic ambiguity. |
| Approach: | They propose to augment existing datasets with detailed crowdsourced annotations of puns, keywords and fine-grained funniness ratings to challenge current models' ability to understand and generate humor. |
| Outcome: | The proposed tasks include explanation generation to aid with pun classification and keyword-conditioned pun generation to challenge state-of-the-art models' ability to understand and generate humor. |
Copied to clipboard
| Challenge: | Existing models struggle to balance predictive accuracy with human-understandable rationales. |
| Approach: | They propose to enhance LLMs by leveraging rationale distillation and domain knowledge injection for trustworthy multimodal rationale generation. |
| Outcome: | Experiments on real-world medical datasets show that ClinRaGen achieves state-of-the-art performance in disease diagnosis and rationale generation. |
Copied to clipboard
| Challenge: | Recent studies have fine-tuned judge models based on open-source LLMs to evaluate the quality of other LLM. |
| Approach: | They propose to use open-source LLMs to evaluate Large Language Models (LLMs) their empirical results show that the models underperform GPT-4 in several dimensions . |
| Outcome: | The proposed models outperform GPT-4 on several dimensions including generalizability, fairness and adaptability. |
Copied to clipboard
| Challenge: | Multipanel images are a common form of visual representations, and humans can achieve approximately 99% accuracy on these questions. |
| Approach: | They propose a benchmark that tests multipanel visual reasoning models with 6,600 triplets of questions, answers, and multipanel images. |
| Outcome: | The proposed benchmark features 6,600 triplets of questions, answers, and multipanel images that challenge state-of-the-art Multimodal Large Language Models (MLLMs) human users can attain approximately 99% accuracy on these questions, compared with previous benchmarks. |
Copied to clipboard
| Challenge: | Existing psychological counseling datasets suffer from monolithic client personas, insufficient therapeutic depth, and a lack of process controllability. |
| Approach: | They propose a framework that evolves static counseling corpora into high-fidelity dialogues . they use a Client Profiler that pairs life scenarios with psychological personality archetypes based on client personality and stage progression . |
| Outcome: | The proposed framework achieves 61-91% win rates against domain-specific baselines in pairwise evaluation and the highest average score in human evaluation, indicating potential for real-world counseling. |
Copied to clipboard
| Challenge: | Existing studies neglect the ontology of knowledge Graph (KG) embeddings and suffer from the dominance issue of facts over ontologies. |
| Approach: | They propose a framework for hyper-relational KG embeddings that captures the hierarchical ontology and a concept-aware contrastive loss to alleviate the dominance issue. |
| Outcome: | The proposed framework improves on three real-world datasets and shows that it can integrate with other embedding methods and improve link prediction performance. |
Copied to clipboard
| Challenge: | Existing research in multi-hop questions has identified two reasoning modes, but has not investigated how these modes differ during inference. |
| Approach: | They propose a classification metric that compares latent reasoning and factual shortcuts in multi-hop questions. |
| Outcome: | The proposed metric achieves 90% accuracy on the proposed datasets and demonstrates effectiveness in RAG conflict scenarios. |
Copied to clipboard
| Challenge: | Existing fact-checking evaluation methods rely on static datasets and classification metrics, which fail to evaluate justification production and uncover the nuanced limitations of LLMs. |
| Approach: | They propose a framework that adaptively and dynamically assesses LLMs’ fact-checking capabilities by incorporating justification production alongside verdict prediction. |
| Outcome: | Experiments show that the framework differentiates among state-of-the-art LLMs, providing valuable insights into model strengths and limitations in model-centric fact-checking analysis. |
Copied to clipboard
| Challenge: | Existing question answering datasets lack numerical reasoning and reasoning processes . current research on numerical reasoning focuses on simple calculations . |
| Approach: | They propose a conversational and bilingual question answering dataset with numerical reasoning with compound mathematical expressions. |
| Outcome: | The proposed model achieves 55.5 exact match scores while human performance is 89.7. |
Copied to clipboard
| Challenge: | Experimental results show that Transformer Encoder model can't automatically capture word order, so explicit position embeddings are required to be fed into the target model. |
| Approach: | They propose a Transformer-based language model DecBERT that uses a causal attention mask to capture word order. |
| Outcome: | The proposed model improves on the GLUE language understanding benchmark and accelerates the pre-training process. |
Copied to clipboard
| Challenge: | Existing methods for visual-to-music generation lack large-scale, high-quality visual-music paired datasets and lack of direct semantic correspondence between visuals and music. |
| Approach: | They propose a framework that distills Chain-of-Thought reasoning to enable visual-to-music generation without paired data. |
| Outcome: | The proposed framework achieves optimal performance on image-to-music and video-to music tasks. |
Copied to clipboard
| Challenge: | Pre-trained language models like BERT achieve superior performances in various NLP tasks without explicit consideration of syntactic information. |
| Approach: | They propose a plug-and-play framework that incorporates syntax trees into pre-trained Transformers. |
| Outcome: | The proposed framework improves on pre-trained models on natural language understanding datasets and shows that it can be used to train pre-structured neural networks. |
Copied to clipboard
| Challenge: | Existing multimodal machine translation methods often extract visual features using pre-trained models while learning text features from scratch, leading to representation imbalance. |
| Approach: | They propose a cross-modal VQA-augmented multimodal machine translation method . it aligns image-source text pairs and image-question text pairs through dual-text contrastive learning . |
| Outcome: | The proposed method outperforms state-of-the-art methods on multiple evaluation metrics. |
Copied to clipboard
| Challenge: | Existing efforts to mitigate length bias in reward models have decreased accuracy . achieving an automatic proxy that perfectly replicates human judgment is challenging in practice. |
| Approach: | They propose an adaptive approach that dynamically adjusts the influence of response length in reward evaluations according to the context of the query. |
| Outcome: | The proposed approach reduces unnecessary verbosity while improving overall response quality. |
Copied to clipboard
| Challenge: | Existing approaches to identifying inappropriate content require extensive human-labeled data and lack cross-issue generalization. |
| Approach: | They propose a reasoning-enhanced multimodal large language model (MLLM) pretraining paradigm for unified inappropriate content detection. |
| Outcome: | The proposed model improves the MLLM's performance in both zero-shot and supervised fine-tuning settings and shows strong generalization capabilities to emergent, previously unseen issues. |
Copied to clipboard
| Challenge: | Existing models excel at capturing semantic correlations within utterance embeddings but fail to determine specific causal relationships. |
| Approach: | They propose to incorporate i.i.d. noise terms into conversation process to build a structural causal model . they propose to use unstructured conversation data to facilitate deep learning . |
| Outcome: | The proposed approach can be implemented in unstructured conversation data and a synthetic dataset that includes i.i.d. noise. |
Copied to clipboard
| Challenge: | Existing approaches to simulate human clients in mental health counseling are limited and cost prohibitive. |
| Approach: | They propose a framework that supports consistent client simulation for mental health counseling by tracking the mental state of a simulated client, controlling its state transitions, and generating for each state behaviors consistent with the client’s motivation, beliefs, preferred plan to change, and and receptivity. |
| Outcome: | The proposed framework can simulate human clients for mental health counseling tasks and achieve higher consistency than previous methods. |
Copied to clipboard
| Challenge: | Existing benchmarks for musical score understanding are narrow in scope, focusing on isolated fragments, short excerpts, or multiple-choice formulations, rather than supporting holistic reasoning over entire scores. |
| Approach: | They propose a benchmark for score-level musical understanding across textual and visual modalities. |
| Outcome: | The musical score understanding benchmark contains 1,800 question-answer pairs from works by Bach, Beethoven, Chopin, Debussy, and others. |
Copied to clipboard
| Challenge: | Existing approaches to reward modeling in reinforcement learning tasks are limited when dealing with ambiguous preferences. |
| Approach: | They propose to use AAM to dynamically calibrate preference margins using the Bradley-Terry model's internal parameter knowledge to improve reward modeling in subjective tasks. |
| Outcome: | The proposed approach improves reward modeling by dynamically calibrating preference margins using the model’s internal parameter knowledge. |
Copied to clipboard
| Challenge: | Existing methods for evaluating code large language models assume access to proprietary training corpora or use external reference sets with manually tuned, non-generalizable thresholds. |
| Approach: | They propose a framework for self-referential leakage detection for gray-box and black-box settings. |
| Outcome: | The proposed framework improves average F1 by 21.52 points in the gray-box setting and 14.46 points in black-box settings over strong baselines. |
Copied to clipboard
| Challenge: | Current methods for steering large language models rely on prompt engineering or reasoning-time guidance. |
| Approach: | They propose a value-controllable pluralistic alignment framework enhanced with conditioned gating that dynamically directs the flow among multiple experts based on an input value or moral vector. |
| Outcome: | The proposed method outperforms prompt-based steering and multi-task PEFT benchmarks on two 8-billion-parameter backbones. |
Copied to clipboard
| Challenge: | Existing studies on social media use tags to profile users, but we have found that sentence-level self-introductions are more natural and engaging. |
| Approach: | They propose a novel topic-guided encoder-decoder framework that uses a user's tweeting history to generate a short sentence outlining their personal interests. |
| Outcome: | The proposed framework outperforms existing encoder-decoder models on a large-scale Twitter dataset and shows that it is more natural and engaging than previous approaches. |
Copied to clipboard
| Challenge: | Existing methods for debunking fake news rely on blending of authentic and fabricated content by creators. |
| Approach: | They propose a model that detects misinformation at sentence-level using social media conversations . they use a bag-level annotation system to train the model . |
| Outcome: | The proposed model outperforms existing state-of-the-art models on three real-world benchmarks and outperformed existing state of the art models in debunking fake news at sentence and article levels. |
Copied to clipboard
| Challenge: | Neural language models are vulnerable to word-level adversarial text attacks . previous word-based search methods assume important words influence prediction . |
| Approach: | They propose a method for similarizing the influence of words with contrast learning that encourages model to learn sentence representations in which words of varying importance have a more uniform influence on prediction. |
| Outcome: | The proposed method is compatible with various training methods and improves model robustness against various adversarial attacks. |
Copied to clipboard
| Challenge: | Existing reasoning large language models (LLMs) generate responses without explicitly aligning thoughts with counseling techniques, limiting their effectiveness. |
| Approach: | They propose a lightweight thinking model that generates therapeutic thoughts to guide MI counseling agents in strategy selection and response generation. |
| Outcome: | The proposed model achieves theory-of-mind assessment comparable to state-of the-art systems with an order of magnitude less computation. |
Copied to clipboard
| Challenge: | Existing methods for event argument extraction (EAE) lack cross-event information and require longer role sequences . et al. (2017): outperforms state-of-the-art methods for EE. |
| Approach: | They propose a separation-and-fusion paradigm to separate the acquisition of cross-event information and fuse it into the argument extraction of a target event. |
| Outcome: | The proposed model outperforms the state-of-the-art models on four widely used datasets. |
Copied to clipboard
| Challenge: | Deploying large language models (LLMs) for long-context inference remains challenging due to their substantial memory and computational demands. |
| Approach: | They propose an uncertainty-aware framework that leverages truncated matrix entropy to identify areas of low information content. |
| Outcome: | The proposed framework reduces the KV cache size to 4.74% of the original and achieves a 6% speedup. |
Copied to clipboard
| Challenge: | Existing fake news detection models are opaque and lack deductive transparency . a framework for dialectical structured reasoning is proposed to address this limitation . |
| Approach: | They propose a framework that model fake news detection as an explicit dialectical process over multimodal social context. |
| Outcome: | The proposed framework achieves state-of-the-art while producing transparent explanations that mirror human reasoning process. |
Copied to clipboard
| Challenge: | Recent advances in large language models have increased the capabilities of conversational AI to solve challenging dialogue problems. |
| Approach: | They propose a task to verify whether two sets of utterances originate from the same speaker. |
| Outcome: | The proposed task aims to verify whether two sets of utterances originate from the same speaker. |
Copied to clipboard
| Challenge: | Existing studies for named entity recognition focus on flat NER, i.e., without nested entities, by sequence labeling methods. |
| Approach: | They propose a Hierarchical Transformer network which decomposes the input sentence into multi-grained spans and enhances the representation learning in a hierarchical manner. |
| Outcome: | The proposed method achieves much better performance than the state-of-the-art approaches on GENIA, ACE-2004, ace-2005 and NNE datasets. |
Copied to clipboard
| Challenge: | Current evaluation methods for large language models face two key challenges: 1. evaluation validity and 2. Result interpretation reduce the pluralistic and incommensurable values to one-dimensional scores. |
| Approach: | They propose a platform for comprehensive value diagnosis of large language models (LLMs) that provides a generative evaluation paradigm that automatically creates real-world test items co-evolving with ever-advancing LLMs. |
| Outcome: | The proposed platform provides a framework for comprehensive value diagnosis of large language models (LLMs) with fine-grained scores and case studies across 27 value dimensions for 33 leading LLMs, customized comparisons, and visualized analysis of LLM’s alignment with cultural values. |
Copied to clipboard
| Challenge: | Existing methods for fake news detection focus on fact-checked reports, resulting in limited coverage and debunking delays. |
| Approach: | They propose a Coarse-to-fine Cascaded Evidence-Distillation neural network for explainable fake news detection based on raw reports . they use hierarchical encoders and cascaded selectors to select most explainable sentences for verdicts on top of selected top-K reports based upon raw reports. |
| Outcome: | The proposed model outperforms baseline detection methods and generates high-quality explanations from diverse evaluation perspectives. |
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are now commonplace in conversation applications, but their misuse for generating harmful responses has raised serious societal concerns. |
| Approach: | They provide a comprehensive overview of recent studies covering attacks, defenses, and evaluations of Large Language Models (LLMs) . |
| Outcome: | The proposed review summarizes three aspects of LLM conversation safety: attacks, defenses, and evaluations. |
Copied to clipboard
| Challenge: | Existing studies in Emotion Recognition in Conversations (ERC) focus on capturing context-sensitive and speaker-sensitive dependencies, ignoring the unintended dataset biases of data. |
| Approach: | They propose a training-free debiasing framework that extracts biases from the model by generating counterfactual utterances and contexts and mitigates them using simple yet empirically robust element-wise subtraction operations. |
| Outcome: | Experiments on three public datasets show that the proposed framework improves generalization ability and fairness across different ERC models. |
Copied to clipboard
| Challenge: | Recent approaches to language model alignment assume homogeneous human preferences, but actual human preferences vary widely and are hard to satisfy with a single language model. |
| Approach: | They propose an RL-free extension of Direct Preference Optimization (DPO) that folds language modeling directly into reward modeling and trains language models as collective reward models that combine all objectives with specific weights. |
| Outcome: | The proposed method matches or outperforms existing methods in safety alignment and long-form question answering. |
Copied to clipboard
| Challenge: | Existing LLMs are delicate and elusive in prompt words and styles. |
| Approach: | They propose an LLM-acquainted prompting technique that includes proficient "native-speaking" they propose to use in-context learning to prompt LLMs to perform high-performance reasoning . |
| Outcome: | The proposed technique achieves step-wise prompts in zero-shot scenarios while maintaining the prompt quality. |
Copied to clipboard
| Challenge: | Multimodal Machine Translation (MMT) is effective in resolving linguistic ambiguities, but visual information often introduces redundancy or noise, potentially impairing translation quality. |
| Approach: | They propose a semantic-augmented framework that integrates "Imagination" and "Contemplation" they first generate synthetic images from source text and align them with authentic images via an optimal transport loss . |
| Outcome: | The proposed framework outperforms baselines on translation datasets with visually ambiguous or weakly correlated content. |
Copied to clipboard
| Challenge: | Digital media platforms often contribute to cognitive-behavioral fixation, a phenomenon in which users exhibit sustained and repetitive engagement with narrow content domains. |
| Approach: | They propose a multimodal topic extraction module and a cognitive-behavioral fixation quantification module that collaboratively enable adaptive, hierarchical, and interpretable assessment of user behavior. |
| Outcome: | The proposed framework lays the groundwork for scalable computational analysis of cognitive fixation. |
Copied to clipboard
| Challenge: | Experimental results demonstrate that a Pruned interpretable knowledge Graph Learning framework for explainable stance detection is state-of-the-art for social media stance prediction. |
| Approach: | They propose a Pruned interpretable knowledge Graph Learning framework for explainable stance detection that incorporates commonsense knowledge and prunes redundant information to ensure precision and minimize noise. |
| Outcome: | The proposed framework achieves state-of-the-art on three public datasets. |
Copied to clipboard
| Challenge: | Existing benchmarks lack the ability to automatically evaluate from users’ perspective and lack the explainability of the results of LLM agents’ code generation capabilities. |
| Approach: | They propose a new benchmark for LLM agents' automated evaluation by simulating user interaction. |
| Outcome: | The proposed benchmark can evaluate the generated projects by user interaction simulation and by code similarity through existing objective indicators. |
Copied to clipboard
| Challenge: | Existing evaluation protocols for few-shot natural language understanding (NLU) tasks are inconsistent and hinder fair comparison and measuring progress. |
| Approach: | They propose an evaluation framework that improves previous evaluation procedures in three key aspects, i.e., test performance, dev-test correlation, and stability. |
| Outcome: | The proposed framework improves evaluation procedures in three key aspects, i.e., performance, dev-test correlation, and stability. |
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are too large to be fine-tuned with budget constraints and some are only accessible via APIs. |
| Approach: | They propose a pluggable Reward-Driven Contextual Adapter that integrates large language models as generators and trains them to refine the retrieved information. |
| Outcome: | The proposed method improves ReQA performance on three datasets by up to 20% compared to existing methods. |
Copied to clipboard
| Challenge: | Existing RAG watermarking methods are limited in their encoding capacity and potential degradation of performance or knowledge quality. |
| Approach: | They propose knowledge-infused and multi-bit watermarking (KMW) for RAG knowledge bases by benign knowledge completion and a tailored generative watermark algorithm. |
| Outcome: | The proposed method extracts watermarks from adversarial RAGs while remaining stealthy and secure. |
Copied to clipboard
| Challenge: | Cultural norms are behavioral rules and conventions shared within specific groups, connecting cultural symbols and values. |
| Approach: | They propose a task that operationalizes cultural variations in language understanding through a natural language inference task that surfaces cultural variations as label disagreement between annotators from different cultural groups. |
| Outcome: | The proposed model can be evaluated at which levels it is culturally aware. |
Copied to clipboard
| Challenge: | rumor detection has been reshaped by large language models (LLMs) this paper proposes a Cognition-Interaction-Behavior (CIB) framework for rumour detection based on collective intelligence . |
| Approach: | They propose a Cognition-Interaction-Behavior framework for rumor detection based on collective intelligence and explore synergistic relationship between LLMs and collective intelligence in rumour governance. |
| Outcome: | The proposed framework unifies existing methods and reveals synergistic relationship between LLMs and collective intelligence in rumor governance. |
Copied to clipboard
| Challenge: | Long, multi-round, multirole interaction trajectories lead to severe information dilution and context window overload, triggering context collapse which destabilizes reasoning. |
| Approach: | They propose a multi-agent framework that compresses and reorganizes multi-round consensus. |
| Outcome: | The proposed framework outperforms baselines across text-based and multimodal tasks while demonstrating superior diagnostic performance and stability in complex clinical scenarios. |
Copied to clipboard
| Challenge: | Existing methods to recommend quotes are evaluated on unpublished datasets . |
| Approach: | They propose to build a dataset that is open and contains three parts including English, standard Chinese and classical Chinese. |
| Outcome: | The proposed model outperforms existing methods on all three parts of QuoteR. |
Copied to clipboard
| Challenge: | Multi-Agent Systems (MAS) are expensive due to static panel designs, where all N agents communicate at every T round. |
| Approach: | They propose an economic framework that transforms agent selection into a dynamic resource allocation game. |
| Outcome: | The proposed system reduces token consumption by over 25% on challenging benchmarks while reducing token consumption. |
Copied to clipboard
| Challenge: | Recent work uses Large Language Models (LLMs) for semantic parsing to address Knowledge Base Question Answering tasks. |
| Approach: | They propose a framework that augments reasoning capabilities of LLMs with Graph Structures in Knowledge Base Question Answering to retrieve question-related graph structures. |
| Outcome: | The proposed framework outperforms existing methods on GrailQA and WebQSP under the few-shot setting. |
Copied to clipboard
| Challenge: | Compositional Zero-Shot Learning (CZSL) is a new research paradigm that learns sub-concepts from seen compositions and recognizes unseen novel combinations. |
| Approach: | They propose a Dual-Modal Semantic Disentanglement framework that integrates visual and textual information to achieve effective sub-concept disentangling. |
| Outcome: | The proposed framework achieves state-of-the-art performance on three benchmark datasets . it integrates a class-centroid bridge module to guide class centroids toward the textual space . |
Copied to clipboard
| Challenge: | Distant supervision uses triple facts to label corpus for relation extraction, leading to wrong labeling and long-tail problems. |
| Approach: | They propose a model to enrich distantly-supervised sentences with entity types by injecting context-free and -related backgrounds into sentences to alleviate sentence-level wrong labeling. |
| Outcome: | The proposed model achieves state-of-the-art on benchmarks and in overall and long-tail performance. |
Copied to clipboard
| Challenge: | Existing sequential LLMs cannot be directly applied to DLMs, as their generation order is arbitrary. |
| Approach: | They propose a stability-aware constraint that allows watermarking only in stable contexts and a bit-controlled, unbiased modulation to preserve the original DLM output distribution. |
| Outcome: | The proposed scheme achieves stable watermarking with minimal quality impact while maintaining high detection accuracy and multi-bit capacity. |
Copied to clipboard
| Challenge: | Existing work on large reasoning models (LRMs) focuses on using reinforcement learning (RL) to train hybrid reasoning models that automatically decide whether to engage in thinking or not based on the complexity of the query. |
| Approach: | They propose to use reinforcement learning to train hybrid reasoning models that automatically decide whether to engage in thinking or not based on the complexity of the query. |
| Outcome: | The proposed model reduces token usage by around 50%$ compared to DeepSeek-R1-Distill-Qwen-1.5B/7B and DeepScaleR-1.5b, while significantly improving accuracy. |
Copied to clipboard
| Challenge: | Existing approaches to handle wrong labeling and long-tail relations are labor-intensive and scarce training data. |
| Approach: | They propose a neural network to handle wrong labeling and long-tail relations by collaborating relation-augmented attention. |
| Outcome: | The proposed neural network improves the state-of-the-art on the NYT dataset . |
Copied to clipboard
| Challenge: | Existing methods for rumor detection are limited to the strict relation of user responses or oversimplify the conversation structure. |
| Approach: | They propose a method that reinforces interaction of user opinions while reducing negative impact imposed by irrelevant posts. |
| Outcome: | The proposed method improves performance on three Twitter datasets and can detect rumors at early stages. |
Copied to clipboard
| Challenge: | Existing work on front-end code generation fails to provide visual fidelity and rendering quality for front- end developers. |
| Approach: | They propose a three-stage pipeline to enhance front-end code generation capabilities in LLMs . they use synthetic data, quality-controlled supervised fine-tuning, and reinforcement learning . |
| Outcome: | The proposed model achieves competitive performance with frontier models while maintaining generation efficiency. |
Copied to clipboard
| Challenge: | Social networks are rife with noise and misleading information, presenting multifaceted challenges for rumor detection. |
| Approach: | They propose a new multi-task learning framework that mines latent intentions and rumor semantic features . they propose to use event-level and intent-level strategies to establish cognitive anchors . |
| Outcome: | The proposed framework improves the effectiveness of rumor detection and addresses the challenges present in the field. |
Copied to clipboard
| Challenge: | Experimental results show that dual encoders outperform sparse and dense retrievers on the BEIR dataset significantly. |
| Approach: | They challenge belief that bottleneck layer is too limited for out-of-domain generalization . they scale up the model while keeping bottleneck as a single dot-product with a fixed size . |
| Outcome: | The proposed model outperforms sparse and dense retrievers on the BEIR dataset significantly. |
Copied to clipboard
| Challenge: | Existing methods for idiomatic expression generation lack parallel data and manual annotations. |
| Approach: | They propose an iterative LLM-SLM collaborative framework that replaces human supervision for idiomatic expression data generation. |
| Outcome: | The proposed framework outperforms DeepSeek-R1 in Chinese Idiom Polishing with a 25.2% improvement in accuracy. |
Copied to clipboard
| Challenge: | a survey of older adults shows that many LLMs mishandle elderly-specific contextual risks. |
| Approach: | They propose a framework to assess elderly-specific contextual risks in LLM interactions . they use a taxonomy to identify 50 fine-grained risk types across mental well-being, financial, medical, toxicity, and privacy domains . |
| Outcome: | a new framework assesses elderly-specific contextual risks in LLM interactions . it achieves 96.2% and 90.9% unsafe-prompt detection accuracy, respectively . |
Copied to clipboard
| Challenge: | Existing researches on conversation-based QA focus on document-based tasks . current researche focuses on document based tasks, but there is a lack of researche on conversation based qa . |
| Approach: | They propose a multi-span extraction model on conversation-based QA and introduce continual pre-training and multi-task learning schemes to further improve model performance. |
| Outcome: | The proposed model outperforms baseline on two Chinese datasets and will be released for research purposes. |
Copied to clipboard
| Challenge: | Metaphors are pervasive in communication, making them crucial for natural language processing. |
| Approach: | They propose a multicultural multimodal metaphor dataset designed for cross-cultural studies of metaphor in Chinese and English. |
| Outcome: | The proposed model improves metaphor comprehension across cultural backgrounds and cultural domains. |
Copied to clipboard
| Challenge: | Existing methods for learning complex sentences with multiple aspects are ill-equipped to learn complex sentences . |
| Approach: | They propose a mutual enhanced transformation network for the ABSA task . it improves representation learning of the aspect with contextual semantic features . |
| Outcome: | The proposed model improves representation learning of the aspect with contextual semantic features, giving the aspect more abundant information. |
Copied to clipboard
| Challenge: | Existing retrieval-augmented approaches focus on ignoring the structural information of the Knowledge Base (KB) and the question. |
| Approach: | They propose a structure-aware subgraph retrieval stage that ranks candidate subgraphs by aligning them with the question’s structure, along with semantic relevance. |
| Outcome: | Experiments on GrailQA, WebQSP, and GraphQuestions show that the proposed framework achieves state-of-the-art performance. |
Copied to clipboard
| Challenge: | Existing work evaluates approximate unlearning under a retrieval paradigm, where adversaries attempt to extract residual knowledge given partial information of the unlearning target. |
| Approach: | They propose a framework to evaluate unlearning membership attacks using member inference techniques to exploit the forget set. |
| Outcome: | The proposed framework assesses whether unlearning leaves behind detectable artifacts that can be exploited to infer membership in the forget set. |
Copied to clipboard
| Challenge: | Existing methods for storytelling lack coherence and consistency, compromising the overall storytelling experience. |
| Approach: | They propose a novel approach that improves the coherence and consistency of automatically generated stories by managing plot nodes and enabling dynamic interactions between different parts of the story. |
| Outcome: | The proposed approach outperforms existing methods in 84.33% of the trials. |
Copied to clipboard
| Challenge: | Existing benchmarks for extracting structured procedural knowledge from unstructured business documents are limited by simplistic schemas and shallow logical dependencies. |
| Approach: | They propose a framework for extracting structured procedural knowledge from unstructured business documents . they propose BREX, a carefully curated benchmark comprising 409 real-world business documents and 2,855 expert-annotated rules . |
| Outcome: | The proposed framework outperforms standard prompts in rule extraction and execution. |
Copied to clipboard
| Challenge: | Existing link prediction techniques focus on learning the complex relationships between entities and relations while ignoring the multimodal information. |
| Approach: | They propose a fact-centric fusion technique that captures complex interactions between different data modalities while accommodating the hyper-relational structure of the KG in a facts-centric manner. |
| Outcome: | The proposed technique improves on two real-world KG datasets by 6.0-6.8% over baselines. |
Copied to clipboard
| Challenge: | Multi-label classification (MLC) faces persistent challenges from label imbalance, spurious correlations, distribution shifts, especially in rare label prediction. |
| Approach: | They propose a Causal Cooperative Game framework that models multi-player cooperative process for multi-label classification. |
| Outcome: | The proposed framework improves rare label prediction and overall robustness compared to baselines. |
Copied to clipboard
| Challenge: | In this paper, we introduce Holistic Semantic Embedding and Global Contrast (HS-GC) to learn the instance- and cluster-level representations. |
| Approach: | They propose a novel loss function that exploits different layers of semantic information in a deep neural network to provide a more holistic semantic text representation. |
| Outcome: | The proposed model outperforms the state-of-the-art model on five text datasets and improves clustering accuracy of 5.9% and 3.2% on the StackOverflow and TREC datasets. |
Copied to clipboard
| Challenge: | Existing studies have shown that Large Language Models (LLMs) memorize long sequences verbatim, with serious copyright and privacy implications. |
| Approach: | They develop a framework to study verbatim memorization in a controlled setting by continuing pre-training from Pythia checkpoints with injected sequences. |
| Outcome: | The proposed framework creates a control model M () and a treatment model M with injected sequences. |
Copied to clipboard
| Challenge: | Neural networks are vulnerable to adversarial examples, i.e., under a black-box scenario. |
| Approach: | They propose a word-level search algorithm that searches for subareas under dynamic search space following the subarea importance. |
| Outcome: | The proposed algorithm can achieve comparable success rates to complex search methods while saving numerous queries and time. |
Copied to clipboard
| Challenge: | Existing methods for named entity recognition ignore visual context bias . NER is a key component of many information extraction tasks . |
| Approach: | They propose to use a multimodal interaction module to generate word-aware visual representations and leverage purely text-based entity span detection as an auxiliary module to guide the final predictions. |
| Outcome: | The proposed approach achieves state-of-the-art on two benchmark datasets. |
Copied to clipboard
| Challenge: | Social event detection relies on labeled data, but annotation is costly and labor-intensive. |
| Approach: | They propose a plug-and-play dual augmentation framework that combines explicit text-based and implicit feature-space augmentation to enhance data diversity and model robustness. |
| Outcome: | The proposed framework outperforms the best baseline model by 17.67% on the Twitter2012 dataset and 15.57% on the twitter2018 dataset in terms of the average F1 score. |
Copied to clipboard
| Challenge: | TableLLM is a robust large language model capable of handling tabular data manipulation tasks. |
| Approach: | They propose a distant supervision method for training which includes a reasoning process extension strategy and a cross-way validation strategy. |
| Outcome: | The proposed model has 8 billion parameters and is capable of handling tabular data tasks. |
Copied to clipboard
| Challenge: | Masked Discrete Diffusion Models (MDMs) enable parallel generation via iterative refinement, but their current decoding paradigms are static and myopic. |
| Approach: | They propose a Regret-Aware Confidence Calibration framework that aligns decoding decisions with the model’s latent self-correction capabilities. |
| Outcome: | The proposed framework aligns decoding decisions with model’s latent self-correction capabilities. |
Copied to clipboard
| Challenge: | Existing methods for extractive text summarization do not consider multiple types of inter-sentential relationships, nor model intra-sententential relationships. |
| Approach: | They propose a novel method to combine different types of relationships among sentences and words to model sentence embedding. |
| Outcome: | The proposed model is compared with existing methods on CNN/DailyMail benchmark dataset to demonstrate its effectiveness. |
Copied to clipboard
| Challenge: | Existing knowledge graphs lack robustness and incompleteness to provide link prediction. |
| Approach: | They propose to capture prior schema-level interactions related to relations by leveraging entity type information and introduce schema-guided negatives to bolster the efficiency of normal contrastive representation learning. |
| Outcome: | The proposed method achieves state-of-the-art performance on multiple established metrics across multiple datasets for link prediction. |
Copied to clipboard
| Challenge: | Existing methods to improve pre-trained language models for many-class classification suffer from verbalizer ambiguity . a significant disparity exists between the pre-training and fine-tuning stages of the model . |
| Approach: | They propose a method to tune pre-trained language models to a broad spectrum of tasks . they use an instance-dependent soft prefix to complement language verbalizers in many-class classification . |
| Outcome: | The proposed method outperforms baselines on many-class datasets. |
Copied to clipboard
| Challenge: | Large Language Models (LLMs)-based agents have fundamentally reshaped artificial intelligence . however, the inherent statelessness of LLMs hinders their ability to maintain logical consistency across complex, multi-step tasks . |
| Approach: | They propose a framework for LLM agent memory mechanisms that formalizes the development process into three stages: storage, reflection, and experience. |
| Outcome: | The proposed framework breaks the development process into three stages . it analyzes the need for long-range consistency, challenges in dynamic environments, and the ultimate goal of continual learning. |
Copied to clipboard
| Challenge: | Existing evaluation methods rely on external evaluators, focusing on training and prompting strategies, but model-aware glass-box features are overlooked. |
| Approach: | They propose to use model-aware glass-box features to evaluate an LLM's output. |
| Outcome: | The proposed model-aware features are reliable quality indicators for self-evaluation on public benchmarks. |
Copied to clipboard
| Challenge: | Large language models excel at processing unstructured data, but integrating time series data with text remains a challenge. |
| Approach: | They propose a self-supervised multimodal framework that uses prompt-guided learning to unify heterogeneous data types. |
| Outcome: | The proposed framework outperforms state-of-the-art approaches on disease diagnosis tasks using real-world datasets. |
Copied to clipboard
| Challenge: | Motivational Interviewing (MI) is a client-centered counseling technique designed to address ambivalence and facilitate behavior change in clients. |
| Approach: | They propose to use a STAR framework to evoke change talk by using large language models to assess MI skill competency, client’s state inference accuracy, topic exploration proficiency, and overall counseling success. |
| Outcome: | The proposed agent outperforms several state-of-the-art methods and shows more realistic counselor-like behavior. |
Copied to clipboard
| Challenge: | Existing studies show that stronger models are not always optimal teachers, suggesting a mismatch between the teacher’s output and the student’s learning ability. |
| Approach: | They propose a method that routes each prompt to its optimal teacher via a query-level router that jointly considers the student models’ learnability and teacher models’ response quality. |
| Outcome: | The proposed method outperforms baselines on six benchmarks including instruct tuning and math reasoning settings. |
Copied to clipboard
| Challenge: | Fill-in-the-Middle (FIM) models suffer from performance degradation and prohibitive latency. |
| Approach: | They propose a search-and-replace infilling framework that integrates agentic verification and editing into a single-pass inference process. |
| Outcome: | The proposed framework harmonizes completion tasks with the instruction-following priors of Chat LLMs, extending the paradigm from static infilling to dynamic context-aware editing. |
Copied to clipboard
| Challenge: | Idioms condense complex semantics into fixed phrases, making idiom comprehension a test of metaphor competence. |
| Approach: | They propose a method to evaluate the metaphor competence of LLMs for the idiom understanding task: the Consistency Rating of Semantic Transparency (CR-ST). |
| Outcome: | The proposed method assesses the difficulty of understanding idioms through two dimensions: overall semantic transparency and constituent semantic transparency, aiming to gauge LLMs’ mastery of metaphor competence. |
Copied to clipboard
| Challenge: | Persona prompting (PP) is increasingly used to steer large language models towards user-specific generation, but its effect on rationales remains underexplored. |
| Approach: | They examine how LLM-generated rationales vary when conditioned on different demographic personas . they use word-level rationale annotations to measure agreement with human annotations based on PP . |
| Outcome: | The proposed model improves classification on the most subjective task, but fails to align with real-world demographic counterparts. |
Copied to clipboard
| Challenge: | Neural language models have demonstrated impressive performance but remain vulnerable to word-level adversarial attacks. |
| Approach: | They propose two standardized search spaces to address the problem of word-level adversarial attacks. |
| Outcome: | The proposed search spaces improve performance and trade-offs in different scenarios. |
Copied to clipboard
| Challenge: | Existing rumor detection methods are poor at detecting false rumors about breaking news or trending topics due to the lack of training data and prior knowledge. |
| Approach: | They propose an adversarial contrastive learning framework to detect false rumors by adapting features learned from well-resourced rumor data to that of the low-resource. |
| Outcome: | The proposed framework improves on two low-resource datasets and shows superior performance . it overcomes restriction of domain and/or language usage and improves robustness . |
Copied to clipboard
| Challenge: | a new task for context-situated pun generation uses a given context to generate puns . human evaluation shows that 69% of top retrieved pun words can be used to generate context-based puns. |
| Approach: | They propose a task where puns are generated based on contextual keywords and pun words. |
| Outcome: | The proposed system generates successful puns 31% of the time given a plausible tuple of context words and pun pairs. |
Copied to clipboard
| Challenge: | Recent results show pre-trained language models (LMs) can improve machine reading comprehension (MRC) Experimental results indicate that KT-NET offers significant and consistent improvements over BERT . |
| Approach: | They propose a method that leverages external knowledge bases to improve machine reading comprehension (MRC) KT-NET employs an attention mechanism to select desired knowledge from KBs and fuses selected knowledge with BERT to enable context- and knowledge-aware predictions. |
| Outcome: | The proposed model outperforms baseline models on ReCoRD and SQuAD1.1 benchmarks and ranks 1st on the ReCoDR and SQUAD1.1 leaderboards. |
Copied to clipboard
| Challenge: | Bank Question corpus is a corpus for sentence semantic equivalence identification (SSEI) because of rich expressions in natural languages, SSEI is really a challenging task. |
| Approach: | They propose to cluster 120,000 question pairs from 1-year online bank custom service logs into stacks by the Word Mover’s Distance (WMD) based Affinity Propagation algorithm to achieve questions with the same intent. |
| Outcome: | The proposed method achieves questions with the same intent by clustering deduplicated questions into stacks by the Word Mover’s Distance (WMD) based Affinity Propagation (AP) algorithm. |
Copied to clipboard
| Challenge: | Generative AI has demonstrated unprecedented creativity in the field of computer vision, yet such phenomena have not been observed in the realm of literary creation. |
| Approach: | They propose a framework for unleashing the creativity of large language models (LLMs) they assign LLMs to different roles involved in real-world scenario, they write . |
| Outcome: | The proposed framework outperforms baselines in terms of coherence, relevance, interestingness and overall quality on automatically generated screenplays. |
Copied to clipboard
| Challenge: | Existing lightweight approaches to retrieval-augmented generation fail to capture latent semantic connections between disjoint entities. |
| Approach: | They propose a lightweight RAG framework that constructs a hypergraph capturing both structure and semantic relationships using a hybrid structural-semantic retrieval mechanism. |
| Outcome: | EHRAG outperforms state-of-the-art methods on four datasets while maintaining zero token consumption. |
Copied to clipboard
| Challenge: | Large language models (LLMs) have demonstrated remarkable capabilities across a wide spectrum of tasks, but performance and reliability in certain specialized domains still fall short of expectations. |
| Approach: | They propose a unified generalist framework that facilitates seamless integration of multiple expert LLMs. |
| Outcome: | The proposed framework outperforms existing multi-LLM collaboration paradigms across six diverse expert domains. |
Copied to clipboard
| Challenge: | Existing neural firststage retrieval models overcome lexical gap issue by projecting query and document to a shared dense space. |
| Approach: | They propose a multi-stage framework for neural passage retrieval using synthetic data, negative sampling, and fusion techniques. |
| Outcome: | The proposed framework improves retrieval accuracy and enhances the negative contrast in both stages. |
Copied to clipboard
| Challenge: | Existing interpretation methods fail to obtain faithful attributions on these models, thereby failing to reveal potential flaws and biases. |
| Approach: | They propose a Contrastive learning regularization method which calibrates the sentence representation of out-of-distribution examples and utilizes adversarial examples to introduce direction information in regularization. |
| Outcome: | The proposed method alleviates the model pathology while impacting generalization ability on in-distribution examples and thus helps interpretation methods obtain more faithful results. |
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have demonstrated remarkable capabilities across various tasks but their performance in complex logical reasoning tasks remains unsatisfactory. |
| Approach: | They propose a propositional logic prompting method which generates expanded logical information descriptions and utilizes them as an additional augmentation to original contexts. |
| Outcome: | Extensive experiments show that Logic-of-Thought boosts the performance of various prompting methods with a striking margin across five logical reasoning tasks. |
Copied to clipboard
| Challenge: | Existing methods for text data augmentation are limited to simple tasks and weak baselines. |
| Approach: | They propose a data augmentation method FlipDA that uses a generative model and a classifier to generate label-flipped data. |
| Outcome: | The proposed method improves many tasks while not negatively affecting the others. |
Copied to clipboard
| Challenge: | Multimodal machine translation (MMT) models focus on intermodal interactions, but focus on simple interactions between nouns and entities in image, overlooking global semantic alignment. |
| Approach: | They propose a Text-Image In-depth Questioning method to deepen interactions and optimize translations by utilizing visual data to capture global semantic alignment. |
| Outcome: | The proposed method achieves state-of-the-art results on five translation directions of Multi30K and AmbigCaps, with +2.35 BLEU on the challenging MSCOCO benchmark. |
Copied to clipboard
| Challenge: | Generative modeling has been the dominant approach for large-scale pretraining and zeroshot generalization. |
| Approach: | They propose a discriminator that predicts whether a text sample comes from the true data distribution and which option has the highest probability of coming from the real data distribution. |
| Outcome: | The proposed discriminative approach outperforms GANs on a number of NLP tasks by 16.0%, 7.8%, and 11.5% respectively. |