Papers by Wenjie Wang
Copied to clipboard
| Challenge: | Extensive experiments on seven semantic textual similarity tasks show our method achieves consistent improvement over the contrastive learning baseline and sets new states of the art. |
| Approach: | They propose a whitening-based contrastive learning method for sentence embedding learning which combines contrastive and shuffled group whitening. |
| Outcome: | The proposed method achieves better alignment and uniformity on seven semantic textual similarity tasks. |
Copied to clipboard
| Challenge: | Recent advances in large generative models have catalyzed a paradigm shift in content generation to Personalized Generation (PGen). |
| Approach: | They propose a multi-level taxonomy that systematically formalizes PGen's key components, core objectives, and abstract workflows. |
| Outcome: | The proposed taxonomy bridging PGen research across multiple modalities highlights open challenges and promising directions for future exploration. |
Copied to clipboard
| Challenge: | Query-focused summarization has been considered as an important extension for text summarizing . lack of large-scale datasets hinders its development . |
| Approach: | They propose to integrate text summarization and question answering into a prefix-based pretraining strategy for few-shot learning in query-focused summarizing. |
| Outcome: | The proposed prefix-based pretraining outperforms fine-tuning on query-focused summarization. |
Copied to clipboard
| Challenge: | generative search engines rely on in-line citations as the key gateway to original webpages . a recent study shows that LLMs tend to cite left-leaning sources at higher rates compared to traditional retrieval systems . |
| Approach: | They construct a dataset of news articles labeled with left- or right-leaning stances . they find that LLMs tend to cite left-leansing sources at higher rates than traditional retrieval systems . |
| Outcome: | The proposed dataset shows that LLMs tend to cite left-leaning sources at higher rates than traditional retrieval systems. |
Copied to clipboard
| Challenge: | Existing methods for linking knowledge graphs lack contextual information in entity neighborhoods, which leads to false prediction results. |
| Approach: | They propose a Schema-augmented Multi-level contrastive LEarning framework to conduct knowledge graph link prediction using a knowledge graph schema. |
| Outcome: | The proposed framework is based on a knowledge graph schema and is compared against state-of-the-art datasets. |
Copied to clipboard
| Challenge: | Existing safety mechanisms for Large Language Models (LLMs) are inadequate to protect against jailbreak attacks, resulting in performance degradation on general tasks. |
| Approach: | They propose a method that directly updates a minimal set of relevant parameters to neutralize harmful behaviors while preserving the model’s utility. |
| Outcome: | The proposed model outperforms baseline methods in mitigating jailbreak attacks while preserving the model’s utility. |
Copied to clipboard
| Challenge: | Existing studies construct attack prompts via manual or automatic methods, but these methods have limitations on cost and quality. |
| Approach: | They propose an attack framework to instruct LLMs to mimic human-generated prompts through in-context learning and a defense framework that fine-tunes victim LLM's through iterative interactions with the attack framework. |
| Outcome: | The proposed approach is based on experiments on different LLMs to evaluate their effectiveness against red teaming attacks. |
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are vulnerable to "jailbreaking" attacks where crafted prompts manipulate them into producing toxic content. |
| Approach: | They propose to improve the target loss objective by combining a cosine decay schedule method with refusal suppression to achieve higher success rates. |
| Outcome: | The proposed approach outperforms baseline attacks and achieves state-of-the-art attack success rates. |
Copied to clipboard
| Challenge: | Counterfactual training is expensive because of the complexity of tabular data. |
| Approach: | They propose a hypothetical training framework that uses paired examples with different hypothetical questions to supervise the direction of model gradient towards the counterfactual answer change. |
| Outcome: | The proposed framework improves on tabular MRC datasets. |
Copied to clipboard
| Challenge: | With the rapid development of large language models, personalized large language model assistants like ChatGPT are limited in personalized services. |
| Approach: | They propose a plug-and-play framework that could facilitate personalized large language model assistants with evolving conditional memory. |
| Outcome: | The proposed framework can preserve the knowledge and experience from the history dialogue with the user, which can be applied to future tailored responses that better align with the users' preferences. |
Copied to clipboard
| Challenge: | Existing reward models evaluate empathy from a single perspective, overlooking bidirectional interaction nature of empathy. |
| Approach: | They propose a reward model that evaluates empathy from a single perspective . they propose PERM to integrate a bystander perspective to monitor overall interaction quality . |
| Outcome: | a new reward model outperforms state-of-the-art models on an emotional intelligence benchmark and an industrial daily conversation dataset. |
Copied to clipboard
| Challenge: | Tuning language models for dialogue generation has been a prevalent paradigm for building capable dialogue agents. |
| Approach: | They propose a multi-round interactive dialogue tuning framework that models the speaker roles of agent and user separately. |
| Outcome: | The proposed framework performs superior to fine-tuning and improves dialogue consistency. |
Copied to clipboard
| Challenge: | Existing approaches to personalized text generation rely on retrieval-augmented generation and parameter-efficient fine-tuning. |
| Approach: | They propose a training-free framework that disentangles and represents personalized writing style as a vector in LLM’s activation-space. |
| Outcome: | The proposed framework achieves 8% relative improvement in personalized generation while reducing storage requirements by 1700 over PEFT method. |
Copied to clipboard
| Challenge: | Existing RAG methods suffer from a two-part problem: semantic drift and concatenation fallacy . et al.: rapid development of Large Language Models has led to a paradigm shift in artificial intelligence . |
| Approach: | They propose a multi-agent retrieval augmentation framework guided by medical domain knowledge to address these challenges. |
| Outcome: | The proposed framework outperforms existing general RAG baselines on five widely used medical benchmarks. |
Copied to clipboard
| Challenge: | Adversary-aware DPO (ADPO) is a training framework that explicitly considers adversary. |
| Approach: | a new framework integrates adversarial training into a pre-trained large language model to enhance safety alignment . adversary-aware DPO provides a framework that explicitly considers adversary . |
| Outcome: | a new training framework outperforms baselines in safety alignment and general utility of large language models. |
Copied to clipboard
| Challenge: | Existing approaches to empathetic response generation only consider causalities between the user’s emotion and the user's experiences and neglect interdependence among causalities and reason them independently. |
| Approach: | They propose to use a conditional variable Graph Auto-Encoder to reason all plausible causalities interdependently and simultaneously given the user’s emotion, dialogue history, and future dialogue content. |
| Outcome: | The proposed method achieves state-of-the-art in a real-world situation. |
Copied to clipboard
| Challenge: | Semantic parsing aims to transform natural language utterances into formal meaning representations (MRs) whereas an NL generator achieves the reverse, the two tasks are often studied separately. |
| Approach: | They propose a method of dual information maximization to regularize the learning process by matching the joint distributions of p and q of NLs. |
| Outcome: | The proposed method empirically maximizes the variational lower bounds of expected joint distributions of NL and MRs. |
Copied to clipboard
| Challenge: | Entity bias affects pretrained (large) language models, causing them to rely on (biased) parametric knowledge to make unfaithful predictions. |
| Approach: | They propose a structured causal model whose parameters are easier to estimate . they propose to perturb the original entity with neighboring entities . |
| Outcome: | The proposed model reduces biasing information pertaining to the original entity while still preserving sufficient semantic information from similar entities. |
Copied to clipboard
| Challenge: | Existing methods to improve reasoning abilities of Large Language Models (LLMs) have limitations due to excessive growth in context length, causing large hardware burden. |
| Approach: | They propose a novel Unified ICL framework that unifies demonstration compression, demonstration selection, and final response generation. |
| Outcome: | The proposed framework unifies demonstration compression, demonstration selection, and final response generation. |
Copied to clipboard
| Challenge: | Molecular Relational Learning (MRL) is a promising way to understand interactions between molecular pairs. |
| Approach: | They propose a novel LLM-based multi-modal framework for molecular interaction modeling following Chain-of-Thought (CoT) theory which integrates graphical information of two molecules in pair. |
| Outcome: | The proposed framework integrates graphical information of two molecules in pair. |
Copied to clipboard
| Challenge: | Existing studies have focused on coding tutoring, but their capabilities in guiding users to solve complex tasks remain underexplored. |
| Approach: | They propose a novel agent workflow, Trace-and-Verify, which combines knowledge tracing to estimate a student’s knowledge state and turn-by-turn verification to ensure effective guidance toward task completion. |
| Outcome: | The proposed agent workflow achieves significantly higher success rates than existing tutoring agents. |
Copied to clipboard
| Challenge: | Medical dialogue systems (MDS) aim to provide patients with medical services, such as diagnosis and prescription. |
| Approach: | They propose a Dual Flow enhanced Medical (DFMed) dialogue generation framework that extracts the medical entities and doctor's dialogue acts used in the dialogue history and models their transitions with an entity-centric graph flow and a sequential act flow. |
| Outcome: | The proposed framework exceeds baselines in both automatic and manual evaluations on two datasets. |
Copied to clipboard
| Challenge: | Multi-choice questions (MCQs) are a common method for assessing the world knowledge of large language models. |
| Approach: | They propose three knowledge-equivalent question variants to assess LLMs' world knowledge . they propose option position shuffle, option label replacement, and conversion to a True/False format . |
| Outcome: | The proposed questions are shuffle, label replacement, and True/False format. |
Copied to clipboard
| Challenge: | Context information is one of the key factors for extractive summarization, but other factors can be used to identify sentence importance. |
| Approach: | They propose to disentangle context and pattern factors for extractive summarization . they separate context and patterns for a better generalization ability in low-resource setting . |
| Outcome: | The proposed model can be used in the zero-shot setting or fine-tuned in the few-shot settings. |
Copied to clipboard
| Challenge: | Large Multimodal Models have demonstrated strong performance on vision-language benchmarks, yet current evaluations focus on single-image reasoning. |
| Approach: | STRIPCIPHER is a benchmark designed to evaluate model ability on understanding implicit narratives in silent comics. |
| Outcome: | STRIPCIPHER is a high-quality, human-annotated dataset featuring fine-grained annotations and comprehensive coverage of varying difficulty levels. |
Copied to clipboard
| Challenge: | Recent studies have shown that adversarial examples can be easily fooled by DNNs, making the robustness and security of NLP models significantly important. |
| Approach: | They propose a differential privacy-based algorithm to achieve certified robustness against word substitution at- tacks in text classification via differential privacy. |
| Outcome: | The proposed model achieves higher accuracy and more than 30X efficiency improvement over existing defense algorithms. |
Copied to clipboard
| Challenge: | Existing solutions to alleviate hallucination have considered utilizing LLMs’ inherent reasoning abilities to alleviating hallucinism, such as self-correction and diverse sampling methods. |
| Approach: | They propose a counterfactual multi-agent debate framework that predetermines LLMs' stances to override their inherent biases for answer inspection. |
| Outcome: | Extensive experiments on four datasets of three tasks demonstrate the superiority of the proposed framework over existing methods. |
Copied to clipboard
| Challenge: | Existing methods for shaping large reasoning models rely on reinforcement learning or fine-tuning with gold-standard reasoning traces. Existing techniques for behavior shaping rely only on additional reward modeling. |
| Approach: | They propose a framework that aligns a model's self-concept with a target belief blueprint and internalizes desired traits by fine-tuning on synthesized, self-reflective QA pairs that affirm the target belief. |
| Outcome: | The proposed framework outperforms behavior-supervised and preference-based models while requiring significantly lower training costs. |
Copied to clipboard
| Challenge: | Multimodal Large Language Models (MLLMs) are susceptible to jailbreak attacks, authors say . multimodal information increases the risk of attacks, but also provides additional data . |
| Approach: | They propose a jailbreaking detector that detects maliciously perturbed image inputs . cross-modality information detector is designed to detect cross-modal similarity between harmful queries and adversarial images. |
| Outcome: | a new tool can detect maliciously perturbed image inputs without modification or computation cost. |
Copied to clipboard
| Challenge: | Existing research has focused on constraint categories, offering little guidance for improving instruction following abilities. |
| Approach: | They propose a multi-dimensional constraint framework that allows for instruction following . they construct 9,106 code-verifiable samples and evaluate 18 LLMs . |
| Outcome: | The proposed framework improves instruction following performance without compromising general performance. |
Copied to clipboard
| Challenge: | Error correction is widely used in automatic speech recognition (ASR) to post-process the generated sentence. |
| Approach: | They propose a fast correction model that takes multiple ASR candidates as input for better correction accuracy. |
| Outcome: | The proposed model can reduce the word error rate (WER) with multiple candidates by 3.2% and 2.6%. |
Copied to clipboard
| Challenge: | Large language models (LLMs) have demonstrated superior ability to serve as ranking models, but they will exhibit discriminatory ranking behaviors based on users’ sensitive attributes (gender). |
| Approach: | They propose an evaluation method to investigate the severity of implicit ranking unfairness and a pair-wise regression method to conduct fair-aware data augmentation for LLM fine-tuning. |
| Outcome: | The proposed method outperforms existing methods in ranking fairness, achieving this with only a small reduction in accuracy. |
Copied to clipboard
| Challenge: | Existing research on building ES conversation systems only considered single-turn interactions with users, which is over-simplified and has limited support for multi-turn systems. |
| Approach: | They propose a multi-turn ES conversation system that uses lookahead heuristics to estimate future user feedback after using particular strategies. |
| Outcome: | The proposed system significantly outperforms baselines in both dialogue generation and strategy planning. |
Copied to clipboard
| Challenge: | Sentence fusion is a conditional generation task that merges related sentences into a coherent text. |
| Approach: | They propose to build an event graph from the input sentences to capture related events in a structured way and use the constructed event graph to guide sentence fusion. |
| Outcome: | The proposed method achieves state-of-the-art on two datasets . it is based on the input sentences and shows that it is effective . |
Copied to clipboard
| Challenge: | Existing methods struggle to control fine-grained reasoning strategies due to conceptual entanglement in LRMs’ hidden states. |
| Approach: | They propose to decompose strategy-entangled hidden states into a disentangled feature space by using Sparse Autoencoders to identify the few strategy-specific features from the vast pool of SAE features. |
| Outcome: | The proposed method outperforms existing methods by 15% in control effectiveness. |
Copied to clipboard
| Challenge: | Recent studies have shown the importance of visual information in multi-party conversations due to the complexity of visual scenes. |
| Approach: | They propose a framework to extract face sequences as visual features from a real speaker's utterance and a pipeline method to extract the face sequence. |
| Outcome: | The proposed framework extracts face sequences of the real speaker of each utterance and improves emotion prediction on the MELD dataset. |
Copied to clipboard
| Challenge: | Existing time series models focus on a narrow spectrum of tasks, such as forecasting or anomaly detection. |
| Approach: | They propose a framework that enables natural language queries across multiple time series tasks such as numerical analytical tasks and open-ended question answering with reasoning. |
| Outcome: | The proposed framework enables natural language queries across multiple time series tasks and allows for more advanced and intuitive interactions with temporal data. |
Copied to clipboard
| Challenge: | Existing reasoning enhancement methods do not capture foresight in LLMs. |
| Approach: | They propose to integrate opponent modeling principles into policy optimization to enhance strategic reasoning in LLMs by integrating opponent modeling into policy. |
| Outcome: | The proposed method outperforms existing reasoning-based LLMs in out-of-domain scenarios and shows that it significantly enhances strategic reasoning across LLM of varying sizes and origins. |
Copied to clipboard
| Challenge: | Existing approaches to large language models are limited to historical backtesting and static data. |
| Approach: | a new large-language model is developed to simulate real-time trading in a virtual stock market . the agent trading arena simulates real-world bid-ask interactions and provides real-life trading scenarios . |
| Outcome: | The Agent Trading Arena simulates real-world market conditions and directly impacts price dynamics. |
Copied to clipboard
| Challenge: | Large language models (LLMs) have achieved significant success in reasoning tasks, including mathematical reasoning and logical deduction. |
| Approach: | They conduct the first comprehensive analysis of how the order of graph descriptions impacts LLM performance. |
| Outcome: | The results show that graph descriptions significantly improve LLMs’ comprehension of graph structures, and the robustness of LLM models to graph description order varies across different tasks. |
Copied to clipboard
| Challenge: | Existing methods for related search have limited semantic redundancy and wasted retrieval quota . generative retrieval approaches lack explicit reasoning, relying on superficial click-through rate rewards . |
| Approach: | They propose a framework that transforms related search into a reasoning-enhanced listwise generation task. |
| Outcome: | Experimental results show that ReList outperforms state-of-the-art methods in query diversity and user engagement. |
Copied to clipboard
| Challenge: | Existing methods operate by learning to fuse modalities, leading to frequent misjudgments. |
| Approach: | They propose a paradigm shift from *learning to fuse* to *learning the reason's process' inspired by the dual-process theory of human cognition, MIND operationalizes a self-improving loop. |
| Outcome: | The proposed model significantly outperforms baseline models and exhibits strong generalization. |
Copied to clipboard
| Challenge: | Extensive experiments on real-world datasets demonstrate that DPL significantly enhances LLM personalization. |
| Approach: | They propose a novel approach that emphasizes extracting inter-user differences to enhance LLM personalization. |
| Outcome: | The proposed approach extracts inter-user differences to enhance LLM personalization. |
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have demonstrated potential in building generative recommendation systems through fine-tuning user behavior data. |
| Approach: | They propose a federated framework for LLM-based recommendation that combines dynamic parameter aggregation and learning speed for different clients. |
| Outcome: | The proposed framework achieves a more balanced client performance and improved overall performance in a computational and storage-efficient way while safeguarding user privacy well. |
Copied to clipboard
| Challenge: | Existing work focuses on behavior cloning from expert demonstrations or preference learning through exploratory trajectory sampling, but these methods often struggle to address long-horizon tasks where suboptimal actions accumulate step by step, causing agents to deviate from correct task trajectories. |
| Approach: | They propose a framework for LLM-based agent learning that identifies suboptimal actions through a step-level reward comparison during exploration and constructs calibrated trajectories using LLM reflection. |
| Outcome: | The proposed framework outperforms existing methods in long-horizon tasks where suboptimal actions accumulate step by step, causing agents to deviate from correct task trajectories. |
Copied to clipboard
| Challenge: | Tabular data preparation is a critical step in enhancing the usability of tabular data. |
| Approach: | They analyze how LMs can be combined with other components for different tabular data preparation tasks. |
| Outcome: | The proposed methods lack the ability to capture the relationships within tables and adapt to the tasks involved. |
Copied to clipboard
| Challenge: | Global scientific publications are growing annually by about 4%-5% (Pinedo et al., 2024). |
| Approach: | They introduce an AI-assisted platform that answers diverse questions from researchers using Retrieval-Augmented Generation (RAG) they develop various tools to understand queries, search from the scientific literature, filter retrieved information, provide accurate and comprehensive answers, and self-refine answers. |
| Outcome: | OpenResearcher is built on Retrieval-Augmented Generation (RAG) to integrate Large Language Models (LLMs) with up-to-date, domain-specific knowledge. |
Copied to clipboard
| Challenge: | Existing length control methods involve fine-tuning the parameters of LLMs, which is inefficient and suboptimal for practical use. |
| Approach: | They propose an iterative sampling framework that regulates LLMs to generate length-constrained text without modifying the underlying parameters. |
| Outcome: | The proposed method achieves 100% success rates on Llama3.1 tasks with minimal additional computational overhead. |
Copied to clipboard
| Challenge: | Existing studies show that large language models are robust in commonsense reasoning . however, some variations in questions can lead to incorrect responses . |
| Approach: | They propose a large-scale bilingual benchmark consisting of 11,200 cases . they conduct extensive experiments on 41 representative LLMs . |
| Outcome: | The proposed benchmark systematically evaluates the robustness of large language models in commonsense reasoning. |
Copied to clipboard
| Challenge: | Recent advances in Large Language Models (LLMs) have shown promising results in complex reasoning tasks. |
| Approach: | They propose to use a multi-turn reasoning evaluation framework to cover multi-turn interactions with the environments of large language models. |
| Outcome: | The proposed framework covers diverse reasoning capabilities, fine-grained difficulty granularity, and necessitates multi-turn interactions with the environments. |
Copied to clipboard
| Challenge: | Existing studies have shown that emotional support conversation models generate unhelpful responses that can hinder their effectiveness. |
| Approach: | They propose a model-agnostic framework called Mitigating unhelpfulness with multifaceted AI feedback for emot io nal support (Muffin) it uses a multifaceted feedback module to assess helpfulness model responses across various facets of emotional support and contrasts helpful and unhelpful responses generated by the model. |
| Outcome: | The proposed framework reduces the likelihood of unhelpful responses by comparing helpful and unhelpfully responses generated by previous models to improve response fluency and relevance. |
Copied to clipboard
| Challenge: | Existing methods to generate toxic content in pretrained language models are resource-intensive and require additional components. |
| Approach: | They propose a method that enables the PLM itself to achieve "self-detoxification" they identify the toxification direction from the normal generation process to the one prompted with the negative prefix and then steer the generation to the reverse direction by manipulating the information movement within the attention layers. |
| Outcome: | The proposed method can achieve comparable performance with state-of-the-art methods without any fine-tuning or extra components. |
Copied to clipboard
| Challenge: | Existing factuality verification methods follow a Decompose-Then-Verify paradigm, which improves granularity but suffers from poor scalability and efficiency. |
| Approach: | They propose a Decompose-Embed-Interact paradigm that shifts factuality verification from costly text-level reasoning to efficient alignment in embedding space. |
| Outcome: | The proposed paradigm shifts factuality verification from costly text-level reasoning to efficient alignment in embedding space . |
Copied to clipboard
| Challenge: | Recent advances in large language model (LLM) agents have accelerated deployment of multi-agent systems for complex tasks. |
| Approach: | They propose an open-source toolkit for instantiating, probing, and measuring emergent risks in LLM-based multi-agent systems under controlled conditions. |
| Outcome: | The proposed toolkit is based on a structured topology–environment–protocol–agent–task quintuple enabling reproducible studies of how communication structure, coordination mechanisms, and incentives shape system-level risks. |
Copied to clipboard
| Challenge: | Existing multimodal question answering models rely on sequential retrieval and reasoning, but this single-path paradigm makes them vulnerable to errors due to misleading intermediate steps. |
| Approach: | They propose a multimodal multi-hop question answering framework guided by an Adaptive Planning Graph . they propose modality-specific strategies that dynamically adapt to distinct data types . |
| Outcome: | The proposed framework outperforms existing models that rely on training. |
Copied to clipboard
| Challenge: | Existing evaluations focus on problem-solving from examiner perspective, overlooking a dual perspective of examiner regarding error identification and correction. |
| Approach: | They propose to use an annotated dataset to evaluate large language models from the examiner perspective and to use diverse prompts to evaluate eleven representative LLMs. |
| Outcome: | The proposed model outperforms all models while LLaMA-2-7B has comparable abilities to closed-source models GPT-3.5 and Gemini Pro. |
Copied to clipboard
| Challenge: | Recent advances in generative language models have demonstrated their ability to memorize knowledge from documents and recall knowledge to respond to user queries effectively. |
| Approach: | They propose to enable multimodal large language models to memorize and recall images within their parameters. |
| Outcome: | The proposed model performs well even with large-scale image candidate sets. |
Copied to clipboard
| Challenge: | Existing methods fail to reconcile click-through rate (CTR) optimization with topic expansion. |
| Approach: | They propose a query generation framework that aligns click-through rate and topic expansion goals through an online DPO paradigm. |
| Outcome: | The proposed approach achieves significant CTR gains (+2.3%) and higher human-rated query quality compared to state-of-the-art methods. |
Copied to clipboard
| Challenge: | Existing benchmarks assess basic Theory of Mind abilities but neglect temporal evolution of mental states in real-world social contexts. |
| Approach: | They propose a benchmark specifically designed to evaluate Large Language Models' ability to understand and track the temporal progression of mental states across interconnected scenarios. |
| Outcome: | The proposed benchmarks underperform humans by 44.7% and show that they can model the dynamic nature of human mental states better than existing models. |
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have a high inference latency stemming from autoregressive decoding. |
| Approach: | They propose a novel decoding paradigm that drafts multiple tokens and verifies them in parallel . they aim to provide a catalyst for further research on Speculative Decoding . |
| Outcome: | The proposed method drafts multiple tokens and verifies them in parallel . it can be used to accelerate inference in large language models. |
Copied to clipboard
| Challenge: | Existing methods to adapt Large Language Models for Recommendation (LLMRec) do not represent collaborative information in a text-like format, which may not align optimally with LLMs. |
| Approach: | They propose a novel LLMRec method that integrates collaborative information through text-like encoding. |
| Outcome: | Extensive experiments show that BinLLM integrates collaborative information better with LLMs. |
Copied to clipboard
| Challenge: | Existing approaches to optimize large language models with human preferences suffer from preference conflicts in the data. |
| Approach: | They propose to construct Pareto-optimal responses to resolve preference conflicts by using a self-improving DPO framework that enables LLMs to self-generate and select Paret-optimized responses. |
| Outcome: | The proposed framework achieves superior Pareto Front performance over baselines on two datasets. |
Copied to clipboard
| Challenge: | Situated conversational recommendation (SCR) uses visual scenes grounded in specific environments and natural language dialogue to deliver contextually appropriate recommendations. |
| Approach: | They propose a framework that integrates scene transition estimation and Bayesian inverse inference to provide contextually appropriate recommendations. |
| Outcome: | The proposed framework achieves superiority over baselines on two representative benchmarks on dynamic scene transitions and implicit user intents. |
Copied to clipboard
| Challenge: | Prompt-based learning is a new language model training paradigm that adapts Pre-trained Language Models (PLMs) to downstream tasks. |
| Approach: | They propose a prompt-based learning paradigm that adapts Pre-trained Language Models to downstream tasks . they use a gradient-based beam search algorithm to generate adversarial triggers . |
| Outcome: | The proposed model improves performance on various natural language processing tasks by optimizing the prompt template. |
Copied to clipboard
| Challenge: | Explicit reasoning trajectories increase performance but often trigger overthinking . despite its importance, this study examines how each step of reasoning affects the final outcome . |
| Approach: | They propose a Reasoning Completion Point Detector that detects the RCP by monitoring rank dynamics of termination tokens. |
| Outcome: | The proposed method reduces token usage by up to 44% while preserving accuracy. |
Copied to clipboard
| Challenge: | Existing Large Language Model (LLM)-based recommender systems face challenges to adapt to dynamic user interests without any model-level updates. |
| Approach: | They propose a framework that establishes recommendation-oriented in-context learning by structuring recent user interactions and current inputs into ICL formats. |
| Outcome: | The proposed model adapts to dynamic user interests without model updates without any model updates and is available online at https://anonymous.4open.science/r/RecICL-8003. |
Copied to clipboard
| Challenge: | Existing research has explored automatic prompt optimization methods to eliminate manual effort in identifying effective prompts for a given task. |
| Approach: | They propose a framework for prompt optimization that can be generalized to an unlabeled target group. |
| Outcome: | The proposed framework improves on target group and source group while generalizing to unlabeled target group. |
Copied to clipboard
| Challenge: | Chain-of-Thought (CoT) has been proven effective in enhancing the reasoning capabilities of large language models (LLMs). |
| Approach: | They propose a chain-of-thought (CoT) prompting approach that enables LLMs to selectively skip less important tokens, allowing for controllable CoT compression. |
| Outcome: | Experiments show that TokenSkip reduces CoT token usage while preserving strong reasoning performance. |
Copied to clipboard
| Challenge: | Existing large language models (LLMs) have enabled agents to tackle complex embodied tasks through environmental interaction, but they still make suboptimal decisions and perform ineffective actions. |
| Approach: | They propose an active belief intervention mechanism that generates explicit belief states . they characterize belief inertia as a key failure mode of LLM-based agents . |
| Outcome: | The proposed method achieves significant gains in task success rates across embodied benchmarks. |
Copied to clipboard
| Challenge: | Infilling a fixed template between the input instruction and initial model output is a common practice for existing LLMs, but it is vulnerable to inference-time jailbreak attacks. |
| Approach: | They propose to fill a fixed template between the input instruction and initial model output and to detach safety mechanisms from the template region to mitigate the risk of inference-time jailbreak attacks. |
| Outcome: | The proposed method is widespread across aligned LLMs and shows that it mitigates inference-time jailbreak vulnerabilities. |
Copied to clipboard
| Challenge: | Existing studies on active learning methods focus on the out-of-distribution generalization of out- of-distortion samples. |
| Approach: | They propose a counterfactual active learning approach that empowers active learning with counterfact thinking to bridge the seen samples with unseen cases. |
| Outcome: | The proposed approach outperforms existing active learning methods on public datasets with comparable IID performance. |
Copied to clipboard
| Challenge: | Existing approaches to self-detection only retrospectively evaluate LLM-generated answers, leading to over-trust in incorrectly generated answers. |
| Approach: | They propose a self-detection paradigm that considers the comprehensive answer space beyond LLM-generated answers to mitigate the over-trust in LLM generated incorrect answers. |
| Outcome: | The proposed framework can be integrated with existing approaches for superior self-detection. |
Copied to clipboard
| Challenge: | Existing methods rely on external tool documentation during reasoning, leading to tool mastery difficulty, tool size constraints, and inference inefficiency. |
| Approach: | They propose a tool-internalized reasoning framework for unified reasoning and tool usage that integrates external tools into Large Language Models (LLMs) to address these issues, they propose 'tool-internet-based' reasoning. |
| Outcome: | The proposed method achieves superior performance across in-domain and out-of-domain settings, highlighting its effectiveness and efficiency. |
Copied to clipboard
| Challenge: | Current approaches use a numeric ID or text piece as the identifier, but these identifieres cannot cover a passage’s content well. |
| Approach: | They propose a new type of identifier that is generated based on the content of a passage and could integrate contextualized information that text pieces lack. |
| Outcome: | The proposed approach performs the best in generative retrieval on three public datasets. |
Copied to clipboard
| Challenge: | Existing studies for sentiment-to-sentiment "translation" only change the underlying sentiment and fail to keep the semantic content. |
| Approach: | They propose a cycled reinforcement learning method that combines neutralization module and emotionalization module. |
| Outcome: | The proposed method outperforms state-of-the-art systems on Yelp and Amazon review datasets. |
Copied to clipboard
| Challenge: | Parallel test-time scaling is a pivotal approach for enhancing large language models. |
| Approach: | They propose two uncertainty-inspired stochastic strategies for parallel test-time scaling for latent reasoning models and a Latent Reward Model for aggregation. |
| Outcome: | The proposed model scales well with compute and enables effective trajectory selection. |
Copied to clipboard
| Challenge: | Recent studies have demonstrated the ability of Large Language Models (LLMs) to process graph problems. |
| Approach: | They propose to decompose substructure counting into node-level tasks distributed among node agents and embed the knowledge of distributed algorithms and DP frameworks in the curator agent and privacy controller. |
| Outcome: | Extensive experiments on 6 real-world datasets validate the effectiveness of the proposed framework for substructure counting tasks under edge local differential privacy (LDP). |
Copied to clipboard
| Challenge: | Existing variational Bayesian models generate responses from a single latent variable, which is not sufficient to model high variability in responses. |
| Approach: | They propose a conditional variable auto-encoder that sequentially introduces latent variables to condition the generation of each word in the response sequence. |
| Outcome: | Empirical results show that the proposed model improves on state-of-the-art models on Opensubtitle and Reddit datasets. |
Copied to clipboard
| Challenge: | a recent study defines a conversation target from the system side to proactively steer conversations toward predefined targets or accomplish specific system-side goals. |
| Approach: | They propose a dataset curation framework that automatically curations a large-scale personalized dialogue dataset using a role-playing approach. |
| Outcome: | The proposed dataset is of high quality and could contribute to exploring personalized target-oriented dialogue. |
Copied to clipboard
| Challenge: | Current RAG system retrieves evidence from knowledge graphs and text documents but has limitations in multi-hop reasoning, multi-entity questions, and source verification. |
| Approach: | They propose a training-free framework that unifies graph topology, document semantics, and source reliability to support deep, faithful reasoning in large language models. |
| Outcome: | The proposed framework outperforms the current hybrid model-based model-driven system by 20.3% and 30.1% on seven benchmark datasets. |
Copied to clipboard
| Challenge: | Existing extractive summarization models generate summaries by selecting salient sentences, but there is a gap between the human-written gold summary and oracle sentence labels. |
| Approach: | They propose to extract fact-level semantic units for better extractive summarization by incorporating a hierarchical structure into the model and incorporate it with BERT using a Hierarchical graph mask. |
| Outcome: | The proposed model achieves state-of-the-art on the CNN/DaliyMail dataset. |
Copied to clipboard
| Challenge: | Current methods focus on catering to existing user interests, leading to polarized recommendation distributions. |
| Approach: | They propose an LLM-based Actor-Critic Agent framework to cultivate latent interests through multi-step recommendations. |
| Outcome: | The proposed framework optimizes long-term rewards and dynamically evolves with user feedback. |
Copied to clipboard
| Challenge: | Goal-directed dialogue systems aim to proactively reach a pre-determined target through multi-turn conversations. |
| Approach: | They propose a coherent dialogue planning approach that uses a stochastic process to model the temporal dynamics of dialogue paths. |
| Outcome: | The proposed approach generates more coherent utterances and achieves the goal with a higher success rate. |
Copied to clipboard
| Challenge: | Existing benchmarks focus on single agentic capability, failing to capture long-horizon real-world scenarios. |
| Approach: | They propose a benchmark that evaluates 6 agentic capabilities across 32 real-world scenarios. |
| Outcome: | Experiments show that closed-source models outperform open-source model (48.4% vs 32.1%) integrating models with advanced scaffolds to form autonomous agents is a paradigm shift. |
Copied to clipboard
| Challenge: | Pre-trained language models have achieved remarkable performance in OpenQA, but for practical deployment, knowledge distillation is crucial to maintain high performance while operating under computational constraints. |
| Approach: | They propose an algorithm to perform unsupervised knowledge distillation without the guidance of labels to achieve 99.5% of performance. |
| Outcome: | The proposed algorithm achieves 99.5% of performance in a commercial question-answering system. |
Copied to clipboard
| Challenge: | Generative retrieval is a promising new paradigm in text retrieval that generates identifier strings of relevant passages as the retrieval target. |
| Approach: | They propose a framework that leverages generative language models to enhance generative retrieval by distillation. |
| Outcome: | The proposed framework achieves state-of-the-art performance among the generative retrieval methods. |
Copied to clipboard
| Challenge: | Large language models (LLMs) have demonstrated remarkable capabilities in machine translation, but most MT-specific LLMs rely heavily on external supervision during training. |
| Approach: | They propose a reinforcement learning framework for machine translation that is reference-free and relies solely on self-judging rewards. |
| Outcome: | The proposed framework outperforms existing LLMs and larger general LLM models on English Chinese translation benchmarks and performs competitively with leading closed-source systems. |
Copied to clipboard
| Challenge: | Language models are exhibiting increasing capability in knowledge utilization and reasoning, but they often suffer from misalignment between their intrinsic knowledge and environmental knowledge, leading to infeasible actions. |
| Approach: | They propose a framework that leverages exploration-induced errors and environmental feedback to enhance environment alignment for embodied agents. |
| Outcome: | The proposed framework outperforms baseline methods and exhibits superior self-correction capabilities. |
Copied to clipboard
| Challenge: | Early approaches focus on text-based reasoning, but they often follow a single task-specific reasoning pattern. |
| Approach: | They propose a generative multimodal reasoning paradigm that unifies diverse reasoning skills by generating intermediate images during the reasoning process. |
| Outcome: | The proposed model unifies diverse multimodal reasoning skills by generating intermediate images during the reasoning process. |