Papers by Xing Wu
Copied to clipboard
| Challenge: | Existing methods to extract webpage snippets ignore contextual information of webpages, which may be sub-optimal. |
| Approach: | They propose a query-aware webpage snippet extraction method called DeepQSE that captures contextual information of webpages. |
| Outcome: | The proposed method can significantly improve the performance of DeepQSE without affecting its performance. |
Copied to clipboard
| Challenge: | Existing methods to analyze aspect-based sentiment analysis focus on word-level dependencies between aspect and opinion expressions. |
| Approach: | They propose a span-level ABSA model which considers consistency of multi-word opinion expressions at the span- level. |
| Outcome: | The proposed model can be used to identify the sentiment polarity of a given aspect . it is based on a table filling method and a regularizer to guarantee consistency . |
Copied to clipboard
| Challenge: | Existing news recommendation methods rely on centralized storage of user behavior data for model training, which may lead to privacy concerns and risks due to the privacy-sensitive nature of user behaviors. |
| Approach: | They propose a privacy-preserving method where user behavior data is locally stored on user devices to train accurate news recommendation models. |
| Outcome: | The proposed method can train accurate news recommendation models without centralized storage of user behavior data. |
Copied to clipboard
| Challenge: | Large language models have mastered syntax-level code generation, but complex algorithmic reasoning remains a challenge. |
| Approach: | They propose a recurrent inductive bias that aligns with the recursive nature of programming logic. |
| Outcome: | The proposed model achieves comparable performance to standard dense models with more parameters. |
Copied to clipboard
| Challenge: | Large language models (LLMs) are susceptible to malicious exploitation, but are often rejected and limited harmfulness is limited. |
| Approach: | They propose two types of reverse alignment techniques: reverse supervised fine-tuning (RSFT) and reverse preference optimization (RPO). |
| Outcome: | The proposed methods can significantly enhance the success rate and harmfulness of jailbreak attacks, but they face high rejection rates and limited harmfulness. |
Copied to clipboard
| Challenge: | Existing interpretation methods only support tasks with specific inputs, limiting their practical applications. |
| Approach: | They propose an extensible module that matches different input data with interpretation methods and consolidates the interpreting outputs. |
| Outcome: | The proposed module can match different input data with interpretation methods and consolidate the interpreting outputs. |
Copied to clipboard
| Challenge: | Large language models (LLMs) have demonstrated remarkable capabilities across various domains since the release of ChatGPT . a key challenge in developing these general capabilities is efficiently sourcing diverse, high-quality data. |
| Approach: | They introduce Flaming-hot Initiation with Regular Execution (FIRE) sampling to efficiently find good responses by promoting diversity. |
| Outcome: | The proposed method enhances inference-time generation quality and benefits training in the alignment stage. |
Copied to clipboard
| Challenge: | Existing news recommendation methods rely on user behavior data to model user interests and user interests. |
| Approach: | They propose a unified news recommendation framework that uses user data locally stored in user clients to train models and serve users in a privacy-preserving way. |
| Outcome: | The proposed framework outperforms baseline methods and effectively protects user privacy. |
Copied to clipboard
| Challenge: | Existing methods to learn user and item representations from review texts do not take into account the user-user and item-item relatedness of the user. |
| Approach: | They propose to use review content and user-item graphs to integrate them as different views. |
| Outcome: | The proposed approach can learn user and item representations from review content and user-item graphs. |
Copied to clipboard
| Challenge: | Existing methods for user profile modeling extract only partial segments from full historical behavior sequence, resulting in incomplete modeling and suboptimal profiling. |
| Approach: | They propose an agent-agnostic LLM-UM framework to augment downstream recommendation agents . it segments complete historical behaviors into clustered groups and performs offline multi-persona profiling . |
| Outcome: | The proposed framework improves agent performance and inference efficiency by 31% and 10% using 30–50% of behavioral data. |
Copied to clipboard
| Challenge: | Existing news recommendation methods rely on news click history to model user interest, but data sparsity is a problem . other kinds of user behaviors such as webpage browsing and search queries can provide useful clues of users’ news reading interest. |
| Approach: | They propose to exploit heterogeneous user behaviors to learn news representations from their titles via CNN networks and apply attention networks to select important words. |
| Outcome: | The proposed approach exploits heterogeneous user behaviors on a real-world dataset. |
Copied to clipboard
| Challenge: | Large language models (LLMs) have demonstrated remarkable performance across a wide range of tasks. |
| Approach: | They propose a new reasoning strategy Solution Guidance (SG) and a plug-and-play training paradigm Solution-Guidance Fine-Tuning (SGFT) which focuses on problem understanding and decomposition at the semantic and logical levels, rather than specific computations. |
| Outcome: | The proposed reasoning strategy Solution Guidance (SG) and plug-and-play training paradigm Solution-Guidance Fine-Tuning (SGFT) improves the reasoning capabilities of small language models on various reasoning tasks. |
Copied to clipboard
| Challenge: | Existing meta-learning techniques may not be well-suited to testing tasks when they are not well-supported by training tasks. |
| Approach: | They propose to use a meta-learning algorithm to add representations for each sentence learned from the extracted sentence-specific knowledge graph. |
| Outcome: | The proposed model is able to represent each sentence learned from the extracted knowledge graph under supervised adaptation and unsupervised adaptation settings. |
Copied to clipboard
| Challenge: | Simultaneous translation is notoriously dif- ficult due to word-order differences. |
| Approach: | They propose a prefix-to-prefix framework that implicitly learns to anticipate in a single translation model. |
| Outcome: | The proposed framework achieves low latency and reasonable qual- ity on 4 directions. |
Copied to clipboard
| Challenge: | Trending topics bring in a new channel for poisoning attacks, resulting in negative impacts on society. |
| Approach: | They propose an LLM-based multi-agent system to simulate trending topics in social media . they propose a time-aware interaction mechanism, centralized message dissemination, and an interactive system . |
| Outcome: | The proposed system simulates trending topics under poisoning attacks on social media platforms. |
Copied to clipboard
| Challenge: | Existing methods to eliminate hallucinations require expensive human annotation . hallucination in multimodal large language models poses unique challenges for current research . |
| Approach: | They propose a fine-grained unlearning framework that performs gradient ascent to eliminate hallucinations without paired data. |
| Outcome: | The proposed method reduces hallucinations while preserving quality with modest computational overhead. |
Copied to clipboard
| Challenge: | RealBench is the first Chinese multimodal multi-image dataset . the dataset contains 9393 samples and 69910 images . |
| Approach: | They propose to create a Chinese multimodal multi-image dataset using 21 models . they use closed-source models that support multi-inputs as well as open-source visual and video models a . |
| Outcome: | The first Chinese multimodal multi-image dataset contains 9393 samples and 69910 images. |
Copied to clipboard
| Challenge: | Role-playing Agents (RPAs) struggle to recognize and respond to hard queries that conflict with their role-play knowledge. |
| Approach: | They propose a lightweight representation editing approach that conveniently shifts conflicting requests to the rejection region, thereby enhancing the model’s refusal accuracy. |
| Outcome: | The proposed model improves RPAs’ refusal ability of conflicting requests while maintaining their general role-playing capabilities. |
Copied to clipboard
| Challenge: | Existing approaches to adapt image-focused models for video understanding have not been successful in analyzing long video sequences. |
| Approach: | They propose a video instruction dataset that outperforms existing video instruction data for fine-tuning MLLMs by incrementally increasing input context length. |
| Outcome: | The proposed model outperforms existing models on video benchmarks and outperformed proprietary models on VideoMME even with a compact 7B model. |
Copied to clipboard
| Challenge: | Existing news recommendation methods learn a single representation for each user, which may be insufficient. |
| Approach: | They propose a neural news recommendation approach which can learn both long- and short-term user representations by using a news encoder and a user encoder. |
| Outcome: | The proposed approach can learn both long- and short-term user representations on a real-world dataset. |
Copied to clipboard
| Challenge: | Large language models (LLMs) have demonstrated exceptional abilities in both text understanding and generation. |
| Approach: | They propose an Embedding Watermark method that implants backdoors on embeddings to protect copyright of large language models. |
| Outcome: | The proposed method protects the copyright of large language models without compromising service quality while minimizing the adverse impact on the original embeddings’ utility. |
Copied to clipboard
| Challenge: | Large language models have attracted increasing attention due to their prominent performance on various tasks. |
| Approach: | They propose to let LLMs learn to ask informative questions to collect visual information . they introduce concepts of denotation and connotation to promote image and question understanding . |
| Outcome: | The proposed model can generate high-quality questions and efficiently collect required information without expensive training or annotations. |
Copied to clipboard
| Challenge: | a new framework for evaluation of exhaustive search capabilities is needed . high-entropy enumeration tasks make such ground truth impossible for humans to create . VERITAS is a framework built on the principle of computationally irreducible constraints . |
| Approach: | They propose a framework that uses non-optimizable constraints to create verifiable searches . VERITAS can generate infinite number of test cases with perfect ground truth and precise difficulty control . |
| Outcome: | a new evaluation framework for large language models is based on non-optimizable constraints . the framework can generate infinite number of test cases with perfect ground truth and precise difficulty control . |
Copied to clipboard
| Challenge: | Existing methods to enhance performance of large language models (LLMs) on Text-to-SQL tasks rely on execution-based or LLM-based reward models. |
| Approach: | They propose a reward model framework for RL-based Text-to-SQL that employs the GMNScore outcome reward model. |
| Outcome: | The proposed reward model outperforms existing reward models on standard benchmarks including Spider and BIRD. |
Copied to clipboard
| Challenge: | Experimental results show text smoothing outperforms data augmentation methods by a substantial margin. |
| Approach: | They propose to use a masked language model to convert a token to a smoothed representation by converting a sentence from its one-hot representation to 'controllable smoothes' they propose to combine text smoothing with other data augmentation methods to achieve better performance. |
| Outcome: | The proposed method outperforms mainstream data augmentation methods by a substantial margin on different datasets in a low-resource regime. |
Copied to clipboard
| Challenge: | Aspect term extraction (ATE) aims at identifying all aspect terms in a sentence . sequence labeling based methods cannot make full use of overall meaning of sentence if they have dependencies between labels. |
| Approach: | They propose to formalize ATE as a sequence-to-sequence (Seq2Seque) learning task . they propose gated unit networks and position-aware attention mechanism to make it suit to ATE . |
| Outcome: | The proposed learning task is effective when labels correspond to words one by one . the proposed learning system is gated unit networks and position-aware attention mechanism . |
Copied to clipboard
| Challenge: | Efficient processing of long contexts in large language models is essential for real-world applications such as retrieval-augmented generation and in-context learning. |
| Approach: | They propose a decoupled compressor-LLM framework that preserves contextual information within condensed embedding representations. |
| Outcome: | The proposed framework outperforms baseline models in three domains and across eight datasets while adapting to different downstream LLMs. |
Copied to clipboard
| Challenge: | Existing news recommendation methods learn a single user embedding for each user from their previous behaviors to represent their overall interest. Existing methods only learn 'one' embeddable representation vectors to model user interest. |
| Approach: | They propose a news recommendation method with hierarchical user interest modeling that captures user interest in news rather than a single user embedding. |
| Outcome: | The proposed method can better capture multi-grained user interest in news. |
Copied to clipboard
| Challenge: | Existing knowledge distillation methods investigate divergence measures but fail to deliver effective supervision when few distribution overlap exists between teacher and student. |
| Approach: | They propose a knowledge distillation method that exploits the Sinkhorn distance to ensure a nuanced assessment of the disparity between teacher and student distributions. |
| Outcome: | The proposed method outperforms state-of-the-art methods on all kinds of LLMs with encoder-only, encoder decoder, and decoded architectures. |
Copied to clipboard
| Challenge: | Existing studies represent each user as a single vector and then match the candidate news vector, which may lose fine-grained information for recommendation. |
| Approach: | They propose a Fine-grained interest matching method for neural news recommendation based on multi-level representations and fine-grain matching between segment pairs of each browsed news and the candidate news at each semantic level. |
| Outcome: | The proposed model can capture more fine-grained interest matching signals by performing interactions between each pair of news at multi-level semantic granularities. |
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have shown remarkable advances in enabling language agents to tackle real-world tasks. |
| Approach: | They propose a tool-using agent-based CAD framework that automates text-to-CAD modeling . they propose an interactive CAD gym to roll out reasoning and tool-augmented interaction trajectories with the CAD engine . |
| Outcome: | The proposed framework can generalize across complex modeling tasks, supporting their open-source counterparts. |
Copied to clipboard
| Challenge: | Existing pre-trained language models are not well-explored and are not reproducible in the literature. |
| Approach: | They propose to improve existing Arabic language pre-trained language models using a more methodical approach. |
| Outcome: | The proposed models outperform existing models on ALUE, a leaderboard-powered benchmark for Arabic NLU and NLG tasks. |
Copied to clipboard
| Challenge: | Long context large language models (LLMs) pose significant challenges for efficient serving due to the large memory footprint and high access overhead of KV cache. |
| Approach: | They propose a retrieval-based method to reduce the memory footprint of LLMs . they propose Windowed Rotary Position Embedding and query-aware vector quantization . |
| Outcome: | The proposed method can achieve lower performance degradation with lower overhead compared to existing methods . it can reduce the memory footprint and access overhead of long context large language models . |
Copied to clipboard
| Challenge: | a new method for learning unsupervised sentence embeddings is proposed . unsup-SimCSE is biased because of the length information encoded into the sentence embeds . |
| Approach: | They propose a new unsupervised sentence embedding method that uses dropout to obtain positive pairs from a pre-trained Transformer encoder. |
| Outcome: | The proposed method outperforms the state-of-the-art unsup-SimCSE on a STS task. |
Copied to clipboard
| Challenge: | Existing news recommendation methods rely on centralized storage of user click behavior data, which may lead to privacy concerns and hazards. |
| Approach: | They propose a federated learning framework for privacy-preserving news recommendation . they propose aggregation of news representations and user model by a client . |
| Outcome: | The proposed framework reduces computation and communication cost on clients while keeping promising model performance. |
Copied to clipboard
| Challenge: | Existing methods for user modeling cannot exploit useful information in unlabeled data . Existing models only model task-specific user information and do not exploit universal user information encoded in user behaviors. |
| Approach: | They propose to pre-train user models from large-scale unlabeled user behavior data. |
| Outcome: | The proposed method can model relatedness between historical and future behaviors on two real-world datasets. |
Copied to clipboard
| Challenge: | sparse sampling of videos suffers from inter-modal redundancy and visual redundancies . et al., 2021) proposes to sparsestly sample frames from videos to alleviate temporal redundance . |
| Approach: | They propose to use sparse sampling to alleviate temporal redundancy in videos . they propose to penalize high-redundant video patches and text tokens . |
| Outcome: | The proposed method improves on four benchmark datasets. |
Copied to clipboard
| Challenge: | under the pandemic of COVID-19, people experiencing COVI D19-related symptoms have a pressing need to consult doctors. |
| Approach: | They develop a medical dialog system that can provide COVID19-related consultations . they use two dialog datasets containing conversations between doctors and patients . |
| Outcome: | The proposed system can provide COVID19-related consultations, but is too small compared with general-domain dialog datasets. |
Copied to clipboard
| Challenge: | Molecular structure elucidation involves deducing a molecule’s structure from various types of spectral data, which is crucial in chemical experimental analysis. |
| Approach: | They propose a Knowledge-enhanced reasoning framework for Molecular Structure Elucidation that leverages Monte Carlo Tree Search for test-time scaling as a plugin to extend the LLMs’ coverage of the chemical structure space. |
| Outcome: | The proposed framework significantly improves on both GPT-4o-mini and GPT4o, and a specialized molecule-spectrum scorer improves performance. |
Copied to clipboard
| Challenge: | Existing research on reinforcement learning for LLMs under data scarcity has not been unified. |
| Approach: | They propose a top-up hierarchical framework built around three complementary perspectives: data-centric, training-centric and framework-centric. |
| Outcome: | The proposed framework provides a clear conceptual foundation for understanding the design space of data-efficient RL for large language models and to guide researchers working in this emerging area. |
Copied to clipboard
| Challenge: | Precisely modeling news and users is critical for news recommendation, and capturing the contexts of words and news is important to learn news and user representations. |
| Approach: | They propose a neural news recommendation approach with multi-head self-attention to model the interactions between words and news and use multi-headed self- attention to capture relatedness between the news. |
| Outcome: | The proposed approach can learn representations from news titles by modeling the interactions between words and users and capture relatedness between the news. |
Copied to clipboard
| Challenge: | Tabular data is an essential resource for many fields, but current methods do not fully utilize the rich information available in tables. |
| Approach: | They propose a method that utilizes metadata information to generate tabular data . they propose long-token partitioning algorithms that enable AIGT to model tables of any scale . |
| Outcome: | The proposed approach achieves state-of-the-art on 14 out of 20 public datasets and two real industry datasets within the Alipay risk control system. |
Copied to clipboard
| Challenge: | Existing research focuses on character-level settings and static evaluation formats fail to capture the complexity of everyday social interactions. |
| Approach: | They propose a dynamic simulation framework for evaluating and improving persona-level role-playing in large language models (LLMs). |
| Outcome: | The proposed framework leverages user-generated social content to construct a nuanced persona bank and elicits multi-turn, context-rich interactions within simulated social environments. |
Copied to clipboard
| Challenge: | Large Language Models (LLMs) can solve complex tasks through iterative information retrieval. |
| Approach: | They propose a turn-level stage-aware policy optimization approach to solve this problem . they introduce a first-occurrence latent reward mechanism to allocate partial rewards . |
| Outcome: | Experiments show that TSPO outperforms state-of-the-art models on Qwen2.5-3B and 7B models. |
Copied to clipboard
| Challenge: | generative AI has created a new way to generate content with humans . varying degrees of human contribution in content generation poses significant challenges for the delineation of originality . |
| Approach: | They propose a framework to measure human contribution in AI-assisted content generation by calculating mutual information between human input and AI-aided output relative to self-information of AI-assist output. |
| Outcome: | The proposed measure discriminates between varying degrees of human contribution across multiple creative domains and is validated in real-world applications. |
Copied to clipboard
| Challenge: | Multi-modal intent recognition (MIR) requires integrating non-verbal cues from real-world contexts to enhance human intention understanding. |
| Approach: | They present a comprehensive review of multi-modal intent recognition . they provide a survey of the field covering textual, visual, and acoustic signals . |
| Outcome: | The present survey summarises the current state of multi-modal intent recognition . it includes a comprehensive taxonomy and advanced methods . |
Copied to clipboard
| Challenge: | Existing methods for learning accurate news representations do not consider topic information in news. |
| Approach: | They propose a neural news recommendation approach with topic-aware news representations using CNN networks and attention networks to select important words. |
| Outcome: | The proposed approach is based on a topic-aware news encoder and user encoder. |
Copied to clipboard
| Challenge: | Personalized news recommendation is an important technique for personalized news service. |
| Approach: | They propose to build a large-scale news recommendation dataset from Microsoft News . they demonstrate that news recommendation relies on the quality of news content understanding . |
| Outcome: | The proposed dataset contains 1 million users and more than 160k English news articles, each of which has rich textual content such as title, abstract and body. |
Copied to clipboard
| Challenge: | Unsupervised contrastive sentence embedding models use InfoNCE loss function . increasing batch size leads to performance degradation when it exceeds threshold . |
| Approach: | They propose a simple smoothing strategy upon the InfoNCE loss function to reduce the number of false-negative pairs in a batch without increasing the batch size. |
| Outcome: | The proposed smoothing strategy improves unsupervised SimCSE on semantic similarity tasks. |
Copied to clipboard
| Challenge: | Existing preference-based methods for medical large vision-Language Models face limitations in medical settings . existing methods are limited by overfitting to superficial cues and pseudo convergence of the preference signal. |
| Approach: | They propose a framework that enables evidence-aware and adaptive preference learning for Med-LVLMs. |
| Outcome: | The proposed framework improves evidence-aware and adaptive preference learning for Med-LVLMs. |
Copied to clipboard
| Challenge: | Existing approaches to textual robustness evaluation focus on slightly modifying the input data, which maintains the original meaning and results in a different prediction. |
| Approach: | They propose a multilingual robustness evaluation toolkit for NLP that integrates universal text transformations, task-specific transformations and adversarial attack. |
| Outcome: | The toolkit includes universal text transformation, task-specific transformation, adversarial attack, subpopulation, and their combinations to provide comprehensive robustness analyses. |
Copied to clipboard
| Challenge: | Existing models for conversation systems operate sentences at word-level . word-based models suffer from Unknown Words Issue and Preference Issue . |
| Approach: | They propose a hybrid-level Encoder-Decoder model which utilizes word-level features and character-level ones. |
| Outcome: | The proposed model outperforms non-word-level models in automatic metrics and human annotations on a Chinese corpus. |
Copied to clipboard
| Challenge: | Existing approaches to support diverse attention variants trade performance for flexibility . expert-written kernels achieve high efficiency but are difficult to adapt . |
| Approach: | They propose a framework that adapts expert-written attention kernels to GPUs . they use a structured lift–transfer–lower workflow to make execution explicit . |
| Outcome: | The proposed framework outperforms existing frameworks and compilers on diverse variants and GPU platforms. |
Copied to clipboard
| Challenge: | Parallel thinking is a promising avenue for scaling test-time compute in Large Language Models . however, coordinating the exploration and aggregation stages remains challenging . |
| Approach: | They propose a parallel thinking framework that explicitly incentivizes coordination between components via end-to-end reinforcement learning. |
| Outcome: | The proposed framework improves accuracy by 6.0% over long chain-of-thought baselines while reducing wall-clock latency by 39.4% under matched token budgets. |
Copied to clipboard
| Challenge: | Existing studies on contrastive learning for sentence embeddings are weak . researchers have started to use contrastive training to learn better unsupervised sentences. |
| Approach: | They propose an information-aggregated contrastive learning framework for learning unsupervised sentence embeddings. |
| Outcome: | The proposed framework outperforms SimCSE on several benchmark datasets w.r.t the semantic text similarity task. |