Papers by Lu Su
Copied to clipboard
| Challenge: | a comparative analysis of paper (meta-)reviews by large language models (LLMs) aims to identify and distinguish LLMs from human activities . |
| Approach: | They present a comparative analysis to identify and distinguish LLM activities from human activities. |
| Outcome: | The proposed analysis aims to improve recognition of instances when someone implicitly uses LLMs for reviewing activities. |
Copied to clipboard
| Challenge: | Existing methods for capturing large BERT models as teachers do not fully exploit the potential advantages of larger teachers. |
| Approach: | They propose a method that leverages a pretrained teacher model to guide the training of a lightweight student model to enhance knowledge transfer. |
| Outcome: | The proposed method enhances knowledge transfer by leveraging a pretrained teacher model to guide the training of a lightweight student model. |
Copied to clipboard
| Challenge: | Existing semantic parsing frameworks rely on nontrivial human labor to generate canonical utterances. |
| Approach: | They propose a framework that uses an unsupervised paraphrase model to parse canonical utterances. |
| Outcome: | The proposed framework is effective and compatible with supervised training. |
Copied to clipboard
| Challenge: | lexical bias stems from content realization, or how things are said, but other forms of bias stem from content selection and organization. |
| Approach: | They use a dataset to analyze news articles annotated with 1,727 bias spans to investigate informational bias. |
| Outcome: | The proposed model shows that informational bias appears more frequently than lexical bias. |
Copied to clipboard
| Challenge: | Existing text-to-SQL models are limited in their generalizability, despite their performance being over-estimated. |
| Approach: | They propose a framework to generate novel text-to-SQL data via automatic and synchronous (DS, SQL) pair altering. |
| Outcome: | The proposed framework generates text-to-SQL data via automatic and synchronous (DS, SQL) pair altering. |
Copied to clipboard
| Challenge: | Experimental results show that our proposed approach yields better attention mechanisms . dominant ASC models are mostly discriminative classifiers based on manual feature engineering . |
| Approach: | They propose a self-supervised approach to aspect-level sentiment classification that mines useful attention supervision information from a training corpus to refine attention mechanisms. |
| Outcome: | The proposed approach yields better attention mechanisms on multiple datasets. |
Copied to clipboard
| Challenge: | Existing methods to encode text-to-SQL data are node-centric and ignore semantics embedded in the topological structure of edges. |
| Approach: | They propose a Line Graph Enhanced Text-to-SQL model to mine relational features without constructing meta-paths. |
| Outcome: | The proposed model achieves state-of-the-art on the cross-domain text-to-SQL benchmark Spider at the time of writing. |
Copied to clipboard
| Challenge: | Recent success in large multimodal models (LMMs) has sparked promising applications of agents capable of autonomously completing complex web tasks. |
| Approach: | They propose a scalable recipe to synthesize the largest and most diverse trajectory-level dataset to date. |
| Outcome: | The proposed model synthesizes the largest and most diverse trajectory-level dataset to date, with 94K successful multimodal web trajectories, 720K screenshots, and 33M web elements. |
Copied to clipboard
| Challenge: | Existing GUI agents struggle to adapt to dynamic and interconnected nature of real-world digital environments, authors show . |
| Approach: | They propose a benchmark to evaluate the transferability of GUI agents across three key dimensions . transBench includes 15 app categories with diverse functionalities . |
| Outcome: | The proposed benchmark shows that existing GUI agents struggle to adapt to dynamic, interconnected environments. |
Copied to clipboard
| Challenge: | Empirical results on Chinese-English and English-German translation tasks demonstrate the effectiveness of our proposed framework. |
| Approach: | They propose an iterative dual domain adaptation framework for neural machine translation that uses multiple corpora to perform bidirectional translation knowledge transfer. |
| Outcome: | Empirical results on Chinese-English and English-German translation tasks demonstrate the effectiveness of the proposed framework. |
Copied to clipboard
| Challenge: | Large language models (LLMs) have demonstrated proficiency across various NLP tasks but often require additional training, such as continual pre-training and supervised fine-tuning. |
| Approach: | They propose to leverage sparsity in pre-trained LLMs to accelerate training by disregarding computations for unimportant neurons. |
| Outcome: | The proposed framework achieves comparable or superior performance to standard training while significantly accelerating the process. |
Copied to clipboard
| Challenge: | Existing semantic parsing models struggle to adapt to unseen database schemas . a new architecture, ShadowGNN, processes schemas at abstract and semantic levels . |
| Approach: | They propose a new architecture which processes schemas at abstract and semantic levels. |
| Outcome: | The proposed architecture outperforms state-of-the-art models on a text-to-sql benchmark . it uses domain-independent representations to extract logical linking between question and schema . |
Copied to clipboard
| Challenge: | Large language model agents have enabled GUI-based automation, but their deployment is limited by noisy data, poor generalization, and lack of support for non-English GUIs. |
| Approach: | They propose an 8B-parameter GUI agent built for robust and efficient on-device GUI interaction. |
| Outcome: | The proposed GUI agent achieves promising performance on five public benchmarks and proposed Chinese benchmark CAGUI. |
Copied to clipboard
| Challenge: | Existing methods to compress long contexts have degraded dramatically as compression ratios increase, sometimes even falling to the closed-book level. |
| Approach: | They propose a query-guided compression method that preserves key information within the compressed context. |
| Outcome: | The proposed method can consistently perform well even at high compression ratios, and offers significant benefits in terms of inference cost and throughput. |
Copied to clipboard
| Challenge: | Existing benchmarks focus on character-centric approach and fail to reflect real-world applications. |
| Approach: | RMTBench is a user-centric bilingual role-playing benchmark featuring 80 diverse characters and over 8,000 dialogue rounds. |
| Outcome: | RMTBench features 80 diverse characters and over 8,000 dialogue rounds. |
Copied to clipboard
| Challenge: | Existing studies use synthetic speech to train and evaluate SpeechRE models, hindering their development . modality gap issue limits performance of existing models, limiting future researches . |
| Approach: | They propose to use speech data to train and evaluate SpeechRE models by using real speech . they propose to train a cross-modal alignment model to bridge the modality gap . |
| Outcome: | The proposed model can train to bridge the modality gap between speech encoder and text decoder . the proposed model is based on two real SpeechRE datasets . |
Copied to clipboard
| Challenge: | Existing task-aware methods require loading the entire input sequence at once for compression, which suffer from computational inefficiency. |
| Approach: | They propose a framework that adopts an adaptive hybrid reading strategy to reduce computational inefficiency and redundant information in long-context scenarios. |
| Outcome: | Experiments show that RAM outperforms baselines on multiple question answering and summarization benchmarks while delivering up to a 12x speedup on long inputs. |
Copied to clipboard
| Challenge: | Existing graph-to-sequence approaches use graph neural networks as encoders, but they lack the structure information needed to translate AMR into the graph-based data. |
| Approach: | They propose a graph-to-sequence task which aims to recover natural language from Abstract Meaning Representations (AMR) they adopt graph attention networks with higher-order neighborhood information to explore the edge relations in AMR graphs. |
| Outcome: | The proposed framework achieves state-of-the-art performance on English AMR benchmark datasets and is able to translate the AMR semantics into the natural language. |
Copied to clipboard
| Challenge: | Existing approaches to embed news as vectors do not integrate features and inter-textual knowledge of news. |
| Approach: | They propose a model that integrates news features and inter-textual knowledge into a dense vector representation. |
| Outcome: | The proposed model can be used to represent news as a dense vector . it is compared with existing models on stock movement prediction and news recommendation tasks . |
Copied to clipboard
| Challenge: | Existing methods to track dialogue state are limited due to data sparsity and long dialogues. |
| Approach: | They propose to use the previous dialogue state and current dialogue utterance as input for DST. |
| Outcome: | The proposed approach outperforms existing methods and improves existing ones. |
Copied to clipboard
| Challenge: | Existing task-oriented dialogue systems lack ontology-aware pretraining methods for task-orientated dialogue. |
| Approach: | They propose an ontology-aware pretrained language model (OPAL) for end-to-end task-oriented dialogue (TOD) . they propose to pretrain on large-scale contextual text data to bridge the gap between the pretraining method and downstream tasks. |
| Outcome: | The proposed model achieves an exciting boost and obtains competitive performance even without any TOD data on CamRest676 and MultiWOZ benchmarks. |
Copied to clipboard
| Challenge: | Existing large language models have exacerbated fairness issues in tabular data generation . inherent historical biases in tabulated data cause LLMs to exacerbate fairness problems . |
| Approach: | They propose a universal debiasing framework that minimizes group-level dependencies . it leverages the autoregressive structure and analytic sampling distributions of LLM-based tabular data generators . |
| Outcome: | The proposed framework minimizes group-level dependencies while reducing mutual information between advantaged and protected attributes. |
Copied to clipboard
| Challenge: | MultiConIR is a benchmark designed to evaluate retrieval and reranking models under nuanced multi-condition query scenarios. |
| Approach: | They propose a benchmark to evaluate retrieval and reranking models under nuanced multi-condition query scenarios. |
| Outcome: | The proposed benchmark evaluates retrieval and reranking models under nuanced multi-condition query scenarios across five domains. |
Copied to clipboard
| Challenge: | Existing models for multidocument summarization do not focus on explicitly modeling the underlying semantic information across documents. |
| Approach: | They propose an entityaware model for abstractive multi-document summarization that augments the classical Transformer-based encoder-decoder framework with a heterogeneous graph consisting of text units and entities as nodes. |
| Outcome: | The proposed model can deal with saliency and redundancy issues explicitly and can be used with pre-trained language models, arriving at improved performance. |
Copied to clipboard
| Challenge: | Chinese word segmentation can be erroneous, ambiguous or inconsistent, causing performance problems. |
| Approach: | They propose a sentence matching framework that uses paired word lattices as input instead of a character sequence. |
| Outcome: | The proposed framework outperforms the state-of-the-art short text matching models on two Chinese datasets. |
Copied to clipboard
| Challenge: | evaluating LLMs' ability to mimic real user behavior remains an open challenge due to the lack of high-quality, publicly available datasets that capture both the observable actions and the internal reasoning of an actual user. |
| Approach: | They propose a dataset of Observation, Persona, Rationale, and Action collected from real human participants during online shopping sessions. |
| Outcome: | The proposed dataset is the first to evaluate how well current LLMs can accurately simulate the next web action of a specific user. |
Copied to clipboard
| Challenge: | Recent studies have explored Continual Instruction Tuning (CIT) in Multimodal Large Language Models (MLLMs), with a primary focus on Task-incremental CIT, where MLLM are required to continuously acquire new tasks. |
| Approach: | They propose a Sparse Mixture of Expert (SMoE) based method for domain-incremental CIT in Multimodal Large Language Models (MLLMs) . they equip the SMoA module with a domain-specific autoregressive loss (DSAL) they establish a new benchmark to evaluate the efficacy of their method . |
| Outcome: | The proposed method outperforms all baselines and is based on a Sparse Mixture of Experts (SMoE) module . |
Copied to clipboard
| Challenge: | Mobile Phone Agents (MPAs) have attracted huge attention due to their practicability in a multitude of scenarios. |
| Approach: | They propose a data mixture optimization solution that extrapolates optimal data mixtures from a trainable network. |
| Outcome: | The proposed model outperforms existing methods on open-source benchmarks and on open source benchmarks. |
Copied to clipboard
| Challenge: | Large Language Models (LLMs) can be used to broaden user experiences beyond established preferences and reinforce feedback loops. |
| Approach: | They propose a hierarchical approach that combines hierarchic planning with LLM inference-time scaling to improve recommendation relevancy without compromising novelty. |
| Outcome: | The proposed approach shows significant gains in both user satisfaction and exploration diversity. |
Copied to clipboard
| Challenge: | Neural Processing Units (NPUs) are critical for AI infrastructure, but their development remains a bottleneck due to vendor-specific Domain-Specific Languages (DSLs). |
| Approach: | They propose a framework for NPU kernel development that bridges the gap in hardware-specific coding . compiler success on complex Level-2 kernels improves from 0% to 95.5%, they say . |
| Outcome: | The proposed framework bridges the gap in hardware-specific coding, showing a near-zero success rate on complex kernels. |
Copied to clipboard
| Challenge: | citing sentences capture salient information in cited papers and the connection between citing and citing papers. |
| Approach: | They propose a BAckground knowledge- and COntent-based framework for citing sentence generation that integrates two types of information: background knowledge and content. |
| Outcome: | The proposed framework outperforms baselines in the citation sentence generation task. |
Copied to clipboard
| Challenge: | Recent studies have evaluated and shown limitations in specific capabilities such as visual understanding, but a systematic evaluation of VLMs’ fundamental WM abilities remains absent. |
| Approach: | They propose a framework that assesses perception and prediction to provide an atomic evaluation of VLMs as WMs. |
| Outcome: | The proposed framework assesses perception and prediction abilities on 15 latest VLMs and compares them to human-level models. |
Copied to clipboard
| Challenge: | Existing methods for quantifying uncertainty in large language models with black-box API access are limited due to the complex data distributions and inner model mechanism. |
| Approach: | They propose a conformal prediction method that minimizes the size of prediction sets and ensures a statistical guarantee of the user-defined coverage. |
| Outcome: | The proposed method outperforms existing methods on close-ended and open-ended questions. |
Copied to clipboard
| Challenge: | Existing LLMs rely on surface-level similarity or manual heuristics to evaluate personalization . Existing evaluation protocols for personalization are lacking sufficient data-driven validation. |
| Approach: | They propose a benchmark to assess personalization by mining CIPDs to quantify individual preferences. |
| Outcome: | The proposed benchmark provides a more comprehensive and discriminative standard than generic metrics. |
Copied to clipboard
| Challenge: | Large language models are prone to providing “midguy” answers regardless of users’ knowledge background, thereby failing to meet each user’s personalized needs. |
| Approach: | They propose to generate personalized answers with LLMs based on users’ past question-answering records. |
| Outcome: | The proposed method generates personalized answers based on user's past question-answering records. |
Copied to clipboard
| Challenge: | Existing studies assume that the support set contains only accurately labeled instances, but this assumption is often unrealistic. |
| Approach: | They propose a self-denoising model for FSRE which can automatically correct noisy labels of support instances. |
| Outcome: | The proposed model outperforms all baselines on two public datasets showing that it can correct mislabeled support instances. |
Copied to clipboard
| Challenge: | Mandarin Alphabetical Words (MAWs) are a key component of Modern Chinese . they are characterized by unique code-mixing idiosyncrasies influenced by language exchanges . |
| Approach: | They propose to construct a large collection of Mandarin Alphabetic Words from Sina Weibo . they propose to use a web-based technique to identify and validate MAWs . |
| Outcome: | The proposed method identifies 16,207 Mandarin Alphabetic Words (MAWs) using a web-based technique . the results show that the proposed method is useful for linguistic research and inquiries . |
Copied to clipboard
| Challenge: | Existing generative models lack the capacity for explicit and controllable reasoning, a key advantage of LLMs. |
| Approach: | They propose a framework that integrates dialogue, reasoning, and personalized recommendation. |
| Outcome: | Experiments across public benchmarks show state-of-the-art performance. |
Copied to clipboard
| Challenge: | Existing Chain-of-Thought (CoT) approaches lack intrinsic correction mechanisms, rendering them vulnerable to error propagation. |
| Approach: | They propose a multi-agent framework that enforces diagnostic rigor through adversarial dialectics. |
| Outcome: | Empirical evaluations show that the proposed framework improves explanation faithfulness and mitigates hallucinations. |
Copied to clipboard
| Challenge: | k-Nearest-Neighbor Machine Translation (kNN-MT) is a popular research paradigm in machine translation. |
| Approach: | They propose a confidence-enhanced kNN-MT model with robust training to reduce noise . they introduce NMT confidence to refine the modeling of important components of kN-MT . |
| Outcome: | The proposed model improves on four benchmark datasets and is robust to training. |
Copied to clipboard
| Challenge: | Existing benchmarks lack social metadata and evaluation framework to meet this urgent evaluation needs. |
| Approach: | They propose a benchmark capable of evaluating HPA and three fact-checking tasks. |
| Outcome: | The proposed framework improves HPA and computational efficiency for RLM-driven systems. |
Copied to clipboard
| Challenge: | Recent advances in language models (LMs) have made it possible to automatically generate feedback that is actionable and well-aligned with human-specified attributes. |
| Approach: | They propose a tool that PROduces Feedback via learning from LM simulated student revisions and propose to iteratively optimize the feedback generator by directly maximizing the effectiveness of students’ overall revising performance. |
| Outcome: | The proposed approach surpasses baseline methods in effectiveness of improving students’ writing and demonstrates enhanced pedagogical values, even though it was not explicitly trained for this aspect. |
Copied to clipboard
| Challenge: | a recent study shows that inappropriate language can cause models to output profanity . authors propose a training framework to prevent such outputs from hurting the usability of models . |
| Approach: | proposed training framework eliminates the causes that trigger the generation of profanity . authors propose a framework that leverages a short list of profans to prevent this . |
| Outcome: | a proposed training framework can prevent models from generating profanity . the proposed framework leverages a short list of profanities examples . |