Papers by Yong Xu

45 papers
RealSec-bench: A Benchmark for Evaluating Secure Code Generation in Real-World Repositories (2026.findings-acl)

Copied to clipboard

Challenge: Existing benchmarks for large language models fail to capture complex interplay between functionality and security.
Approach: They propose a benchmark for secure code generation constructed from real-world, high-risk Java repositories.
Outcome: The proposed benchmarks highlight the gap between functional and secure code generation in LLMs.
Beyond Demographics: Enhancing Cultural Value Survey Simulation with Multi-Stage Personality-Driven Cognitive Reasoning (2025.emnlp-main)

Copied to clipboard

Challenge: Introducing **MARK**, a framework for cultural value survey simulation . based on type dynamics theory, it improves accuracy and interpretation of models .
Approach: They propose a framework that integrates psychological theory into cultural value survey simulations.
Outcome: The proposed framework outperforms baseline models on the World Values Survey by 10% accuracy and reduces divergence between model predictions and human preferences.
Towards Real-World Writing Assistance: A Chinese Character Checking Benchmark with Faked and Misspelled Characters (2024.acl-long)

Copied to clipboard

Challenge: Existing studies focus on misspelled characters, ignoring faked characters which are more common and difficult to correct.
Approach: They propose to use Chinese character checking to identify and correct wrong characters in texts by human annotation.
Outcome: The proposed dataset is the first real-world visual and the largest human-crafted dataset for the Chinese character checking scenario.
PromptSource: An Integrated Development Environment and Repository for Natural Language Prompts (2022.acl-demo)

Copied to clipboard

Challenge: PromptSource is a system for creating, sharing, and using natural language prompts . prompts are used to train and query language models in zero-shot learning settings .
Approach: PromptSource is a system for creating, sharing, and using natural language prompts . et al.: using prompts to train and query language models is emerging area in NLP . they propose a templating language for defining data-linked prompts, a user interface that iterates on prompt development .
Outcome: PromptSource is a system for creating, sharing, and using natural language prompts . it has a templating language for defining data-linked prompts and a community-driven set of guidelines .
AlphaFin: Benchmarking Financial Analysis with Retrieval-Augmented Stock-Chain Framework (2024.lrec-main)

Copied to clipboard

Challenge: Currently, ML&DL methods fail to provide reasons for stock trend predictions, lacking interpretability and reasoning processes. large language models (LLMs) suffer from hallucinations and are unable to keep up with the latest information.
Approach: They develop a method to train large language models to handle financial analysis tasks . they use AlphaFin datasets to compare performance with traditional methods .
Outcome: The proposed method improves stock trend prediction and financial question answering tasks.
MAVEN-ARG: Completing the Puzzle of All-in-One Event Understanding Dataset with Event Argument Annotation (2024.acl-long)

Copied to clipboard

Challenge: Existing datasets for event understanding have limited coverage due to complexity of tasks.
Approach: They propose a dataset that augments MAVEN datasets with event argument annotations . they propose 98,591 events and 290,613 arguments obtained with laborious human annotation .
Outcome: The proposed dataset is the first all-in-one dataset supporting event detection, event argument extraction, and event relation extraction.
CityEQA: A Hierarchical LLM Agent on Embodied Question Answering Benchmark in City Space (2025.emnlp-main)

Copied to clipboard

Challenge: Embodied Question Answering (EQA) tasks are primarily focused on indoor environments, leaving the complexities of urban settings unexplored.
Approach: They propose a task where an embodied agent answers open-vocabulary questions in dynamic city spaces.
Outcome: The proposed agent achieves 60.7% of human-level answering accuracy compared to baselines . the proposed agent outperforms existing agents in open-ended city spaces .
Call Me When Necessary: LLMs can Efficiently and Faithfully Reason over Structured Environments (2024.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) have shown potential in reasoning over structured environments, e.g., knowledge graphs and tables.
Approach: They propose a framework that allows LLMs to efficiently and faithfully reason over structured environments.
Outcome: The proposed framework surpasses state-of-the-art fine-tuned methods on three KGQA and two TableQA datasets and surpasse CWQ and WTQ methods.
VIGIL: Defending LLM Agents Against Tool-Stream Injection via Verify-Before-Commit (2026.acl-long)

Copied to clipboard

Challenge: Existing defenses for indirect prompt injection are limited by static protection mechanisms . existing models prioritize injected rules due to strict alignment, whereas static protections sever the feedback loop required for adaptive reasoning.
Approach: They propose a framework that shifts the paradigm from restrictive isolation to a verify-before-commit protocol.
Outcome: The proposed framework outperforms state-of-the-art dynamic defenses by reducing the attack success rate by over 22% while more thandoubling utility under attack compared to static baselines.
EGSS: Entropy-guided Stepwise Scaling for Reliable Software Engineering (2026.acl-long)

Copied to clipboard

Challenge: Entropy-Guided Stepwise Scaling (EGSS) is a novel TTS framework for software engineering tasks.
Approach: They propose an entropy-guided stepwise scaling framework that balances efficiency and effectiveness through entropic-guide encoding and robust test-suite augmentation.
Outcome: EGSS boosts performance by 5–10% across all evaluated models, and reduces inference-time token usage by over 28% . compared to existing methods, EGS reduces token usage and reduce inference time by over 20% .
Streamlining the Collaborative Chain of Models into A Single Forward Pass in Generation-Based Tasks (2025.findings-acl)

Copied to clipboard

Challenge: Recent advances in "Chain of Models" approach increase resource demands as each model must be deployed separately.
Approach: They propose a prompt-tuning method that enables models to share hidden states . they modify input and attention masks during training to eliminate redundant forward passes .
Outcome: Empirical results show that FTHSS matches the performance of traditional model chains while improving inference efficiency.
Leveraging Only the Category Name for Aspect Detection through Prompt-based Constrained Clustering (2022.findings-emnlp)

Copied to clipboard

Challenge: Aspect category detection (ACD) aims to automatically identify user-concerned aspects from online reviews.
Approach: They propose a method that relies on the category name of each aspect and a pretrained language model to generate constraints for clustering.
Outcome: The proposed framework performs better than existing weakly supervised methods on nine benchmark datasets.
SARA: Salience-Aware Reinforced Adaptive Decoding for Large Language Models in Abstractive Summarization (2025.acl-long)

Copied to clipboard

Challenge: Existing decoding strategies neglect the explicit use of salient contextual information and rely on static hyperparameters to fix the balance between contextual and prior knowledge.
Approach: They propose a salience-aware reinforced adaptive decoding (SARA) which incorporates salient contextual information and allows the model to determine reliance on source document's context, salient context, and model's prior knowledge based on pointwise mutual information.
Outcome: The proposed model improves the quality and faithfulness of summaries across LLMs without modifying their weights.
EducationQ: Evaluating LLMs’ Teaching Capabilities Through Multi-Agent Dialogue Framework (2025.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) are increasingly used as educational tools, yet evaluating their teaching capabilities remains challenging due to the resource-intensive nature of teacher-student interactions.
Approach: They propose a multi-agent dialogue framework that efficiently assesses teaching capabilities through simulated dynamic educational scenarios.
Outcome: The proposed framework outperforms open-source models on 1,498 questions across 13 disciplines and 10 difficulty levels on 1,400 questions.
FedPETuning: When Federated Learning Meets the Parameter-Efficient Tuning Methods of Pre-trained Language Models (2023.findings-acl)

Copied to clipboard

Challenge: Existing research on federated learning (FL) for pre-trained language models (PLMs) with increasing concerns about data privacy, enterprises or institutions are not allowed to collect data from end devices or local clients to a centralized server for fine-tuning PLMs.
Approach: They investigate the parameter-efficient tuning of pre-trained language models (PLMs) and develop a federated benchmark for four representative PETuning methods .
Outcome: The proposed method can defend against privacy attacks and maintain acceptable performance with reducing heavy resource consumption.
On Diversified Preferences of Large Language Model Alignment (2024.findings-emnlp)

Copied to clipboard

Challenge: Large language models (LLMs) can be fine tuned with human feedback, but human preferences can be diversified due to annotators’ different tastes, which hinders the effectiveness of LLM alignment methods.
Approach: They propose a calibration error metric to evaluate large language models (LLMs) and a multi-objective reward learning method to enhance the calibration performance of RMs on shared preferences.
Outcome: The proposed model can be adopted as a key calibration error and MORE can achieve superior alignment performance.
UniRel: Unified Representation and Interaction for Joint Relational Triple Extraction (2022.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to extract rich correlations between entities and relations are not fully exploited by existing methods.
Approach: They propose to unify entities and relations by jointly encoding them within a concatenated natural language sequence and unify the modeling of interactions with a proposed Interaction Map.
Outcome: The proposed method is more efficient and efficient than existing methods and can be scaled up to 2021.
CityCube: Benchmarking Cross-view Spatial Reasoning on Vision-Language Models in Urban Environments (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks focus on indoor or street settings, overlooking challenges of open-ended urban spaces.
Approach: They propose a benchmark to probe cross-view spatial reasoning capabilities of current VLMs in urban settings.
Outcome: The citycube benchmark examines the performance of current vision-language models in urban environments.
ICL-Bandit: Relevance Labeling in Advertisement Recommendation Systems via LLM (2025.findings-emnlp)

Copied to clipboard

Challenge: In-context learning (ICL) is a common practice to enhance LLM performance on domain-specific tasks.
Approach: They propose a method that leverages large language models to enhance query-ad relevance labeling . they identify and provide superior demonstrations for ICL, thereby improving labeling performance .
Outcome: The proposed method improves query-ad relevance labeling performance by providing demonstrations.
Generator-Assistant Stepwise Rollback Framework for Large Language Model Agent (2025.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to integrate thoughts with actions can cause irreversible error propagation . Xi et al., 2023; Zhang eet coll., 2023) have focused on enhancing large language model (LLM) agents capable of helping humans tackle real-world challenges.
Approach: They propose a framework called Generator-Assistant Stepwise Rollback to induce better decision-making for LLM agents by integrating a generator and an assistant to examine each action produced by the generator.
Outcome: The proposed framework improves on three widely used benchmarks and can integrate seamlessly with other methods.
HS-STaR: Hierarchical Sampling for Self-Taught Reasoners via Difficulty Estimation and Budget Reallocation (2025.emnlp-main)

Copied to clipboard

Challenge: Recent studies have incorporated reward models to guide response selection or decoding, aiming to obtain higher-quality data.
Approach: They propose a Hierarchical Sampling framework for self-taught reasoners that allocates a fixed sampling budget to problem boundary-level problems and then reallocates the remaining budget toward high-utility problems during a re-sampling phase.
Outcome: The proposed framework outperforms baseline models without additional sampling budgets across multiple reasoning benchmarks and backbone LLMs.
EmRel: Joint Representation of Entities and Embedded Relations for Multi-triple Extraction (2022.naacl-main)

Copied to clipboard

Challenge: Existing studies only explore entity representations, but propose a novel triple perspective for relation extraction.
Approach: They propose to explicitly introduce relation representation and jointly represent it with entities to identify valid triples.
Outcome: The proposed method is based on ablations and document-level relation extraction and joint entity and relation extraction.
Everything of Thoughts: Defying the Law of Penrose Triangle for Thought Generation (2024.findings-acl)

Copied to clipboard

Challenge: Recent advances in Large Language Models (LLMs) have greatly advanced problem solving in diverse domains such as mathematical reasoning and knowledge reasoning.
Approach: They propose a thought prompting approach called 'Everything of Thoughts' it leverages pretrained reinforcement learning and Monte Carlo Tree Search to incorporate external domain knowledge and planning capability into thoughts.
Outcome: The proposed approach outperforms existing approaches on game of 24, 8-Puzzle, and Pocket Cube.
Temporal Extrapolation and Knowledge Transfer for Lifelong Temporal Knowledge Graph Reasoning (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for lifelong TKG reasoning only address part of the challenges.
Approach: They propose a temporal-path-based reinforcement learning framework for lifelong TKG reasoning . they add temporal displacement into the action space of RL to extrapolate for the future .
Outcome: The proposed model outperforms existing models against well-adapted baselines on three lifelong TKG reasoning benchmarks.
The Agent’s First Day: Benchmarking Learning, Exploration, and Scheduling in the Workplace Scenarios (2026.findings-acl)

Copied to clipboard

Challenge: Existing research mainly focuses on performance upper bounds in static environments, overlooking stochastic real-world deployment.
Approach: They propose a dynamic evaluation environment that simulates a "trainee" agent continuously exploring a novel setting.
Outcome: The proposed model evaluates agents in a dynamic evaluation environment that simulates a "trainee" agent continuously exploring a novel setting.
Identifying Collective Intelligence Factor in LLM Agent Groups for Generalizable Multi-Agent System Design (2026.findings-acl)

Copied to clipboard

Challenge: Prior studies have focused on designing customized MAS for specific tasks . a critical research question remains: do LLM agent groups exhibit a form of "general intelligence"
Approach: They find a Collective Intelligence factor in human groups that captures their general capability.
Outcome: The proposed model predicts the ACI factor based on the features of LLM agent groups and can improve generalization abilities.
LogiGraph: Logical Reasoning with Contrastive Learning and Lightweight Graph Networks (2025.coling-main)

Copied to clipboard

Challenge: Existing methods emphasize contextual semantics while others pay more attention to explicit logical features. Existing models utilize graph convolutional networks (GCN) for node updates, still exhibiting some shortcomings.
Approach: They propose a logical reasoning method with contrastive learning and lightweight graph networks (LogiGraph) they employ conjunction and punctuation marks as two types of edges to construct a dual graph.
Outcome: The proposed method improves the GCN and employs conjunction and punctuation marks as two types of edges to construct a dual graph.
HVGuard: Utilizing Multimodal Large Language Models for Hateful Video Detection (2025.emnlp-main)

Copied to clipboard

Challenge: Existing methods for hateful video detection rely on unimodal analysis or feature fusion . Existing tools struggle to capture cross-modal interactions and reason through implicit hate in sarcasm and metaphor .
Approach: They propose a reasoning-based hateful video detection framework with multimodal large language models . they integrate Chain-of-Thought reasoning to enhance multimodal interaction modeling .
Outcome: The proposed framework outperforms existing tools on two public datasets covering English and Chinese.
Let LLMs Take on the Latest Challenges! A Chinese Dynamic Question Answering Benchmark (2025.coling-main)

Copied to clipboard

Challenge: Recent work has noted that due to the extremely high cost of iterative updates of LLMs, they are often unable to answer dynamic questions well.
Approach: They propose a Chinese Dynamic QA benchmark containing question-answer pairs related to the latest dynamic questions on the Chinese Internet.
Outcome: The proposed benchmark will be one of the key data resources for improving LLMs’ Chinese question-answering ability in the future.
Parameter-Efficient Conversational Recommender System as a Language Processing Task (2024.eacl-long)

Copied to clipboard

Challenge: Existing methods to recommend items are categorized into attribute-based and generation-based methods.
Approach: They propose to represent items in natural language and formulate a conversational recommender system that can be optimized in a single stage without relying on non-textual metadata.
Outcome: The proposed model can be optimized in a single stage, without relying on non-textual metadata such as a knowledge graph.
Dual Encoder: Exploiting the Potential of Syntactic and Semantic for Aspect Sentiment Triplet Extraction (2024.lrec-main)

Copied to clipboard

Challenge: Aspect Sentiment Triple Extraction (ASTE) is an advanced natural language processing task.
Approach: They propose a Dual Encoder: Exploiting the potential of Syntactic and Semantic model which maximizes syntactical and semantic relationships among words.
Outcome: The proposed model surpasses the current state-of-the-art on public benchmarks and shows that it is highly efficient.
Unsupervised Sign Language Translation and Generation (2024.findings-acl)

Copied to clipboard

Challenge: Experimental results on the BBC-Oxford Sign Language dataset reveal that USLNet achieves competitive results compared to supervised baseline models.
Approach: They propose an unsupervised sign language translation and generation network that learns from abundant single-modality data without parallel sign language data.
Outcome: The proposed model achieves competitive results compared to baseline models on the BBC-Oxford Sign Language dataset and Open-Domain American Sign Language data.
QueryAgent: A Reliable and Efficient Reasoning Framework with Environmental Feedback based Self-Correction (2024.acl-long)

Copied to clipboard

Challenge: Existing methods for semantic parsing fail when hallucinations are encountered . QueryAgent solves a question step-by-step and performs stepwise self-correction .
Approach: They propose a framework that solves a query step-by-step and performs stepwise self-correction.
Outcome: The proposed framework outperforms existing methods on GrailQA and GraphQ by 5.7 and 15.0 points.
A Relaxed Matching Procedure for Unsupervised BLI (2020.acl-main)

Copied to clipboard

Challenge: Recent studies have shown that unsupervised bilingual lexicon induction is even on par with supervised methods.
Approach: They propose a relaxed matching procedure to find a more precise matching between two languages by aligning source and target embedding space bidirectionally.
Outcome: The proposed method significantly outperforms previous unsupervised methods on standard benchmarks.
Defining and Evaluating Visual Language Models’ Basic Spatial Abilities: A Perspective from Psychometrics (2025.acl-long)

Copied to clipboard

Challenge: Existing studies assessing the spatial abilities of VLMs lack a solid theoretical foundation and lack measurable data.
Approach: They propose a psychometric framework defining five basic spatial abilities in Visual Language Models.
Outcome: The proposed framework defines five basic spatial abilities in Visual Language Models (VLMs) it provides a comprehensive evaluation benchmark and methodological perspective for embodied AI development .
Multi-view Classification Model for Knowledge Graph Completion (2020.aacl-main)

Copied to clipboard

Challenge: Existing knowledge graph completion models only evaluated candidate triples from content information.
Approach: They propose a multi-view classification model where multiple views are performed based on both content and context information for candidate triple evaluation.
Outcome: The proposed model improves on two representative datasets and improves performance.
Beyond Itinerary Planning—A Real-World Benchmark for Multi-Turn and Tool-Using Travel Tasks (2026.acl-long)

Copied to clipboard

Challenge: Existing studies on LLM performance on travel planning have shown that existing settings are limited due to limited domain coverage, insufficient modeling of users’ implicit preferences in multi-turn conversations, and a lack of evaluation of agents’ capability boundaries.
Approach: They propose a benchmark to evaluate LLMs' planning and tool-use abilities in real-world settings by collecting user queries, user preferences, and tools from real scenarios.
Outcome: The proposed benchmark evaluates agents' capabilities in real-world settings and shows that even advanced models exhibit imbalanced performance across different capabilities.
Knowledge Mechanisms in Large Language Models: A Survey and Perspective (2024.findings-emnlp)

Copied to clipboard

Challenge: Using large language models, we can understand knowledge mechanisms in LLMs for learning, storage, utilization, and evolution.
Approach: They propose to analyze knowledge mechanisms in Large Language Models (LLMs) they examine utilization, evolution, and the potential dark knowledge (hypothesis) they hope to help understand knowledge in LLMs and provide insights for future research .
Outcome: The proposed model can be used to analyze the evolution of parametric knowledge in LLMs.
SEACrowd: A Multilingual Multimodal Data Hub and Benchmark Suite for Southeast Asian Languages (2024.emnlp-main)

Copied to clipboard

Challenge: Southeast Asia (SEA) is home to over 1,300 indigenous languages and 671 million people . prevailing AI models suffer from a significant lack of representation of texts, images, and audio datasets from SEA .
Approach: They propose to provide a resource center that provides standardized corpora in nearly 1,000 SEA languages across three modalities.
Outcome: a new benchmark assesses the quality of AI models on 36 SEA languages across 13 tasks . the results highlight the importance of SEA as a culturally diverse region .
QueryAttack: Jailbreaking Aligned Large Language Models Using Structured Non-natural Query Language (2025.findings-acl)

Copied to clipboard

Challenge: Existing methods to bypass security defenses of large language models (LLMs) are not effective, but QueryAttack can be jailbroken.
Approach: They propose a framework to examine generalizability of safety alignment by translating malicious queries into structured non-natural query languages.
Outcome: The proposed framework can achieve high attack success rates and jailbreak various defense methods on mainstream LLMs.
Memory-Augmented LLM-based Multi-Agent System for Automated Feature Generation on Tabular Data (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for automated feature generation rely on predefined operator libraries and do not incorporate feature semantics, limiting their ability to produce high-quality features.
Approach: They propose a Memory-Augmented LLM-based Multi-Agent System (MALMAS) that decomposes the generation process into agents with distinct responsibilities.
Outcome: The proposed method extracts informative features from raw tabular data without manual intervention and is crucial for accurate, generalizable machine learning.
Semi-Supervised Bilingual Lexicon Induction with Two-way Interaction (2020.emnlp-main)

Copied to clipboard

Challenge: Existing semisupervised methods do not fully utilize the knowledge hidden in annotated and nonannotated data, which hinders further improvement of their performance.
Approach: They propose a semi-supervised BLI framework to encourage interaction between supervised signal and unsupervised alignment.
Outcome: The proposed framework can incorporate any supervised and unsupervised BLI methods based on optimal transport and bi-directional lexicon update.
Diffuse Thinking: Exploring Diffusion Language Models as Efficient Thought Proposers for Reasoning (2026.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) have demonstrated strong capabilities in complex reasoning tasks, yet their autoregressive generation paradigm makes it computationally prohibitive to explore diverse reasoning paths.
Approach: They propose a framework that combines diffusion-based generation with autoregressive evaluation to efficiently generate diverse intermediate reasoning thoughts and employ LLMs as evaluators to assess and select candidates based on their plausibility and correctness.
Outcome: The proposed framework improves inference efficiency while maintaining competitive or superior reasoning accuracy.
FuseSearch: Learning Adaptive Parallel Execution for Efficient Code Localization (2026.findings-acl)

Copied to clipboard

Challenge: Existing parallel code localization agents suffer from a 34.9% redundant tool invocation rate . specialized localization agent that operate as dedicated search components is needed to achieve high localization accuracy.
Approach: They propose a parallel code localization system that reframes parallel code execution as a quality–efficiency co-optimization problem.
Outcome: The proposed method matches SOTA performance while being 93.6% faster.
SpikeVoice: High-Quality Text-to-Speech Via Efficient Spiking Neural Network (2024.acl-long)

Copied to clipboard

Challenge: SpikeVoice performs high-quality Text-To-Speech (TTS) via SNN . major obstacle to using SNN for such generative tasks lies in the demand for models to grasp long-term dependencies.
Approach: They propose a brain-inspired Spiking Neural Network (SNN) which performs high-quality Text-To-Speech (TTS) via SNN and explores the potential of SNN to "speak".
Outcome: The proposed model achieves comparable results to Artificial Neural Networks (ANN) with only 10.5% energy consumption of ANN.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations