Papers by Yuan Ma

47 papers
A Survey of LLM-based Agents in Medicine: How far are we from Baymax? (2025.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) are transforming healthcare through their ability to understand and assist with medical tasks.
Approach: They analyze system profiles, clinical planning, medical reasoning frameworks, and external capacity enhancement.
Outcome: The findings highlight the future directions in medical reasoning, physical system integration, and training simulations.
Unity in Diversity: Collaborative Pre-training Across Multimodal Medical Sources (2024.acl-long)

Copied to clipboard

Challenge: Current pre-training techniques rely on a limited scope of medical data, limiting the range of downstream tasks.
Approach: They propose a pre-training strategy that unifies patient data within individual sources and captures explicit and implicit correlations between patients across different sources.
Outcome: The proposed strategy bridges the gap between multimodal medical sources by aggregating patient data within individual sources and capturing explicit and implicit correlations between patients across sources.
EVA: Evolving Semantic Adversaries for Red-Teaming GUI Agents Against Environmental Injection Attacks (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods for red-teaming face a trade-off between requiring target-specific knowledge and incurring prohibitive computational costs.
Approach: They propose a framework that evolves payloads exclusively on the semantic dimension via a discovery-deployment pipeline.
Outcome: Experiments show that EVA outperforms baselines in terms of attack success rate while evolving benign seeds into successful attacks within 1.18 to 1.71 iterations.
PaddleSpeech: An Easy-to-Use All-in-One Speech Toolkit (2022.naacl-demo)

Copied to clipboard

Challenge: PaddleSpeech is an open-source speech toolkit that supports speech-to-text and text-to speech tasks.
Approach: They describe the design philosophy and core architecture of PaddleSpeech to support several essential speech-to-text and text-to speech tasks.
Outcome: The proposed framework achieves competitive or state-of-the-art performance on various speech datasets and implements the most popular methods.
Early Detection of Fake News by Utilizing the Credibility of News, Publishers, and Users based on Weakly Supervised Learning (2020.coling-main)

Copied to clipboard

Challenge: Existing models for fake news detection are often insufficient or lacking in features . a novel structure-aware multi-head attention network can detect fake news in 4 hours .
Approach: They propose a structure-aware multi-head attention network to detect fake news in mass news . they use credibility of publishers and users as prior weakly supervised information .
Outcome: The proposed model can detect fake news in 4 hours with an accuracy of over 91% . the proposed model is faster than the state-of-the-art models .
GrocLM: Grocery Category Recommendation in E-Commerce with Large Language Models (2026.acl-industry)

Copied to clipboard

Challenge: a growing number of online grocery shoppers are using category-level recommendation systems . traditional item-level methods face scalability and accuracy challenges .
Approach: a new language model is developed to encode cyclical purchasing patterns into model parameters . the model is scalable and more business-aligned than traditional item-level methods .
Outcome: a new language model outperforms standard methods in a live production environment . the proposed model achieves a 7.5% relative improvement in cart-adds per impression .
Robustness via Referencing: Defending against Prompt Injection Attacks by Referencing the Executed Instruction (2026.findings-acl)

Copied to clipboard

Challenge: Prompt injection attacks manipulate large language models (LLMs) by misleading them to deviate from the original input instructions and execute maliciously injected instructions.
Approach: They propose a prompt injection defense method that suppresses the model's instruction-following tendencies rather than suppressing them.
Outcome: The proposed method outperforms prompt-engineering-based approaches and fine-tuning methods and reduces the ASR to nearly 0% in some scenarios.
RankPrompt: Step-by-Step Comparisons Make Language Models Better Reasoners (2024.lrec-main)

Copied to clipboard

Challenge: Existing solutions to reasoning tasks require extensive human annotations or fail in scenarios with inconsistent responses.
Approach: They propose a new method that enables LLMs to self-rank their responses without additional resources.
Outcome: The proposed method improves reasoning performance of ChatGPT and GPT-4 with 13% improvement over existing methods.
AgentRouter: A Knowledge-Graph-Guided LLM Router for Collaborative Multi-Agent Question Answering (2026.acl-long)

Copied to clipboard

Challenge: Existing approaches to agent routing emphasize cost efficiency while overlooking the fine-grained contextual and relational structure inherent in QA tasks.
Approach: They propose a framework that formulates multi-agent QA as a knowledge-graph-guided routing problem supervised by empirical performance signals.
Outcome: The proposed framework outperforms single-agent and ensemble baselines while generalizing across benchmarks and LLM backbones.
ParaCook: On Time-Efficient Planning for Multi-Agent Systems (2026.findings-acl)

Copied to clipboard

Challenge: Existing agent benchmarks focus on task completion while neglecting time efficiency in parallel and asynchronous operations.
Approach: They propose a framework for large language models that allows agents to plan long-horizon tasks in a scalable way.
Outcome: The proposed framework is based on the Overcooked game and can be used to evaluate time efficiency-aware multi-agent planning.
ThinkLinker: From Low-Rank Interaction to Knowledge-Aware Verification for Multimodal Entity Linking (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods for multimodal entity linking rely on textual context for disambiguation . textual contextual information alone fails to resolve ambiguity, leading to unreliable disambiguations in weak contexts.
Approach: They propose a two-stage multimodal entity linking framework called ThinkLinker . they propose fusion mechanism to model joint dependencies among features .
Outcome: The proposed framework outperforms state-of-the-art models on public benchmark datasets.
Fluent and Low-latency Simultaneous Speech-to-Speech Translation with Self-adaptive Training (2020.findings-emnlp)

Copied to clipboard

Challenge: Current approaches to simultaneous speech-to-speech translation accumulate more and more latencies in later sentences when the speaker talks faster.
Approach: They propose a method which generates more fluent target speech latency than the baseline . they propose to use self-adaptive translation to adjust the length of translations to accommodate different source speech rates.
Outcome: Xiong et al., 2019) show that the proposed method generates more fluent target speech latency than baseline . authors say it provides more natural communication process than speech-to-text translation . xiong and colleagues say the proposed technique is more efficient than current approaches .
KS-Lottery: Finding Certified Lottery Tickets for Multilingual Transfer in Large Language Models (2025.naacl-long)

Copied to clipboard

Challenge: Existing studies have shown that a small subset of parameters is highly effective in fine-tuning . prior work shows that there are a few additional parameters corresponding to an intrinsic dimension in a well-trained Large Language Model.
Approach: They propose a method to identify a small subset of LLM parameters highly effective in multilingual fine-tuning.
Outcome: The proposed method can find the certified winning tickets in the embedding layer, and fine-tuning on the found parameters is guaranteed to perform as well as full fine- tuning.
Quantifying the Impact of Structured Output Format on Large Language Models through Causal Inference (2026.findings-eacl)

Copied to clipboard

Challenge: Prior studies have examined the impact of structured output on LLMs’ generation quality, often presenting one-way findings.
Approach: They propose to derive five potential causal structures characterizing the influence of structured output on LLMs’ generation using one assumed and two guaranteed constraints.
Outcome: The proposed pipeline can be extended to other modules and is not limited to structured output but can be used in industrial applications.
KAPALM: Knowledge grAPh enhAnced Language Models for Fake News Detection (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing methods of fake news detection focus on news entity information and ignore structured knowledge among news entities.
Approach: They propose a model that fuses coarse- and fine-grained representations of entity knowledge from Knowledge Graphs (KGs) they identify entities in news content and link them to entities in KGs.
Outcome: The proposed model outperforms state-of-the-art models on two benchmark datasets and is competitive in the few-shot scenario.
Investigating and Mitigating the Multimodal Hallucination Snowballing in Large Vision-Language Models (2024.acl-long)

Copied to clipboard

Challenge: Large Vision-Language Models (LVLMs) suffer from multimodal hallucinations . however, the generated hallucines could influence the models’ subsequent generation .
Approach: They propose a framework to evaluate LVLMs' behaviors when encountering generated hallucinations and a method to revise the output distribution of LVLs with the one derived from the residual visual input.
Outcome: The proposed framework reduces the performance of open-source LVLMs by 31%, indicating that they are prone to accept the generated hallucinations and make false claims that they would not have supported without distractions.
CIF-Bench: A Chinese Instruction-Following Benchmark for Evaluating the Generalizability of Large Language Models (2024.findings-acl)

Copied to clipboard

Challenge: a recent study shows that large language models have limited generalization in low-resource languages like Chinese.
Approach: They propose to evaluate the zero-shot generalizability of large language models to the Chinese language . they release only half of the dataset publicly, with the remainder kept private .
Outcome: The Chinese Instruction-Following Benchmark evaluates the generalizability of LLMs to the Chinese language.
PivotFEC: Enhancing Few-shot Factual Error Correction with a Pivot Task Approach using Large Language Models (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for Factual Error Correction (FEC) use mask-then-correct paradigms . however, the lack of datasets containing false claims has impeded progress .
Approach: They propose a method that enhances few-shot FEC with a pivot task approach using large language models.
Outcome: The proposed method outperforms its few-shot counterpart by 7.9 points in SARI . it improves widely-adopted SARI metrics by 11.3 compared to the best-performing methods .
HiGoE: Hierarchical Graph of Evidence to Enhance Retrieval-Augmented Generation for Long-context Summarization (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for long-context summarization fail to capture high-level thematic structures and long-range dependencies.
Approach: They propose a hierarchical Graph of Evidence to reduce hallucination and attention dilution by replacing unreliable chunk-based methods with a filtered proposition–evidence graph.
Outcome: Experiments show that HiGoE surpasses baselines in quality and efficiency.
OpenAttack: An Open-source Textual Adversarial Attack Toolkit (2021.acl-demo)

Copied to clipboard

Challenge: Various attack models are distinct and implemented with different programming frameworks and settings, which hinders quick utilization and fair comparison of attack models.
Approach: They propose an open-source textual adversarial attack toolkit to solve these issues by combining 15 typical attack models into one toolkit.
Outcome: The proposed toolkit supports all attack types, multilinguality, and parallel processing.
ChatMusician: Understanding and Generating Music Intrinsically with LLM (2024.findings-acl)

Copied to clipboard

Challenge: Despite LLMs' impressive capabilities in musical knowledge, music reasoning remains an unsolved task.
Approach: They propose an open-source large language model (LLM) that integrates intrinsic musical abilities into LLaMA2 and GPT-3.5.
Outcome: The proposed model can understand and generate music with a pure text tokenizer without external multi-modal neural structures or tokenizers.
TriPlay-RL: Tri-Role Self-Play Reinforcement Learning for LLM Safety Alignment (2026.acl-long)

Copied to clipboard

Challenge: Existing approaches to safety alignment of large language models rely on costly manual annotations or human review.
Approach: They propose a closed-loop reinforcement learning framework called TriPlay-RL that enables iterative collaboration among three roles with near-zero manual annotation.
Outcome: The proposed framework achieves 20%–50% improvement in adversarial effectiveness while preserving high output diversity while achieving 10%–30% gains in safety performance without degrading general reasoning capability.
CAST: Corpus-Aware Self-similarity Enhanced Topic modelling (2025.naacl-long)

Copied to clipboard

Challenge: Existing topic modelling methods encode contextual information of documents while ignoring contextual details of candidate centroid words. Existing methods are limited by the contextualization gap.
Approach: They propose a topic modelling method that builds upon candidate centroid word embeddings contextualized on the dataset and a self-similarity-based method to filter out less meaningful tokens.
Outcome: The proposed method significantly enhances the coherence and diversity of generated topics, and handles noisy data, outperforming strong baselines.
Multi-lingual Argumentative Corpora in English, Turkish, Greek, Albanian, Croatian, Serbian, Macedonian, Bulgarian, Romanian and Arabic (L18-1)

Copied to clipboard

Challenge: Argumentative corpora are costly to create and available only in few languages with English dominating the area.
Approach: They use 8 different argument mining classifiers trained for English to build a parallel corpora in which the source language is English and the target language is either a Balkan language or Arabic.
Outcome: The proposed method is based on 8 different argument mining classifiers trained for English and project the decision to the target language.
Making MLLMs Blind: Adversarial Smuggling Attacks in MLLM Content Moderation (2026.findings-acl)

Copied to clipboard

Challenge: Multimodal Large Language Models (MLLMs) are increasingly being deployed as content moderators . however, they exploit the Human-AI capability gap and create adversarial environments . smuggling attacks exploit the human-AI gap and exploit the vulnerability .
Approach: They construct a benchmark to evaluate the vulnerability of MLLMs as content moderators . they identify three root causes: limited capabilities of vision encoders, robustness gap in OCR .
Outcome: The proposed model exploits the Human-AI capability gap and is vulnerable to smuggling attacks.
Text-to-Text Automatic Story Generation: A Survey (2026.eacl-srw)

Copied to clipboard

Challenge: Automated story generation aims to produce coherent, engaging, and contextually consistent narratives with minimal or no human involvement . despite advances in large language models, maintaining narrative coherence, character consistency, storyline diversity, and plot controllability in generating stories is still challenging.
Approach: They propose to develop new evaluation metrics and better data sets to support automatic story generation.
Outcome: The proposed evaluation metrics and better datasets will improve narrative coherence and consistency and explore practical applications of story generation.
FlowSearch: Advancing Deep Research with Dynamic Structured Knowledge Flow (2026.acl-long)

Copied to clipboard

Challenge: FlowSearch is a multi-agent framework that actively constructs and evolves a dynamic structured knowledge flow to drive subtask execution and reasoning.
Approach: They propose a multi-agent framework that actively constructs and evolves a dynamic structured knowledge flow to drive subtask execution and reasoning.
Outcome: The proposed framework achieves competitive performance on GAIA, HLE, GPQA and TRQA benchmarks and is available to download.
x1: Learning to Think Adaptively Across Languages and Cultures (2026.findings-acl)

Copied to clipboard

Challenge: Existing large language models (LLMs) ignore this diversity by reasoning in a single dominant language.
Approach: They propose a family of reasoning models that can adaptively reason in an advantageous language on a per-instance basis.
Outcome: The proposed model can reason in a single dominant language on a per-instance basis.
Train in Vain: Functionality-Preserving Poisoning to Prevent Unauthorized Use of Code Datasets (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods for dataset poisoning require full-dataset poison, which breaks code compilability.
Approach: They propose a functionality-preserving poisoning approach that injects short, compilable weak-use fragments into executed code paths.
Outcome: The proposed method contaminates 10% of the dataset while maintaining 100% compilability and functional correctness.
AEGIS: A Holistic Benchmark for Evaluating Forensic Analysis of AI-Generated Academic Images (2026.acl-long)

Copied to clipboard

Challenge: AEGIS examines whether current models can effectively audit AI-generated images in academic papers.
Approach: They propose a holistic benchmark for forensic analysis of AI-Generated academic ImageS that reveals limitations in academic image forensics.
Outcome: AEGIS compared with existing benchmarks on seven academic categories and features key advances in forensic analysis.
An Effective and Efficient Entity Alignment Decoding Algorithm via Third-Order Tensor Isomorphism (2022.acl-long)

Copied to clipboard

Challenge: Existing methods focus on graph representation learning, but decoding is a key part of the process.
Approach: They propose an EA Decoding Algorithm via Third-order Tensor Isomorphism (DATTI) they combine two sets of isomorphic equations to enhance the decoding process .
Outcome: The proposed algorithm can deliver significant performance improvements even on the most advanced methods while the extra required time is less than 3 seconds.
ToPro: Token-Level Prompt Decomposition for Cross-Lingual Sequence Labeling Tasks (2024.eacl-long)

Copied to clipboard

Challenge: Prompt-based methods have been successfully applied to multilingual pretrained language models for zero-shot cross-lingual understanding.
Approach: They propose a prompt-based method for token-level sequence labeling tasks . they propose to decompose an input sentence into single tokens and apply one prompt template to each token.
Outcome: The proposed method outperforms Vanilla fine-tuning and Prompt-Tuning in zero-shot cross-lingual transfer . the method also attains state-of-the-art performance when employed with the mT5 model .
CC-Tuning: A Cross-Lingual Connection Mechanism for Improving Joint Multilingual Supervised Fine-Tuning (2025.acl-long)

Copied to clipboard

Challenge: Existing fine-tuning approaches that focus on English-centric training corpora often introduce implicit cross-lingual alignment, overlooking the potential for more profound, latent-level cross-linguistic interactions.
Approach: They propose a multilingual fine-tuning paradigm that explicitly establishes a cross-lingual connection mechanism at the latent level.
Outcome: The proposed model outperforms vanilla SFT and offers a strong latent-level alternative to data-level augmentation methods.
Caution for the Environment: Multimodal LLM Agents are Susceptible to Environmental Distractions (2025.acl-long)

Copied to clipboard

Challenge: Experimental results show that multimodal GUI agents are susceptible to environmental distractions.
Approach: They propose a scenario where both user and agent are benign and environment is not malicious . they implement an adversarial environment injection and analyze the approach to improve faithfulness .
Outcome: The proposed approach improves faithfulness of multimodal large language model agents in a graphical user interface environment.
Large Language Models Have Intrinsic Meta-Cognition, but Need a Good Lens (2025.emnlp-main)

Copied to clipboard

Challenge: Existing studies have focused on the cognitive error detection capabilities of Large Language Models (LLMs), but few studies have examined the meta-cognitive abilities of LLMs.
Approach: They propose an automated meta-cognition evaluation framework for evaluation of LLMs and a Markovian Intrinsic Reward Adjustment strategy to boost current lenses.
Outcome: The proposed framework can be used to evaluate the meta-cognition abilities of LLMs and improve them.
Your RAG is Unfair: Exposing Fairness Vulnerabilities in Retrieval-Augmented Generation via Backdoor Attacks (2025.emnlp-main)

Copied to clipboard

Challenge: Retrieval-augmented generation (RAG) enhances factual grounding but introduces new attack surfaces, particularly through backdoor attacks.
Approach: They propose a framework that exposes fairness vulnerabilities in RAG through a two-phase backdoor attack.
Outcome: Empirical results show that BiasRAG achieves high attack success rates while remaining undetectable under standard fairness evaluations.
COIG-CQIA: Quality is All You Need for Chinese Instruction Fine-tuning (2025.findings-naacl)

Copied to clipboard

Challenge: Existing datasets for Chinese instruction tuning are not well-aligned with Chinese users’ interaction patterns.
Approach: They propose to use Chinese instruction tuning datasets to improve instruction fine-tuning for Chinese users.
Outcome: The proposed dataset shows that Chinese models achieve competitive performance in diverse benchmarks.
SAFE-QAQ: End-to-End Slow-Thinking Audio-Text Fraud Detection via Reinforcement Learning (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for fraud detection rely on transcribed text, lacking acoustic cues . a proposed framework for audio-based slow-thinking fraud detection eliminates transcription errors .
Approach: They propose a framework for audio-based slow-thinking fraud detection that eliminates transcription errors and rewards slow-thought reasoning by capturing fine-grained audio details.
Outcome: The proposed method improves accuracy, inference efficiency, and real-time processing capabilities.
What Makes a Good Curriculum? Disentangling the Effects of Data Ordering on LLM Mathematical Reasoning (2026.acl-long)

Copied to clipboard

Challenge: Curriculum learning (CL) orders data corpus by difficulty, but prior work employs disparate difficulty metrics and training setups.
Approach: They propose a framework that decomposes curriculum difficulty into five dimensions: Problem Difficulty, Model Surprisal, Confidence Margin, Predictive Uncertainty and Decision Variability.
Outcome: The proposed framework decomposes curriculum difficulty into five dimensions . the results show that no curriculum strategy dominates universally .
Label-Specific Dual Graph Neural Network for Multi-Label Text Classification (2021.acl-long)

Copied to clipboard

Challenge: Existing studies for multi-label text classification do not explore label-specific semantic components from documents.
Approach: They propose a label-specific dual graph neural network that incorporates category information to learn label-related components from documents.
Outcome: The proposed model outperforms state-of-the-art models on three benchmark datasets and achieves better performance with respect to tail labels.
MATCH: Modulating Attention via In-Context Retrieval for Long-Context Transformers (2026.acl-long)

Copied to clipboard

Challenge: Existing approaches to improve efficiency often enforce rigid structural constraints such as local attention windows.
Approach: They propose a framework that augments sparse-attention mechanisms with dynamically integrated in-context information through an efficient retrieval system.
Outcome: Empirical results show that MATCH significantly improves the performance of sparse-attention models on synthetic and real-world natural-language tasks.
UniPCM: Universal Pre-trained Conversation Model with Task-aware Automatic Prompt (2024.lrec-main)

Copied to clipboard

Challenge: Recent studies have shown that multi-task instruction tuning after pre-training greatly improves the model’s robustness and transfer ability, which is crucial for building a high-quality dialog system.
Approach: They propose to use Task-aware Automatic Prompt generation (TAP) to automatically generate high-quality prompts from 15 dialog-related tasks.
Outcome: The proposed model is robust to input prompts and capable of various dialog-related tasks.
Hierarchical Pretraining on Multimodal Electronic Health Records (2023.emnlp-main)

Copied to clipboard

Challenge: Existing pretraining models on EHR data are too specific, limiting their transferability.
Approach: They propose a general, unified pretraining framework for hierarchically multimodal EHR data that can be used to train models on a large dataset before fine-tuning it on 'upstream' tasks.
Outcome: The proposed model performs on eight downstream tasks spanning three levels and compares with baselines on 18 different tasks.
A Simple Temporal Information Matching Mechanism for Entity Alignment between Temporal Knowledge Graphs (2022.coling-1)

Copied to clipboard

Challenge: Existing methods for EA between temporal KGs incorporate relational and temporal information into entity embeddings.
Approach: They propose a method to generate unsupervised alignment seeds using temporal information from TKGs.
Outcome: The proposed method outperforms the previous methods by using temporal information.
TextFlint: Unified Multilingual Robustness Evaluation Toolkit for Natural Language Processing (2021.acl-demo)

Copied to clipboard

Challenge: Existing approaches to textual robustness evaluation focus on slightly modifying the input data, which maintains the original meaning and results in a different prediction.
Approach: They propose a multilingual robustness evaluation toolkit for NLP that integrates universal text transformations, task-specific transformations and adversarial attack.
Outcome: The toolkit includes universal text transformation, task-specific transformation, adversarial attack, subpopulation, and their combinations to provide comprehensive robustness analyses.
DavIR: Data Selection via Implicit Reward for Large Language Models (2025.acl-long)

Copied to clipboard

Challenge: 6% of Alpaca dataset selected with DavIR can steer both LLaMA and Gemma models to produce superior performance compared to the same models trained on the full 52K dataset.
Approach: They propose a model-based data selection method for post-training Large Language Models . they generalize Reducible Holdout Loss to core-set selection problem of causal language modeling .
Outcome: The proposed method can steer both LLaMA and Gemma models to superior performance compared to the same models trained on the full 52K dataset.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations