Papers by Tian Yuan

45 papers
Rethinking Data Selection at Scale: Random Selection is Almost All You Need (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing data selection techniques are designed for small data pools, a study finds . filtering data by token length is an efficient method for improving results .
Approach: They use self-scoring methods that do not rely on external help to perform fine-tuning . they also find that filtering data by token length offers a stable and efficient method .
Outcome: The proposed methods outperform random selection on large datasets on large data pools.
Dynamic Routing Transformer Network for Multimodal Sarcasm Detection (2023.acl-long)

Copied to clipboard

Challenge: Existing methods for multimodal sarcasm detection rely on fixed architectures to capture cross-modal incongruity.
Approach: They propose a method that uses dynamic paths to activate different routing transformer modules with hierarchical co-attention adapting to cross-modal incongruity.
Outcome: The proposed method is compared to state-of-the-art methods on a public dataset.
Detoxifying Large Language Models via the Diversity of Toxic Samples (2025.emnlp-main)

Copied to clipboard

Challenge: Existing methods for analyzing and utilizing toxic samples are limited . current methods fail to fully harness their potential .
Approach: They propose a diverse detoxification framework that leverages toxic samples' diversity . they propose MPSG strategy and SC-DPO approach to elicit personalized toxic responses .
Outcome: The proposed framework could be used to optimize large language models for user safety . it incorporates two components: MPSG strategy and SC-DPO approach .
ImaRA: An Imaginative Frame Augmented Method for Low-Resource Multimodal Metaphor Detection and Explanation (2025.findings-naacl)

Copied to clipboard

Challenge: Existing methods for multimodal metaphor detection neglect cross-domain and attribute similarity characteristics underlying multimodal understanding.
Approach: They propose an Imaginative FRame Augmented method for multimodal metaphor detection and explanation . they use a cross-modal imagination dataset rich in multimodal multimodal expressions .
Outcome: The proposed method outperforms existing methods with training data on two datasets.
PaddleSpeech: An Easy-to-Use All-in-One Speech Toolkit (2022.naacl-demo)

Copied to clipboard

Challenge: PaddleSpeech is an open-source speech toolkit that supports speech-to-text and text-to speech tasks.
Approach: They describe the design philosophy and core architecture of PaddleSpeech to support several essential speech-to-text and text-to speech tasks.
Outcome: The proposed framework achieves competitive or state-of-the-art performance on various speech datasets and implements the most popular methods.
Modeling Conceptual Attribute Likeness and Domain Inconsistency for Metaphor Detection (2023.emnlp-main)

Copied to clipboard

Challenge: Metaphor detection aims to distinguish between metaphorical and literal expressions in text.
Approach: They propose an attribute likeness and domain inconsistency learning framework for wordpair metaphor detection based on conceptual metaphor theory . they model attribute likeity with an attribute siamese network and devise a domain contrastive learning strategy to learn semantic inconsistentness of concepts in source and target domains .
Outcome: The proposed framework outperforms existing word-pair and token-level methods on four datasets.
Retrieval Enhanced Data Augmentation for Question Answering on Privacy Policies (2023.eacl-main)

Copied to clipboard

Challenge: Existing labeled datasets are heavily imbalanced, limiting the QA performance in this domain.
Approach: They propose a question answering task that captures relevant text segments from unlabeled policy documents and expands the positive examples in the training set.
Outcome: The proposed framework elevates the baseline by a large margin (10% F1) and achieves a new state-of-the-art F1 score of 50%.
Refuse Whenever You Feel Unsafe: Improving Safety in LLMs via Decoupled Refusal Training (2025.acl-long)

Copied to clipboard

Challenge: Large Language Models exhibit a level of intelligence that is both impressive and everevolving, but their ability to refuse generating unsafe content is a double-edged sword.
Approach: They propose a method to tackle a refusal position bias within safety tuning data that compromises the models’ ability to appropriately refuse generating unsafe content.
Outcome: The proposed method significantly improves model safety without compromising performance and surpasses baseline methods in defending against attacks.
Conditional Supervised Contrastive Learning for Fair Text Classification (2022.findings-emnlp)

Copied to clipboard

Challenge: Recent advances in natural language processing have demonstrated societal bias in existing NLP models.
Approach: They propose to use contrastive learning to learn fair representations for text classification . they conduct experiments on two text datasets to demonstrate their methods are stable .
Outcome: The proposed methods balancing task performance and bias mitigation are stable in different hyperparameter settings.
Chain of Ideas: Revolutionizing Research Via Novel Idea Development with LLM Agents (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for idea generation either trivially prompt LLMs or expose LLM to extensive literature without indicating useful information.
Approach: They propose a chain-of-ideas agent that organizes literature in a chains structure . they propose evaluating idea-generation methods from different perspectives .
Outcome: The proposed agent outperforms existing methods and matches human quality in idea generation.
Meta-Rewarding Language Models: Self-Improving Alignment with LLM-as-a-Meta-Judge (2025.emnlp-main)

Copied to clipboard

Challenge: Existing methods for improving large language models have focused on improving model responses rather than judgment capabilities, resulting in rapid saturation during iterative training.
Approach: They propose an iterative Meta-Rewarding step where the model judges its own judgements and uses that feedback to refine its judgment skills.
Outcome: The proposed model improves Llama-3-8B-Instruct from 22.9% to 39.4% on AlpacaEval 2 and 20.6% to 29.1% on Arena-Hard.
FastClass: A Time-Efficient Approach to Weakly-Supervised Text Classification (2022.emnlp-main)

Copied to clipboard

Challenge: Recent research shows keyword-driven methods can achieve state-of-the-art performance on various tasks.
Approach: They propose an efficient weakly-supervised text classification approach using unlabeled data . they use dense text representation to retrieve class-relevant documents from unlabed corpus .
Outcome: The proposed weakly-supervised classification method outperforms keyword-driven models on a wide range of classification tasks.
AgentCPM-GUI: Building Mobile-Use Agents with Reinforcement Fine-Tuning (2025.emnlp-demos)

Copied to clipboard

Challenge: Large language model agents have enabled GUI-based automation, but their deployment is limited by noisy data, poor generalization, and lack of support for non-English GUIs.
Approach: They propose an 8B-parameter GUI agent built for robust and efficient on-device GUI interaction.
Outcome: The proposed GUI agent achieves promising performance on five public benchmarks and proposed Chinese benchmark CAGUI.
Measuring Large Language Models’ Adversarial Behavior in Social Deduction Games (2026.findings-acl)

Copied to clipboard

Challenge: Existing safety evaluations focus on refusal-based methods that test whether models avoid responding to inappropriate or violent requests, leaving open questions about how models behave in interactive social settings.
Approach: They propose to use a meta-LLM to construct a closed behavioral taxonomy from a multi-agent simulation to examine adversarial behavior of large language models.
Outcome: The proposed model-based model-driven model-model-based taxonomy shows that the model-led model-learning model exhibits distinct behavioral profiles and influences social stability and competitive success.
FineSteer: A Unified Framework for Fine-Grained Inference-Time Steering in Large Language Models (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for inference-time steering fail to be effective, utility-preserving and training-efficient due to rigid, one-size-fits-all designs and limited adaptability.
Approach: They propose a steering framework that decomposes inference-time steering into two stages . they propose 'conditional steering' mechanism that preserves model utility by avoiding unnecessary steering . a 'mixture-of-Steering-Experts' mechanism captures multimodal nature of desired steering behaviors .
Outcome: The proposed framework outperforms the state-of-the-art methods on safety and truthfulness benchmarks.
PLUE: Language Understanding Evaluation Benchmark for Privacy Policies in English (2023.acl-short)

Copied to clipboard

Challenge: Existing efforts to understand privacy policies are limited by processing the language in a way exclusive to a single task focusing on certain privacy practices.
Approach: They propose a privacy policy language understanding evaluation benchmark to evaluate the understanding of privacy policies across multiple tasks.
Outcome: The proposed framework improves the understanding of privacy policies across multiple tasks.
Explicit Alignment and Many-to-many Entailment Based Reasoning for Conversational Machine Reading (2023.findings-emnlp)

Copied to clipboard

Challenge: Recent research has explored how to improve the abilities of decision-making and question generation.
Approach: They propose a pipeline framework that aligns the document and user-provided information in an explicit way, makes decisions using a lightweight many-to-many entailment reasoning module and generates follow-up questions based on the document.
Outcome: The proposed framework achieves state-of-the-art in micro-accuracy and ranks the first place on the public leaderboard of the CMR benchmark dataset ShARC.
HiGoE: Hierarchical Graph of Evidence to Enhance Retrieval-Augmented Generation for Long-context Summarization (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for long-context summarization fail to capture high-level thematic structures and long-range dependencies.
Approach: They propose a hierarchical Graph of Evidence to reduce hallucination and attention dilution by replacing unreliable chunk-based methods with a filtered proposition–evidence graph.
Outcome: Experiments show that HiGoE surpasses baselines in quality and efficiency.
ChatMusician: Understanding and Generating Music Intrinsically with LLM (2024.findings-acl)

Copied to clipboard

Challenge: Despite LLMs' impressive capabilities in musical knowledge, music reasoning remains an unsolved task.
Approach: They propose an open-source large language model (LLM) that integrates intrinsic musical abilities into LLaMA2 and GPT-3.5.
Outcome: The proposed model can understand and generate music with a pure text tokenizer without external multi-modal neural structures or tokenizers.
Intent Classification and Slot Filling for Privacy Policies (2021.acl-long)

Copied to clipboard

Challenge: Sentences written in privacy policies explain privacy practices and the constituent text spans convey further specific information.
Approach: They propose an English corpus of 5,250 intent and 11,788 slot annotations . they propose two alternative neural approaches to model the corpus as a sequence-to-sequence learning task.
Outcome: The proposed corpus predicts intent classification and slot filling, while the sequence tagging method outperforms slot filler by a large margin.
MTAVG-Bench: A Diagnostic Benchmark for Multi-Talker Dialogue-Centric Audio-Video Generation (2026.acl-long)

Copied to clipboard

Challenge: Existing evaluation benchmarks for text-to-audio-video (T2AV) generation are largely designed for human-recorded videos or single-speaker settings.
Approach: They propose a failure-driven diagnostic benchmark for multi-talker dialogue-centric audio-video generation.
Outcome: The benchmark evaluates multi-speaker dialogue generation at four levels: audio-visual signal fidelity, temporal attribute consistency, social interaction, and cinematic expression.
PolicyQA: A Reading Comprehension Dataset for Privacy Policies (2020.findings-emnlp)

Copied to clipboard

Challenge: Privacy policy documents are long and verbose. Hence, a question answering system can help users find the information that is relevant and important to them.
Approach: They propose to provide users with a short text span from policy documents to search for answers from a long text segment.
Outcome: The proposed question answering system can help users find information relevant to them.
RiT: Rubrics-in-Thinking Reinforcement Learning for Improved Reasoning in Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Large Reasoning Models benefit from generating intermediate reasoning steps alongside final answers.
Approach: They propose a framework to introduce thinking-rubric supervision into intermediate reasoning.
Outcome: The proposed framework outperforms outcome-only RL baselines on reasoning-intensive and open-ended tasks.
ToHRE: A Top-Down Classification Strategy with Hierarchical Bag Representation for Distantly Supervised Relation Extraction (2020.coling-main)

Copied to clipboard

Challenge: Existing methods to find relational facts from texts lack hierarchical information of relations.
Approach: They propose a hierarchical classification framework which extracts relation in a top-down manner.
Outcome: The proposed method significantly outperforms state-of-the-art methods on NYT dataset . the proposed method generates large amounts of training data by aligning KBs with unlabeled corpora .
A Theory Guided Scaffolding Instruction Framework for LLM-Enabled Metaphor Reasoning (2024.naacl-long)

Copied to clipboard

Challenge: Existing methods for metaphor detection and reasoning struggle to explain the underlying reasoning process behind the metaphorical/literal judgment.
Approach: They propose a Theory guided Scaffolding Instruction framework that instructs an LLM to infer the underlying reasoning process of metaphor detection guided by metaphor theories for the first time.
Outcome: The proposed method significantly outperforms both the LLM-based reasoning methods and the SOTA methods in metaphor detection.
Shorten After You’re Right: Lazy Length Penalties for Reasoning RL (2026.findings-acl)

Copied to clipboard

Challenge: Existing shortening methods for long reasoning models rely on additional supervision or multi-stage post-training.
Approach: They propose a lazy length penalty that imposes length pressure on models without extra training stages.
Outcome: The proposed method significantly reduces response length without extra training stages while maintaining or improving performance.
LoRATK: LoRA Once, Backdoor Everywhere in the Share-and-Play Ecosystem (2025.findings-emnlp)

Copied to clipboard

Challenge: distributing LLMs without a proven track record like ‘meta-llama‘ or ‘qwen‘ rarely gains community traction.
Approach: They propose a simple, efficient, yet specific recipe for a backdoor LoRA to be injected into task-enhancing LoRAs and examine the mechanisms of such infections.
Outcome: The proposed model allows attackers to scale the distribution of compromised LoRAs with minimal effort by leveraging the rich pool of shared LoRA assets.
KG-Adapter: Enabling Knowledge Graph Integration in Large Language Models through Parameter-Efficient Fine-Tuning (2024.findings-acl)

Copied to clipboard

Challenge: Large language models (LLMs) are criticized for lack of expertise and knowledge conflict . KG-Adapter is a parameter-level KG integration method for decoder-only LLMs .
Approach: They propose a parameter-level KG integration method based on parameter-efficient fine-tuning . they use KG-Adapter to integrate knowledge graphs with LLMs and perform joint reasoning .
Outcome: The proposed method outperforms the current state-of-the-art method on four datasets for two different tasks.
Causality-aware Concept Extraction based on Knowledge-guided Prompting (2023.acl-long)

Copied to clipboard

Challenge: Concepts in knowledge graphs (KGs) are far from complete in existing knowledge graph models.
Approach: They propose to equip a PLM-based extractor with a knowledge-guided prompt to alleviate concept bias by removing spurious co-occurrence correlations from existing knowledge.
Outcome: The proposed prompt can alleviate concept bias and improve the performance of existing models.
R-Judge: Benchmarking Safety Risk Awareness for LLM Agents (2024.findings-emnlp)

Copied to clipboard

Challenge: Large language models (LLMs) have shown compelling abilities in reasoning, decision-making, and instruction following.
Approach: They propose a benchmark to evaluate the proficiency of large language models (LLMs) in judging and identifying safety risks given agent interaction records.
Outcome: The proposed model outperforms the best-performing model, GPT-4o, while no other models significantly exceed the random.
PV-SQL: Synergizing Database Probing and Rule-based Verification for Text-to-SQL Agents (2026.findings-acl)

Copied to clipboard

Challenge: Existing text-to-SQL systems struggle with deep contextual understanding .
Approach: They propose a framework that provides a tool to help query databases with deeper contextual understanding . they propose two components that iteratively generate probing queries and verify queries .
Outcome: Experiments show PV-SQL outperforms the best text-to-SqL baseline by 5% execution accuracy and 20.8% valid efficiency score while consuming fewer tokens.
IAPT: Instance-Aware Prompt Tuning for Large Language Models (2024.acl-long)

Copied to clipboard

Challenge: Existing methods for prompt tuning require many soft tokens to guarantee performance . large language models still require a large amount of GPU memory and computations to fine-tune .
Approach: They propose to use a parameter-efficient soft prompt generator to generate idiosyncratic soft prompts for each input instruction.
Outcome: The proposed method outperforms the baselines with comparable tunable parameters and is more efficient than LoRA under the single-backbone multi-tenant setting.
Towards Better Entity Linking with Multi-View Enhanced Distillation (2023.acl-long)

Copied to clipboard

Challenge: Entity linking is a fundamental task in Natural Language Processing (NLP), connecting mentions within unstructured contexts to their corresponding entities in a Knowledge Base (KB).
Approach: They propose a dual-encoder framework that can efficiently match mentions to two-encoding frameworks by a global-view.
Outcome: The proposed framework achieves state-of-the-art on several entity linking benchmarks.
Target-Oriented Relation Alignment for Cross-Lingual Stance Detection (2023.findings-acl)

Copied to clipboard

Challenge: Existing work on cross-lingual stance detection has ignored the inconsistency in the occurrences and distributions of targets between languages, which consequently degrades the performance of stance detector in low-resource languages.
Approach: They propose a fine-grained method which considers both target-level associations and language-level alignments to learn the in-language and cross-language associations.
Outcome: The proposed method is compared with competing methods under variant settings and shows that it performs better in low-resource languages.
Bridging Word-Pair and Token-Level Metaphor Detection with Explainable Domain Mining (2024.acl-long)

Copied to clipboard

Challenge: Existing methods for word-pair metaphor detection provide intermediate explainable clues for detection results.
Approach: They propose a method to bridge word-pair and token-level metaphor detection by modeling word pairs as explainable intermediate information.
Outcome: The proposed method bridges word-pair and token-level metaphor detection by using word pairs . it provides intermediate explainable clues for the detection results, but this is a challenge .
POINTS-Reader: Distillation-Free Adaptation of Vision-Language Models for Document Conversion (2025.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to training document conversion models with manual annotation are costly and time-consuming, and training student models by distilling outputs from teacher models can significantly limit their performance in real-world applications.
Approach: They propose a fully automated framework for constructing high-quality document extraction datasets and models capable of handling diverse document formats and layouts.
Outcome: The proposed model outperforms existing models and improves on annotated documents.
Preference Heads in Large Language Models: A Mechanistic Framework for Interpretable Personalization (2026.acl-long)

Copied to clipboard

Challenge: Large Language Models exhibit strong implicit personalization ability, but most approaches treat this behavior as a black box.
Approach: They propose a mechanistic interpretation perspective and propose 'sparse' set of Preference Heads . they compute a Preference Contribution Score for each attention head and compare their predictions .
Outcome: The proposed framework computes a Preference Contribution Score (PCS) for each attention head and measures its causal impact on user aligned outputs.
Rethinking Expert Trajectory Utilization in LLM Post-training for Mathematical Reasoning (2026.acl-long)

Copied to clipboard

Challenge: evolving generic Large Language Models into specialized Large Reasoning Models requires effective post-training.
Approach: They propose a plasticity-ceiling framework to harness expert trajectories . they establish the Sequential SFT-then-RL pipeline as the superior standard .
Outcome: The proposed framework overcomes stability and premature convergence deficits in synchronized approaches.
An LLM-Enabled Knowledge Elicitation and Retrieval Framework for Zero-Shot Cross-Lingual Stance Identification (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing research is conducted in monolingual setting on English datasets, whereas in other low-resource languages, it lacks sufficient data for training quality stance detection models.
Approach: They propose a knowledge elicitation and retrieval framework that leverages the capability of large language models for stance knowledge acquisition and matches the target language input to the most relevant stance information.
Outcome: The proposed framework improves on multilingual datasets and competitive baselines.
A Novel Cascade Binary Tagging Framework for Relational Triple Extraction (2020.acl-main)

Copied to clipboard

Challenge: Existing approaches to extract relational triples from unstructured text are inadequate to solve the overlapping triple problem.
Approach: They propose a cascade binary tagging framework that models relations as functions that map subjects to objects in a sentence.
Outcome: The proposed framework outperforms state-of-the-art methods on two datasets . it outperformed baseline methods by 17.5 and 30.2 absolute gains .
Interactive Text-to-SQL Generation via Editable Step-by-Step Explanations (2023.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to generate SQL from natural language are still making many mistakes . a new interaction mechanism allows users to edit a step-by-step explanation of a query to fix errors.
Approach: They propose a mechanism that allows users to edit a step-by-step explanation of a query to fix errors.
Outcome: The proposed approach can achieve better performance than multiple SOTA approaches on multiple datasets and 24 participants.
EvoMemKG: An Evolvable Memory Agent for Multi-hop Knowledge Graph Reasoning (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods for integrating knowledge graphs with large language models lack continuous learning capabilities.
Approach: They propose an agent framework with a dynamic, evolvable memory mechanism specifically designed for KG reasoning.
Outcome: EvoMemKG achieves state-of-the-art performance without training or tools . it achieves improvements of up to 20% over baseline on multi-hop queries .
Towards Unified Representations of Knowledge Graph and Expert Rules for Machine Learning and Reasoning (2022.aacl-main)

Copied to clipboard

Challenge: Empirical study shows superiority of proposed method over time-tested knowledge-driven and data-driven methods.
Approach: They propose a cognitive knowledge graph that unifies expert rules and relational facts as the substrate of machine learning and reasoning models.
Outcome: Empirical results show the proposed method superior to time-tested methods . the proposed model can perform both learning and reasoning with labeled data .
Is Parameter Collision Hindering Continual Learning in LLMs? (2025.coling-main)

Copied to clipboard

Challenge: Existing methods to learn multiple tasks in parallel often lead to catastrophic forgetting, resulting in overwriting knowledge.
Approach: They propose a non-collision low-rank Adaptation approach that leverages low collision rates to enhance continual learning (CL) in large language models.
Outcome: The proposed approach achieves better task orthogonality and higher task orthognality than existing SOTA methods.
Controllable Memory Usage: Balancing Anchoring and Innovation in Long-Term Human–Agent Interaction (2026.acl-long)

Copied to clipboard

Challenge: Existing systems that use memory as an "all-or-nothing" approach to memory usage are often static and rely on experience-following tendencies.
Approach: They propose a framework that allows users to dynamically regulate memory reliance by adding context into the model's prompt.
Outcome: The proposed model outperforms prompting and memory masking strategies in multiple scenarios.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations