Papers by An Yang

41 papers
Rethinking Data Selection at Scale: Random Selection is Almost All You Need (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing data selection techniques are designed for small data pools, a study finds . filtering data by token length is an efficient method for improving results .
Approach: They use self-scoring methods that do not rely on external help to perform fine-tuning . they also find that filtering data by token length offers a stable and efficient method .
Outcome: The proposed methods outperform random selection on large datasets on large data pools.
Thread: A Logic-Based Data Organization Paradigm for How-To Question Answering with Retrieval Augmented Generation (2025.emnlp-main)

Copied to clipboard

Challenge: Recent advances in retrieval-augmented generation (RAG) have substantially improved question-answering systems, particularly for factoid ‘5Ws’ questions.
Approach: They propose a data organization paradigm where large language models transform documents into more structured and loosely interconnected LUs.
Outcome: Experiments in open-domain and industrial settings show that the proposed paradigm outperforms existing paradigms and shows high adaptability across diverse document formats.
Transparent Reference-free Automated Evaluation of Open-Ended User Survey Responses (2025.emnlp-industry)

Copied to clipboard

Challenge: Existing methods to evaluate open-ended survey responses are expensive and lack ground-truth reference for comparison.
Approach: They propose a two-stage evaluation framework specifically designed for human survey responses that uses gibberish filtering to remove nonsensical responses.
Outcome: The proposed evaluation framework outperforms existing metrics on English and Korean datasets and shows strong correlations with expert assessment.
Detecting Subtle Differences between Human and Model Languages Using Spectrum of Relative Likelihood (2024.emnlp-main)

Copied to clipboard

Challenge: Existing methods for detecting modelgenerated texts from human texts are limited by the fact that absolute likelihood values of texts are bound to certain linguistic and cognitive constraints.
Approach: They propose to use relative likelihood values instead of absolute ones to extract useful features from the spectrum-view of likelihood for the human-model text detection task.
Outcome: The proposed method can reveal subtle differences between human and model languages, which find theoretical roots in psycholinguistics studies.
Beware of Your Po! Measuring and Mitigating AI Safety Risks in Role-Play Fine-Tuning of LLMs (2025.acl-long)

Copied to clipboard

Challenge: Existing role-play fine-tuning techniques improve role adaptability but may degrade safety performance, especially for villainous characters.
Approach: They propose safety-aware Role-Play Fine-Tuning (SaRFT) to balance role-playing capabilities and safety.
Outcome: The proposed method outperforms state-of-the-art baselines under both LoRA and full-parameter fine-tuning settings.
MOOSE-Copilot: A Web-Based Interactive Assistant for Unified Exploratory and Fine-Grained Scientific Hypothesis Discovery (2026.acl-demo)

Copied to clipboard

Challenge: Existing approaches to scientific hypothesis discovery operate autonomously with little to no human guidance.
Approach: They propose a framework that empowers scientists to steer the generative process via explicit signals.
Outcome: The proposed framework outperforms existing models in terms of quality and accuracy of the input signals.
Hello Again! LLM-powered Personalized Agent for Long-term Dialogue (2025.naacl-long)

Copied to clipboard

Challenge: Existing dialogue systems focus on brief single-session interactions, neglecting real-world needs for long-term companionship and personalized interactions.
Approach: They propose a model-agnostic framework for long-term dialogue agents . they use event summary and persona management to enable reasoning .
Outcome: The proposed framework incorporates three independently tunable modules dedicated to event perception, persona extraction, and response generation.
LongSpec: Long-Context Lossless Speculative Decoding with Efficient Drafting and Verification (2026.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) can process extremely long contexts, requiring efficient inference over extended inputs.
Approach: They propose a model that uses a constant-sized key-value cache to train long-context models.
Outcome: Experimental results show that LongSpec achieves 3.26x speedup over strong Flash Attention baselines and 2.34x wall clock time on four math reasoning tasks.
Evaluation Metrics for Headline Generation Using Deep Pre-Trained Embeddings (2020.lrec-1)

Copied to clipboard

Challenge: Recent generative language models have shown promise in abstractive summarization tasks.
Approach: They propose to use Fr echet embedding distance and angular embeddable similarity to evaluate the performance of generative language models in abstractive summarization tasks.
Outcome: The proposed metric shows close relation with human judgments and has overall better correlations with them.
A Reinforcement Learning Framework for Robust and Secure LLM Watermarking (2026.eacl-long)

Copied to clipboard

Challenge: Existing watermarking algorithms rely on heuristic green/red token lists . however, these lists are inconsistent and can be compromised .
Approach: They propose a framework for robust and secure LLM watermarking using reinforcement learning.
Outcome: The proposed method achieves state-of-the-art trade-off across all criteria with notable improvements in resistance to spoofing attacks without degrading other criteria.
RMTBench: Benchmarking LLMs Through Multi-Turn User-Centric Role-Playing (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing benchmarks focus on character-centric approach and fail to reflect real-world applications.
Approach: RMTBench is a user-centric bilingual role-playing benchmark featuring 80 diverse characters and over 8,000 dialogue rounds.
Outcome: RMTBench features 80 diverse characters and over 8,000 dialogue rounds.
CSLM: A Framework for Question Answering Dataset Generation through Collaborative Small Language Models (2024.findings-emnlp)

Copied to clipboard

Challenge: Collecting high-quality question-answer (QA) pairs is vital for training large language models, but computational demands and associated costs often render such approaches prohibitive for the average researcher.
Approach: They propose a small-scaled, open-source solution that generates QA pairs from documents or raw corpora using large-scale models like Llama-70B.
Outcome: Experiments on domain-specific datasets show that the proposed model can generate high-quality QA pairs, making it accessible to a broader range of researchers.
Musical Score Understanding Benchmark: Evaluating Large Language Models’ Comprehension of Complete Musical Scores (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks for musical score understanding are narrow in scope, focusing on isolated fragments, short excerpts, or multiple-choice formulations, rather than supporting holistic reasoning over entire scores.
Approach: They propose a benchmark for score-level musical understanding across textual and visual modalities.
Outcome: The musical score understanding benchmark contains 1,800 question-answer pairs from works by Bach, Beethoven, Chopin, Debussy, and others.
MPO: Multilingual Safety Alignment via Reward Gap Optimization (2025.acl-long)

Copied to clipboard

Challenge: Existing preference learning methods for safety alignment are monolingual and struggle with noisy multilingual data.
Approach: They propose a multilingual reward gaP optimization approach that leverages the well-aligned safety capabilities of the dominant language to improve safety alignment across multiple languages.
Outcome: Extensive experiments on three LLMs, LLaMA-3.1, Gemma-2 and Qwen2.5, validate MPO’s efficacy in multilingual safety alignment without degrading general multilingual utility.
PACE: Prefix-Protected and Difficulty-Aware Compression for Efficient Reasoning (2026.findings-acl)

Copied to clipboard

Challenge: Existing LRMs often suffer from "overthinking" and excessively long reasoning traces . a dual-level framework for length compression of LRM is proposed .
Approach: They propose a framework for prefix-protected and difficulty-aware compression under hierarchical supervision.
Outcome: The proposed framework reduces token usage while improving accuracy on math benchmarks.
ThinkAnswer Loss: Balancing Semantic Similarity and Exact Matching for LLM Reasoning Enhancement (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for knowledge distillation use Chain-of-Thought (CoT) and answer pairs, but they lack appropriate supervision signals.
Approach: They propose a framework that decouples CoT and answer supervision . the framework applies semantic similarity constraints while maintaining strict literal matching for the answer .
Outcome: The proposed framework decouples CoT and answer supervision while maintaining strict literal matching for the answer.
Multimodal Invariant Sentiment Representation Learning (2025.findings-acl)

Copied to clipboard

Challenge: Existing methods for multimodal sensing ignore significant sentiment distribution imbalances and cross-modal sentiment conflicts, hindering performance improvement.
Approach: They propose a method to learn stable multimodal invariant sentiment representations by incorporating distributional discrepancies and sentiment conflicts into the model training.
Outcome: The proposed method improves MSA performance and achieves new state-of-the-art.
PLAWBENCH: A Rubric-Based Benchmark for Evaluating LLMs in Real-World Legal Practice (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks for large language models (LLMs) are coarse, single-dimensional metrics and do not explicitly assess fine-grained legal reasoning.
Approach: They propose a Practical Law Benchmark to evaluate large language models in real-world legal practice scenarios.
Outcome: The proposed model is based on 850 questions and 13 scenarios with expert-designed evaluation rubrics.
Refining Corpora from a Model Calibration Perspective for Chinese Spelling Correction (2024.findings-acl)

Copied to clipboard

Challenge: Chinese Spelling Correction (CSC) lacks large-scale high-quality corpora due to labor-intensive labeling of spelling errors in real-life writing or typing scenarios.
Approach: They propose to use OCR/ASR-based generation to refine Chinese Spelling Correction models on random replacement-based corpora and filter them based on prediction confidence.
Outcome: The proposed model outperforms existing models on three widely-used benchmarks while significantly alleviating over-correction.
Harder Task Needs More Experts: Dynamic Routing in MoE Models (2024.acl-long)

Copied to clipboard

Challenge: Unlike existing MoE approaches that rely on fixed TopK Routing, our dynamic expert selection framework dynamically allocates experts based on the confidence level in expert selection for each input.
Approach: They propose a dynamic expert selection framework that dynamically allocates experts based on the confidence level in expert selection for each input.
Outcome: The proposed method achieves an average improvement of 0.7% with less than 90% activated parameters and outperforms dense models in QA and machine translation tasks.
SWE-Swiss: A Multi-Task Fine-Tuning and RL Recipe for High-Performance Issue Resolution (2026.findings-acl)

Copied to clipboard

Challenge: SWE-Swiss-32B demonstrates strong generalization to other common LLM benchmarks.
Approach: They propose a two-phase training recipe that decomposes issue resolution into three core skills: Localization, Repair, and Unit Test Generation.
Outcome: The proposed model achieves a 60.2% score on the SWE-bench Verified benchmark and is in the top-tier performance bracket of much larger models.
MorphoBench: A Benchmark with Difficulty Adaptive to Model Reasoning (2026.findings-acl)

Copied to clipboard

Challenge: Existing benchmarks designed to evaluate the reasoning capabilities of large models are limited in scope and lack flexibility to adapt difficulty according to evolving reasoning capacities of models.
Approach: They propose a benchmark that incorporates multidisciplinary questions to evaluate the reasoning capabilities of large models and can adjust and update question difficulty based on the reasoning abilities of advanced models.
Outcome: The proposed benchmark incorporates multidisciplinary questions to evaluate the reasoning capabilities of large models and can adjust and update question difficulty based on the reasoning abilities of advanced models.
AgentOCR: Reimagining Agent History via Optical Self-Compression (2026.acl-long)

Copied to clipboard

Challenge: Recent advances in large language models (LLMs) have enabled agentic systems trained with reinforcement learning over multi-turn interaction, but practical deployment is bottlenecked by rapidly growing textual histories that inflate token and memory costs.
Approach: They propose a framework that represents the accumulated observation-action history as a compact rendered image.
Outcome: The proposed framework preserves over 95% of text-based agent performance while significantly reducing token consumption (>50%), yielding consistent token and memory efficiency.
Sketch and Refine: Towards Faithful and Informative Table-to-Text Generation (2021.findings-acl)

Copied to clipboard

Challenge: Existing methods for table-to-text generation suffer from poor faithfulness and low coverage.
Approach: They propose a method that combines Autoregressive and Non-Autoregressive generation to generate a table-to-text from a key-value table using a skeleton and an edit-based non-autoregressively generation model.
Outcome: The proposed method outperforms the existing methods on WikiPerson and WikiBio datasets on coverage and faithfulness.
HMoE: Heterogeneous Mixture of Experts for Language Modeling (2025.emnlp-main)

Copied to clipboard

Challenge: Mixture of Experts (MoE) models use homogeneous experts with diverse capacities, resulting in a lack of expert specialization and parameter utilization.
Approach: They propose a framework where experts differ in size and possess diverse capacities . they propose HMoE to encourage frequent activation of smaller experts .
Outcome: The proposed framework outperforms homogeneous homogenous MoE models on evaluation benchmarks and achieves lower loss rate with fewer activated parameters.
EmoRes: Toward Adaptive Psychological Support via User-Agnostic Benchmark and Topic-Mining Agent (2026.findings-acl)

Copied to clipboard

Challenge: Large language models generate fragmented and emotionally inconsistent dialogues lacking the therapeutic structure necessary for reliable assessment.
Approach: They propose a framework that boosts psychological reasoning via a Topic-Mining Emotional Agent and a multi-perspective Self-Reflection Agent.
Outcome: The proposed framework improves topic continuity, emotional coherence, and clinical interpretability over baselines and validated by ablation studies and human evaluations.
Purging the Gray Zone: Latent-Geometric Denoising for Precise Knowledge Boundary Awareness (2026.findings-acl)

Copied to clipboard

Challenge: Existing abstention fine-tuning methods cause models to suffer from label noise near the decision boundaries.
Approach: They propose a latent space representation perspective for abstention fine-tuning . they propose 'geometric denoising' framework that constructs a truth hyperplane .
Outcome: The proposed framework significantly enhances model truthfulness and demonstrates strong generalization in out-of-distribution scenarios.
Proxy-Driven Robust Multimodal Sentiment Analysis with Incomplete Data (2025.acl-long)

Copied to clipboard

Challenge: Existing studies focus on optimizing model structures to handle uncertain missingness, but models still face challenges when dealing with uncertain missing data.
Approach: They propose a data-centric robust multimodal sentiment analysis method, Proxy-Driven Robust Multimodal Fusion, which maps unimodal data to the latent space of Gaussian distributions to capture core features and structure.
Outcome: The proposed method outperforms existing models in noise resistance and achieves state-of-the-art performance on multiple benchmark datasets.
SeDev: Structured Semantic Exploration for LLM-Driven Code Generation (2026.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) have shown remarkable capabilities in automating code generation, but they suffer from insufficient exploration of the vast solution space.
Approach: They propose a large-scale LLM-driven code generation framework that efficiently finds high-quality solutions in only a few iterations.
Outcome: The proposed framework outperforms baselines while maintaining reasonable time and computational costs.
Prompt Tuning for Unified Multimodal Pretrained Models (2023.findings-acl)

Copied to clipboard

Challenge: Prompt tuning has demonstrated success in natural language pretraining and even vision pretraining.
Approach: They propose to apply prompt tuning to a unified sequence-to-sequence pretrained model by adding a sequence of learnable embeddings to each layer and finetuning the pretrained models on downstream tasks.
Outcome: The proposed method outperforms other parameter-efficient tuning methods on multimodal models and is robust against adversarial attacks.
AdaSteer: Your Aligned LLM is Inherently an Adaptive Jailbreak Defender (2025.emnlp-main)

Copied to clipboard

Challenge: Activation steering offers training-free defense but relies on fixed steering coefficients, resulting in suboptimal protection and increased false rejections of benign inputs.
Approach: They propose an adaptive activation steering method that dynamically adjusts model behavior based on input characteristics.
Outcome: The proposed method outperforms baseline methods across multiple jailbreak attacks with minimal impact on utility.
Gradient-Attention Guided Dual-Masking Synergetic Framework for Robust Text-based Person Retrieval (2025.emnlp-main)

Copied to clipboard

Challenge: a large-scale visionlanguage pre-training framework is limited by the scarcity of large-sized annotated vision-language data . noise-resistant data construction pipeline is needed to filter and caption web-sourced images . noisy text tokens can be a problem for fine-grained representation learning .
Approach: They develop a noise-resistant data construction pipeline that leverages in-context learning capabilities of MLLMs to automatically filter and caption web-sourced images.
Outcome: The proposed framework improves cross-modal alignment by masking noisy textual tokens based on the gradient-attention similarity score.
SciDTB: Discourse Dependency TreeBank for Scientific Abstracts (P18-2)

Copied to clipboard

Challenge: Discourse relations are annotated on scientific articles.
Approach: They propose a domain-specific discourse treebank annotated on scientific articles . they use dependency trees to represent discourse structure, which is flexible and simplified .
Outcome: The proposed treebank is a benchmark for evaluating discourse dependency parsers.
Rationales Are Not Silver Bullets: Measuring the Impact of Rationales on Model Performance and Reliability (2025.findings-acl)

Copied to clipboard

Challenge: Existing studies have shown that training language models with rationales augmentation is beneficial, but this view does not hold consistently.
Approach: They conduct comprehensive investigations to thoroughly inspect the impact of rationales on model performance and a novel perspective of model reliability.
Outcome: The proposed method outperforms untrained models in several areas and provides informative regulations on the broad utilization of rationales.
DaNet: Dual-Aware Enhanced Alignment Network for Multimodal Aspect-Based Sentiment Analysis (2025.findings-acl)

Copied to clipboard

Challenge: Existing methods assume a direct alignment between images and aspects, matching the entire image with a corresponding aspect. Existing algorithms assume 'direct alignment' between images, introducing noise.
Approach: They propose a Dual-Aware Enhanced Alignment Network (DaNet) that can enhance fine-grained multimodal aspect-image alignment and denoising.
Outcome: The proposed system outperforms existing methods in three subtasks and is available on https://github.com/***/DaNet.
Learning Relation Alignment for Calibrated Cross-modal Retrieval (2021.acl-long)

Copied to clipboard

Challenge: despite advances in multimodal pre-training, cross-modal retrieval remains challenging . lack of relation consistency impairs contextualized representation of image-text pairs .
Approach: They propose a new metric to quantify the relation consistency by measuring the semantic distance between linguistic and visual relations.
Outcome: The proposed method boosts the performance of prevailing models on Flickr30k and MS COCO datasets by a considerable margin.
RWKV-CLIP: A Robust Vision-Language Representation Learner (2024.emnlp-main)

Copied to clipboard

Challenge: Using large image-text datasets, large-scale image-data sets have been used for visionlanguage pre-training.
Approach: They propose a framework that leverages Large Language Models to combine and refine information from web-based image-text pairs, synthetic captions, and detection tags.
Outcome: The proposed framework can combine and refine information from web-based image-text pairs, synthetic captions, and detection tags.
Enhancing Pre-Trained Language Representations with Rich Knowledge for Machine Reading Comprehension (P19-1)

Copied to clipboard

Challenge: Recent results show pre-trained language models (LMs) can improve machine reading comprehension (MRC) Experimental results indicate that KT-NET offers significant and consistent improvements over BERT .
Approach: They propose a method that leverages external knowledge bases to improve machine reading comprehension (MRC) KT-NET employs an attention mechanism to select desired knowledge from KBs and fuses selected knowledge with BERT to enable context- and knowledge-aware predictions.
Outcome: The proposed model outperforms baseline models on ReCoRD and SQuAD1.1 benchmarks and ranks 1st on the ReCoDR and SQUAD1.1 leaderboards.
Transferring General Multimodal Pretrained Models to Text Recognition (2023.findings-acl)

Copied to clipboard

Challenge: Existing methods for text recognition rely on large-scale pretraining on human-annotated or synthetic data.
Approach: They propose a method to transfer multimodal pretrained models to text recognition using image captioning.
Outcome: The proposed method outperforms the baselines and achieves state-of-the-art performance in the Chinese text recognition benchmark.
PANDA: Preference Adaptation for Enhancing Domain-Specific Abilities of LLMs (2024.findings-acl)

Copied to clipboard

Challenge: Large language models have demonstrated considerable capabilities across various tasks . however, they often fall short of the performance achieved by domain-specific state-of-the-art models .
Approach: They propose a tuning-free method to augment domain-specific abilities of Large language models . they leverage insights from the response preference of expert models to augment LLMs .
Outcome: The proposed method outperforms the expert model on 4 ScienceWorld tasks.
SecureVibeBench: Benchmarking Secure Vibe Coding of AI Agents via Reconstructing Vulnerability-Introducing Scenarios (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks fail to capture scenarios in which vulnerabilities are introduced by humans . we evaluate 5 popular code agents supported by 5 LLMs on SecureVibeBench .
Approach: They propose a benchmarking tool that compares 105 C/C++ secure coding tasks . they use real-world open-source vulnerabilities and a comprehensive evaluation tool .
Outcome: The proposed benchmarks show that code agents struggle to produce correct and secure code . the best performing agent produces merely 23.8% correct and secured solutions .

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations