Papers by Yuan Jin

43 papers
HATA: Trainable and Hardware-Efficient Hash-Aware Top-k Attention for Scalable Large Model Inference (2025.findings-acl)

Copied to clipboard

Challenge: Existing top-k attention methods struggle to strike a balance between efficiency and accuracy.
Approach: They propose a top-k attention approach that integrates low-overhead techniques into the Top-k Attention process to achieve 7.2 speedup compared to vanilla full attention.
Outcome: The proposed approach achieves 7.2 speedup compared to current top-k attention methods while maintaining model accuracy.
Beyond Under-Alignment: Atomic Preference Enhanced Factuality Tuning for Large Language Models (2025.findings-naacl)

Copied to clipboard

Challenge: Existing work evaluates the factuality of large language models on in-domain (ID) datasets and the factuality on out-of-domain datasets.
Approach: They propose a framework that enhances model’s awareness of factuality at the granularity of individual facts and propose 'Atomic Preference Enhanced Factuality Tuning' this framework enhances the model’ s awareness and accuracy of factual information at the level of individual factual facts.
Outcome: The proposed framework improves model performance by an average of on ID and OOD datasets, which is highly effective.
Tracking Life’s Ups and Downs: Mining Life Events from Social Media Posts for Mental Health Analysis (2025.acl-long)

Copied to clipboard

Challenge: Existing studies have indicated that major life events can greatly impact individuals’ mental health, but shedding its light on social media data is challenging due to the complexity and ambiguity nature of life events.
Approach: They propose to extract life events mentioned in posts on social media to uncover a social media event dataset which includes 12 major life event categories that are likely to occur in everyday life.
Outcome: The proposed dataset includes 12 life event categories that are likely to occur in everyday life and is human-annotated under iterative procedure and boasts a high level of quality.
Look Light, Think Heavy: What Multimodal Chain-of-Thought Reasoning Can and Cannot Do (2026.acl-long)

Copied to clipboard

Challenge: Existing open-source models often yield only marginal overall improvements, possibly due to an overemphasis on mathematical reasoning at the expense of broader capabilities.
Approach: They evaluate 12 multimodal tasks using 14 non-reasoning models and 8 reasoning models.
Outcome: The proposed method is effective in multimodal reasoning tasks, the authors show . they show that it lacks the ability to maintain deep visual introspection throughout the reasoning process.
HacRED: A Large-Scale Relation Extraction Dataset Toward Hard Cases in Practical Applications (2021.findings-acl)

Copied to clipboard

Challenge: Relation extraction (RE) is an essential topic in natural language processing and has attracted extensive attention.
Approach: They propose a case-oriented construction framework to build a hard case relation extraction dataset with 65,225 relational facts annotated from 9,231 documents.
Outcome: The proposed model achieves a high 96% F1 score on data quality and is far lower than humans.
CogKTR: A Knowledge-Enhanced Text Representation Toolkit for Natural Language Understanding (2022.emnlp-demos)

Copied to clipboard

Challenge: Existing knowledge-enhanced methods are limited to knowledge-intensive tasks.
Approach: They propose a knowledge-enhanced text representation toolkit for natural language understanding . it combines knowledge acquisition, knowledge representation, knowledge injection and knowledge application .
Outcome: The proposed toolkit supports knowledge acquisition, knowledge representation, knowledge injection, and knowledge application.
A Survey on Efficient Large Language Model Training: From Data-centric Perspectives (2025.acl-long)

Copied to clipboard

Challenge: achieving data-efficient post-training of Large Language Models is a key research question.
Approach: They propose a taxonomy of data-efficient LLM post-training methods from a data-centric perspective.
Outcome: The proposed methods cover data selection, data quality enhancement, synthetic data generation, data distillation and compression, and self-evolving data ecosystems.
Locate, Steer, and Improve: A Practical Survey of Actionable Mechanistic Interpretability in Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Existing literature on mechanistic interpretation (MI) treats it as an observational science, leaving practical applications underexplored.
Approach: They propose a survey structured around the pipeline to identify and improve MI models.
Outcome: The proposed framework enables tangible improvements in Alignment, Capability, and Efficiency.
Cutting Off the Head Ends the Conflict: A Mechanism for Interpreting and Mitigating Knowledge Conflicts in Language Models (2024.findings-acl)

Copied to clipboard

Challenge: Existing methods to expand internal memory boundaries of language models by providing external context can often conflict, leading to knowledge conflicts.
Approach: They propose a method that prunes conflicting attention heads without updating model parameters.
Outcome: The proposed method can flexibly control eight LMs to use internal memory or external context without updating model parameters.
R³A: Reinforced Reasoning for Relevance Assessment for RAG in User-Generated Content Platforms (2026.acl-industry)

Copied to clipboard

Challenge: Existing approaches to query–document relevance assessment are limited . ambiguous user intent and asymmetric relevance are challenges for RAG platforms .
Approach: They propose a decomposed reasoning model for relevance assessment that decomposes query intent into intent inference and evidence grounding.
Outcome: The proposed model outperforms strong baselines on offline benchmarks and achieves significant gains in large-scale online A/B testing.
Neural Attention-Aware Hierarchical Topic Model (2021.emnlp-main)

Copied to clipboard

Challenge: Neural topic models (NTMs) use deep neural networks to learn topic information.
Approach: They propose a variational autoencoder model that reconstructs sentence and document word counts using bag-of-words embeddings and pre-trained semantic embedders.
Outcome: The proposed model lowers reconstruction errors at sentence and document levels and finds more coherent topics from real-world datasets.
Taylor Unswift: Secured Weight Release for Large Language Models via Taylor Expansion (2024.emnlp-main)

Copied to clipboard

Challenge: Existing mechanisms compromise ownership rights or raise data privacy concerns . existing mechanisms compromise security of released large language models .
Approach: They propose a TaylorMLP to preserve the ownership of large language models by transforming the weights of LLMs into Taylor-series parameters instead of releasing original weights .
Outcome: The proposed model preserves ownership of large language models and prevents their abuse by adjusting the generation speed and causing low-speed token generation.
CogKGE: A Knowledge Graph Embedding Toolkit and Benchmark for Representing Multi-source and Heterogeneous Knowledge (2022.acl-demo)

Copied to clipboard

Challenge: Existing methods focus on entity-centric knowledge, but CogKGE supports heterogeneous knowledge.
Approach: They propose a knowledge graph embedding toolkit to represent multi-source and heterogeneous knowledge.
Outcome: The proposed toolkit provides a unified programming framework for KGE tasks and a series of knowledge representations for downstream tasks.
Video-LLaVA: Learning United Visual Representation by Alignment Before Projection (2024.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to visual-language understanding lack unified tokenization for images and videos . lack of unified visual representations makes it difficult to learn multi-modal interactions from poor projection layers.
Approach: They propose to unify visual representation into the language feature space to advance the foundational LLM towards a unified LVLM.
Outcome: The proposed model outperforms Video-ChatGPT on image benchmarks and on 9 image benchmark benchmarks.
Whispers that Shake Foundations: Analyzing and Mitigating False Premise Hallucinations in Large Language Models (2024.emnlp-main)

Copied to clipboard

Challenge: Large language models generate hallucinated text when confronted with false premise questions . authors propose a method to mitigate false premises hallucinosity .
Approach: They propose a method to constrain false premise attention heads during the model inference process.
Outcome: The proposed method improves performance by constraining false premise attention heads . it yields a notable increase of nearly 20% of model performance .
Reasoning over Precedents Alongside Statutes: Case-Augmented Deliberative Alignment for LLM Safety (2026.acl-long)

Copied to clipboard

Challenge: OpenAI introduces deliberative alignment (DA) to enhance safety of its o-series models, but effectiveness of this approach in open-source LLMs is understudied.
Approach: They propose a case-augmented deliberative alignment method for large language models . they propose to use reinforcement learning on self-generated safety reasoning chains .
Outcome: The proposed method avoids narrowly enumerated rules and allows broader adaptability.
VisPCO: Visual Token Pruning Configuration Optimization via Budget-Aware Pareto-Frontier Learning for Vision-Language Models (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for visual token pruning rely on predefined configurations without determining whether they achieve optimal performance.
Approach: They propose a framework that formulates visual token pruning as a Pareto configuration optimization problem to automatically identify optimal configurations.
Outcome: The proposed framework approximates the empirical Pareto frontier obtained through grid search and generalizes well across pruning methods and VLM architectures.
KV Cache Compression, But What Must We Give in Return? A Comprehensive Benchmark of Long Context Capable Approaches (2024.findings-emnlp)

Copied to clipboard

Challenge: Long context capability is a crucial competency for large language models as it mitigates the human struggle to digest long-form texts.
Approach: They propose to evaluate 10+ state-of-the-art approaches for long context-capable LLMs.
Outcome: The proposed methods are compared against 10+ state-of-the-art approaches across seven categories of long context tasks.
PivotFEC: Enhancing Few-shot Factual Error Correction with a Pivot Task Approach using Large Language Models (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for Factual Error Correction (FEC) use mask-then-correct paradigms . however, the lack of datasets containing false claims has impeded progress .
Approach: They propose a method that enhances few-shot FEC with a pivot task approach using large language models.
Outcome: The proposed method outperforms its few-shot counterpart by 7.9 points in SARI . it improves widely-adopted SARI metrics by 11.3 compared to the best-performing methods .
Efficient KL Divergence Estimation via Truncated Top-K Integration for Large Language Models (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for estimating KL divergence using only top-k tokens suffer from high variance or systematic bias.
Approach: They propose a top-k Importance-weighted KL Estimator that exploits the Zipfian structure of language model distributions by integrating only the top-K tokens.
Outcome: The proposed estimator outperforms existing estimators on multiple benchmarks while exhibiting lower variance.
Graph Attention Network with Memory Fusion for Aspect-level Sentiment Analysis (2020.aacl-main)

Copied to clipboard

Challenge: Recent studies ignored the syntactic relationship between the aspect and its corresponding context words, leading the model to focus on syntaktically unrelated words mistakenly.
Approach: They propose to extend the graph convolutional network by assigning different weights to edges of connected words.
Outcome: The proposed method can improve on five datasets showing that it learns and exploits multiword relations and draws different weights of words to improve performance.
TriPlay-RL: Tri-Role Self-Play Reinforcement Learning for LLM Safety Alignment (2026.acl-long)

Copied to clipboard

Challenge: Existing approaches to safety alignment of large language models rely on costly manual annotations or human review.
Approach: They propose a closed-loop reinforcement learning framework called TriPlay-RL that enables iterative collaboration among three roles with near-zero manual annotation.
Outcome: The proposed framework achieves 20%–50% improvement in adversarial effectiveness while preserving high output diversity while achieving 10%–30% gains in safety performance without degrading general reasoning capability.
ChemAmp: Amplified Chemistry Tools via Composable Agents (2026.findings-acl)

Copied to clipboard

Challenge: LLM-based agents are powerful tools for automating complex scientific workflows, especially in chemistry, but their single-task performance is limited by tool constraints.
Approach: They propose a framework that optimizes the collective capabilities of specialized tools by dynamic coordination within individual tasks.
Outcome: The proposed framework outperforms chemistry-specialized models, generalist LLMs, and agent systems with tool orchestration.
Med-MoE: Mixture of Domain-Specific Experts for Lightweight Medical Vision-Language Models (2024.findings-emnlp)

Copied to clipboard

Challenge: Recent advances in multimodal large language models have seen remarkable progress for medical decision-making, however, they are designated for specific classification or generative tasks and require model training or finetuning on large-scale datasets with sizeable parameters and tremendous computing.
Approach: They propose a framework that tackles discriminative and generative multimodal medical tasks using multimodal alignment, instruction tuning and routing.
Outcome: The proposed model can achieve superior performance to or on par with state-of-the-art baselines while only requiring 30%-50% of activated model parameters.
Act as you think: Reinforcing Consistent Reasoning in Medical Visual Question Answering (2026.acl-long)

Copied to clipboard

Challenge: Recent advances have improved the accuracy of medical visual question answering (Med-VQA) however, the high stakes nature of the medical domain has precipitated a shift towards interpretability and transparency of reasoning processes.
Approach: They propose a reinforcement learning from verifiable rewards framework that rewards internal consistency and logical coherence.
Outcome: The proposed framework rewards internal consistency and logical coherence, and is highly versatile, the authors show.
Leveraging Information Bottleneck for Scientific Document Summarization (2021.findings-emnlp)

Copied to clipboard

Challenge: Existing methods to extract salient sentences from document are unsupervised and rely on graph-based methods for sentence ranking.
Approach: They propose an unsupervised extractive approach to document level summarization based on the Information Bottleneck principle.
Outcome: The proposed framework can be extended to a multi-view framework by different signals.
D-RAG: Differentiable Retrieval-Augmented Generation for Knowledge Graph Question Answering (2025.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to Knowledge Graph Question Answering (KGQA) use Retrieval-Augmented Generation (RAG) but subgraph selection process is non-differentiable, preventing end-to-end training of the retriever and the generator.
Approach: They propose a Differentiable RAG approach that optimizes the retriever and the generator for KGQA.
Outcome: The proposed approach outperforms state-of-the-art approaches on WebQSP and CWQ.
Transformer over Pre-trained Transformer for Neural Text Segmentation with Enhanced Topic Coherence (2021.findings-emnlp)

Copied to clipboard

Challenge: Existing models for text segmentation use supervised and unsupervised learning to perform tasks such as text summarization and keyword extraction.
Approach: They propose a transformer over transformer framework to perform neural text segmentation.
Outcome: The proposed framework outperforms state-of-the-art models in terms of semantic coherence measure . bottom-level sentence encoders pre-trained on specific languages yield better performance .
Dynamic Augmentation Data Selection for Few-shot Text Classification (2022.findings-emnlp)

Copied to clipboard

Challenge: Data augmentation is a popular method for fine-tuning pre-trained language models to increase model robustness and performance.
Approach: They propose a dynamic data selection method to select effective augmentation data from different augmentation sources according to the model’s learning stage by identifying a set of augmentation samples that optimally facilitates the learning process of the most current model.
Outcome: The proposed method outperforms strong baselines on a variety of sentence classification tasks.
RISER: Orchestrating Latent Reasoning Skills for Adaptive Activation Steering (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods for domain-specific reasoning with large language models require updating parameter updates.
Approach: They propose a plug-and-play intervention framework that adaptively steers LLM reasoning in activation space.
Outcome: The proposed framework achieves zero-shot accuracy improvements of 3.4–6.5% over the base model while outperforming chain-of-thought-style reasoning with 2–3 higher token efficiency and robust accuracy gains.
LOOK-M: Look-Once Optimization in KV Cache for Efficient Multimodal Long-Context Inference (2024.findings-emnlp)

Copied to clipboard

Challenge: Long-context Multimodal Large Language Models (MLLMs) require substantial computational resources for inference . the growth of their multimodal Key-Value (KV) cache challenges memory and time efficiency.
Approach: They propose a fine-tuning-free approach that efficiently reduces the multimodal KV cache size while maintaining performance comparable to a full cache.
Outcome: The proposed method reduces the multimodal KV cache size while maintaining performance comparable to a full cache.
Correcting Pronoun Homophones with Subtle Semantics in Chinese Speech Recognition (2024.lrec-main)

Copied to clipboard

Challenge: Chinese speech recognition is becoming prevalent due to the similar semantic context of the entities and the overlap of Chinese pronunciation.
Approach: They propose three models to address common confusion issues in Chinese speech recognition . they implement a language model, a LSTM model with semantic features and a rule-based assisted Ngram model .
Outcome: The proposed models achieve highest recognition rate for “T” correction with improvements from 70% in the popular voice input methods up to 90%.
Dunhuang-Bench: How Well Do MLLMs Understand Cultural Heritage? (2026.findings-acl)

Copied to clipboard

Challenge: Recent advances in Multimodal Large Language Models (MLLMs) have led to extensive evaluations on Chinese cultural benchmarks.
Approach: They construct a large-scale benchmark comprising 486 images and 22,970 QA pairs to evaluate MLLMs' cultural understanding.
Outcome: The proposed benchmark incorporates three task formats to evaluate MLLMs’ cultural understanding: Question Answering with Text Description, Multi-turn Dialogue, and Question Answers with Choices.
Multimodal Transformers are Hierarchical Modal-wise Heterogeneous Graphs (2025.acl-long)

Copied to clipboard

Challenge: Multimodal Sentiment Analysis (MSA) is a rapidly developing field that integrates multimodal information to recognize sentiments.
Approach: They propose a multimodal fusion model that integrates multimodal information to recognize sentiments using multimodal transformers.
Outcome: The proposed model achieves significantly higher performance than MulTs and the existing model is robust.
U-Fold: Dynamic Intent-Aware Context Folding for User-Centric Agents (2026.findings-acl)

Copied to clipboard

Challenge: Existing context-folding methods are designed for single-query or single-intent scenarios.
Approach: They propose a dynamic context-folding framework tailored to user-centric tasks that preserves fine-grained information through dynamic context folding.
Outcome: The proposed framework outperforms ReAct and previous folding frameworks on long, noisy tasks.
RAG-RewardBench: Benchmarking Reward Models in Retrieval Augmented Generation for Preference Alignment (2025.findings-acl)

Copied to clipboard

Challenge: Existing retrieval augmented language models often overlook effective alignment with human preferences.
Approach: They propose a benchmark to evaluate RMs in retrieval augmented language models . they incorporate 18 RAG subsets, six retrievers, and 24 RALMs to increase diversity .
Outcome: The proposed benchmark combines 18 RAG subsets, six retrievers, and 24 RALMs to increase diversity of data sources.
ATLAS: Orchestrating Heterogeneous Models and Tools for Multi-Domain Complex Reasoning (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches to optimize large language models with external tools are limited.
Approach: They propose a dual-path framework for dynamic tool usage in cross-domain complex reasoning . they exploit empirical priors for domain-specific alignment and RL-based multi-step routing .
Outcome: The proposed framework outperforms closed-source models and existing methods on in-distribution and out-of-distortion tasks.
Taming the Real-world Complexities in CPT E/M Coding with Large Language Models (2025.emnlp-industry)

Copied to clipboard

Challenge: Evaluation and Management (E/M) coding is performed by physicians and trained human coders who review clinical encounter notes and electronic health record data to assign appropriate codes.
Approach: They propose a framework that automates evaluation and management coding tasks using the Current Procedural Terminology (CPT) taxonomy.
Outcome: The proposed framework achieves an increase in coding accuracy of more than 36% over a commercial CPT E/M coding system and almost 5% over our strongest single-prompt baseline.
COIG-CQIA: Quality is All You Need for Chinese Instruction Fine-tuning (2025.findings-naacl)

Copied to clipboard

Challenge: Existing datasets for Chinese instruction tuning are not well-aligned with Chinese users’ interaction patterns.
Approach: They propose to use Chinese instruction tuning datasets to improve instruction fine-tuning for Chinese users.
Outcome: The proposed dataset shows that Chinese models achieve competitive performance in diverse benchmarks.
Learning Semantic Textual Similarity via Topic-informed Discrete Latent Variables (2022.emnlp-main)

Copied to clipboard

Challenge: Recent discrete latent variable models have received a surge of interest in both NLP and CV . they are comparable to the continuous counterparts in representation learning, but are more interpretable in their predictions.
Approach: They develop a topic-informed discrete latent variable model for semantic textual similarity . they inject the quantized representation into a transformer-based language model .
Outcome: The proposed model outperforms strong baselines in semantic textual similarity tasks.
RAP: Efficient Text-Video Retrieval with Sparse-and-Correlated Adapter (2024.findings-acl)

Copied to clipboard

Challenge: Text-Video Retrieval (TVR) aims to align relevant video content with natural language queries.
Approach: They propose to conduct efficient text-video Retrieval with a salient-and-correlated AdaPter . they propose a low-rank modulation module to refine per-image features from frozen CLIP backbone .
Outcome: Experiments on four TVR datasets show that the proposed method performs better than other methods.
Different Absorption from the Same Sharing: Sifted Multi-task Learning for Fake News Detection (D19-1)

Copied to clipboard

Challenge: Existing methods for detecting fake news use shared features as complementarity features without selection.
Approach: They propose a sifted multi-task learning method with a selected sharing layer for fake news detection.
Outcome: The proposed method boosts the F1-score by more than 0.87%, 1.31% on two public and widely used competition datasets.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations