Papers by Su Yang

78 papers
GQLBench: A Large-Scale Cross-Domain, Cross-Dialect Benchmark for NL2GQL (2026.acl-long)

Copied to clipboard

Challenge: despite growing interest in NL2GQL, benchmarking progress has been constrained by the lack of resources that are simultaneously large-scale, cross-domain, and cross-dialect.
Approach: They propose a framework that integrates NL2SQL-to-NL2GQL conversion with graph-native data generation.
Outcome: The proposed framework supports execution-based evaluation on Cypher and ISO-GQL, covering hundreds of graph databases and over 20k natural language questions for each dialect.
USB: A COMPREHENSIVE AND UNIFIED SAFETY EVALUATION BENCHMARK FOR MULTIMODAL LARGE LANGUAGE MODELS (2026.acl-long)

Copied to clipboard

Challenge: Existing safety benchmarks fail to provide reliable assessments due to limited risk coverage, insufficient scale and the oversight of complex modality combinations.
Approach: They propose a framework that covers 61 risk categories across four modality interactions to address this gap.
Outcome: The proposed framework covers 61 risk categories across four distinct modality interactions.
GIFT: Guided Fine-Tuning and Transfer for Enhancing Instruction-Tuned Language Models (2026.acl-long)

Copied to clipboard

Challenge: Existing adapter-based transfer methods treat instruction-tuned models as passive targets . direct fine-tuning can disrupt this delicate balance and lead to instability or performance degradation.
Approach: They propose a framework that incorporates instruction-level guidance into task adaptation.
Outcome: The proposed framework outperforms direct fine-tuning and representative transfer-based baselines while maintaining robust generalization and favorable test-time scaling behavior.
Bridging Subword Gaps in Pretrain-Finetune Paradigm for Natural Language Generation (2021.acl-long)

Copied to clipboard

Challenge: Existing methods to pretrain language models are limited by one-size-fits-all vocabulary . embeddings of mismatch tokens can be efficiently initialized in downstream tasks .
Approach: They propose to extend pretrain-finetune pipeline with an embedding transfer step . plug-and-play embeddable generator is introduced to generate any input token .
Outcome: The proposed approach allows for more efficient and better performed NLG models.
Unsupervised Dual Paraphrasing for Two-stage Semantic Parsing (2020.acl-main)

Copied to clipboard

Challenge: Existing semantic parsing frameworks rely on nontrivial human labor to generate canonical utterances.
Approach: They propose a framework that uses an unsupervised paraphrase model to parse canonical utterances.
Outcome: The proposed framework is effective and compatible with supervised training.
Treasures Outside Contexts: Improving Event Detection via Global Statistics (2021.emnlp-main)

Copied to clipboard

Challenge: Existing neural-based ED models are confused by changeable contexts during testing . we propose a system that extracts statistical event features from word-event cooccurrence frequencies .
Approach: They propose to integrate a set of statistical event features from word-event co-occurrence frequencies into the training set to cooperate with contextual features.
Outcome: The proposed model outperforms ten strong baselines on ACE2005 and KBP2015 datasets.
ToolRM: Towards Agentic Tool-Use Reward Modeling (2026.findings-acl)

Copied to clipboard

Challenge: lack of reliable reward models for tool-use tasks has limited progress toward agentic AI . recent advances in agentic artificial intelligence are driven by tool-using capabilities of large language models.
Approach: They propose a pipeline that constructs pairwise preference data using rule-based scoring and multidimensional sampling to build lightweight reward models.
Outcome: The proposed model outperforms existing models on tool calling tasks with higher accuracy.
Beta Distribution Guided Aspect-aware Graph for Aspect Category Sentiment Analysis with Affective Knowledge (2021.emnlp-main)

Copied to clipboard

Challenge: Existing methods for aspect category sentiment analysis do not necessarily occur in a sentence.
Approach: They propose a Beta Distribution-guided aspect-aware graph construction based on external knowledge . they use aspect-related words as the pivots to derive aspect-relevant weights .
Outcome: The proposed approach outperforms the state-of-the-art methods on 6 benchmark datasets.
An Evaluation Resource for Grounding Translation Errors (2025.findings-emnlp)

Copied to clipboard

Challenge: Current fine-grained error analyses do not ground the errors to the reasons why the annotated text spans are erroneous.
Approach: They use a bi-directional grounding scheme to ground erroneous text in two directions . if the error spans of both directions are consistent, the explanation is valid .
Outcome: The proposed grounding process improves translation error detection significantly.
Exploiting Emotion-Semantic Correlations for Empathetic Response Generation (2023.findings-emnlp)

Copied to clipboard

Challenge: Empathetic response generation aims to generate empathetic responses by understanding the speaker’s emotional feelings from the language of dialogue.
Approach: They propose a dynamical Emotion-Semantic Correlation Model (ESCM) which constructs dynamic emotion-semantics through the interaction of context and emotions.
Outcome: The proposed model understands emotions more accurately and expresses fluent and informative empathetic responses.
CB-Whisper: Contextual Biasing Whisper Using Open-Vocabulary Keyword-Spotting (2024.lrec-main)

Copied to clipboard

Challenge: End-to-end automatic speech recognition systems struggle to recognize rare name entities such as personal names, organizations and terminologies that are not frequently encountered in the training data.
Approach: They propose a convolutional neural network-based ASR system that performs open-vocabulary keyword-spotting before the decoder to match the features between the entities and the utterances.
Outcome: The proposed system significantly improves mixed-error-rate (MER) and entity recall compared to the original Whisper model on three internal datasets and two publicly available datasets.
Iterative Dual Domain Adaptation for Neural Machine Translation (D19-1)

Copied to clipboard

Challenge: Empirical results on Chinese-English and English-German translation tasks demonstrate the effectiveness of our proposed framework.
Approach: They propose an iterative dual domain adaptation framework for neural machine translation that uses multiple corpora to perform bidirectional translation knowledge transfer.
Outcome: Empirical results on Chinese-English and English-German translation tasks demonstrate the effectiveness of the proposed framework.
Understanding How Value Neurons Shape the Generation of Specified Values in LLMs (2025.findings-emnlp)

Copied to clipboard

Challenge: Current approaches to interpret value representations are limited by superficial judgments over mechanistic analysis.
Approach: They propose a mechanistic interpretability framework that uses the Schwartz Values Survey to interpret value . they use a dataset that operationalizes four dimensions of universal value through behavioral contexts .
Outcome: The proposed method bridges psychological value frameworks with neuron analysis in large language models.
TACLR: A Scalable and Efficient Retrieval-based Method for Industrial Product Attribute Value Identification (2025.acl-long)

Copied to clipboard

Challenge: Existing methods for product attribute value identification face critical challenges . seller-provided attribute values are often incomplete or inaccurate .
Approach: They propose a retrieval-based method that uses taxonomy-aware contrastive learning . they use product profiles and candidate values to encode and retrieve attributes based on similarity .
Outcome: The proposed method is based on a taxonomy-aware, hard negative sampling and adaptive inference with dynamic thresholds.
AgentCPM-GUI: Building Mobile-Use Agents with Reinforcement Fine-Tuning (2025.emnlp-demos)

Copied to clipboard

Challenge: Large language model agents have enabled GUI-based automation, but their deployment is limited by noisy data, poor generalization, and lack of support for non-English GUIs.
Approach: They propose an 8B-parameter GUI agent built for robust and efficient on-device GUI interaction.
Outcome: The proposed GUI agent achieves promising performance on five public benchmarks and proposed Chinese benchmark CAGUI.
Towards Better Graph-based Cross-document Relation Extraction via Non-bridge Entity Enhancement and Prediction Debiasing (2024.findings-acl)

Copied to clipboard

Challenge: Existing studies on relation extraction ignore non-bridge entities, leading to bias during inference.
Approach: They propose a graph-based cross-document Relation Extraction model with non-bridge entity enhancement and prediction debiasing that integrates non-cross entities with target entities and bridge entities.
Outcome: The proposed model outperforms baseline models on open and closed datasets.
Mitigating Catastrophic Forgetting in Large Language Models with Self-Synthesized Rehearsal (2024.acl-long)

Copied to clipboard

Challenge: Existing methods to train LLMs on previous training data are not feasible in real-world applications because of catastrophic forgetting.
Approach: They propose a framework that uses the LLM to generate synthetic instances for rehearsal and refine the instance outputs based on the synthetic inputs.
Outcome: The proposed framework achieves superior or comparable performance compared to conventional rehearsal-based approaches while being more data-efficient.
RMTBench: Benchmarking LLMs Through Multi-Turn User-Centric Role-Playing (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing benchmarks focus on character-centric approach and fail to reflect real-world applications.
Approach: RMTBench is a user-centric bilingual role-playing benchmark featuring 80 diverse characters and over 8,000 dialogue rounds.
Outcome: RMTBench features 80 diverse characters and over 8,000 dialogue rounds.
WR-One2Set: Towards Well-Calibrated Keyphrase Generation (2022.emnlp-main)

Copied to clipboard

Challenge: Experimental results show that keyphrase generation has serious calibration errors . ONE2SET generates short phrases summarizing an input document .
Approach: They propose a paradigm for keyphrase generation that generates short phrases summarizing an input document.
Outcome: The proposed model over-estimates tokens and makes it well-calibrated on common datasets.
Context-Aware Language Modeling for Goal-Oriented Dialogue Systems (2022.findings-naacl)

Copied to clipboard

Challenge: Goal-oriented dialogue systems face a trade-off between fluent language generation and task-specific control.
Approach: They propose a method to fine-tune language models in a goal-aware way . they evaluate a flight-booking method with a context-assisted language model .
Outcome: The proposed method outperforms the state-of-the-art method on a flight-booking task by 7% in terms of task success.
Multi-Level Cross-Modal Alignment for Speech Relation Extraction (2024.emnlp-main)

Copied to clipboard

Challenge: Existing studies use synthetic speech to train and evaluate SpeechRE models, hindering their development . modality gap issue limits performance of existing models, limiting future researches .
Approach: They propose to use speech data to train and evaluate SpeechRE models by using real speech . they propose to train a cross-modal alignment model to bridge the modality gap .
Outcome: The proposed model can train to bridge the modality gap between speech encoder and text decoder . the proposed model is based on two real SpeechRE datasets .
Beyond Natural Language: LLMs Leveraging Alternative Formats for Enhanced Reasoning and Communication (2024.findings-emnlp)

Copied to clipboard

Challenge: Natural language (NL) has long been the predominant format for human cognition and communication, but its utility in LLMs has not been thoroughly examined.
Approach: They propose to allow LLMs to choose the most suitable format before reasoning or communicating, and to automate the selection process.
Outcome: The proposed format improves reasoning efficiency and reduces token usage while maintaining communicative effectiveness.
TofuEval: Evaluating Hallucinations of LLMs on Topic-Focused Dialogue Summarization (2024.naacl-long)

Copied to clipboard

Challenge: Existing LLMs hallucinate significant amounts of factual errors in the dialogue domain, regardless of the model’s size.
Approach: They propose to evaluate topic-focused dialogue summarization by using large language models (LLMs) they use human annotations to evaluate factual consistency and explain factually inconsistent sentences.
Outcome: The proposed evaluation benchmark on topic-focused dialogue summarization shows that existing LLMs hallucinate significant amounts of factual errors regardless of the model’s size.
PlotGen-Bench: Evaluating VLMs on Generating Visualization Code from Diverse Plots across Multiple Libraries (2026.findings-acl)

Copied to clipboard

Challenge: PlotGen-Bench evaluates vision-language models' ability to generate executable visualization code from plots under realistic and complex visualization requirements.
Approach: They propose a benchmark to evaluate plot-to-code generation in vision-language models . they use Matplot, Matplos, Mat3D, Mat4D, and Mat4E to evaluate their performance .
Outcome: The proposed benchmark covers 9 major categories, 30 subcategories, and 3 core tasks . it covers 2D, 3D and animated plots across 5 widely used visualization libraries.
Constituency Lattice Encoding for Aspect Term Extraction (2020.coling-main)

Copied to clipboard

Challenge: a challenge for aspect term extraction is to extract phrase-level aspect terms . a constituency lattice structure is constructed using the span annotations of constituents of a sentence .
Approach: They propose to incorporate the span annotations of constituents of a sentence to leverage syntactic information in neural network models.
Outcome: The proposed model outperforms existing models on two benchmark datasets.
Multi-Domain Neural Machine Translation with Word-Level Domain Context Discrimination (D18-1)

Copied to clipboard

Challenge: Experimental results on Chinese-English and English-French multi-domain translation tasks demonstrate the effectiveness of the proposed model.
Approach: They propose to use mixed-domain parallel sentences to construct a unified model that allows translation to switch between different domains.
Outcome: The proposed model distinguishes and exploits word-level domain contexts on Chinese-English and English-French translation tasks.
Learning to Answer Psychological Questionnaire for Personality Detection (2021.findings-emnlp)

Copied to clipboard

Challenge: Existing text-based personality detection research relies on data-driven approaches to implicitly capture personality cues in online posts lacking the guidance of psychological knowledge.
Approach: They propose a model to capture key information in texts and a questionnaire to help the user to make a personality assessment.
Outcome: The proposed model captures key information in texts and a questionnaire and can be used to improve personality prediction.
Beyond Single-Value Metrics: Evaluating and Enhancing LLM Unlearning with Cognitive Diagnosis (2025.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) have been used to remove harmful knowledge and undesirable capabilities.
Approach: They propose a framework that leverages Cognitive Diagnosis Modeling to evaluate LLM unlearning.
Outcome: The proposed framework enhances evaluation and facilitates removal of harmful abilities.
Capture Human Disagreement Distributions by Calibrated Networks for Natural Language Inference (2022.findings-acl)

Copied to clipboard

Challenge: Previously, it's common to disregard it as noise or as a sign of poor-quality data, as their annotations are heavily based on personal experience and opinions.
Approach: They propose to capture the human disagreement distribution from the perspective of model calibration.
Outcome: The proposed model can achieve competitive performance when well-calibrated, on divergence scores between predictive probability and the true human opinion distribution, and the accuracy.
News2vec: News Network Embedding with Subnode Information (D19-1)

Copied to clipboard

Challenge: Existing approaches to embed news as vectors do not integrate features and inter-textual knowledge of news.
Approach: They propose a model that integrates news features and inter-textual knowledge into a dense vector representation.
Outcome: The proposed model can be used to represent news as a dense vector . it is compared with existing models on stock movement prediction and news recommendation tasks .
Narrative Question Answering with Cutting-Edge Open-Domain QA Techniques: A Comprehensive Study (2021.tacl-1)

Copied to clipboard

Challenge: Recent advances in open-domain question answering (ODQA) have led to human-level performance on many datasets.
Approach: They provide a comprehensive and quantitative analysis about the difficulty of book QA . they compare the results of their research with extensive ODQA experiments .
Outcome: The proposed model outperforms existing models on event-oriented questions on the NarrativeQA dataset.
Exploring the Impact of Model Scaling on Parameter-Efficient Tuning (2023.emnlp-main)

Copied to clipboard

Challenge: Parameter-efficient tuning (PET) methods can drive large pre-trained language models by training only minimal parameters.
Approach: They propose a parameter-efficient tuning method that is compatible with a tunable module and uses a random number generator to optimize fewer table parameters.
Outcome: The proposed method is compatible with a tunable module and tested on 11 NLP tasks.
AutoBreach: Universal and Adaptive Jailbreaking with Efficient Wordplay-Guided Optimization via Multi-LLMs (2025.findings-naacl)

Copied to clipboard

Challenge: Existing jailbreak research exhibits limitations in universality, validity, and efficiency . Existing methods for jailbreaking LLMs have limited validity and effectiveness .
Approach: They propose a black-box approach that uses wordplay-guided mapping rule sampling to create universal adversarial prompts.
Outcome: The proposed method efficiently identifies security vulnerabilities across various LLMs, achieving an average success rate of over 80% with fewer than 10 queries.
Improving Latent Alignment in Text Summarization by Generalizing the Pointer Generator (D19-1)

Copied to clipboard

Challenge: Modern pointer generators only capture exact word matches, ignoring possible inflections or abstractions, which restricts its power of capturing richer latent alignment.
Approach: They propose a pointer generator architecture that allows the model to "edit" pointed tokens instead of always copying them.
Outcome: The proposed model captures more latent alignment relations than exact word matches and generates higher-quality summaries validated by both qualitative and quantitative evaluations.
Part Represents Whole: Improving the Evaluation of Machine Translation System Using Entropy Enhanced Metrics (2022.findings-aacl)

Copied to clipboard

Challenge: Existing machine translation metrics have poor correlations with human assessments . entropy-based evaluations are often limited to a limited number of samples .
Approach: They propose a fast and unsupervised approach to enhance machine translation metrics using entropy by introducing sentence-level difficulty.
Outcome: The proposed method outperforms existing metrics on five sub-tracks in the WMT19 Metrics shared tasks.
Failure makes the agent stronger: Enhancing Accuracy through Structured Reflection for Reliable Tool Interactions (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches to self-reflection rely on heuristic prompting or unidirectional reasoning traces.
Approach: They propose a structured reflection method that transforms the "from error to repair" process into a first-class, controllable, and trainable action.
Outcome: The proposed method improves multi-turn tool-call success rates and error recovery while reducing redundant calls.
DaMo: Data Mixing Optimizer in Fine-tuning Multimodal LLMs for Mobile Phone Agents (2026.findings-acl)

Copied to clipboard

Challenge: Mobile Phone Agents (MPAs) have attracted huge attention due to their practicability in a multitude of scenarios.
Approach: They propose a data mixture optimization solution that extrapolates optimal data mixtures from a trainable network.
Outcome: The proposed model outperforms existing methods on open-source benchmarks and on open source benchmarks.
A Novel Graph-based Multi-modal Fusion Encoder for Neural Machine Translation (2020.acl-main)

Copied to clipboard

Challenge: Existing multi-modal neural machine translation models do not fully exploit fine-grained semantic correspondences between semantic units of different modalities.
Approach: They propose a graph-based multi-modal fusion encoder that exploits fine-grained semantic correspondences between different modalities.
Outcome: The proposed encoder significantly extends the conventional text-based translation by taking images as additional inputs.
Specificity-Driven Cascading Approach for Unsupervised Sentiment Modification (D19-1)

Copied to clipboard

Challenge: Existing methods for unsupervised sentiment modification lack specific information in text generated without parallel data . specificity-driven cascading approach can improve specificity of generated text and content preservation .
Approach: They propose a specificity-driven cascading approach for unsupervised sentiment modification . the method performs target sentiment addition and content reconstruction independently .
Outcome: The proposed method outperforms competitive systems by a large margin on Yelp and Amazon datasets.
Adaptive Gating in Mixture-of-Experts based Language Models (2023.emnlp-main)

Copied to clipboard

Challenge: Existing models employ a fixed gating network where each token is computed by the same number of experts.
Approach: They propose a flexible training strategy that allows tokens to be processed by a variable number of experts based on expert probability distribution.
Outcome: The proposed model reduces training time and inference quality while maintaining sparsity while maintaining inference accuracy.
Good Reasoning Makes Good Demonstrations: Implicit Reasoning Quality Supervision via In-Context Reinforcement Learning (2026.findings-acl)

Copied to clipboard

Challenge: Reinforcement Learning with Verifiable Rewards (RLVR) improves reasoning in large language models but treats all correct solutions equally, potentially reinforcing flawed traces that arrive at correct answers by chance.
Approach: They propose a method that reweights rewards by a factor approximately proportional to Evidence Gain and assigns higher weights to high-quality traces without requiring costly computation.
Outcome: Experiments on mathematical reasoning benchmarks show that Reinforcement Learning with Verifiable Rewards (RLVR) improves reasoning in large language models but treats all correct solutions equally.
InstructDiff: Domain-Adaptive Data Selection via Contrastive Entropy for Efficient LLM Fine-Tuning (2026.acl-long)

Copied to clipboard

Challenge: Existing data selection methods suffer from severe domain specificity . existing methods for general instruction-following fail on reasoning tasks .
Approach: They propose a framework that operationalizes contrastive entropy as a domain-adaptive selection criterion through warmup calibration, bi-directional NLL filtering, and entropic-based ranking.
Outcome: Experiments show that InstructDiff outperforms baseline training on reasoning tasks while using only 10% of the data.
Multi-Value-Product Retrieval-Augmented Generation for Industrial Product Attribute Value Identification (2025.emnlp-industry)

Copied to clipboard

Challenge: Existing methods for product attribute value identification suffer from cascading errors and lack of generalization capability.
Approach: They propose a multi-level retrieval scheme that uses products and attribute values as distinct hierarchical levels in PAVI domain.
Outcome: The proposed method performs better than the state-of-the-art methods on a real-world industrial dataset.
Bridging the Domain Gaps in Context Representations for k-Nearest Neighbor Neural Machine Translation (2023.acl-long)

Copied to clipboard

Challenge: Existing methods to improve k-Nearest neighbor machine translation (kNN-MT) are based on the ability to non-parametrically adapt to new domains.
Approach: They propose a method to boost the datastore retrieval of k-Nearest neighbor machine translation by reconstructing the original datastore.
Outcome: The proposed method boosts the retrieval and translation quality of k-Nearest neighbor machine translation by reconstructing the original datastore.
Red Teaming Large Reasoning Models (2026.acl-long)

Copied to clipboard

Challenge: Large Reasoning Models (LRMs) have emerged as a powerful advancement in multi-step reasoning tasks, but they introduce safety and reliability risks, such as CoT-hijacking and prompt-induced inefficiencies.
Approach: They propose a unified benchmark to assess the trustworthiness of Large Reasoning Models.
Outcome: The proposed benchmark evaluates truthfulness, safety and efficiency on 26 models.
AscendKernelGen: LLM-Driven Kernel Generation for NPUs (2026.findings-acl)

Copied to clipboard

Challenge: Neural Processing Units (NPUs) are critical for AI infrastructure, but their development remains a bottleneck due to vendor-specific Domain-Specific Languages (DSLs).
Approach: They propose a framework for NPU kernel development that bridges the gap in hardware-specific coding . compiler success on complex Level-2 kernels improves from 0% to 95.5%, they say .
Outcome: The proposed framework bridges the gap in hardware-specific coding, showing a near-zero success rate on complex kernels.
Vision-Language Introspection: Mitigating Overconfident Hallucinations in MLLMs via Interpretable Bi-Causal Steering (2026.acl-long)

Copied to clipboard

Challenge: Existing approaches to overcome object hallucination are limited . Existing mitigations include costly retraining and a training-free inference framework .
Approach: They propose a training-free inference framework that simulates a metacognitive self-correction process.
Outcome: The proposed framework reduces object hallucination rates by 12.67% on MMHal-Bench and improves accuracy by 5.8% on POPE.
Efficient k-Nearest-Neighbor Machine Translation with Dynamic Retrieval (2024.findings-acl)

Copied to clipboard

Challenge: Existing models for non-parametric domain adaptation lack kNN retrieval at each timestep, leading to substantial time overhead.
Approach: They propose a kNN-MT-based model that uses a domain-specific translation knowledge store to interpolate the prediction distribution of the model.
Outcome: The proposed model significantly extends kNN-MT with dynamic retrieval on widely-used datasets.
Semantic-Unit-Based Dilated Convolution for Multi-Label Text Classification (D18-1)

Copied to clipboard

Challenge: a novel model for multi-label text classification is proposed for the task of assigning multiple labels for a given text.
Approach: They propose a novel model for multi-label text classification based on sequence-to-sequence learning and a hybrid attention mechanism that extracts both the word-level and the semantic unit.
Outcome: The proposed model is competitive to the baseline models and more robust to classifying low-frequency labels.
Bridging the Gap between Training and Inference: Multi-Candidate Optimization for Diverse Neural Machine Translation (2022.findings-naacl)

Copied to clipboard

Challenge: Existing diverse NMT models lack translation diversity due to a discrepancy between training and inference . despite the success of diverse NTM, there is still a lack of translation diversity .
Approach: They propose a multi-candidate optimization framework for diverse NMT to deal with this defect.
Outcome: The proposed framework is transparent to basic diverse NMT models, and universally makes better trade-off between diversity and quality.
MMTutorBench: The First Multimodal Benchmark for AI Math Tutoring (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks for AI math tutoring largely overlook these skills.
Approach: They evaluate 12 leading multimodal large language models and find clear performance gaps between them.
Outcome: The proposed benchmarks show that they can solve 770 problems and provide diagnostics and guidance to students step by step.
Rotation Control Unlearning: Quantifying and Controlling Continuous Unlearning for LLM with The Cognitive Rotation Space (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods to remove undesirable data from Large Language Models suffer from cumulative catastrophic utility loss under continuous unlearning requests.
Approach: They propose a method that leverages the rotational salience weight of RCU to quantify and control the unlearning degree in the continuous unlearning process.
Outcome: The proposed method achieves SOTA performance without a retained dataset.
Exploring Layer-wise Information Effectiveness for Post-Training Quantization in Small Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Large language models with billions of parameters are often over-provisioned . smaller models exhibit lower robustness under extreme low-bit quantization .
Approach: They propose a hardware-native, metric-driven post-training quantization framework that keeps uniform bit-width within each layer while mixing precision across layers.
Outcome: LieQ reduces large accuracy gap observed for large language models with billions of parameters while preserving standard multiplication kernels.
Do Vision-Language Models Have Internal World Models? Towards an Atomic Evaluation (2025.findings-acl)

Copied to clipboard

Challenge: Recent studies have evaluated and shown limitations in specific capabilities such as visual understanding, but a systematic evaluation of VLMs’ fundamental WM abilities remains absent.
Approach: They propose a framework that assesses perception and prediction to provide an atomic evaluation of VLMs as WMs.
Outcome: The proposed framework assesses perception and prediction abilities on 15 latest VLMs and compares them to human-level models.
Applying Contrastive Learning to Code Vulnerability Type Classification (2024.emnlp-main)

Copied to clipboard

Challenge: Recent approaches to classification of vulnerabilities ignore their relationships and treat each class in isolation, resulting in non-scalable code vector representations.
Approach: They propose a hierarchical contrastive learning framework to bring vector representations of related CWEs closer together and use max-pooling to enable the model to handle longer vulnerability code inputs.
Outcome: The proposed framework outperforms state-of-the-art methods by 2.97%-17.90% on accuracy and 0.98%-22.27% on weighted-F1 with even better performance on higher-quality datasets.
Co-Evolving LLMs and Embedding Models via Density-Guided Preference Optimization for Text Clustering (2025.emnlp-main)

Copied to clipboard

Challenge: Existing methods for text clustering use static pseudo-oracles, i.e., unidirectionally querying them for similarity assessment or data augmentation.
Approach: They propose a training framework that enables bidirectional refinement between LLMs and embedding models by using task-aware prompts to guide the LLM in generating interpretations for the input texts.
Outcome: Experiments on 14 benchmark datasets across 5 tasks demonstrate the effectiveness of the proposed training framework.
DeepPlanning: Benchmarking Long-Horizon Agentic Planning with Verifiable Constraints (2026.acl-long)

Copied to clipboard

Challenge: Existing LLM planning benchmarks emphasize local, step-level reasoning rather than global constrained optimization.
Approach: They propose a benchmark for practical long-horizon agent planning that uses local constrained reasoning and global constrained optimization.
Outcome: The proposed benchmarks show that even frontier agentic LLMs struggle with these problems.
Contextual Domain Classification with Temporal Representations (2021.naacl-industry)

Copied to clipboard

Challenge: Existing studies that incorporate context in SLU have focused on domains where context is limited to a few minutes.
Approach: They propose temporal representations that combine wall-clock second difference and turn order offset information to utilize both recent and distant context in a novel large-scale setup.
Outcome: The proposed model reduces 13.04% of classification errors compared to baseline . previous studies have focused on domains where context is limited to a few minutes .
Personalized Question Answering with User Profile Generation and Compression (2025.findings-emnlp)

Copied to clipboard

Challenge: Large language models are prone to providing “midguy” answers regardless of users’ knowledge background, thereby failing to meet each user’s personalized needs.
Approach: They propose to generate personalized answers with LLMs based on users’ past question-answering records.
Outcome: The proposed method generates personalized answers based on user's past question-answering records.
Amadeus: Autoregressive Model with Bidirectional Attribute Modelling for Symbolic Music (2026.acl-long)

Copied to clipboard

Challenge: Existing symbolic music generation models represent musical notes as a sequence of attribute tokens with fixed unidirectional dependencies.
Approach: They propose a symbolic music generation framework that adopts a autoregressive and a discrete diffusion architectures for note attributes.
Outcome: The proposed framework improves state-of-the-art models across objective and subjective metrics.
Language Agents: Foundations, Prospects, and Risks (2024.emnlp-tutorials)

Copied to clipboard

Challenge: Language agents are autonomous agents that can follow language instructions to perform diverse tasks in real-world or simulated environments.
Approach: They propose to provide a conceptual framework for language agents and a comprehensive discussion on key topics.
Outcome: The proposed tutorial provides a conceptual framework of language agents and comprehensive discussion on important topic areas.
Optimizing NLU Reranking Using Entity Resolution Signals in Multi-domain Dialog Systems (2021.naacl-industry)

Copied to clipboard

Challenge: In dialog systems, the Natural Language Understanding component makes the interpretation decision before the mentioned entities are resolved.
Approach: They propose to leverage Entity Resolution (ER) features in NLU reranking to learn model weights . they propose a score distribution matching method to ensure the models are calibrated .
Outcome: The proposed approach outperforms the baseline model on multiple domain evaluations.
SeedBench: A Multi-task Benchmark for Evaluating Large Language Models in Seed Science (2025.acl-long)

Copied to clipboard

Challenge: Seed science is essential for modern agriculture, but its application in seed science remains limited due to a shortage of experts and limited availability of online resources.
Approach: They evaluate 26 leading large language models and compare them against a set of benchmarks . they find that there is a gap between the power of LLMs and real-world seed science problems .
Outcome: The new seed benchmark highlights the gap between the power of large language models and real-world seed science problems.
GaLa: Hypergraph-Guided Visual Language Models for Procedural Planning (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods for procedural planning over-rely on visual inputs and lack structured semantic information.
Approach: They propose a vision–language framework for multimodal procedural planning that exploits implicit spatial relations and deep semantics encoded in object attributes.
Outcome: The proposed framework outperforms existing methods in terms of execution success rate, LCS, and planning correctness.
Rethinking Pragmatics in Large Language Models: Towards Open-Ended Evaluation and Preference Tuning (2024.emnlp-main)

Copied to clipboard

Challenge: Existing methods to assess social-pragmatic inference in large language models are inadequacy, and preferential tuning is the best approach.
Approach: They propose to use free-form models' responses as a measure to assess social-pragmatic reasoning and advocate for preference optimization over supervised finetuning (SFT).
Outcome: The proposed model outperforms supervised finetuning (SFT) and offers a near-free launch in pragmatic abilities without compromising general capabilities.
A Self-Denoising Model for Robust Few-Shot Relation Extraction (2025.acl-long)

Copied to clipboard

Challenge: Existing studies assume that the support set contains only accurately labeled instances, but this assumption is often unrealistic.
Approach: They propose a self-denoising model for FSRE which can automatically correct noisy labels of support instances.
Outcome: The proposed model outperforms all baselines on two public datasets showing that it can correct mislabeled support instances.
CLLE: A Benchmark for Continual Language Learning Evaluation in Multilingual Machine Translation (2022.findings-emnlp)

Copied to clipboard

Challenge: Existing benchmarks for Continual Language Learning (CLL) are limited due to the complexity of the task and the lack of unified benchmarks.
Approach: They propose a Continual Language Learning Evaluation benchmark CLLE in multilingual translation.
Outcome: The proposed method is effective when compared with other strong benchmarks.
M2RC-EVAL: Massively Multilingual Repository-level Code Completion Evaluation (2025.acl-long)

Copied to clipboard

Challenge: Existing repository-level code completion benchmarks focus on a limited number of languages . existing benchmarks report overall average scores of different languages ignoring fine-grained abilities .
Approach: They propose to use repository-level code completion benchmarks to evaluate general code intelligence abilities across languages for existing code Large Language Models.
Outcome: The proposed benchmarks improve the code completion abilities of existing LLMs by using two types of annotations on the parsed syntax tree.
Specialist or Generalist? Instruction Tuning for Specific NLP Tasks (2023.emnlp-main)

Copied to clipboard

Challenge: Recent studies have shown that instruction tuning can be a data-efficient method for transforming large language models into generalist models, but their performance lags behind specialist models trained exclusively for specific tasks.
Approach: They propose to incorporate broadcoverage generalist instruction tuning into large language models to build a specialist model by incorporating task specificity and skill requirements.
Outcome: The proposed method improves model performance when task coverage is broad and when training data is limited.
The Fall of ROME: Understanding the Collapse of LLMs in Model Editing (2024.findings-emnlp)

Copied to clipboard

Challenge: Recent studies have found that model editing methods can cause large language models to collapse with just a single edit.
Approach: They propose a method that uses prefixed keys and adds prefixes during testing to prevent model collapse.
Outcome: The proposed method prevents model collapse while maintaining effectiveness, the authors show . Rank-One Model Editing (ROME) has been found to cause model collapse with just a single edit .
BaseCal: Unsupervised Confidence Calibration via Base Model Signals (2026.acl-long)

Copied to clipboard

Challenge: Post-trained LLMs typically compromise reliability with severe overconfidence, resulting in inaccurate responses.
Approach: They propose a solution that feeds PoLLMs into the base LLM to get confidence.
Outcome: The proposed solution reduces expected calibration error (ECE) by 42.90% compared to the best unsupervised baselines.
Towards User-Driven Neural Machine Translation (2021.acl-long)

Copied to clipboard

Challenge: a good translation should implicitly mirror user traits rather than translate the original content semantically.
Approach: They propose a framework that captures user traits from historical inputs . they propose 'user-driven' NMT to model user behavior under a zero-shot learning fashion .
Outcome: The proposed framework can capture user traits from historical inputs under zero-shot learning fashion.
Multimodal Context Carryover (2022.emnlp-industry)

Copied to clipboard

Challenge: Existing voice-only dialogue systems lack multimodality support, which can lead to costly system redesigns.
Approach: They propose to augment existing voice-only dialogue systems with additional multimodal components to facilitate quick delivery of visual modality support with minimal changes.
Outcome: The proposed framework improves visual modality support with minimal changes on an in-house multi-modal visual navigation data set.
An Expert is Worth One Token: Synergizing Multiple Expert LLMs as Generalist via Expert Token Routing (2024.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) have demonstrated remarkable capabilities across a wide spectrum of tasks, but performance and reliability in certain specialized domains still fall short of expectations.
Approach: They propose a unified generalist framework that facilitates seamless integration of multiple expert LLMs.
Outcome: The proposed framework outperforms existing multi-LLM collaboration paradigms across six diverse expert domains.
Locate-and-Focus: Enhancing Terminology Translation in Speech Language Models (2025.acl-long)

Copied to clipboard

Challenge: Existing methods for terminology translation struggle with interference from irrelevant noise.
Approach: They propose a Locate-and-Focus method that locates terminologies within utterances to construct translation knowledge by minimizing irrelevant information for ST models.
Outcome: The proposed method locates terminologies within utterances and enhances the success rate of terminology translation while maintaining robust general translation performance.
Crabs: Consuming Resource via Auto-generation for LLM-DoS Attack under Black-box Settings (2025.findings-acl)

Copied to clipboard

Challenge: Existing studies on white-box attacks focus on black-box LLMs, leaving black- box scenarios underexplored.
Approach: They propose an automated algorithm designed for black-box LLMs that constructs the DoS Attack Tree and expands the node coverage to achieve effectiveness under black- box conditions.
Outcome: The proposed algorithm can be used to build a DoS Attack Tree and expand the node coverage to achieve effectiveness under black-box conditions.
Enhancing Agentic Textual Graph Retrieval with Synthetic Stepwise Supervision (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for integrating textual graphs with LLMs are limited by symbolic inference and high annotation costs.
Approach: They propose a textual graph reasoning framework that integrates textual diagrams with large language models.
Outcome: The proposed approach achieves 15.6% accuracy and 17.2% in F1 score on three common datasets.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations