Papers by Jinsong Su

82 papers
GIFT: Guided Fine-Tuning and Transfer for Enhancing Instruction-Tuned Language Models (2026.acl-long)

Copied to clipboard

Challenge: Existing adapter-based transfer methods treat instruction-tuned models as passive targets . direct fine-tuning can disrupt this delicate balance and lead to instability or performance degradation.
Approach: They propose a framework that incorporates instruction-level guidance into task adaptation.
Outcome: The proposed framework outperforms direct fine-tuning and representative transfer-based baselines while maintaining robust generalization and favorable test-time scaling behavior.
Bridging Subword Gaps in Pretrain-Finetune Paradigm for Natural Language Generation (2021.acl-long)

Copied to clipboard

Challenge: Existing methods to pretrain language models are limited by one-size-fits-all vocabulary . embeddings of mismatch tokens can be efficiently initialized in downstream tasks .
Approach: They propose to extend pretrain-finetune pipeline with an embedding transfer step . plug-and-play embeddable generator is introduced to generate any input token .
Outcome: The proposed approach allows for more efficient and better performed NLG models.
A Sequence-to-Sequence&Set Model for Text-to-Table Generation (2023.findings-acl)

Copied to clipboard

Challenge: Existing models for text-to-table generation are order-insensitive, but suffer from errors . a novel sequence-tosequence&set model generates table body rows in parallel .
Approach: They propose a sequence-to-sequence generation task that serializes each table into a token sequence during training by concatenating all rows in a top-down order.
Outcome: The proposed model outperforms baselines on commonly-used datasets.
Confidence Based Bidirectional Global Context Aware Training Framework for Neural Machine Translation (2022.acl-long)

Copied to clipboard

Challenge: Existing studies focus on how to effectively exploit bidirectional global contexts in neural machine translation models.
Approach: They propose a Confidence Based Bidirectional Global Context Aware training framework for NMT . they incorporate bidirectional global context to the NMT model on unconfidently-predicted target words .
Outcome: The proposed framework improves the NMT model on three large-scale translation datasets by +1.02, +0.57 BLEU scores.
Self-Consistency Boosts Calibration for Math Reasoning (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing solutions for math reasoning tasks use semantic parsing or AST decoding, but performance can degrade dramatically even with slight changes to the questions.
Approach: They propose three calibration methods based on self-consistency for math reasoning tasks.
Outcome: The proposed methods bridge model confidence and accuracy better than existing methods based on p(True) or logit.
Leveraging Dependency Forest for Neural Medical Relation Extraction (D19-1)

Copied to clipboard

Challenge: Existing methods for medical relation extraction use dependency syntax as a source of features.
Approach: They propose a method to extract relational information from medical literature by using dependency forests.
Outcome: The proposed method outperforms the standard tree-based methods in the medical domain.
Towards Making the Most of Dialogue Characteristics for Neural Chat Translation (2021.emnlp-main)

Copied to clipboard

Challenge: Neural Chat Translation (NCT) models that use dialogue characteristics of chat are often incoherent and speakerirrelevant.
Approach: They propose to introduce the modeling of dialogue characteristics into the NCT model by capturing the inherent dialogue characteristics.
Outcome: The proposed model can translate conversational text between speakers of different languages.
Towards Robust Neural Machine Translation with Iterative Scheduled Data-Switch Training (2022.coling-1)

Copied to clipboard

Challenge: Existing methods on robust neural machine translation (NMT) construct adversarial examples by injecting noise into authentic examples and indiscriminately exploit two types of examples.
Approach: They propose an iterative scheduled data-switch training framework to mitigate this problem by injecting noise into authentic examples and indiscriminately exploiting two types of examples.
Outcome: The proposed model outperforms several competitive benchmarks on four translation benchmarks.
CNSL-bench: Benchmarking the Sign Language Understanding Capabilities of MLLMs on Chinese National Sign Language (2026.acl-long)

Copied to clipboard

Challenge: CNSL-bench is the first comprehensive Chinese National Sign Language benchmark . current MLLMs are inferior to human performance, despite advances in multimodal modeling .
Approach: They propose a Chinese National Sign Language benchmark to evaluate multimodal large language models in sign language understanding.
Outcome: The proposed benchmark evaluates 21 open-source and proprietary MLLMs . results show that current models are inferior to human performance .
DetectRL-X: Towards Reliable Multilingual and Real-World LLM-Generated Text Detection (2026.acl-long)

Copied to clipboard

Challenge: Existing detectors are limited in their ability to detect large language models generated content in multilingual environments.
Approach: They propose a multilingual benchmark to evaluate advanced detectors across 8 dimensions to better align with real-world applications.
Outcome: The proposed benchmark encompasses 8 languages commonly used in commercial contexts and collects human-written texts from 6 domains highly susceptible to LLM misuse.
A Variational Hierarchical Model for Neural Cross-Lingual Summarization (2022.acl-long)

Copied to clipboard

Challenge: Existing studies on cross-lingual summarization focus on pipeline methods or jointly training an end-to-end model through an auxiliary MT or MS objective.
Approach: They propose a hierarchical model for the cross-lingual summarization task . the model is based on the conditional variational auto-encoder .
Outcome: The proposed model generates better cross-lingual summaries than comparison models in the few-shot setting.
An Evaluation Resource for Grounding Translation Errors (2025.findings-emnlp)

Copied to clipboard

Challenge: Current fine-grained error analyses do not ground the errors to the reasons why the annotated text spans are erroneous.
Approach: They use a bi-directional grounding scheme to ground erroneous text in two directions . if the error spans of both directions are consistent, the explanation is valid .
Outcome: The proposed grounding process improves translation error detection significantly.
Progressive Self-Supervised Attention Learning for Aspect-Level Sentiment Analysis (P19-1)

Copied to clipboard

Challenge: Experimental results show that our proposed approach yields better attention mechanisms . dominant ASC models are mostly discriminative classifiers based on manual feature engineering .
Approach: They propose a self-supervised approach to aspect-level sentiment classification that mines useful attention supervision information from a training corpus to refine attention mechanisms.
Outcome: The proposed approach yields better attention mechanisms on multiple datasets.
Type-Driven Multi-Turn Corrections for Grammatical Error Correction (2022.findings-acl)

Copied to clipboard

Challenge: Existing studies focus on data augmentation to combat exposure bias . but data augmented models lack the ability to recognize the procedure of gradual corrections .
Approach: They propose a type-driven multi-turn corrections approach that uses multiple training instances to train dominant models.
Outcome: The proposed model achieves state-of-the-art single-model performance on English GEC benchmarks.
Iterative Dual Domain Adaptation for Neural Machine Translation (D19-1)

Copied to clipboard

Challenge: Empirical results on Chinese-English and English-German translation tasks demonstrate the effectiveness of our proposed framework.
Approach: They propose an iterative dual domain adaptation framework for neural machine translation that uses multiple corpora to perform bidirectional translation knowledge transfer.
Outcome: Empirical results on Chinese-English and English-German translation tasks demonstrate the effectiveness of the proposed framework.
Towards Better Document-level Relation Extraction via Iterative Inference (2022.emnlp-main)

Copied to clipboard

Challenge: Existing methods only consider feature information of entity pairs, but our model exploits both feature information and previous predictions of entity pair.
Approach: They propose a document-level relation extraction model with iterative inference to extract relations between entities from raw texts.
Outcome: The proposed model outperforms existing methods on three commonly-used datasets.
BigVideo: A Large-scale Video Subtitle Translation Dataset for Multimodal Machine Translation (2023.findings-acl)

Copied to clipboard

Challenge: Existing datasets focus on captions describing images or videos, which are not large and diverse enough.
Approach: They propose a large-scale video subtitle translation dataset to facilitate multi-modality machine translation.
Outcome: The proposed dataset is 10 times larger than the widely used *How2* and *VaTeX* datasets.
Sentiment-Aware Word and Sentence Level Pre-training for Sentiment Analysis (2022.emnlp-main)

Copied to clipboard

Challenge: Existing pre-trained language representation models (PLMs) capture sentiment information from word-level while under-considering sentence-level information.
Approach: They propose a Sentiment-aware pre-trained language model with combined Word-level and Sentence-level Pre-training tasks that enhance the PLM’s knowledge about sentiment words.
Outcome: The proposed model achieves state-of-the-art on various sentence-level and aspect-level sentiment classification benchmarks.
A Multi-Agent Framework with Automated Decision Rule Optimization for Cross-Domain Misinformation Detection (2025.emnlp-main)

Copied to clipboard

Challenge: Existing methods for misinformation detection are limited by domain knowledge and expert experience.
Approach: They propose a Multi-Agent Framework for cross-domain misinformation detection with Automated Decision Rule Optimization (MARO) they first employ multiple expert agents to analyze target-domain news, then introduce a question-reflection mechanism that guides expert agents for higher-quality analysis.
Outcome: The proposed framework improves on a common dataset and shows that iteratively improves over existing methods.
Beyond Black-Box Interventions: Latent Probing for Faithful Retrieval-Augmented Generation (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches to improve contextual faithfulness treat the LLM as a black box, generating responses that are inconsistent with the provided context.
Approach: They propose a framework for faithful RAG that operates in three stages: (i) fine-grained knowledge pruning to filter irrelevant context, (ii) latent conflict probing to identify hard conflicts in the model’s latent space, and (iv) conflict-aware attention to modulate attention heads toward faithful context integration.
Outcome: Experiments show that ProbeRAG significantly improves both accuracy and contextual faithfulness.
A Learning Rate Path Switching Training Paradigm for Version Updates of Large Language Models (2024.emnlp-main)

Copied to clipboard

Challenge: Version updates are an indispensable requirement for Large Language Models . a large learning rate in the first stage and a complete learning decay process are crucial for version updates of LLMs.
Approach: They propose a learning rate path switching training paradigm for version updates of Large Language Models.
Outcome: The proposed paradigm reduces training cost to 58% when training four versions of LLMs compared to PTFS and CPT .
Deconvolution-Based Global Decoding for Neural Machine Translation (C18-1)

Copied to clipboard

Challenge: Existing models for Neural Machine Translation (NMT) use Recurrent Neural Network (RNN) to generate translation word by word following a sequential order.
Approach: They propose a Neural Machine Translation (NMT) model that decodes the sequence with the guidance of its structural prediction of the target-side context.
Outcome: The proposed model is more competitive compared with the state-of-the-art methods and reduces repetition with the instruction from the target-side context for decoding.
Towards Better Graph-based Cross-document Relation Extraction via Non-bridge Entity Enhancement and Prediction Debiasing (2024.findings-acl)

Copied to clipboard

Challenge: Existing studies on relation extraction ignore non-bridge entities, leading to bias during inference.
Approach: They propose a graph-based cross-document Relation Extraction model with non-bridge entity enhancement and prediction debiasing that integrates non-cross entities with target entities and bridge entities.
Outcome: The proposed model outperforms baseline models on open and closed datasets.
Mitigating Catastrophic Forgetting in Large Language Models with Self-Synthesized Rehearsal (2024.acl-long)

Copied to clipboard

Challenge: Existing methods to train LLMs on previous training data are not feasible in real-world applications because of catastrophic forgetting.
Approach: They propose a framework that uses the LLM to generate synthetic instances for rehearsal and refine the instance outputs based on the synthetic inputs.
Outcome: The proposed framework achieves superior or comparable performance compared to conventional rehearsal-based approaches while being more data-efficient.
LLaVE: Large Language and Vision Embedding Models with Hardness-Weighted Contrastive Learning (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing LMM-based embedding models exhibit a high degree of overlap in similarity distribution between positive and negative pairs, making it challenging to distinguish hard negative pairs effectively.
Approach: They propose a framework that improves the embedding model's representation learning for negative pairs based on their discriminative difficulty.
Outcome: The proposed framework improves the embedding model's representation learning for negative pairs based on their discriminative difficulty.
AVG-LLaVA: An Efficient Large Multimodal Model with Adaptive Visual Granularity (2025.findings-acl)

Copied to clipboard

Challenge: Existing large multimodal models typically divide high-resolution images into multiple local images and a global image, leading to a large number of visual tokens.
Approach: They propose an LMM that can adaptively select the appropriate visual granularity based on the input image and instruction.
Outcome: The proposed model significantly reduces visual tokens and speeds up inference on 11 benchmarks.
Retaining Key Information under High Compression Ratios: Query-Guided Compressor for LLMs (2024.acl-long)

Copied to clipboard

Challenge: Existing methods to compress long contexts have degraded dramatically as compression ratios increase, sometimes even falling to the closed-book level.
Approach: They propose a query-guided compression method that preserves key information within the compressed context.
Outcome: The proposed method can consistently perform well even at high compression ratios, and offers significant benefits in terms of inference cost and throughput.
WR-One2Set: Towards Well-Calibrated Keyphrase Generation (2022.emnlp-main)

Copied to clipboard

Challenge: Experimental results show that keyphrase generation has serious calibration errors . ONE2SET generates short phrases summarizing an input document .
Approach: They propose a paradigm for keyphrase generation that generates short phrases summarizing an input document.
Outcome: The proposed model over-estimates tokens and makes it well-calibrated on common datasets.
Multi-Level Cross-Modal Alignment for Speech Relation Extraction (2024.emnlp-main)

Copied to clipboard

Challenge: Existing studies use synthetic speech to train and evaluate SpeechRE models, hindering their development . modality gap issue limits performance of existing models, limiting future researches .
Approach: They propose to use speech data to train and evaluate SpeechRE models by using real speech . they propose to train a cross-modal alignment model to bridge the modality gap .
Outcome: The proposed model can train to bridge the modality gap between speech encoder and text decoder . the proposed model is based on two real SpeechRE datasets .
HEALing Entropy Collapse: Enhancing Exploration in Few-Shot RLVR via Hybrid-Domain Entropy Dynamics Alignment (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for training reasoning-oriented large language models assume high-resource settings with abundant data.
Approach: They propose a framework that integrates high-value general-domain data to promote more diverse exploration.
Outcome: The proposed framework matches or surpasses RLVR trained with 32 target-domain samples using 32 target domain samples.
Multi-Domain Neural Machine Translation with Word-Level Domain Context Discrimination (D18-1)

Copied to clipboard

Challenge: Experimental results on Chinese-English and English-French multi-domain translation tasks demonstrate the effectiveness of the proposed model.
Approach: They propose to use mixed-domain parallel sentences to construct a unified model that allows translation to switch between different domains.
Outcome: The proposed model distinguishes and exploits word-level domain contexts on Chinese-English and English-French translation tasks.
LegalGraphRAG: Multi-Agent Graph Retrieval-Augmented Generation for Reliable Legal Reasoning (2026.acl-long)

Copied to clipboard

Challenge: Graph-based Retrieval-Augmented Generation (GraphRAG) is a new approach to document retrieval, but it is not suitable for legal reasoning.
Approach: They propose a framework for reliable legal reasoning that structures knowledge as relational graphs and uses a multi-agent system to verify validity.
Outcome: The proposed framework outperforms existing GraphRAG models in accurate and trustworthy legal analysis.
Accelerating Neural Transformer via an Average Attention Network (P18-1)

Copied to clipboard

Challenge: Using parallelizable attention networks, the neural Transformer is slow to train due to auto-regressive architecture and self-attention in the decoder.
Approach: They propose an average attention network to replace the original self-attention model in the decoder of the neural Transformer.
Outcome: The proposed network can decode sentences over four times faster than the original version with almost no loss in training time and translation performance.
Continual Learning for Multilingual Neural Machine Translation via Dual Importance-based Model Division (2023.emnlp-main)

Copied to clipboard

Challenge: Existing methods focus on preventing catastrophic forgetting by making compromises between the original and new language pairs, leading to sub-optimal performance on both translation tasks.
Approach: They propose a dual importance-based model division method to divide the model parameters into two parts and separate the translation of the original and new tasks.
Outcome: The proposed method outperforms strong baselines under different incremental translation scenarios.
OpenFact: Factuality Enhanced Open Knowledge Extraction (2023.tacl-1)

Copied to clipboard

Challenge: Existing OIE systems organize knowledge into subject-relation-object (SRO) triplets, and they use templates to extract such knowledge triplet.
Approach: They propose a framework to handle expressiveness and groundedness in OpenFact . they propose to use templates, extra constraints, and adopt human efforts to ensure that most triplets contain enough details.
Outcome: The proposed framework improves expressiveness and groundedness of OpenFact . it is more accurate and denser than OPIEC-Linked, which is grounded to Wikidata .
LLM-OREF: An Open Relation Extraction Framework Based on Large Language Models (2025.emnlp-main)

Copied to clipboard

Challenge: Existing studies focus on building models that can only handle predefined relations . however, their reliance on human annotation limits their practicality .
Approach: They propose an open relation extraction framework that can generalize to new relations not encountered during training.
Outcome: The proposed framework can generalize to new relations not encountered during training.
Improving LLM Generations via Fine-Grained Self-Endorsement (2024.findings-acl)

Copied to clipboard

Challenge: Recent large language models (LLMs) have demonstrated remarkable capabilities but can still fail frequently on knowledge-intensive tasks.
Approach: They propose a self-endorsement framework that leverages fine-grained fact-level comparisons across multiple sampled responses.
Outcome: The proposed framework can improve factuality of generations with simple prompts across scales of LLMs.
Domain Adaptation for Conversational Query Production with the RAG Model Feedback (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing studies have focused on human-annotated search queries but they can not cover conversations of various domains.
Approach: They propose a domain adaptation framework that uses retrieval-augmented generation to improve the model's robustness.
Outcome: The proposed model is more robust and performs significantly better in a more challenging setting over strong baselines.
Towards Linear Time Neural Machine Translation with Capsule Networks (D19-1)

Copied to clipboard

Challenge: Neural Machine Translation (NMT) is an endto-end learning approach to machine translation.
Approach: They propose a capsule network with dynamic routing for linear time Neural Machine Translation . they map the source sentence into a matrix with pre-determined size and apply a deep LSTM network to decode the target sequence from the source representation.
Outcome: The proposed network achieves comparable results with the Transformer system on English-German and English-French tasks.
Structural Information Preserving for Graph-to-Text Generation (2020.acl-main)

Copied to clipboard

Challenge: Existing models that mess up or drop the core structural information of input graphs are lacking in graph-to-text generation.
Approach: They propose to leverage richer training signals to guide a graph-to-text generation model by focusing on autoencoding losses and back-propagating the losses to better calibrate the model.
Outcome: Experiments on two benchmarks show the proposed model over a state-of-the-art model . two types of autoencoding losses are used to back-propagate the model based on multitask training .
PATIMT-Bench: A Multi-Scenario Benchmark for Position-Aware Text Image Machine Translation in Large Vision-Language Models (2025.findings-emnlp)

Copied to clipboard

Challenge: Current TIMT studies focus on providing translations for all text within an image, neglecting to provide bounding boxes and covering limited scenarios.
Approach: They extend traditional TIMT into position-aware TIMt to support fine-grained translation . they introduce an Adaptive Image OCR Refinement Pipeline to refine results .
Outcome: The proposed model supports fine-grained and layout-preserving translation . the experimental data highlight the scalability and generalizability of the model.
MHGRL: An Effective Representation Learning Model for Electronic Health Records (2024.lrec-main)

Copied to clipboard

Challenge: Effective EHR representations are key to achieving high performance in healthcare applications.
Approach: They propose a multimodal heterogeneous graph-enhanced representation learning to learn EHR representations using medical ontology and textual notes.
Outcome: The proposed model outperforms baseline models on two real clinical datasets in downstream tasks.
Don’t Get Lost in the Trees: Streamlining LLM Reasoning by Overcoming Tree Search Exploration Pitfalls (2025.acl-long)

Copied to clipboard

Challenge: Recent advances in tree search algorithms guided by verifiers have significantly enhanced the reasoning capabilities of large language models (LLMs), but at the cost of increased computational resources.
Approach: They propose an e ffici ent tree sear ch framework that is a plug-and-play system compatible with various tree search algorithms.
Outcome: The proposed framework reduces computational costs and prioritizes resource allocation to harder tasks (Levels 3-4) over simpler ones (Level 1-2), addressing both over-exploration in basic problems and under-exploation in complex cases.
Adaptive Token-level Cross-lingual Feature Mixing for Multilingual Neural Machine Translation (2022.emnlp-main)

Copied to clipboard

Challenge: Multilingual neural machine translation models can translate multiple language pairs in a single model but lacks ability to capture language-specific features.
Approach: They propose a token-level feature mixing method that captures different features and dynamically determines feature sharing across languages.
Outcome: The proposed method outperforms baselines and can be extended to zero-shot translation.
Advancing SMoE for Continuous Domain Adaptation of MLLMs: Adaptive Router and Domain-Specific Loss (2025.acl-long)

Copied to clipboard

Challenge: Recent studies have explored Continual Instruction Tuning (CIT) in Multimodal Large Language Models (MLLMs), with a primary focus on Task-incremental CIT, where MLLM are required to continuously acquire new tasks.
Approach: They propose a Sparse Mixture of Expert (SMoE) based method for domain-incremental CIT in Multimodal Large Language Models (MLLMs) . they equip the SMoA module with a domain-specific autoregressive loss (DSAL) they establish a new benchmark to evaluate the efficacy of their method .
Outcome: The proposed method outperforms all baselines and is based on a Sparse Mixture of Experts (SMoE) module .
A Novel Graph-based Multi-modal Fusion Encoder for Neural Machine Translation (2020.acl-main)

Copied to clipboard

Challenge: Existing multi-modal neural machine translation models do not fully exploit fine-grained semantic correspondences between semantic units of different modalities.
Approach: They propose a graph-based multi-modal fusion encoder that exploits fine-grained semantic correspondences between different modalities.
Outcome: The proposed encoder significantly extends the conventional text-based translation by taking images as additional inputs.
Exploring All-In-One Knowledge Distillation Framework for Neural Machine Translation (2023.emnlp-main)

Copied to clipboard

Challenge: Existing knowledge distillation methods only obtain one lightweight student each time . this could be resource-intensive and resulting in multiple students not being optimally utilized .
Approach: They propose a knowledge distillation framework which generates multiple satisfactory students at once.
Outcome: The proposed framework generates multiple satisfactory students at once.
BAPO: Boundary-Aware Policy Optimization for Reliable Agentic Search (2026.findings-acl)

Copied to clipboard

Challenge: Existing RL-based agentic search models fail to recognize reasoning boundaries and rarely admit "I DON'T KNOW" lack of reliability leads to plausible but unreliable answers, introducing significant risks .
Approach: They propose a framework to cultivate reliable boundary awareness without compromising accuracy.
Outcome: Experiments show that the proposed framework improves the reliability of agentic search models.
Empowering Backbone Models for Visual Text Generation with Input Granularity Control and Glyph-Aware Training (2024.emnlp-main)

Copied to clipboard

Challenge: Existing text-to-image models struggle to generate images with legible visual texts . current models lack support for Chinese texts, misspelling, and lack of diversity .
Approach: They propose to empower backbone models to generate visual texts in Chinese and English . they propose to augment conventional training objective with glyph-aware training losses .
Outcome: The proposed methods can generate visual texts in English and Chinese while maintaining image generation quality.
Enhancing Chinese Word Segmentation via Pseudo Labels for Practicability (2021.findings-acl)

Copied to clipboard

Challenge: Pre-trained language models alleviate segmentation ambiguity and out-of-vocabulary (OOV) words.
Approach: They propose a semisupervised neural method which distills knowledge from unlabeled data to a student model to improve both in-domain and out-of-domain CWS.
Outcome: The proposed method can keep practicability of the lightweight student model and improve segmentation effectively on downstream Chinese NLP tasks.
Getting the Most out of Simile Recognition (2022.findings-emnlp)

Copied to clipboard

Challenge: Recent work ignores features other than surface strings and suffers from data hunger issue.
Approach: They propose to use simile sentence classification and simile component extraction to find simile components.
Outcome: The proposed model outperforms current state-of-the-art systems and baselines.
Adaptive Simultaneous Sign Language Translation with Confident Translation Length Estimation (2024.lrec-main)

Copied to clipboard

Challenge: Existing non-simultaneous sign language translation methods suffer from inherent inference delays in real-time scenarios.
Approach: They propose an adaptive policy for simultaneous sign language translation that progressively converts incrementally received sign video into its corresponding natural sentence.
Outcome: The proposed policy excels in situations requiring extremely low latency.
Simplifying Neural Machine Translation with Addition-Subtraction Twin-Gated Recurrent Networks (D18-1)

Copied to clipboard

Challenge: Existing gated recurrent networks have a vanishing gradient, allowing for more matrix transformations and less transparent functions.
Approach: They propose an additionsubtraction twin-gated recurrent network (ATR) to simplify neural machine translation.
Outcome: The proposed system is more transparent than LSTM/GRU due to the simplification.
Bridging the Domain Gaps in Context Representations for k-Nearest Neighbor Neural Machine Translation (2023.acl-long)

Copied to clipboard

Challenge: Existing methods to improve k-Nearest neighbor machine translation (kNN-MT) are based on the ability to non-parametrically adapt to new domains.
Approach: They propose a method to boost the datastore retrieval of k-Nearest neighbor machine translation by reconstructing the original datastore.
Outcome: The proposed method boosts the retrieval and translation quality of k-Nearest neighbor machine translation by reconstructing the original datastore.
Efficient k-Nearest-Neighbor Machine Translation with Dynamic Retrieval (2024.findings-acl)

Copied to clipboard

Challenge: Existing models for non-parametric domain adaptation lack kNN retrieval at each timestep, leading to substantial time overhead.
Approach: They propose a kNN-MT-based model that uses a domain-specific translation knowledge store to interpolate the prediction distribution of the model.
Outcome: The proposed model significantly extends kNN-MT with dynamic retrieval on widely-used datasets.
BACO: A Background Knowledge- and Content-Based Framework for Citing Sentence Generation (2021.acl-long)

Copied to clipboard

Challenge: citing sentences capture salient information in cited papers and the connection between citing and citing papers.
Approach: They propose a BAckground knowledge- and COntent-based framework for citing sentence generation that integrates two types of information: background knowledge and content.
Outcome: The proposed framework outperforms baselines in the citation sentence generation task.
Bridging the Gap between Training and Inference: Multi-Candidate Optimization for Diverse Neural Machine Translation (2022.findings-naacl)

Copied to clipboard

Challenge: Existing diverse NMT models lack translation diversity due to a discrepancy between training and inference . despite the success of diverse NTM, there is still a lack of translation diversity .
Approach: They propose a multi-candidate optimization framework for diverse NMT to deal with this defect.
Outcome: The proposed framework is transparent to basic diverse NMT models, and universally makes better trade-off between diversity and quality.
HyperNetwork-based Decoupling to Improve Model Generalization for Few-Shot Relation Extraction (2023.emnlp-main)

Copied to clipboard

Challenge: Existing studies cannot generalize well to unseen relations using Prototypical Networks . current approaches are dependent on large amount of labeled data and cannot deal with unseense relations well.
Approach: They propose a HyperNetwork-based Decoupling approach to improve FSRE generalization . they propose FSre models with an encoder, network generator and refined classifiers .
Outcome: The proposed method improves the generalization of few-shot relation extraction models.
CEMT:Controllable Element-Oriented Machine Translation via Structured Linguistic Reasoning (2026.findings-acl)

Copied to clipboard

Challenge: Large Language Models suffer from paraphrasing errors, omissions, or hallucinations when input contains translation-specific elements that require strict preservation or controlled transformation.
Approach: They propose a Controllable Element-Oriented Machine Translation framework that decomposes the translation process into a linguistically grounded analysis, strategy formulation, and final generation.
Outcome: The proposed framework improves on the WMT23/24 Chinese–English benchmarks while significantly reducing element-level constraint violations.
Exploring Dynamic Selection of Branch Expansion Orders for Code Generation (2021.acl-long)

Copied to clipboard

Challenge: Existing code generation models model abstract syntax tree (AST) but not suitable for all multi-branch nodes.
Approach: They propose to equip a Seq2Tree model with a branch selector to determine optimal expansion orders for multi-branch nodes.
Outcome: The proposed model can determine optimal expansion orders of branches for multi-branch nodes.
TempParaphraser: “Heating Up” Text to Evade AI-Text Detection through Paraphrasing (2025.emnlp-main)

Copied to clipboard

Challenge: Existing detectors that perform well on benchmark datasets have weaknesses that can be exploited to manipulate AI-text.
Approach: They propose a framework that simulates high-temperature sampling effects through multiple normal-temperaturing generations, effectively evading detection.
Outcome: The proposed framework reduces detector accuracy by an average of 82.5% while preserving high text quality.
Translatotron-V(ison): An End-to-End Model for In-Image Machine Translation (2024.findings-acl)

Copied to clipboard

Challenge: In-image machine translation (IIMT) aims to translate an image containing texts in source language into an image with translations in target language.
Approach: They propose an end-to-end IIMT model with four modules that translate images . they propose a two-stage training framework to assist the model in learning alignment across languages .
Outcome: The proposed model outperforms cascaded models with only 70.9% of parameters and is highly accurate.
Exploring Better Text Image Translation with Multimodal Codebook (2023.acl-long)

Copied to clipboard

Challenge: Current studies on text image translation face bottlenecks due to lack of a publicly available dataset and poor optical character recognition.
Approach: They propose a text image translation model with a multimodal codebook and an OCR dataset for Chinese-English translation.
Outcome: The proposed model can associate the image with relevant texts, providing useful supplementary information for translation.
One2Set + Large Language Model: Best Partners for Keyphrase Generation (2024.emnlp-main)

Copied to clipboard

Challenge: Existing selection methods make redundant selections, causing poor recall and accuracy.
Approach: They propose a framework to generate keyphrases from a one2set-based model and an LLM as selector.
Outcome: The proposed framework surpasses state-of-the-art models in absent keyphrase prediction.
Selective Contrastive Learning For Gloss Free Sign Language Translation (2026.acl-long)

Copied to clipboard

Challenge: Recent SLT systems adopt CLIP-like Vision-Language pretraining, but the random in-batch contrast provides few, batch-dependent negatives.
Approach: They propose a method to train sign video-text similarity over a time period of 3 months . they use a random in-batch contrast strategy to track negative video- text similarity .
Outcome: The proposed system improves sign language translation by focusing on challenging negatives . the results show that the random in-batch contrast provides few negatives and noisy supervision .
Improving Graph-based Sentence Ordering with Iteratively Predicted Pairwise Orderings (2021.emnlp-main)

Copied to clipboard

Challenge: Existing sentence ordering models can be classified into pairwise ordering models and set-to-sequence models.
Approach: They propose a novel sentence ordering framework which introduces two classifiers to make better use of pairwise orderings for graph-based sentence ordering.
Outcome: The proposed model achieves state-of-the-art performance on five commonly-used datasets.
HCRE: LLM-based Hierarchical Classification for Cross-Document Relation Extraction with a Prediction-then-Verification Strategy (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches to cross-document relation extraction (RE) focus on identifying relations between head and tail entities from single sentence or document.
Approach: They propose a hierarchical relation tree-based LLM-based hierarchic classification model for cross-document relation extraction (HCRE) based on predefined relations, the model can perform hierarchically classification level by level.
Outcome: The proposed model outperforms existing baselines and validates its effectiveness.
Neural Machine Translation with Decoding History Enhanced Attention (C18-1)

Copied to clipboard

Challenge: Neural machine translation with source-side attention has been criticized for its poor memory performance.
Approach: They propose to use a Decoding History Enhanced Attention mechanism to render NMT models better at selecting both source-side and target-side information.
Outcome: The proposed model improves by 0:9 BLEU on Chinese-English translation and the state-of-the-art on a larger task.
A Self-Denoising Model for Robust Few-Shot Relation Extraction (2025.acl-long)

Copied to clipboard

Challenge: Existing studies assume that the support set contains only accurately labeled instances, but this assumption is often unrealistic.
Approach: They propose a self-denoising model for FSRE which can automatically correct noisy labels of support instances.
Outcome: The proposed model outperforms all baselines on two public datasets showing that it can correct mislabeled support instances.
CLLE: A Benchmark for Continual Language Learning Evaluation in Multilingual Machine Translation (2022.findings-emnlp)

Copied to clipboard

Challenge: Existing benchmarks for Continual Language Learning (CLL) are limited due to the complexity of the task and the lack of unified benchmarks.
Approach: They propose a Continual Language Learning Evaluation benchmark CLLE in multilingual translation.
Outcome: The proposed method is effective when compared with other strong benchmarks.
EmoTrans: Emotional Transition-based Model for Emotion Recognition in Conversation (2024.lrec-main)

Copied to clipboard

Challenge: Emotions are causally transmitted among communication participants, facilitating comprehension of intricate changes in emotional states during the conversation.
Approach: They propose an Emotional Transition-based Emotion Recognizer that captures ET features in an emotional conversation by concatenating the most recent utterances with their corresponding speakers.
Outcome: The proposed model is sensitive to emotions and captures ET features in the sample.
FaithfulRAG: Fact-Level Conflict Modeling for Context-Faithful Retrieval-Augmented Generation (2025.acl-long)

Copied to clipboard

Challenge: Existing faithful RAG approaches enforce strict context adherence, but they forcibly suppress the model’s parametric knowledge, which undermines the model's internal knowledge structure and increases the risk of misinterpreting the context.
Approach: They propose a framework that resolves knowledge conflicts by explicitly modeling discrepancies between the model’s parametric knowledge and retrieved context.
Outcome: The proposed framework outperforms state-of-the-art methods in knowledge conflict cases and identifies conflicting knowledge at the fact level and designs a self-thinking process.
Investigating Inference-time Scaling for Chain of Multi-modal Thought: A Preliminary Study (2025.findings-acl)

Copied to clipboard

Challenge: Inference-time scaling of chain-of-thought (CoT) has been demonstrated as a promising approach for addressing multi-modal reasoning tasks.
Approach: They propose to integrate visual and textual modalities within the reasoning process . they adopt a consistency-enhanced verifier to ensure effective guidance for both methods across different thought paradigms.
Outcome: The proposed method outperforms text-only reasoning on 10 tasks spanning diverse domains and requires higher token consumption for processing richer visual inputs.
Signer Diversity-driven Data Augmentation for Signer-Independent Sign Language Translation (2024.findings-naacl)

Copied to clipboard

Challenge: Existing methods for sign language translation (SLT) rely on signer identity labels, which is often impractical and costly in real-world applications.
Approach: They propose a signer diversity-driven data augmentation method that can generalize to signers not encountered during training.
Outcome: The proposed method achieves state-of-the-art results without relying on signer identity labels.
IBADR: an Iterative Bias-Aware Dataset Refinement Framework for Debiasing NLU models (2023.emnlp-main)

Copied to clipboard

Challenge: Using manual data analysis, dataset refinement approaches are often unable to cover all the potential biased features.
Approach: They propose an iterative bias-aware dataset refinement framework which debiases NLU models without predefining biased features.
Outcome: The proposed framework outperforms existing methods and is compatible with model-centric methods.
Towards Robust k-Nearest-Neighbor Machine Translation (2022.emnlp-main)

Copied to clipboard

Challenge: k-Nearest-Neighbor Machine Translation (kNN-MT) is a popular research paradigm in machine translation.
Approach: They propose a confidence-enhanced kNN-MT model with robust training to reduce noise . they introduce NMT confidence to refine the modeling of important components of kN-MT .
Outcome: The proposed model improves on four benchmark datasets and is robust to training.
RC3: Regularized Contrastive Cross-lingual Cross-modal Pre-training (2023.findings-acl)

Copied to clipboard

Challenge: Existing V&L pre-training methods rely on strictly-aligned multilingual image-text pairs generated from English-centric datasets.
Approach: They propose a regularized cross-lingual visual contrastive learning objective that constrains representation proximity of weakly-aligned multilingual image-text pairs.
Outcome: The proposed model outperforms competing models with weak zero-shot capability on 5 multi-modal tasks across 6 languages.
Towards User-Driven Neural Machine Translation (2021.acl-long)

Copied to clipboard

Challenge: a good translation should implicitly mirror user traits rather than translate the original content semantically.
Approach: They propose a framework that captures user traits from historical inputs . they propose 'user-driven' NMT to model user behavior under a zero-shot learning fashion .
Outcome: The proposed framework can capture user traits from historical inputs under zero-shot learning fashion.
Revisiting Non-Autoregressive Translation at Scale (2023.findings-acl)

Copied to clipboard

Challenge: Extensive experiments on two advanced NAT models show scaling can improve translation performance.
Approach: They empirically examine the impact of scaling on NAT behaviors on a large-scale WMT dataset.
Outcome: The proposed model can achieve comparable performance with the scaling model while maintaining the superiority of decoding speed with standard NAT models.
Exploring Contextual Word-level Style Relevance for Unsupervised Style Transfer (2020.acl-main)

Copied to clipboard

Challenge: Existing methods to unsupervised style transfer lack fine-grained control of the influence from the target style.
Approach: They propose a model that exploits the relevance of each output word to the target style . they pretrain a style classifier and train an attentional Seq2seq model to reconstruct input sentences .
Outcome: The proposed model achieves state-of-the-art performance in terms of transfer accuracy and content preservation.
Locate-and-Focus: Enhancing Terminology Translation in Speech Language Models (2025.acl-long)

Copied to clipboard

Challenge: Existing methods for terminology translation struggle with interference from irrelevant noise.
Approach: They propose a Locate-and-Focus method that locates terminologies within utterances to construct translation knowledge by minimizing irrelevant information for ST models.
Outcome: The proposed method locates terminologies within utterances and enhances the success rate of terminology translation while maintaining robust general translation performance.
Orchestrating Tokens and Sequences: Dynamic Hybrid Policy Optimization for RLVR (2026.findings-acl)

Copied to clipboard

Challenge: Existing RLVR algorithms focus on different granularities and have complementary strengths and limitations.
Approach: They propose a framework for reinforcement learning with verifiable rewards that bridges RLVR and GSPO . group-level importance ratios are used to update a policy, which preserves fine-grained credit assignment .
Outcome: The proposed framework outperforms existing methods on seven reasoning benchmarks.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations