Papers by Liang Ma

86 papers
Plan-then-Seam: Towards Efficient Table-to-Text Generation (2023.findings-eacl)

Copied to clipboard

Challenge: Recent work explicitly decomposes the generation process into content planning and surface generation stages, employing two autoregressive networks for them respectively.
Approach: They propose a non-parallelelizable table-to-text model that produces outputs in parallel with one network.
Outcome: The proposed model achieves 3.0 5.6 times speedup for inference time, reducing 50% parameters, while maintaining as least comparable performance against strong two-stage table-to-text competitors.
Temporal Knowledge Graph Reasoning with Dynamic Hypergraph Embedding (2024.lrec-main)

Copied to clipboard

Challenge: Existing models that model temporal dynamics with knowledge graphs and graph convolution networks lack high-order interactions between objects in TKG, which is an important factor to predict future facts.
Approach: They propose to embed temporal knowledge graph reasoning by constructing hypergraphs based on temporal information graphs at different timestamps and then adapt dynamic meta-embedding to fit TKG.
Outcome: The proposed method outperforms baseline models on public TKG datasets and provides good interpretation for the predicted results.
Sarcasm-R1: Enhancing Sarcasm Detection through Focused Reasoning (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for sarcasm detection are limited by supervised learning or prompt engineering . a new approach decomposes sarcasm detection into three dimensions: language, context, and emotion .
Approach: They propose a method that decomposes sarcasm detection into three dimensions: language, context, and emotion.
Outcome: The proposed method outperforms state-of-the-art methods in most cases.
POLYCHARTQA: Benchmarking Large Vision-Language Models with Multilingual Chart Question Answering (2026.acl-long)

Copied to clipboard

Challenge: Existing chart understanding benchmarks are overwhelmingly English-centric, limiting their accessibility and relevance to global audiences.
Approach: They propose a multilingual chart question answering benchmark that enables efficient multilingual generation via data translation and code reuse.
Outcome: The proposed benchmark systematically evaluates multilingual chart understanding on state-of-the-art LVLMs and shows a significant performance gap between English and other languages.
PaddleSpeech: An Easy-to-Use All-in-One Speech Toolkit (2022.naacl-demo)

Copied to clipboard

Challenge: PaddleSpeech is an open-source speech toolkit that supports speech-to-text and text-to speech tasks.
Approach: They describe the design philosophy and core architecture of PaddleSpeech to support several essential speech-to-text and text-to speech tasks.
Outcome: The proposed framework achieves competitive or state-of-the-art performance on various speech datasets and implements the most popular methods.
SAC: Neural Speech Codec with Semantic-Acoustic Dual-Stream Quantization (2026.acl-long)

Copied to clipboard

Challenge: Existing speech codecs struggle to balance high-quality reconstruction with semantically rich representations, limiting their effectiveness in both generative and understanding tasks.
Approach: They propose a neural speech codec with semantic-acoustic dual-stream quantization that disentangles semantic and acousian modeling into two dedicated streams.
Outcome: The proposed codec outperforms state-of-the-art speech tokenizers in auto-propagating text-to-speech models.
Are Large Language Models Reliable Reviewers? A Benchmark for Error Detection in Financial Documents (2026.findings-acl)

Copied to clipboard

Challenge: Existing LLMs struggle to identify errors in financial documents, a study shows . 18% of financial practitioners make errors daily, one-third make errors several times weekly, and 59% make errors multiple times monthly.
Approach: They introduce FinED-Bench, a publicly available Benchmark for financial error detection . it covers nine real-world financial scenarios and includes over 900 documents in 2025 . supervised fine-tuning can significantly improve the performance of weaker LLMs, they show .
Outcome: The proposed benchmark covers nine real-world financial scenarios and includes over 900 documents reported in 2025 that are unseen by existing language models.
ACR: Adaptive Context Refactoring via Context Refactoring Operators for Multi-Turn Dialogue (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches to multi-turn dialogues lack contextual consistency and dependencies, and models struggle to maintain factual faithfulness as interaction turns increase.
Approach: They propose an adaptive context refactoring framework that monitors and reshapes the interaction history to mitigate contextual inertia and state drift.
Outcome: The proposed model outperforms baselines while reducing token consumption.
Knowledge-Augmented Multimodal Clinical Rationale Generation for Disease Diagnosis with Small Language Models (2025.acl-long)

Copied to clipboard

Challenge: Existing models struggle to balance predictive accuracy with human-understandable rationales.
Approach: They propose to enhance LLMs by leveraging rationale distillation and domain knowledge injection for trustworthy multimodal rationale generation.
Outcome: Experiments on real-world medical datasets show that ClinRaGen achieves state-of-the-art performance in disease diagnosis and rationale generation.
Simpler and Faster Learning of Adaptive Policies for Simultaneous Translation (D19-1)

Copied to clipboard

Challenge: Recent work on simultaneous translation is difficult because of its latency and quality.
Approach: They propose a supervised-learning framework to learn adaptive policies from parallel text sequences . they use a model that predicts when a target word is read or WRITE if context provides enough information .
Outcome: Experiments on German=>English show that the proposed method can learn flexible policies with better BLEU scores and similar latencies compared to previous work.
Self-Renewal Prompt Optimizing with Implicit Reasoning (2024.findings-emnlp)

Copied to clipboard

Challenge: Recent advances in NLP have been driven by the development of Large Language Models (LLMs).
Approach: They propose a self-renewal approach to optimize LLM outputs to better align with human preferences without supervised fine-tuning.
Outcome: The proposed approach improves outputs to better align with human preferences across LLMs and tasks without supervised fine-tuning.
AutoRAN: Automated Hijacking of Safety Reasoning in Large Reasoning Models (2026.acl-long)

Copied to clipboard

Challenge: Large reasoning models (LRMs) generate coherent reasoning paths before conclusions, but they introduce new vulnerabilities.
Approach: They propose a framework that leverages a weaker but less-aligned model to simulate execution reasoning for initial hijacking attempts and iteratively refines attacks by exploiting reasoning patterns leaked through the target LRM’s refusals.
Outcome: The proposed framework achieves 100% success rate within one or few turns, neutralizing reasoning-based defenses even when evaluated by robustly aligned external models.
UniSonate: A Unified Model for Speech, Music, and Sound Effect Generation with Text Instructions (2026.acl-long)

Copied to clipboard

Challenge: Generative audio modeling has been fragmented into specialized tasks such as text-to-speech (TTS), text- to-music (TTM), and text-ta (TTA) specialized models require reference audio for timbre cloning and strict phoneme alignment, whereas TTA models generate unstructured textures from open-ended captions.
Approach: They propose a unified flow-matching framework capable of synthesizing speech, music, sound effects . they propose 'token injection mechanism' that projects unstructured environmental sounds into structured temporal latent space .
Outcome: The proposed framework achieves state-of-the-art performance in instruction-based TTS and TTM while maintaining competitive fidelity in TTA.
Texar: A Modularized, Versatile, and Extensible Toolkit for Text Generation (P19-3)

Copied to clipboard

Challenge: Texar is an open-source text generation toolkit that supports a broad set of text generation tasks.
Approach: They introduce Texar, an open-source text generation toolkit that supports text generation tasks.
Outcome: Texar supports machine translation, summarization, dialog, content manipulation, and more.
PsyScam: A Benchmark for Psychological Techniques in Real-World Scams (2025.findings-emnlp)

Copied to clipboard

Challenge: PTs are employed by scammers to manipulate victims and cause lasting psychological trauma.
Approach: They propose a benchmark to capture the PTs employed in real-worldscam reports and investigate how LLMs can be utilized to generate variants of scams based on the pts and the contexts provided by thesescams.
Outcome: The proposed model can generate variants of scams based on the PTs employed in real-world scam reports and the contexts provided by these scams.
CSMCIR: CoT-Enhanced Symmetric Alignment with Memory Bank for Composed Image Retrieval (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches to search for images using single-modality are limited by representation space fragmentation.
Approach: They propose a unified representation framework that achieves efficient query-target alignment . they introduce a multi-level Chain-of-Thought prompting strategy that guides MLMs to generate discriminative, semantically compatible captions for target images .
Outcome: The proposed framework achieves efficient query-target alignment through synergistic components.
Graph Reasoning Paradigm: Structured and Symbolic Reasoning with Topology-Aware Reinforcement Learning for Large Language Models (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for long chain-of-thought (LCoT) are coarse-grained, reward hacking, and poor generalization.
Approach: They propose a Long Chain-of-Thought (LCoT) model that integrates reinforcement learning with verifiable rewards with a process-aware verification approach.
Outcome: The proposed model improves reasoning and code generation tasks while reducing the cost of training and performance bottlenecks.
PFDial: A Structured Dialogue Instruction Fine-tuning Method Based on UML Flowcharts (2025.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) have shown remarkable progress in dialogue and reasoning, but they struggle to solve strictly constrained dialogue tasks.
Approach: They construct a dataset that contains 12,705 high-quality Chinese dialogue instructions from 440 flowcharts containing 5,055 process nodes.
Outcome: The proposed model outperforms GPT-4o models on backward transitions and outperformed GPT-42 models on the same dataset.
QSpell 250K: A Large-Scale, Practical Dataset for Chinese Search Query Spell Correction (2025.naacl-industry)

Copied to clipboard

Challenge: Chinese Search Query Spell Correction is a task designed to identify and correct typographical errors within queries.
Approach: They propose a large-scale benchmark specifically developed for Chinese Query Spell Correction.
Outcome: The proposed benchmark covers a broad range of topics, including formal entities, everyday colloquialisms and idiomatic expressions.
Direct Simultaneous Speech-to-Text Translation Assisted by Synchronized Streaming ASR (2021.findings-acl)

Copied to clipboard

Challenge: Existing approaches to simultaneous speech-to-text translation suffer from error propagation and extra latency.
Approach: They propose a new paradigm for simultaneous speech-to-text translation using two separate decoders . they use multitask learning to jointly learn these two tasks with a shared encoder .
Outcome: The proposed method achieves substantially better translation quality at similar levels of latency.
Simultaneous Translation with Flexible Policy via Restricted Imitation Learning (P19-1)

Copied to clipboard

Challenge: Existing approaches to simultaneous translation have been limited and use fixed-latency policies or a complicated two-staged model.
Approach: They propose a single model that adds a “delay” token to the target vocabulary and a restricted dynamic oracle to greatly simplify training.
Outcome: The proposed model achieves better BLEU scores and lower latencies compared to fixed and RL-learned policies on Chinese -> English simultaneous translation.
Is LLM an Overconfident Judge? Unveiling the Capabilities of LLMs in Detecting Offensive Language with Annotation Disagreement (2025.findings-acl)

Copied to clipboard

Challenge: Existing studies focus on evaluating large language models' ability to handle disagreement cases.
Approach: They evaluate the performance of large language models in detecting offensive language at varying levels of agreement.
Outcome: The proposed model improves detection accuracy and model alignment with human judgment by using disagreement samples in training.
EX-FEVER: A Dataset for Multi-hop Explainable Fact Verification (2024.findings-acl)

Copied to clipboard

Challenge: Existing studies on fact verification lack a high-quality dataset for explainability . existing systems lack evidence retrieval and veracity prediction, limiting the ability to verify a claim .
Approach: They propose a dataset for multi-hop explainable fact verification that summarises and modifies Wikipedia documents.
Outcome: The proposed dataset aims to improve the accuracy of multi-hop explainable fact verification systems.
BUMP: A Benchmark of Unfaithful Minimal Pairs for Meta-Evaluation of Faithfulness Metrics (2023.acl-long)

Copied to clipboard

Challenge: Existing benchmarks measure the correlation with human judgements of faithfulness on model-generated summaries, but they are insufficient for diagnosing whether metrics are consistent, effective on human-written texts, and sensitive to different error types.
Approach: They propose to use unfaithful minimal pairs to measure the consistency of automatic faithfulness metrics by comparing human-written summary pairs with a dataset of 889 human-writing, minimally different summary pairs.
Outcome: The proposed benchmarks show that the most discriminative metrics tend not to be the most consistent, and that the best performing metrics are sensitive to errors.
From Hypothesis to Publication: A Comprehensive Survey of AI-Driven Research Support Systems (2025.findings-emnlp)

Copied to clipboard

Challenge: rapid development of artificial intelligence (AI) technologies has inspired researchers to explore how AI can accelerate and enhance research.
Approach: They organize the relevant studies into three main categories: hypothesis formulation, hypothesis validation, and manuscript publication.
Outcome: The authors summarize the current state of research in three main areas: hypothesis formulation, hypothesis validation, and manuscript publication.
Simultaneous Translation (2020.emnlp-tutorials)

Copied to clipboard

Challenge: Simultaneous translation is a problem that has long been considered one of the hardest problems in AI . this tutorial will provide a deep understanding of the history and the recent advances in simultaneous translation.
Approach: This tutorial will examine the design and evaluation of policies for simultaneous translation . it will provide an overview of the history and recent advances in simultaneous translation.
Outcome: This tutorial will examine the design and evaluation of policies for simultaneous translation .
STACL: Simultaneous Translation with Implicit Anticipation and Controllable Latency using Prefix-to-Prefix Framework (P19-1)

Copied to clipboard

Challenge: Simultaneous translation is notoriously dif- ficult due to word-order differences.
Approach: They propose a prefix-to-prefix framework that implicitly learns to anticipate in a single translation model.
Outcome: The proposed framework achieves low latency and reasonable qual- ity on 4 directions.
Alleviating Hallucinations from Knowledge Misalignment in Large Language Models via Selective Abstention Learning (2025.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) suffer from severe hallucination issues due to the knowledge misalignment between the pre-training stage and the supervised fine-tuning stage.
Approach: They propose a training objective with an abstention mechanism that selectively rejects tokens that misalign with the desired knowledge distribution via a special [REJ] token.
Outcome: The proposed model selectively rejects tokens that misalign with the desired knowledge distribution via a special [REJ] token.
SLAM-Omni: Timbre-Controllable Voice Interaction System with Single-Stage Training (2025.findings-acl)

Copied to clipboard

Challenge: a new spoken dialogue system with single-stage training is demonstrating its low latency and high quality . SLAM-Omni achieves zero-shot timbre control by modeling spoken language with semantic tokens .
Approach: They propose a timbre-controllable, end-to-end voice interaction system with single-stage training.
Outcome: The proposed system outperforms previous models on 4 GPUs with limited data.
Simultaneous Translation Policies: From Fixed to Adaptive (2020.acl-main)

Copied to clipboard

Challenge: Adaptive policies can balance translation quality and latency based on context information . previous methods on obtaining adaptive policies rely on complicated training process .
Approach: They propose to obtain adaptive policies by a simple heuristic composition of fixed policies . they propose to use a heurism to obtain policies that can outperform fixed ones .
Outcome: Experiments on Chinese -> English and German -> english show that adaptive policies outperform fixed policies by up to 4 BLEU points for the same latency.
Opportunistic Decoding with Timely Correction for Simultaneous Translation (2020.acl-main)

Copied to clipboard

Challenge: Existing approaches to balancing translation quality and latency are either too aggressive or too conservative.
Approach: They propose an opportunistic decoding technique that always (over-)generates a certain mount of extra words at each step to keep the audience on track with the latest information.
Outcome: The proposed technique reduces latency and increases BLEU with no over-generating . it also corrects mistakes in the overgenerated words when observing more context .
Fluent and Low-latency Simultaneous Speech-to-Speech Translation with Self-adaptive Training (2020.findings-emnlp)

Copied to clipboard

Challenge: Current approaches to simultaneous speech-to-speech translation accumulate more and more latencies in later sentences when the speaker talks faster.
Approach: They propose a method which generates more fluent target speech latency than the baseline . they propose to use self-adaptive translation to adjust the length of translations to accommodate different source speech rates.
Outcome: Xiong et al., 2019) show that the proposed method generates more fluent target speech latency than baseline . authors say it provides more natural communication process than speech-to-text translation . xiong and colleagues say the proposed technique is more efficient than current approaches .
Multi-Reference Training with Pseudo-References for Neural Translation and Text Generation (D18-1)

Copied to clipboard

Challenge: Neural text generation has been quite successful recently, but during training time, only one reference is considered for each example, even though there are often multiple references available.
Approach: They propose an algorithm to generate exponentially many pseudo-references by compressing existing references into lattices and traversing them to generate new pseudo-References.
Outcome: The proposed model significantly improves on baselines in machine translation and image captioning, and is comparable to existing models.
MKT: A Multi-Stage Knowledge Transfer Framework to Mitigate Catastrophic Forgetting in Multi-Domain Chinese Spelling Correction (2025.emnlp-industry)

Copied to clipboard

Challenge: Chinese Spelling Correction (CSC) is a model that detects and corrects spelling errors in given sentences.
Approach: They propose a model-agnostic model with an evolving teacher model and dynamic distillation weights for knowledge transfer in each domain rather than focusing solely on new domain knowledge.
Outcome: The proposed model-agnostic framework is based on an evolving teacher model and dynamic distillation weights for knowledge transfer in each domain, rather than focusing solely on new domain knowledge.
Making Pre-trained Language Models Better Continual Few-Shot Relation Extractors (2024.lrec-main)

Copied to clipboard

Challenge: Existing methods to learn new relations with limited labeled data are prone to catastrophic forgetting and overfitting.
Approach: They propose a framework that uses prompts to acquire more generalized knowledge . they propose CFRE to continuously learn new relations while retaining knowledge of old ones .
Outcome: The proposed method outperforms state-of-the-art methods by a large margin and significantly mitigates catastrophic forgetting and overfitting in low-resource scenarios.
Second Language (Arabic) Acquisition of LLMs via Progressive Vocabulary Expansion (2025.acl-long)

Copied to clipboard

Challenge: In the evolving landscape of large language models, the predominant focus has been on English and Chinese.
Approach: They propose to utilize Arabic-specific vocabulary in the tokenizer to accelerate decoding.
Outcome: The proposed model achieves decent performance comparable to the best Arabic LLMs across various Arabic benchmarks.
Logical Consistency is Vital: Neural-Symbolic Information Retrieval for Negative-Constraint Queries (2025.findings-acl)

Copied to clipboard

Challenge: Current dense retrieval methods compute similarities between dense vectors but overlook the real query intents.
Approach: They propose a neuro-symbolic information retrieval method that leverages first-order logic to optimize the embeddings of naive natural language by considering the logical consistency between queries and documents.
Outcome: The proposed method outperforms existing methods on negative-constraint queries under zero-shot and low-resource retrieval tasks.
Don’t Tell the Answer, Truly Guide the Reasoning During RL Rollouts (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods such as GRPO often break down when task difficulty exceeds the model’s capacity, resulting in sparse rewards and inefficient training.
Approach: They propose to measure the compatibility between external guidance and a model's intrinsic policy by introducing an adaptive framework to enhance reasoning performance while explicitly preserving high Affinity.
Outcome: The proposed framework outperforms baseline models while maintaining high Affinity.
MixRED: A Mix-lingual Relation Extraction Dataset (2024.lrec-main)

Copied to clipboard

Challenge: Existing research focuses on monolingual relation extraction, but there is a significant gap in understanding relation extraction in the mix-lingual scenario.
Approach: They propose a task of considering relation extraction in the mix-lingual scenario . they construct a human-annotated dataset to support the task .
Outcome: The proposed task evaluates state-of-the-art supervised models and large language models on the human-annotated dataset MixRED.
Investigating and Mitigating the Multimodal Hallucination Snowballing in Large Vision-Language Models (2024.acl-long)

Copied to clipboard

Challenge: Large Vision-Language Models (LVLMs) suffer from multimodal hallucinations . however, the generated hallucines could influence the models’ subsequent generation .
Approach: They propose a framework to evaluate LVLMs' behaviors when encountering generated hallucinations and a method to revise the output distribution of LVLs with the one derived from the residual visual input.
Outcome: The proposed framework reduces the performance of open-source LVLMs by 31%, indicating that they are prone to accept the generated hallucinations and make false claims that they would not have supported without distractions.
CIF-Bench: A Chinese Instruction-Following Benchmark for Evaluating the Generalizability of Large Language Models (2024.findings-acl)

Copied to clipboard

Challenge: a recent study shows that large language models have limited generalization in low-resource languages like Chinese.
Approach: They propose to evaluate the zero-shot generalizability of large language models to the Chinese language . they release only half of the dataset publicly, with the remainder kept private .
Outcome: The Chinese Instruction-Following Benchmark evaluates the generalizability of LLMs to the Chinese language.
MoDULA: Mixture of Domain-Specific and Universal LoRA for Multi-Task Learning (2024.emnlp-main)

Copied to clipboard

Challenge: Recent advances in open-source Large Language Models (LLMs) have achieved notable successes in natural language processing.
Approach: They propose a Parameter Efficient Fine-Tuning paradigm for improved fine-tuning and parameter efficiency in multi-task learning.
Outcome: The proposed model outperforms existing methods on multi-task learning while reducing training costs by over 80% without losing general capability.
Agent Trading Arena: A Study on Numerical Understanding in LLM-Based Agents (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing approaches to large language models are limited to historical backtesting and static data.
Approach: a new large-language model is developed to simulate real-time trading in a virtual stock market . the agent trading arena simulates real-world bid-ask interactions and provides real-life trading scenarios .
Outcome: The Agent Trading Arena simulates real-world market conditions and directly impacts price dynamics.
ADaPT: Token-Level Decoupling for Efficient Large Reasoning Models (2026.findings-acl)

Copied to clipboard

Challenge: Existing efficiency-oriented methods attempt to shorten or mix reasoning strategies, yet often degrade reasoning capability.
Approach: They propose a token-level dual-process framework that explicitly decouples efficiency and correctness signals during training.
Outcome: The proposed framework reduces inference cost while maintaining strong reasoning ability across multiple benchmarks.
Improving Simultaneous Translation by Incorporating Pseudo-References with Fewer Reorderings (2021.emnlp-main)

Copied to clipboard

Challenge: Existing systems for simultaneous translation are still trained on full-sentence bitexts due to the abundance of unnecessary long-distance reorderings.
Approach: They propose to rewrite target side of existing full-sentence corpora into simultaneous-style translation by adding generated pseudo-references to the target side.
Outcome: Experiments on ZhEn and JaEn simultaneous translation show that the proposed method improves on existing full-sentence corpora.
Robust Neural Machine Translation with Joint Textual and Phonetic Embedding (P19-1)

Copied to clipboard

Challenge: Neural machine translation models are sensitive to noises in input sentences . one special kind of noise is the homophone noise, where words are replaced by other words with similar pronunciations.
Approach: They propose to embed phonetic and textual information into neural machine translation datasets to improve robustness to homophone noises.
Outcome: The proposed method improves the robustness of neural machine translation to homophone noises on clean test sets.
A La Carte Embedding: Cheap but Effective Induction of Semantic Feature Vectors (P18-1)

Copied to clipboard

Challenge: Existing word2vec-based methods for learning rare or unseen words have been criticized for degrading performance in small corpus settings.
Approach: They propose a la carte embedding method that relies on a linear transformation that is efficiently learnable using pretrained word vectors and linear regression.
Outcome: The proposed method is based on a new dataset showing that it can be used when a word is encountered even if only a single usage example is available.
ChatMusician: Understanding and Generating Music Intrinsically with LLM (2024.findings-acl)

Copied to clipboard

Challenge: Despite LLMs' impressive capabilities in musical knowledge, music reasoning remains an unsolved task.
Approach: They propose an open-source large language model (LLM) that integrates intrinsic musical abilities into LLaMA2 and GPT-3.5.
Outcome: The proposed model can understand and generate music with a pure text tokenizer without external multi-modal neural structures or tokenizers.
Best Practices for Distilling Large Language Models into BERT for Web Search Ranking (2025.coling-industry)

Copied to clipboard

Challenge: Recent studies have highlighted the potential of Large Language Models (LLMs) as zero-shot relevance rankers.
Approach: They propose to use a ranking loss to transfer ranking knowledge from LLMs to smaller models like BERT.
Outcome: The proposed model has been successfully integrated into a commercial web search engine as of February 2024.
CorNav: Autonomous Agent with Self-Corrected Planning for Zero-Shot Vision-and-Language Navigation (2024.findings-acl)

Copied to clipboard

Challenge: Existing vision-and-language navigation methods do not incorporate environmental feedback into their decision-making processes.
Approach: They propose a framework that incorporates environmental feedback into decision-making and a 3D simulator that renders realistic scenarios using Unreal Engine 5.
Outcome: The proposed framework outperforms existing vision-and-language navigation methods in a zero-shot multi-task setting by 28.1% on average.
Distilling Causal Effect from Miscellaneous Other-Class for Continual Named Entity Recognition (2022.emnlp-main)

Copied to clipboard

Challenge: Existing methods for Named Entity Recognition (NER) are not able to learn Other-Class in the same way as new entity types.
Approach: They propose a unified causal framework to retrieve causality from new entity types and Other-Class.
Outcome: The proposed method outperforms the state-of-the-art method on three benchmark datasets.
Beta-LR: Interpretable Logical Reasoning based on Beta Distribution (2024.findings-naacl)

Copied to clipboard

Challenge: Existing methods to capture logical information from text are limited by the uncertainty of the text.
Approach: They propose a probabilistic embedding method to capture logical information from text . they embed texts into beta distributions on each dimension to eliminate logical uncertainty .
Outcome: The proposed method achieves competitive performances on two datasets.
Speculative Beam Search for Simultaneous Translation (D19-1)

Copied to clipboard

Challenge: Beam search is widely used in (full-sentence) machine translation but its application to simultaneous translation remains highly non-trivial.
Approach: They propose a beam search algorithm that hallucinates several steps into the future to reach a more accurate decision by implicitly benefiting from a target language model.
Outcome: The proposed method improves on language models over diverse language pairs and shows significant improvements over greedy search.
Document Image Machine Translation with Dynamic Multi-pre-trained Models Assembling (2024.naacl-long)

Copied to clipboard

Challenge: Existing TIMT tasks focus on text-line-level images.
Approach: They propose to extend the existing TIMT task and introduce a new framework to translate a source document image to markdown-formatted target translation.
Outcome: The proposed task aims to translate a source document image with long context and complex layout structure to markdown-formatted target translation.
Breaking the Beam Search Curse: A Study of (Re-)Scoring Methods and Stopping Criteria for Neural Machine Translation (D18-1)

Copied to clipboard

Challenge: Beam search is widely used in neural machine translation, but beam sizes larger than 5 hurt translation quality.
Approach: They propose to use beam search to improve translation quality by using hyperparameter-free methods that outperform the widely-used heuristic of length normalization by +2.0 BLEU.
Outcome: The proposed methods outperform the widely-used heuristic on Chinese-to-English translation and achieve the best results among all methods.
Beyond Prompt Engineering: A Systematic Analysis of Prompt Lexical Sensitivity and Its Impacts on Quality (2026.findings-acl)

Copied to clipboard

Challenge: Existing studies on prompt engineering have focused on optimizing models for performance under stylistic perturbations.
Approach: They conduct the first analysis of n-gram token-level mechanisms . they find that higher average performance is inherently associated with lower variance and greater stability.
Outcome: The proposed model reduces the variance of the generated code by 40% . the proposed model is based on a large-scale dataset of 132,000 prompt variants .
MaXIFE: Multilingual and Cross-lingual Instruction Following Evaluation (2025.acl-long)

Copied to clipboard

Challenge: Existing evaluation methods focus on single-language scenarios, overlooking multilingual and cross-lingual contexts.
Approach: They propose a tool to assess instruction-following capabilities across 23 different languages with 1667 verifiable instruction tasks.
Outcome: MaXIFE evaluates instruction-following capabilities across 23 languages with 1667 verifiable instruction tasks.
On the Off-Target Problem of Zero-Shot Multilingual Neural Machine Translation (2023.findings-acl)

Copied to clipboard

Challenge: Despite its success, multilingual neural machine translation suffers from the off-target issue, where the translation is in the wrong language.
Approach: They propose a language-aware vocabulary sharing algorithm that can be used to increase the lexical distance between languages by isolating the vocab of different languages in the decoder.
Outcome: The proposed algorithm reduces off-target rate for 90 translation tasks from 29% to 8%, while improving overall BLEU score by an average of 1.9 points without extra training cost or sacrificing the supervised directions’ performance.
ARES: Adaptive Red-Teaming and End-to-End Repair of Policy-Reward System (2026.acl-long)

Copied to clipboard

Challenge: Existing red-teaming approaches focus on policy-level weaknesses, but they overlook systemic weaknesses . aRES exploits dual-targeting weaknesses in both the core LLM and the RM simultaneously.
Approach: a new framework uncovers weaknesses in both the core and the reward models simultaneously . a "Safety Mentor" generates semantically coherent adversarial prompts .
Outcome: ARES uncovers weaknesses in both the core LLM and the RM simultaneously . it fine-tunes the LM to detect harmful content, then optimizes the core model .
RSDA: Restoring Stale Data Affinity via Dynamic Renovation Strategy for Mitigating Data Scarcity (2026.acl-long)

Copied to clipboard

Challenge: High-quality data is the cornerstone of advancing large language models, but the supply of premium data is nearing depletion, while vast stale corpora remain underutilized.
Approach: They propose a framework to restore stale data affinity by quantifying the latent value of samples and employing a dynamic renovation strategy selection mechanism to determine the optimal component-level strategy.
Outcome: The proposed framework achieves performance improvements using less than 10% of the data volume, underscoring that the latent potential of stale corpora remains largely untapped.
KCVR: Knowledge-Centric Video Reconstruction for Structured Pedagogical Summarization via Dynamic Graph Planning (2026.acl-long)

Copied to clipboard

Challenge: Existing summarization methods compress content for gist browsing, but they break prerequisite logic in instructional videos.
Approach: They propose a framework that decouples epistemic planning from content generation.
Outcome: The proposed framework outperforms strong end-to-end baselines on Knowledge Progression Consistency and Learning Objective Coverage.
Improving Encoder by Auxiliary Supervision Tasks for Table-to-Text Generation (2021.acl-long)

Copied to clipboard

Challenge: Experimental results show that our method not only has a good generalization but also outperforms previous methods on several metrics: BLEU, Content Selection, Content Ordering.
Approach: They propose to build an entity graph from the input tables and introduce a reasoning module to perform reasoning on the graph.
Outcome: The proposed method outperforms previous methods on several metrics: BLEU, Content Selection, Content Ordering.
An Examination of the Compositionality of Large Generative Vision-Language Models (2024.naacl-long)

Copied to clipboard

Challenge: Recent studies have focused on the compositionality of vision-language models (VLMs) however, the performance of GVLMs in multimodal compositional reasoning remains under-explored.
Approach: They propose a syntactical bias score to quantify GVLMs' syntaktical bias . they propose 'SADE' task to assess GVLs's robustness against inclination toward syntical correctness.
Outcome: The proposed benchmarks are based on evaluation metrics and current benchmarks.
3AM: An Ambiguity-Aware Multi-Modal Machine Translation Dataset (2024.lrec-main)

Copied to clipboard

Challenge: Existing studies have shown that visual information in existing MMT datasets is insufficient, causing models to disregard it and overestimate their capabilities.
Approach: They propose to use 3AM to create an ambiguity-aware multimodal machine translation dataset.
Outcome: The proposed dataset includes more ambiguity and a greater variety of captions and images than other MMT datasets.
SciMMIR: Benchmarking Scientific Multi-modal Information Retrieval (2024.findings-acl)

Copied to clipboard

Challenge: Multi-modal information retrieval (MMIR) is a rapidly evolving field . current benchmarks for image-text pairings overlook the scientific domain .
Approach: They develop a scientific domain-specific MMIR benchmark to evaluate image-text pairings using open-access research paper corpora.
Outcome: The proposed benchmarks are based on 530K image-text pairs extracted from scientific documents with detailed captions.
JARVIS-VLA: Post-Training Large-Scale Vision Language Models to Play Visual Games with Keyboards and Mouse (2025.findings-acl)

Copied to clipboard

Challenge: Visual Language Action models have shown promise in decision-making tasks, but have been neglected in previous work .
Approach: They propose a new paradigm for visual language action models that enhances the foundation model prior to action-specific tuning by first post-training it on a curated set of visual and linguistic tasks using self-supervised learning.
Outcome: The proposed model outperforms the best agent baseline on a diverse set of atomic tasks and surpasses imitation learning-based policies in Minecraft.
SPEAK: Spiking Neurons as an Entropy-Aware Tokenizer for Large Language Models (2026.acl-long)

Copied to clipboard

Challenge: Existing tokenizers fail to explicitly leverage historical tokenization results . large language models (LLMs) have demonstrated remarkable effectiveness across NLP tasks .
Approach: They propose a tokenizer that integrates spiking neurons to explicitly leverage historical tokenization results.
Outcome: The proposed tokenizer leverages historical tokenization results, but does not selectively leverage history based on contextual relevance.
PibE-MPP: A Play-it-by-Ear Masking Performance Plug-in for LLMs (2026.findings-acl)

Copied to clipboard

Challenge: Random masking is a widely adopted classic baseline in large language models (LLMs).
Approach: They propose a play-it-by-ear masking performance plug-in which enables LLMs to adaptively select masking target combinations for each task.
Outcome: The proposed performance plug-in retains the advantages and mitigates the drawbacks of random masking in large language models.
One2Set + Large Language Model: Best Partners for Keyphrase Generation (2024.emnlp-main)

Copied to clipboard

Challenge: Existing selection methods make redundant selections, causing poor recall and accuracy.
Approach: They propose a framework to generate keyphrases from a one2set-based model and an LLM as selector.
Outcome: The proposed framework surpasses state-of-the-art models in absent keyphrase prediction.
Born a BabyNet with Hierarchical Parental Supervision for End-to-End Text Image Machine Translation (2024.lrec-main)

Copied to clipboard

Challenge: Existing research on text image machine translation (TIMT) is divided into two types: Cascade methods combine text image recognition and MT models to recognize source language text images.
Approach: They propose a method which is optimized with hierarchical parental supervision to improve translation performance.
Outcome: The proposed method significantly outperforms existing methods on synthetic and real-world tests on both synthetic and realistic images.
Multi-View Source Ablation for Faithful Summarization (2023.findings-eacl)

Copied to clipboard

Challenge: MuFaSSa is a metric for evaluating faithfulness of abstractive summaries . it uses different strategies to remove information from source document to form multiple ablated views .
Approach: They propose a metric for evaluating faithfulness of abstractive summaries using multiple ablated views.
Outcome: The proposed metric outperforms existing models on summarization tasks and human-annotated faithfulness labels.
Graph-to-Text Generation with Dynamic Structure Pruning (2022.coling-1)

Copied to clipboard

Challenge: Recent studies show that explicitly modeling the input graph structure can significantly improve the performance.
Approach: They propose a structure-aware cross-attention mechanism to re-encode the graph representation conditioning on the newly generated context at each decoding step.
Outcome: The proposed model improves performance on two graph-to-text datasets with only minor increase on computational cost.
InfoGain-RAG: Boosting Retrieval-Augmented Generation through Document Information Gain-based Reranking and Filtering (2025.emnlp-main)

Copied to clipboard

Challenge: Retrieval-Augmented Generation (RAG) frameworks struggle with identifying whether retrieved documents meaningfully contribute to answer generation.
Approach: They propose a document-related metric to quantify the contribution of retrieved documents to correct answer generation.
Outcome: The proposed framework outperforms existing approaches on both single and multiple retrieval paradigms.
ProMedTS: A Self-Supervised, Prompt-Guided Multimodal Approach for Integrating Medical Text and Time Series (2025.findings-acl)

Copied to clipboard

Challenge: Large language models excel at processing unstructured data, but integrating time series data with text remains a challenge.
Approach: They propose a self-supervised multimodal framework that uses prompt-guided learning to unify heterogeneous data types.
Outcome: The proposed framework outperforms state-of-the-art approaches on disease diagnosis tasks using real-world datasets.
HCRE: LLM-based Hierarchical Classification for Cross-Document Relation Extraction with a Prediction-then-Verification Strategy (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches to cross-document relation extraction (RE) focus on identifying relations between head and tail entities from single sentence or document.
Approach: They propose a hierarchical relation tree-based LLM-based hierarchic classification model for cross-document relation extraction (HCRE) based on predefined relations, the model can perform hierarchically classification level by level.
Outcome: The proposed model outperforms existing baselines and validates its effectiveness.
From Completion to Editing: Unlocking Context-Aware Code Infilling via Search-and-Replace Instruction Tuning (2026.acl-long)

Copied to clipboard

Challenge: Fill-in-the-Middle (FIM) models suffer from performance degradation and prohibitive latency.
Approach: They propose a search-and-replace infilling framework that integrates agentic verification and editing into a single-pass inference process.
Outcome: The proposed framework harmonizes completion tasks with the instruction-following priors of Chat LLMs, extending the paradigm from static infilling to dynamic context-aware editing.
COIG-CQIA: Quality is All You Need for Chinese Instruction Fine-tuning (2025.findings-naacl)

Copied to clipboard

Challenge: Existing datasets for Chinese instruction tuning are not well-aligned with Chinese users’ interaction patterns.
Approach: They propose to use Chinese instruction tuning datasets to improve instruction fine-tuning for Chinese users.
Outcome: The proposed dataset shows that Chinese models achieve competitive performance in diverse benchmarks.
Advancing Large Language Model Attribution through Self-Improving (2024.emnlp-main)

Copied to clipboard

Challenge: Teaching large language models to generate text with citations to evidence sources requires high-quality attribution data, which is costly and labor-intensive.
Approach: They propose a framework for iteratively improving the attribution capability of large language models (LLMs) by attributing output to verifiable sources.
Outcome: Experiments on three open-domain question-answering datasets show that START improves in aggregating information across multiple sources.
CATS: A Pragmatic Chinese Answer-to-Sequence Dataset with Large Scale and High Quality (2023.acl-long)

Copied to clipboard

Challenge: Current datasets bias in the English language while leaving other languages underexplored.
Approach: They propose a Chinese answer-to-sequence dataset with high quality and large scale . they propose encoding space for two hybrid knowledge resources to convert this task to a graph-totext problem.
Outcome: The proposed method is effective in generating textual descriptions for the Chinese answer-to-sequence dataset.
Learning to Stop in Structured Prediction for Neural Machine Translation (N19-1)

Copied to clipboard

Challenge: Beam search optimization solves many problems in neural machine translation, but lacks principled stopping criteria and does not learn how to stop during training.
Approach: They propose a ranking method which enables an optimal beam search stop-ping criteria and a structured prediction loss function which penalizes suboptimal finished candidates produced by beam search during training.
Outcome: Experiments on synthetic and real languages show that the proposed methods improve translation quality and length.
Incremental Text-to-Speech Synthesis with Prefix-to-Prefix Framework (2020.findings-emnlp)

Copied to clipboard

Challenge: Text-to-speech synthesis (TTS) has seen rapid progress in recent years, but still suffers from latencies.
Approach: They propose a neural incremental TTS approach that synthesizes speech in an online fashion, playing a segment of audio while generating the next.
Outcome: Experiments on English and Chinese TTS show that the proposed approach achieves similar speech naturalness compared to full sentence TTS, but with a constant (1-2 words) latency.
Route Sparse Autoencoder to Interpret Large Language Models (2025.emnlp-main)

Copied to clipboard

Challenge: Sparse autoencoders (SAEs) extract interpretable and monosemantic features in large language models . prior work focused on feature extraction from a single layer, failing to capture activations that span multiple layers.
Approach: They propose a framework that integrates a routing mechanism with a shared SAE to efficiently extract features from multiple layers.
Outcome: The proposed framework extracts features from multiple layers while incurring minimal parameter overhead while achieving high interpretability and flexibility.
Data to Defense: The Role of Curation in Aligning Large Language Models Against Safety Compromise (2025.emnlp-main)

Copied to clipboard

Challenge: Recent studies have identified a vulnerability in large language models (LLMs) during customization.
Approach: They propose an adaptive data curation approach that allows any text to be curated to enhance its effectiveness in counteracting harmful samples during customization.
Outcome: The proposed approach reduces compromising effects and generates 100% safe responses.
Free your mouse! Command Large Language Models to Generate Code to Format Word Documents (2024.emnlp-main)

Copied to clipboard

Challenge: Recent LLMs have significantly improved code generation, making it increasingly accessible to users.
Approach: They propose an automatic document formatting method, Text-to-Format, driven by various prompting strategies and a high-quality dataset DocFormEval data.
Outcome: The proposed method improves the efficiency and experience of users in formatting the document and improves document formatting task.
Enhancing Agentic Textual Graph Retrieval with Synthetic Stepwise Supervision (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for integrating textual graphs with LLMs are limited by symbolic inference and high annotation costs.
Approach: They propose a textual graph reasoning framework that integrates textual diagrams with large language models.
Outcome: The proposed approach achieves 15.6% accuracy and 17.2% in F1 score on three common datasets.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations