Papers by Yu Ma

125 papers
Enhancing Speech-to-Speech Dialogue Modeling with End-to-End Retrieval-Augmented Generation (2025.findings-emnlp)

Copied to clipboard

Challenge: End-to-end speech-to speech (S2S) dialogue systems face key challenges in incorporating external knowledge into their models.
Approach: They propose a framework that directly retrieves relevant textual knowledge from speech queries.
Outcome: The proposed framework improves the performance of end-to-end speech-tospeech dialogue systems while achieving higher retrieval efficiency.
Automatic Speech Recognition Datasets in Cantonese: A Survey and New Dataset (2022.lrec-1)

Copied to clipboard

Challenge: In this paper, we address the problem of data scarcity for the Hong Kong Cantonese language . due to the popularization of deep learning, ASR technology has led to a significant improvement in recognizing many languages.
Approach: They propose to use a dataset to analyze the data available for the Hong Kong Cantonese language . they use zh-HK as a source and a state-of-the-art ASR model to build a powerful model .
Outcome: The proposed model improves on the biggest existing dataset, Common Voice zh-HK.
Unified Thinker: A General Reasoning Core for Image Generation (2026.acl-long)

Copied to clipboard

Challenge: generative models struggle with logic-intensive instruction following, exposing a persistent reasoning–execution gap.
Approach: They propose a task-agnostic reasoning architecture for general image generation . they propose pixel-level feedback to ground the Thinker's policy in pixel feedback .
Outcome: The proposed system significantly improves image reasoning and generation quality.
Leveraging Unit Language Guidance to Advance Speech Modeling in Textless Speech-to-Speech Translation (2025.findings-acl)

Copied to clipboard

Challenge: Existing textless speech-to-speech translation models have two main challenges: 1) learning cross-modal features and 2) learning alignment of difference languages in long sequences.
Approach: They propose a unit language to overcome two main modeling challenges . they propose task prompt modeling to utilize the unit language in guiding the modeling process.
Outcome: The proposed language improves over a strong baseline and achieves comparable performance to models trained with text.
Beyond the Leaderboard: Rethinking Medical Benchmarks for Large Language Models (2026.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) are proving significant potential in healthcare, prompting numerous benchmarks to evaluate their capabilities.
Approach: They propose a framework that deconstructs benchmark development into five stages from design to governance and provides a checklist of 46 medically-tailored criteria.
Outcome: The framework deconstructs benchmark development into five stages from design to governance and provides a comprehensive checklist of 46 medically-tailored criteria.
Recall with Reasoning: Chain-of-Thought Distillation for Mamba’s Long-Context Memory and Extrapolation (2025.emnlp-main)

Copied to clipboard

Challenge: Existing long-context memory methods such as Mamba struggle with long-constituency when the length of the processed text exceeds the model's training length.
Approach: They propose a method that uses chain-of-thought summarization to teach Mamba to actively recall and reason over long contexts.
Outcome: Experiments on LONGMEMEVAL and HELMET show that RwR outperforms existing long-term memory methods while preserving short-context capabilities.
MenatQA: A New Dataset for Testing the Temporal Comprehension and Reasoning Abilities of Large Language Models (2023.findings-emnlp)

Copied to clipboard

Challenge: Large language models (LLMs) have shown nearly saturated performance on many NLP tasks.
Approach: They construct multiple sensitive factors time QA which encompasses three temporal factors . they test current mainstream LLMs with different parameter sizes .
Outcome: The proposed model incorporates three temporal factors with 2,853 samples . the results show that LLMs fall behind smaller models on these factors .
Few-shot Named Entity Recognition with Entity-level Prototypical Network Enhanced by Dispersedly Distributed Prototypes (2022.coling-1)

Copied to clipboard

Challenge: Existing prototypical networks for named entity recognition suffer from label dependency and tightly distributed prototypes, thus causing misclassifications.
Approach: They propose an Entity-level Prototypical Network enhanced by dispersedly distributed prototypes to build entity-level prototypes and distribute them dispersionally.
Outcome: The proposed system outperforms the previous models on two evaluation tasks and the Few-NERD settings in terms of overall performance.
CodeFlowBench: A Multi-turn, Iterative Benchmark for Complex Code Generation (2026.acl-long)

Copied to clipboard

Challenge: Modern software development demands code that is maintainable, testable, and scalable by organizing the implementation into modular components with iterative reuse of existing codes.
Approach: They propose a benchmark to evaluate LLMs' ability to perform codeflow by reusing existing functions over multiple turns.
Outcome: The proposed benchmarks show that LLMs perform significantly worse in multi-turn codeflow scenarios and that their performance inversely correlates with dependency complexity.
PaddleSpeech: An Easy-to-Use All-in-One Speech Toolkit (2022.naacl-demo)

Copied to clipboard

Challenge: PaddleSpeech is an open-source speech toolkit that supports speech-to-text and text-to speech tasks.
Approach: They describe the design philosophy and core architecture of PaddleSpeech to support several essential speech-to-text and text-to speech tasks.
Outcome: The proposed framework achieves competitive or state-of-the-art performance on various speech datasets and implements the most popular methods.
Are Large Language Models Reliable Reviewers? A Benchmark for Error Detection in Financial Documents (2026.findings-acl)

Copied to clipboard

Challenge: Existing LLMs struggle to identify errors in financial documents, a study shows . 18% of financial practitioners make errors daily, one-third make errors several times weekly, and 59% make errors multiple times monthly.
Approach: They introduce FinED-Bench, a publicly available Benchmark for financial error detection . it covers nine real-world financial scenarios and includes over 900 documents in 2025 . supervised fine-tuning can significantly improve the performance of weaker LLMs, they show .
Outcome: The proposed benchmark covers nine real-world financial scenarios and includes over 900 documents reported in 2025 that are unseen by existing language models.
COM2SENSE: A Commonsense Reasoning Benchmark with Complementary Sentences (2021.findings-acl)

Copied to clipboard

Challenge: Recent advances in pretrained language models have shown promising results on commonsense reasoning benchmark datasets.
Approach: They propose a commonsense reasoning benchmark dataset with 4k sentence pairs . they propose 'gamified' model-in-the-loop setup to incentivize challenging samples .
Outcome: The proposed benchmarks show that the proposed model achieves 71% standard accuracy and 51% pairwise accuracy, well below human performance.
Unsupervised Dual Paraphrasing for Two-stage Semantic Parsing (2020.acl-main)

Copied to clipboard

Challenge: Existing semantic parsing frameworks rely on nontrivial human labor to generate canonical utterances.
Approach: They propose a framework that uses an unsupervised paraphrase model to parse canonical utterances.
Outcome: The proposed framework is effective and compatible with supervised training.
ROSE: A Reward-Oriented Data Selection Framework for LLM Task-Specific Instruction Tuning (2025.findings-emnlp)

Copied to clipboard

Challenge: Prevailing methods for task-specific instruction tuning use similarity metrics to select training data . but instruction tuning loss often fails to exhibit a monotonic relationship with actual task performance .
Approach: They propose a task-specific instruction tuning method that leverages pairwise preference loss as a reward signal.
Outcome: The proposed method surpasses state-of-the-art methods for task-specific instruction tuning.
F5-TTS: A Fairytaler that Fakes Fluent and Faithful Speech with Flow Matching (2025.acl-long)

Copied to clipboard

Challenge: Recent research in Text-to-Speech (TTS) has experienced great advancement . current models can synthesize speech for any given text and mimic the speaker of audio prompt.
Approach: They propose a fully non-autoregressive text-to-speech system based on flow matching with Diffusion Transformer (DiT) without complex designs such as duration model, text encoder, and phoneme alignment, the text input is simply padded with filler tokens to the same length as input speech, and then denoising is performed for speech generation.
Outcome: The proposed system achieves an inference RTF of 0.15, which is greatly improved compared to state-of-the-art diffusion-based models.
DANLI: Deliberative Agent for Following Natural Language Instructions (2022.emnlp-main)

Copied to clipboard

Challenge: Recent work on embodied AI agents that can perform tasks by following human language instructions is limited by reactive methods, which are insufficient for long-horizon complex tasks.
Approach: They propose a neuro-symbolic deliberative agent that, while following language instructions, proactively applies reasoning and planning based on its neural and symbolic representations acquired from past experience.
Outcome: The proposed agent achieves greater than 70% improvement over reactive baselines on the challenging TEACh benchmark.
I2E: From Image Pixels to Actionable Interactive Environments for Text-Guided Image Editing (2026.acl-long)

Copied to clipboard

Challenge: Existing text-guided image editing methods rely on end-to-end pixel-level inpainting paradigm . existing models lack such intermediate representations and Reasoning-then-action process .
Approach: They propose a "Decompose-then-Action" paradigm that revisits image editing as an actionable interaction process within a structured environment.
Outcome: The proposed paradigm outperforms existing methods in compositional editing tasks.
SynET: Synonym Expansion using Transitivity (2020.findings-emnlp)

Copied to clipboard

Challenge: Existing approaches to find synonyms from text corpora are distributed and pattern based, but they suffer from low precision and low recall.
Approach: They propose a task of synonym expansion using transitivity and propose auxiliary task to reduce the impact of noisy sentences.
Outcome: The proposed approach reduces the impact of noisy sentences and reduces noise in a real-world dataset.
PAEG: Phrase-level Adversarial Example Generation for Neural Machine Translation (2022.coling-1)

Copied to clipboard

Challenge: Existing methods for adversarial example generation are word-level or character-level, which ignore the ubiquitous phrase structure.
Approach: They propose a phrase-level adversarial example generation framework to enhance the robustness of the translation model by adopting a sentence-level substitution strategy.
Outcome: The proposed method improves translation performance and robustness to noise on three benchmarks.
A Retrieve-and-Rewrite Initialization Method for Unsupervised Machine Translation (2020.acl-main)

Copied to clipboard

Challenge: Recent work shows successful methods for unsupervised machine translation (UMT) initialization stage is important since bad initialization may wrongly squeeze the search space and too much noise may hurt the final performance.
Approach: They propose a retrieval and rewriting based method to better initialize unsupervised translation models.
Outcome: The proposed method improves translation performance by over 4 BLEU scores.
UFO: A UI-Focused Agent for Windows OS Interaction (2025.naacl-long)

Copied to clipboard

Challenge: UFO is a UI-Fcused agent designed to fulfill user requests tailored to Windows OS applications . it decomposes user requests using divide-and-conquer approach, enabling seamless navigation and addressing sub-tasks across multiple applications.
Approach: They propose a UI-Fcused Windows OS agent that decomposes user requests using a divide-and-conquer approach and incorporates a control interaction module tailored for Windows OS.
Outcome: The proposed agent decomposes user requests using divide-and-conquer approach, enabling seamless navigation and addressing sub-tasks across multiple applications.
Title2Event: Benchmarking Open Event Extraction with a Large-scale Chinese Title Dataset (2022.emnlp-main)

Copied to clipboard

Challenge: Existing EE datasets define fixed event types and design specific schemas for each of them, failing to cover diverse events emerging from the online text.
Approach: They propose to use a sentence-level dataset to benchmark Open Event Extraction without restricting event types.
Outcome: The proposed dataset contains more than 42,000 news titles in 34 topics collected from Chinese web pages.
CB-Whisper: Contextual Biasing Whisper Using Open-Vocabulary Keyword-Spotting (2024.lrec-main)

Copied to clipboard

Challenge: End-to-end automatic speech recognition systems struggle to recognize rare name entities such as personal names, organizations and terminologies that are not frequently encountered in the training data.
Approach: They propose a convolutional neural network-based ASR system that performs open-vocabulary keyword-spotting before the decoder to match the features between the entities and the utterances.
Outcome: The proposed system significantly improves mixed-error-rate (MER) and entity recall compared to the original Whisper model on three internal datasets and two publicly available datasets.
Exploring Mathematical Extrapolation of Large Language Models with Synthetic Data (2024.findings-acl)

Copied to clipboard

Challenge: Large language models (LLMs) have shown excellent capabilities in language understanding, text generation and many other tasks, but struggle in complex multi-step reasoning problems such as mathematical reasoning.
Approach: They propose to fine tune an open-llama-3B model to perform well on multi-step reasoning tasks via synthetic data.
Outcome: The proposed model can reach a zero-shot pass@1 at 0.44 on the in-domain dataset and demonstrates certain generalization capabilities on the out-of-domain data.
WebRollback: Enhancing Web Agents with Explicit Rollback Mechanisms (2026.eacl-short)

Copied to clipboard

Challenge: Recent studies have adopted a greedy one-way search strategy to deal with dynamic web environments.
Approach: They propose to integrate a rollback mechanism into web agents to allow them to revert back to a previous state in navigation trajectory.
Outcome: The proposed method is able to revert back to a previous state in its navigation trajectory, allowing the models to directly control the search process.
FAITH: Factuality Alignment through Integrating Trustworthiness and Honestness (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches to correct factually inaccurate outputs are lacking the semantic richness needed to properly understand its internal states of trustworthiness and honesty.
Approach: They propose a framework for factuality alignment that integrates natural-language uncertainty signals with external knowledge and computes confidence scores and semantic entropy from LLM outputs.
Outcome: Extensive experiments on four knowledge-intensive benchmarks show that FAITH improves the factual accuracy and truthfulness of Large Language Models (LLMs).
Fantastic Questions and Where to Find Them: FairytaleQA – An Authentic Dataset for Narrative Comprehension (2022.acl-long)

Copied to clipboard

Challenge: Existing QA datasets rarely distinguish fine-grained reading skills, such as the understanding of varying narrative elements.
Approach: They propose to use FairytaleQA to generate 10,580 questions based on 278 children-friendly stories to assess model's fine-grained learning skills.
Outcome: The proposed dataset consists of 10,580 questions derived from 278 children-friendly stories, covering seven types of narrative elements or relations.
Character-level White-Box Adversarial Attacks against Transformers via Attachable Subwords Substitution (2022.emnlp-main)

Copied to clipboard

Challenge: Existing methods to attack transformer models are not effective at character level, but they are a natural attack scenario.
Approach: They propose a character-level adversarial attack method against transformer models . they use a gradient-based method to find the most vulnerable words in a sentence .
Outcome: The proposed method outperforms previous methods on sentence-level and token-level tasks.
Sparsity-Accelerated Training for Large Language Models (2024.findings-acl)

Copied to clipboard

Challenge: Large language models (LLMs) have demonstrated proficiency across various NLP tasks but often require additional training, such as continual pre-training and supervised fine-tuning.
Approach: They propose to leverage sparsity in pre-trained LLMs to accelerate training by disregarding computations for unimportant neurons.
Outcome: The proposed framework achieves comparable or superior performance to standard training while significantly accelerating the process.
AUGUST: an Automatic Generation Understudy for Synthesizing Conversational Recommendation Datasets (2023.findings-acl)

Copied to clipboard

Challenge: Existing work on conversational recommendation systems lacks high-quality data . existing datasets lack large-scale and high-level data based on human annotators .
Approach: They propose an automatic dataset synthesis approach that generates large-scale recommendation dialogues using structured graphs based on user-item information from the real world.
Outcome: The proposed approach can generate large-scale and high-quality recommendation dialogues . it exploits user preferences, knowledge graphs, and conversation ability from existing datasets based on real-world data .
OpenWebVoyager: Building Multimodal Web Agents via Iterative Real-World Exploration, Feedback and Optimization (2025.acl-long)

Copied to clipboard

Challenge: Existing studies focus on building text-only agents in synthetic environments where the reward signals are clearly defined.
Approach: They propose a multimodal web agent that can autonomously conduct real-world exploration and improve itself after each iteration.
Outcome: The proposed agent improves itself after each iteration, demonstrating strong performance across multiple test sets.
Fake Alignment: Are LLMs Really Aligned Well? (2024.naacl-long)

Copied to clipboard

Challenge: Existing studies on large language models have shown that they are poorly aligned in practice.
Approach: They propose a framework to evaluate safety in large language models . they propose two new metrics to quantify fake alignment and obtain corrected performance estimation.
Outcome: The proposed framework and two metrics show that some models with purported safety are poorly aligned in practice.
Retrieval-augmented GUI Agents with Generative Guidelines (2025.emnlp-main)

Copied to clipboard

Challenge: GUI agents powered by vision-language models struggle with real-world tasks due to their complex nature and limited training data.
Approach: They propose a lightweight vision-language model that leverages web tutorials at inferencetime to synthesize GUI agents.
Outcome: The proposed agent outperforms baseline GUI agents and surpasses other inference baselines by 2.6% to 13.3% across two model sizes.
Response-G1: Explicit Scene Graph Modeling for Proactive Streaming Video Understanding (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for streaming video understanding are query-agnostic and implicitly model video evidence.
Approach: They propose a framework that establishes explicit, structured alignment between the accumulated video evidence and the query’s expected response conditions via scene graphs.
Outcome: The proposed model achieves more interpretable and accurate response timing decisions on both proactive and reactive tasks.
SpecAgent: A Speculative Retrieval and Forecasting Agent for Code Completion (2026.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) excel at code-related tasks but struggle in real software repositories.
Approach: They propose a large-scale agent that injects repository context at inference time to improve both latency and code-generation quality by proactively exploring repository files during indexing and constructing speculative context.
Outcome: Experiments show that SpecAgent achieves 9–11% relative performance gains compared to baselines while significantly reducing inference latency.
AdaDHP: Fine-Grained Fine-Tuning via Dual Hadamard Product and Adaptive Parameter Selection (2025.acl-long)

Copied to clipboard

Challenge: Increasing number of parameters can be challenging under resource-constrained environments.
Approach: They propose a parameter-efficient fine-tuning method with fewer parameters and finer granularity that can adaptively select important parameters for each task.
Outcome: The proposed method can fine-tune important parameters for each task, while maintaining the same weights.
3R: Enhancing Sentence Representation Learning via Redundant Representation Reduction (2025.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to improve sentence representations lack fine-grained guidance on reducing redundant information.
Approach: They propose a method that dynamically identifies redundant information from a dimensional perspective and trains the SRL model to redistribute semantics on different dimensions.
Outcome: The proposed method improves sentence representations on seven semantic text similarity benchmarks.
SLAM-Omni: Timbre-Controllable Voice Interaction System with Single-Stage Training (2025.findings-acl)

Copied to clipboard

Challenge: a new spoken dialogue system with single-stage training is demonstrating its low latency and high quality . SLAM-Omni achieves zero-shot timbre control by modeling spoken language with semantic tokens .
Approach: They propose a timbre-controllable, end-to-end voice interaction system with single-stage training.
Outcome: The proposed system outperforms previous models on 4 GPUs with limited data.
CDT: A Comprehensive Capability Framework for Large Language Models Across Cognition, Domain, and Task (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing benchmarks focus on isolated abilities, lacking a holistic framework for assessing LLM capabilities.
Approach: They propose a Cognition-Domain-Task framework which measures a model’s capabilities across three dimensions.
Outcome: The proposed framework improves performance on dataset evaluation and data selection, while achieving higher scores on general and specific benchmarks.
CAMO: An Agentic Framework for Automated Causal Discovery from Micro Behaviors to Macro Emergence in LLM Agent Simulations (2026.findings-acl)

Copied to clipboard

Challenge: LLM-empowered agent simulations generate rich, adaptive, and often nonlinear interaction patterns.
Approach: They propose an automated Causal discovery framework for LLM agent simulations that converts mechanistic hypotheses into computable factors and learns a compact causal representation centered on an emergent target.
Outcome: Experiments across four emergent settings demonstrate the promise of CAMO.
UniTabNet: Bridging Vision and Language Models for Enhanced Table Structure Recognition (2024.findings-emnlp)

Copied to clipboard

Challenge: Table structure recognition technology is a critical tool for processing and analyzing large volumes of tabular data.
Approach: They propose a framework for table structure parsing based on the image-to-text model and a vision guider to refine the model’s capability to understand textual semantics in table images.
Outcome: The proposed framework improves on a dataset of PubTabNet, PubTables1M, WTW, and iFLYTAB and will be made publicly available.
Vision-Language Models Mistake Head Orientation for Gaze Direction: Nonverbal Conversation Cues (2026.findings-acl)

Copied to clipboard

Challenge: Where someone looks is a nonverbal communication cue that children and adults readily use.
Approach: They used 1,360 real-world photos to construct evaluation stimuli for Vision-Language Models (VLMs) they found a substantial performance gap between VLMs and humans .
Outcome: The proposed model outperforms existing models in predicting gaze direction using head orientation rather than eye appearance.
PLAWBENCH: A Rubric-Based Benchmark for Evaluating LLMs in Real-World Legal Practice (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks for large language models (LLMs) are coarse, single-dimensional metrics and do not explicitly assess fine-grained legal reasoning.
Approach: They propose a Practical Law Benchmark to evaluate large language models in real-world legal practice scenarios.
Outcome: The proposed model is based on 850 questions and 13 scenarios with expert-designed evaluation rubrics.
Second Language (Arabic) Acquisition of LLMs via Progressive Vocabulary Expansion (2025.acl-long)

Copied to clipboard

Challenge: In the evolving landscape of large language models, the predominant focus has been on English and Chinese.
Approach: They propose to utilize Arabic-specific vocabulary in the tokenizer to accelerate decoding.
Outcome: The proposed model achieves decent performance comparable to the best Arabic LLMs across various Arabic benchmarks.
WebVoyager: Building an End-to-End Web Agent with Large Multimodal Models (2024.acl-long)

Copied to clipboard

Challenge: Existing web agents only handle one input modality and are evaluated only in simplified web simulators or static web snapshots, greatly limiting their applicability in real-world scenarios.
Approach: They propose a large multimodal model-powered web agent that can complete user instructions end-to-end by interacting with real-world websites.
Outcome: The proposed agent achieves 59.1% task success rate, surpassing both GPT-4 and WebVoyager setups.
Beyond Unimodal Shortcuts: MLLMs as Cross-Modal Reasoners for Grounded Named Entity Recognition (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches to GMNER use MLLMs as auxiliary tools, causing cumulative error propagation and a lack of rigorous cross-modal verification.
Approach: They propose a model that enforces structured cross-modal reasoning through Multi-style Reasoning Schema Injection and Constraint-guided Verifiable Optimization.
Outcome: The proposed model enforces structured cross-modal reasoning through multi-style Reasoning Schema Injection and Constraint-guided Verifiable Optimization.
Don’t Tell the Answer, Truly Guide the Reasoning During RL Rollouts (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods such as GRPO often break down when task difficulty exceeds the model’s capacity, resulting in sparse rewards and inefficient training.
Approach: They propose to measure the compatibility between external guidance and a model's intrinsic policy by introducing an adaptive framework to enhance reasoning performance while explicitly preserving high Affinity.
Outcome: The proposed framework outperforms baseline models while maintaining high Affinity.
RePair: Automated Program Repair with Process-based Feedback (2024.findings-acl)

Copied to clipboard

Challenge: Commercial-scale language models (LMs) have taken APR to unprecedented levels, but they are limited by parameters and humans interact with them through explicit prompts.
Approach: They propose a method that utilizes process supervision to improve program repair by allowing users to input feedback from compilers and test cases.
Outcome: The proposed method outperforms large outcome-based generation methods and is inspired by strategies used in programming competitions.
Speech-Text Pre-training for Spoken Dialog Understanding with Explicit Cross-Modal Alignment (2023.acl-long)

Copied to clipboard

Challenge: Existing speech-text pre-training methods are limited to one or two specific tasks, despite their success in speech-language processing tasks.
Approach: They propose a temporal position prediction task to capture the speech-text alignment . they use a textual dialog pre-training task to generalize a response selection task .
Outcome: The proposed model is superior in learning speech-text alignment and multi-turn dialog context.
WebAggregator: Enhancing Compositional Reasoning Capabilities of Deep Research Agent Foundation Models (2026.acl-long)

Copied to clipboard

Challenge: Existing agentic systems are retrieval-heavy but reasoning-light . current systems lack compositional reasoning, a key component of deep research .
Approach: They propose a data synthesis pipeline WebAggregator to shift agentic paradigm . they use Proactive Explorer to collect interconnected knowledge and Compositional Logic Proposer to weave knowledge into complex questions .
Outcome: The proposed pipeline surpasses GPT-4.1 and matches Claude-3.7-Sonnet on GAIA, WebWalkerQA, and XBench.
FFAEval: Evaluating Dialogue System via Free-For-All Ranking (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing evaluation metrics for open-domain dialogue systems show poor correlation with human assessment.
Approach: They propose a free-for-all human evaluation framework that shares dialogue history with annotators for multi-turn scoring.
Outcome: The proposed framework achieves a strong correlation with human assessment on English and Chinese dialogue systems.
Curr-ReFT: Overcoming Training Bottlenecks in Small-scale Vision-Language Models via Curriculum Reinforcement Finetuning (2025.findings-emnlp)

Copied to clipboard

Challenge: State-of-the-art vision-language models require massive scaling that limits practical deployment.
Approach: They propose to use supervised fine-tuning to train small-scale vision-language models but face out-of-domain collapse when trained with traditional supervised learning (SFT).
Outcome: Experiments show that curr-reFT achieves state-of-the-art performance across visual tasks in both in- and out-of domain settings and benchmarks.
ADaPT: Token-Level Decoupling for Efficient Large Reasoning Models (2026.findings-acl)

Copied to clipboard

Challenge: Existing efficiency-oriented methods attempt to shorten or mix reasoning strategies, yet often degrade reasoning capability.
Approach: They propose a token-level dual-process framework that explicitly decouples efficiency and correctness signals during training.
Outcome: The proposed framework reduces inference cost while maintaining strong reasoning ability across multiple benchmarks.
GigaSpeech 2: An Evolving, Large-Scale and Multi-domain ASR Corpus for Low-Resource Languages with Automated Crawling, Transcription and Refinement (2025.acl-long)

Copied to clipboard

Challenge: GigaSpeech 2 is a large-scale, multi-domain, multilingual speech recognition corpus for low-resource languages.
Approach: They propose a large-scale, multi-domain, multilingual speech recognition corpus for low-resource languages and an automated pipeline for data crawling, transcription, and label refinement.
Outcome: The proposed corpus reduces the word error rate for Thai, Indonesian, and Vietnamese on a realistic YouTube test set by 25% to 40% compared to Whisper large-v3.
Toward Automated Robustness Evaluation of Mathematical Reasoning (2026.findings-acl)

Copied to clipboard

Challenge: Existing robustness evaluations rely on hand-crafted templates or a limited set of perturbation rules, resulting in model failure.
Approach: They propose a framework inspired by software stress testing that generates adversarial variants via a multi-round rewrite-verify loop, ensuring semantic consistency while successfully inducing model failure.
Outcome: The proposed framework generates adversarial variants dynamically for each LLM, minimizing the risk of data contamination.
From Script to Stage: Automating Experimental Design for Social Simulations with LLMs (2026.findings-acl)

Copied to clipboard

Challenge: Xu et al., 2024): multi-agent simulations based on large language models are a new paradigm for social science research . traditional experimental design relies on interdisciplinary expertise and technical barriers . Xiaoping and Xin eli argue that LLM-driven agents are unreliable for rigorous experimental design due to hallucinations and limited verifiability.
Approach: They propose a framework for multi-agent experiment design based on script generation . Script Composition, Script Finalization, and Actor Generation are the core phases of the framework .
Outcome: The proposed framework lowers the barrier for social science experimental design and provides scientifically grounded decision support for policy-making.
Natural-Language Policies to Executable Decisions: An Interpretable Large Language Model Framework (2026.acl-industry)

Copied to clipboard

Challenge: a production-grade pricing system for tourism is challenging due to unstructured nature of travel orders and ever-evolving pricing policies.
Approach: They propose a production-grade pricing system with a strict decision boundary . they propose to combine structured extraction and bounded policy/path selection with interpretable condition trees .
Outcome: The proposed system processed 3,960 orders in six months and reduced the order management team from 15-20 to 3 . the system reduced the per-order handling time from 10 minutes to 2 minutes.
Explicit Cross-lingual Pre-training for Unsupervised Machine Translation (D19-1)

Copied to clipboard

Challenge: Existing approaches to build initial unsupervised machine translation models with cross-lingual n-gram embeddings are inexplicit and limited.
Approach: They propose a cross-lingual pre-training method that incorporates cross-linguistic training signals into pre-trained models by randomly choosing source n-grams in the input text stream.
Outcome: The proposed method significantly improves the performance of unsupervised machine translation.
TIARA: Multi-grained Retrieval for Robust Question Answering over Large Knowledge Base (2022.emnlp-main)

Copied to clipboard

Challenge: KBQA is a challenging area for pre-trained language models due to its extensive space and complexity.
Approach: They propose a model that uses multi-grained retrieval to focus on most relevant KB contexts . constrained decoding is used to control output space and reduce generation errors .
Outcome: The proposed model outperforms existing models on GrailQA and WebQuestionsSP.
On the Effectiveness of Sentence Encoding for Intent Detection Meta-Learning (2022.naacl-main)

Copied to clipboard

Challenge: Recent studies on few-shot intent detection have attempted to formulate the task as a meta-learning problem.
Approach: They propose to modify a few-shot intent detection task to produce a non-trivially strong performance without further domain-specific adaptation.
Outcome: The proposed model improves on the prototypical network variants with task-specific fine-tuning.
CriticLean: Critic-Guided Reinforcement Learning for Mathematical Formalization (2026.acl-long)

Copied to clipboard

Challenge: Existing approaches to formalizing mathematical statements face limitations in accuracy, especially in the context of complex, highlevel problems that involve sophisticated mathematical reasoning.
Approach: They propose a CriticLean framework that elevates the role of the critic from a passive validator to an active learning component and introduce a benchmark to measure models’ ability to distinguish semantically correct from incorrect formalizations.
Outcome: The proposed framework outperforms open- and closed-source benchmarks and shows that it significantly outperformed existing models.
Spider: A Large-Scale Human-Labeled Dataset for Complex and Cross-Domain Semantic Parsing and Text-to-SQL Task (D18-1)

Copied to clipboard

Challenge: Existing datasets for semantic parsing are too small in terms of number of programs for training modern data-intensive models.
Approach: They propose a large-scale complex and cross-domain semantic parsing task for a database . they use a dataset with 10,181 questions and 5,693 unique complex SQL queries .
Outcome: The proposed task is different from previous tasks because it uses the same database and program . the best model achieves only 9.7% exact matching accuracy on a database split setting.
Sparse Brains are Also Adaptive Brains: Cognitive-Load-Aware Dynamic Activation for LLMs (2026.findings-eacl)

Copied to clipboard

Challenge: Existing sparsity methods lack adaptivity to contextual or model structural demands or incur prohibitive computational overhead.
Approach: They propose a Cognitive-Load-Aware Dynamic Activation framework that synergizes statistical sparsity with semantic adaptability.
Outcome: The proposed framework achieves 20% average speedup with less than 2% accuracy degradation outperforming Griffin and TT.
VReST: Enhancing Reasoning in Large Vision-Language Models through Tree Search and Self-Reward Mechanism (2025.acl-long)

Copied to clipboard

Challenge: Large Vision-Language Models (LVLMs) have shown exceptional performance in multimodal tasks, but their effectiveness in complex visual reasoning is constrained.
Approach: They propose a training-free approach that enhances Reasoning in Large Vision-Language Models . they propose integrating Monte Carlo Tree Search and Self-Reward mechanisms into the reasoning tree .
Outcome: The proposed approach surpasses current prompting methods and secures state-of-the-art performance across three multimodal reasoning benchmarks.
Decoupled Dialogue Modeling and Semantic Parsing for Multi-Turn Text-to-SQL (2021.findings-acl)

Copied to clipboard

Challenge: Recent work on Text-to-SQL for multi-turn dialogue has attracted great interest . current approaches mostly employ end-to end models and face data sparsity problems .
Approach: They propose a decoupled multi-turn text-to-SQL framework where dialogue context is explicitly solved by an utterance rewrite model and a single-turn Text-toSQl parser are proposed.
Outcome: The proposed method outperforms existing models on SParC and CoSQL datasets without annotated in-domain data.
TriPlay-RL: Tri-Role Self-Play Reinforcement Learning for LLM Safety Alignment (2026.acl-long)

Copied to clipboard

Challenge: Existing approaches to safety alignment of large language models rely on costly manual annotations or human review.
Approach: They propose a closed-loop reinforcement learning framework called TriPlay-RL that enables iterative collaboration among three roles with near-zero manual annotation.
Outcome: The proposed framework achieves 20%–50% improvement in adversarial effectiveness while preserving high output diversity while achieving 10%–30% gains in safety performance without degrading general reasoning capability.
Safety in Large Reasoning Models: A Survey (2025.findings-emnlp)

Copied to clipboard

Challenge: Large Reasoning Models (LRMs) have a high level of advanced reasoning capabilities, but they are vulnerable and vulnerable.
Approach: This paper presents the first comprehensive survey of Large Reasoning Models . it explores the new safety risks, attacks, and defense strategies specific to LRMs based on reasoning .
Outcome: The proposed study examines the safety and security risks of large reasoning models.
Chain-of-Skills: A Configurable Model for Open-Domain Question Answering (2023.acl-long)

Copied to clipboard

Challenge: Using customized retrieval models, model transferability and scalability are limited.
Approach: They propose a modular retrieval model where individual modules correspond to key skills that can be reused across datasets.
Outcome: The proposed model outperforms self-supervised retrievers in zero-shot evaluations and achieves state-of-the-art fine-tuned retrieval performance on NQ, HotpotQA and OTT-QA.
DivScene: Towards Open-Vocabulary Object Navigation with Large Vision Language Models in Diverse Scenes (2025.findings-emnlp)

Copied to clipboard

Challenge: Large Vision-Language Models (LVLMs) have achieved significant progress in tasks like visual question answering and document understanding.
Approach: They introduce DivScene, a large-scale dataset with 4,614 houses across 81 scene types and 5,707 kinds of target objects.
Outcome: The proposed dataset provides a much greater diversity of target objects and scene types than existing datasets, enabling a comprehensive task evaluation.
Dynamic Scaling of Unit Tests for Code Reward Modeling (2025.acl-long)

Copied to clipboard

Challenge: Existing large language models struggle to produce accurate responses on the first attempt for complex reasoning tasks like code generation.
Approach: They propose a lightweight yet effective unit test generator that scales unit tests based on problem difficulty.
Outcome: The proposed approach significantly improves performance on three benchmarks.
LongWeave: A Long-Form Generation Benchmark Bridging Real-World Relevance and Verifiability (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing benchmarks for long-form generation assess real-world queries with hard-to-verify metrics or use synthetic setups that overlook real-life intricacies.
Approach: They propose a new approach that balances verifiable and real-world assessment with Target-Anchored Evaluation.
Outcome: The proposed model balances real-world and verifiable assessment with Target-Anchored Evaluation (TAE) it generates queries, textual materials, and anchors based on verifier targets within real-life scenarios .
Timeline Summarization based on Event Graph Compression via Time-Aware Optimal Transport (2021.emnlp-main)

Copied to clipboard

Challenge: Existing methods for timeline summarization ignore the events’ intra-structures and inter-structure connections.
Approach: They propose to represent news articles as an event-graph, thus compressing the whole graph to its salient sub-graph.
Outcome: The proposed method significantly improves on the state-of-the-art on three real-world datasets, including two public benchmarks and a Timeline100 dataset.
TVWorld: Foundations for Remote-Control TV Agents (2026.findings-acl)

Copied to clipboard

Challenge: Existing work on large vision–language models focuses on point-and-click interaction, while remote-control interaction is underexplored.
Approach: They propose a topology-aware training framework that injects topology awareness into LVLMs.
Outcome: The proposed model achieves 68.3% success rate on TVWorld-N, surpassing closed-source benchmarks and state-of-the-art (SOTA) benchmarks show that existing agents lack topology awareness for focus-based, long-horizon TV navigation.
Document Image Machine Translation with Dynamic Multi-pre-trained Models Assembling (2024.naacl-long)

Copied to clipboard

Challenge: Existing TIMT tasks focus on text-line-level images.
Approach: They propose to extend the existing TIMT task and introduce a new framework to translate a source document image to markdown-formatted target translation.
Outcome: The proposed task aims to translate a source document image with long context and complex layout structure to markdown-formatted target translation.
Educational Question Generation of Children Storybooks via Question Type Distribution Learning and Event-centric Summarization (2022.acl-long)

Copied to clipboard

Challenge: Existing methods to generate educational questions of fairytales or storybooks are difficult to implement due to adults lacking the skills or time to integrate such interactive opportunities.
Approach: They propose a question generation method that first learns the question type distribution of an input story paragraph, and then summarizes salient events which can be used to generate high-cognitive-demand questions.
Outcome: The proposed method performs well on automatic and human evaluation metrics on a newly proposed educational question-answering dataset FairytaleQA.
CoT-Valve: Length-Compressible Chain-of-Thought Tuning (2025.acl-long)

Copied to clipboard

Challenge: Wei et al., 2022) have developed a powerful method for enhancing the reasoning capabilities of large language models.
Approach: They propose to use a tuning and inference strategy to control the length of reasoning chains by a parameter space direction to control their length.
Outcome: The proposed method reduces reasoning chains on GSM8K from 741 to 225 tokens with a minor performance drop (95.07% to 94.92%) and on AIME from 6827 to 4629 tokens, with only one additional incorrect answer.
LLMs know their vulnerabilities: Uncover Safety Gaps through Natural Distribution Shifts (2025.acl-long)

Copied to clipboard

Challenge: Current safety training focuses on teaching models to reject harmful queries, but recent research shows that adversarial attacks or jailbreak methods bypass these safety mechanisms.
Approach: They propose to use a new attack method to craft multi-turn toxic prompts that gradually lead LLMs to reveal unsafe content.
Outcome: The proposed method outperforms existing methods in diversity, effectiveness, and efficiency across aligned LLMs.
WebCoT: Enhancing Web Agent Reasoning by Reconstructing Chain-of-Thought in Reflection, Branching, and Rollback (2025.findings-emnlp)

Copied to clipboard

Challenge: Web agents powered by Large Language Models lack the ability to perform in uncertain web environments.
Approach: They propose to reconstruct web agents' reasoning skills into chain-of-thought rationales by fine-tuning their LLM backbone into a web-based model.
Outcome: The proposed approach significantly improves the agent self-improving benchmark OpenWebVoyager, demonstrating that it can be used to improve the agent's reasoning skills.
LPO: Towards Accurate GUI Agent Interaction via Location Preference Optimization (2026.findings-acl)

Copied to clipboard

Challenge: Existing strategies for spatial localization are limited due to their limited capacity to perceive positional data.
Approach: They propose a location-based approach that leverages locational data to optimize interaction preferences.
Outcome: The proposed approach achieves SOTA results across offline benchmarks and real-world evaluations.
A Joint Coreference-Aware Approach to Document-Level Target Sentiment Analysis (2024.acl-long)

Copied to clipboard

Challenge: Existing work on aspect-based sentiment analysis (ABSA) focuses on sentence level, document level ABSA is more practical and requires holistic document-level understanding capabilities.
Approach: They propose a learning framework to jointly model the DTSA task and the coreference resolution task using ChatGPT.
Outcome: The proposed framework reduces the reliance on annotated coreference information and alleviates evaluation bias caused by missing coreference targets.
WebEvolver: Enhancing Web Agent Self-Improvement with Co-evolving World Model (2025.emnlp-main)

Copied to clipboard

Challenge: Agent self-improvement, where agents train their underlying Large Language Model (LLM) on self-sampled trajectories, shows promising results but often stagnates in web environments due to limited exploration and under-utilization of pretrained web knowledge.
Approach: They propose a co-evolving Large Language Model (LLM) that predicts the next observation based on current observation and action within the web environment.
Outcome: The proposed framework shows that agents can perform better in real-world web environments without using any distillation from more powerful close-sourced models.
Bridging the Editing Gap in LLMs: FineEdit for Precise and Targeted Text Modifications (2025.findings-emnlp)

Copied to clipboard

Challenge: a recent study shows that large language models can perform precise text editing tasks.
Approach: InstrEditBench is a benchmark dataset that compares 30,000 structured editing tasks . experimental evaluations show FineEdit outperforms state-of-the-art models .
Outcome: The proposed model outperforms state-of-the-art models on single-turn edits and mistral-7B-OpenOrca on direct edits.
CI-AVSR: A Cantonese Audio-Visual Speech Datasetfor In-car Command Recognition (2022.lrec-1)

Copied to clipboard

Challenge: In-car smart assistants should be able to process general as well as car-related commands and perform corresponding actions, which eases driving and improves safety.
Approach: They propose a dataset for in-car command recognition in the cantonese language with both video and audio data.
Outcome: The proposed model can achieve a considerable quality on the clean test set, but the speech recognition quality on noisy data is still inferior.
CSDS: A Fine-Grained Chinese Dataset for Customer Service Dialogue Summarization (2021.emnlp-main)

Copied to clipboard

Challenge: Existing summarization methods are prone to generate redundant and incoherent summaries, causing the performance to be worse.
Approach: They propose a Chinese dataset for Customer Service Dialogue Summarization (CSDS) that provides role-oriented summaries to acquire different speakers' viewpoints.
Outcome: The proposed dataset improves the abstractive summaries in two aspects . it also provides role-oriented summary to acquire different speakers’ viewpoints .
LLMs as World Models: Data-Driven and Human-Centered Pre-Event Simulation for Disaster Impact Assessment (2025.emnlp-main)

Copied to clipboard

Challenge: Recent advances in large language models (LLMs) show promise in simulating complex scenarios.
Approach: They examine multiple LLMs to proactively estimate perceived earthquake impacts using multimodal datasets and multimodal imagery.
Outcome: The framework generates Modified Mercalli Intensity (MMI) predictions at zip code and county scales using multimodal datasets.
CycleOIE: A Low-Resource Training Framework For Open Information Extraction (2025.coling-main)

Copied to clipboard

Challenge: Open Information Extraction (OpenIE) models rely heavily on large amounts of annotated data.
Approach: They propose a training framework that maximizes data efficiency through a cycle-consistency mechanism.
Outcome: The proposed approach improves the quality of training data by curating low-quality datasets annotated by a large language model.
Ditto: A Simple and Efficient Approach to Improve Sentence Embeddings (2023.emnlp-main)

Copied to clipboard

Challenge: Prior studies diagnose the anisotropy problem in sentence embeddings from pre-trained language models without fine-tuning.
Approach: They propose an unsupervised method that weights words with model-based importance estimations and computes the weighted average of word representations from pre-trained models as sentence embeddings.
Outcome: Empirical evaluations show that the proposed method can alleviate the anisotropy problem and improve various pre-trained models on the STS benchmarks.
ASCEND: A Spontaneous Chinese-English Dataset for Code-switching in Multi-turn Conversation (2022.lrec-1)

Copied to clipboard

Challenge: Code-switching is a speech phenomenon occurring when a speaker switches language during a conversation.
Approach: They propose to collect Mandarin Chinese-English code-switching corpus from read speech rather than spontaneous speech to address this phenomenon.
Outcome: ASCEND consists of 10.62 hours of clean speech, collected from 23 bilingual speakers of Chinese and English.
Improving Contextual Representation with Gloss Regularized Pre-training (2022.findings-naacl)

Copied to clipboard

Challenge: Experimental results show that the gloss regularizer module enhances word semantic similarity in pre-training.
Approach: They propose an auxiliary gloss regularizer module to BERT pre-training to enhance word semantic similarity.
Outcome: The proposed model improves word similarity in word-level and sentence-level representation.
MMLU-ProX: A Multilingual Benchmark for Advanced Large Language Model Evaluation (2025.emnlp-main)

Copied to clipboard

Challenge: Existing large language model evaluation benchmarks focus on English, while current multilingual tasks lack parallel questions that specifically assess cross-lingual reasoning abilities.
Approach: They propose a comprehensive benchmark covering 29 languages, built on an English benchmark.
Outcome: The MMLU-ProX is a comprehensive benchmark covering 29 languages, built on an English benchmark.
CH-SIMS: A Chinese Multimodal Sentiment Analysis Dataset with Fine-grained Annotation of Modality (2020.acl-main)

Copied to clipboard

Challenge: Existing studies in multimodal sentiment analysis only use unified multimodal annotations, which do not reflect the independent sentiment of single modalities.
Approach: They propose a Chinese single- and multi-modal sentiment analysis dataset with multimodal and independent unimodal annotations that can be used to study the interaction between modalities.
Outcome: The proposed methods achieve state-of-the-art performance and learn more distinctive unimodal representations.
Can Reasoning Path still be Effective as Input? Bridging Post-Reasoning to Chain-of-Thought Compression (2026.acl-long)

Copied to clipboard

Challenge: Existing work on reducing CoT generation in reasoning impairs the necessary information for deriving the correct answer.
Approach: They propose a reasoning paradigm that takes CoT as a part of context to simplify the reasoning task for Large Language Models (LLMs).
Outcome: The proposed framework reduces the generation length of LLMs, but its effectiveness hinges on the efficiency and reliability of the contextual CoT generation.
UniCorn: Towards Self-Improving Unified Multimodal Models through Self-Generated Supervision (2026.acl-long)

Copied to clipboard

Challenge: Unified Multimodal Models have achieved remarkable success in cross-modal comprehension, but a gap persists in their ability to translate internal knowledge into faithful and controllable synthesis.
Approach: They propose a self-improvement framework that partitions a single UMM into three collaborative roles: Proposer, Solver, and Judge.
Outcome: The proposed framework improves on TIIF, DPG, CompBench and UniCycle benchmarks.
CCIM: Cross-modal Cross-lingual Interactive Image Translation (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing research on text image machine translation (TIMT) lacks recognized source language information resulting in a decrease in translation performance.
Approach: They propose a cross-modal cross-lingual interactive model which incorporates source language information by synchronizing source and target language results.
Outcome: The proposed model outperforms end-to-end models and has faster decoding speed with smaller model size than cascade models.
AMR-based Network for Aspect-based Sentiment Analysis (2023.acl-long)

Copied to clipboard

Challenge: Recent studies have used dependency trees to extract relation between aspects and contexts, but there is a potential mismatch between the dependency tree and sentiment classification as a semantic task.
Approach: They propose to replace the syntactic dependency tree with a semantic structure to capture the relation between an aspect and a context.
Outcome: The proposed model improves ABSA on four public datasets with 1.13% improvement over baselines.
Knowledge Distillation with Reptile Meta-Learning for Pretrained Language Model Compression (2022.coling-1)

Copied to clipboard

Challenge: Knowledge distillation (KD) can transfer knowledge from the original model into a compact model to achieve model compression.
Approach: They propose a knowledge distillation method with reptile meta-learning to facilitate the transfer of knowledge from the teacher to the student.
Outcome: Extensive experiments on the GLUE benchmark show the proposed method performs better than previous methods.
MoPS: Modular Story Premise Synthesis for Open-Ended Automatic Story Generation (2024.acl-long)

Copied to clipboard

Challenge: Existing sources of story premises are limited by a lack of diversity, uneven quality, and high costs that make them difficult to scale.
Approach: They propose a method which breaks down story premises into modules like background and persona for automated design and generation.
Outcome: The proposed framework excels in diversity, fascination, completeness, and originality compared to those induced from large language models and captured from public datasets.
ESF: Efficient Sensitive Fingerprinting for Black-Box Tamper Detection of Large Language Models (2025.findings-acl)

Copied to clipboard

Challenge: Large language models (LLMs) are increasingly utilized in diverse applications, including code generation, legal document analysis, medical diagnosis, and decision-making.
Approach: They propose a fingerprinting method tailored for black-box tamper detection of large language models.
Outcome: The proposed method detects tampering with a 99.2% detection rate using 5 fingerprint samples across state-of-the-art LLMs.
E-ABSA20K: A Dataset and Propose-and-Verify for Aspect-Based Sentiment Analysis in Long E-commerce Reviews (2026.findings-acl)

Copied to clipboard

Challenge: Aspect-based Sentiment Analysis (ABSA) is critical for extracting actionable product insights from e-commerce reviews.
Approach: They propose a framework that decomposes ABSA into two stages to extract review-level quadruple reviews from 20K reviews from four product categories.
Outcome: The proposed framework outperforms existing benchmarks and single-stage prompting and competitive ABSA extraction baselines.
Evaluating the Expressive Appropriateness of Speech in Rich Contexts (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for evaluating expressive speech focus on word accuracy, naturalness, signal quality, or emotional intensity at the utterance level.
Approach: They propose a framework for Evaluating Expressive Appropriateness in speech that assesses whether a speech sample aligns with the underlying communicative intent implied by its discourse-level narrative context.
Outcome: The proposed framework outperforms existing speech evaluation and analysis systems on a human-annotated test set.
TSPO: Breaking the Double Homogenization Dilemma in Multi-turn Search Policy Optimization (2026.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) can solve complex tasks through iterative information retrieval.
Approach: They propose a turn-level stage-aware policy optimization approach to solve this problem . they introduce a first-occurrence latent reward mechanism to allocate partial rewards .
Outcome: Experiments show that TSPO outperforms state-of-the-art models on Qwen2.5-3B and 7B models.
Orthogonal Representation Editing: Decoupling Semantic Entanglement in Batch Knowledge Editing of LLMs (2026.findings-acl)

Copied to clipboard

Challenge: Existing knowledge editing methods suffer from performance degradation in batch knowledge editing.
Approach: They propose an orthogonal representation editing method which decouples semantic entanglement from edit vectors and enforcing orthogonals on edit vector.
Outcome: The proposed method outperforms existing methods and achieves superior performance in cross-lingual knowledge editing scenarios.
TableLLM: Enabling Tabular Data Manipulation by LLMs in Real Office Usage Scenarios (2025.findings-acl)

Copied to clipboard

Challenge: TableLLM is a robust large language model capable of handling tabular data manipulation tasks.
Approach: They propose a distant supervision method for training which includes a reasoning process extension strategy and a cross-way validation strategy.
Outcome: The proposed model has 8 billion parameters and is capable of handling tabular data tasks.
MODE-LSTM: A Parameter-efficient Recurrent Network with Multi-Scale for Sentence Classification (2020.emnlp-main)

Copied to clipboard

Challenge: Existing models for sentence classification use linear convolution, which may not be sufficient to model the non-consecutive dependency of the phrase and may overfit the sequential information.
Approach: They propose a model that extracts multi-scale n-gram features for understanding the semantic meaning of sentences by some key-phrases located at different positions.
Outcome: The proposed model outperforms existing models on eight benchmark datasets and is competitive against state-of-the-art models.
S2ST-Omni: Hierarchical Language-Aware SpeechLLM Adaptation for Multilingual Speech-to-Speech Translation (2026.findings-acl)

Copied to clipboard

Challenge: S2ST-Omni integrates a speech-to-text frontend with a modular, plug-and-play text-tospeech backend.
Approach: They propose a compositional S2ST framework that integrates a speech-to-text frontend with a modular, plug-and-play text-tospeech backend.
Outcome: The proposed framework outperforms existing frameworks in translation and synthesis . it integrates a speech-to-text translation frontend with a plug-and-play text-tospeech backend .
Born a BabyNet with Hierarchical Parental Supervision for End-to-End Text Image Machine Translation (2024.lrec-main)

Copied to clipboard

Challenge: Existing research on text image machine translation (TIMT) is divided into two types: Cascade methods combine text image recognition and MT models to recognize source language text images.
Approach: They propose a method which is optimized with hierarchical parental supervision to improve translation performance.
Outcome: The proposed method significantly outperforms existing methods on synthetic and real-world tests on both synthetic and realistic images.
Pru-CoT: Towards Efficient Reasoning Distillation via Pruning Chain-of-Thought (2026.findings-acl)

Copied to clipboard

Challenge: Existing heuristics fail to capture global causal logic due to rigid rules and limited search spaces.
Approach: They propose a framework that extracts the essential logical structure from reasoning chains.
Outcome: Experiments show that Pru-CoT models generate more compact reasoning paths compared to models trained on verbose data.
Few-shot In-context Learning on Knowledge Base Question Answering (2023.acl-long)

Copied to clipboard

Challenge: KB-BINDER enables few-shot in-context learning over knowledge base questions . KBQA is a difficult problem due to the heterogeneity of knowledge bases .
Approach: They propose a framework that enables few-shot in-context learning over KBQA tasks.
Outcome: The proposed framework can outperform state-of-the-art models on GraphQA and MetaQA datasets.
ConFit v2: Improving Resume-Job Matching using Hypothetical Resume Embedding and Runner-Up Hard-Negative Mining (2025.findings-acl)

Copied to clipboard

Challenge: Existing methods to model resume-job fit are sparse since job seekers apply to only a few jobs.
Approach: They propose two techniques to enhance the encoder’s contrastive training process by augmenting job data with hypothetical reference resume generated by a large language model and creating high-quality hard negatives from unlabeled resume/job pairs using a novel hard-negative mining strategy.
Outcome: The proposed method outperforms ConFit and prior methods on two real-world datasets and achieves an average improvement of 13.8% in recall and 17.5% in nDCG across job-ranking and resume-ranker tasks.
NLP Reproducibility For All: Understanding Experiences of Beginners (2023.acl-long)

Copied to clipboard

Challenge: a study with 93 students in an introductory NLP class shows that beginners' programming skill and comprehension of research papers have a limited impact on their effort spent completing the exercise.
Approach: a study conducted with 93 students in an introductory NLP course questioned them on their programming background and programming background.
Outcome: The results show that beginners' programming skill and comprehension of research papers have a limited impact on their effort spent on the exercise.
Takin-VC: Expressive Zero-Shot Voice Conversion via Adaptive Hybrid Content Encoding and Enhanced Timbre Modeling (2025.acl-long)

Copied to clipboard

Challenge: Expressive zero-shot voice conversion (VC) aims to modify source timbre to match unseen speaker . existing zero- shot VC systems struggle to reproduce paralinguistic information in highly expressive speech .
Approach: They propose a framework for expressive zero-shot voice conversion that uses hybrid content encoding and memory-augmented context-aware timbre modeling.
Outcome: The proposed framework surpasses state-of-the-art VC systems in speech naturalness, speaker similarity, and speaker similarness.
Enhancing Cross-lingual Natural Language Inference by Soft Prompting with Multilingual Verbalizer (2023.findings-acl)

Copied to clipboard

Challenge: Existing approaches to cross-lingual natural language inference lack annotated parallel corpora.
Approach: They propose a new prompt learning framework with the Multilingual Verbalizer for XNLI that uses a multilingual verbalizer to align the representations of original and augmented multilingual questions into a unified semantic space with consistency regularization.
Outcome: The proposed framework outperforms existing methods under few-shot and full-shot cross-lingual transfer settings.
Stand on The Shoulders of Giants: Building JailExpert from Previous Attack Experience (2025.emnlp-main)

Copied to clipboard

Challenge: Existing methods to generate human-aligned content with a “jailbreak prompt” are inefficient and repetitive, causing inefficiency and a lack of experience.
Approach: They propose a framework that integrates past attack experiences to aid current jailbreak attempts.
Outcome: The proposed framework improves both attack effectiveness and efficiency compared to the current black-box jailbreak method.
URO-Bench: Towards Comprehensive Evaluation for End-to-End Spoken Dialogue Models (2025.findings-emnlp)

Copied to clipboard

Challenge: a lack of comprehensive evaluations for SDMs in speech-to-speech (S2S) scenarios is a major challenge for end-to end spoken dialogue models.
Approach: They propose to provide an extensive evaluation framework for end-to-end spoken dialogue models (SDMs) that includes both cognitive dimensions and paralinguistic cues .
Outcome: The proposed benchmark is divided into two difficulty levels: basic track and pro track, each comprising 20 test sets, evaluating the spoken dialogue model’s abilities in U**nderstanding, **R**easoning, and **O**ral conversation.
Understanding the Therapeutic Relationship between Counselors and Clients in Online Text-based Counseling using LLMs (2024.findings-emnlp)

Copied to clipboard

Challenge: In traditional face-to-face therapy, the assessment of therapeutic alliance is not directly translated to text-based settings.
Approach: They propose an automatic approach to understand the development of therapeutic alliance in text-based counseling by using large language models.
Outcome: The proposed approach demonstrates that the framework is effective in identifying the therapeutic alliance in text-based counseling.
When and Who? Conversation Transition Based on Bot-Agent Symbiosis Learning Network (2020.coling-main)

Copied to clipboard

Challenge: a bot-agent symbiosis is a method for transparent conversation transition in online customer service applications.
Approach: They propose a bot-agent symbiosis approach to solve conversation transition problems . they provide user feedback and develop deep neural networks to predict the NPS .
Outcome: The proposed approach outperforms state-of-the-art methods on real-time data generated from an online service support platform.
Dense X Retrieval: What Retrieval Granularity Should We Use? (2024.emnlp-main)

Copied to clipboard

Challenge: a learned dense retrieval model is often overlooked when using a corpus for inference, resulting in a design choice of retrieval unit . granularity of retrievals is important for both retrieval and downstream tasks .
Approach: They propose a retrieval unit for dense retrieval that uses propositions to index corpus . propositions are defined as atomic expressions within text, each encapsulating a distinct factoid .
Outcome: The proposed retrieval unit outperforms passage-level units on retrieval and downstream tasks.
Semi-supervised Relation Extraction via Incremental Meta Self-Training (2021.findings-emnlp)

Copied to clipboard

Challenge: Existing methods suffer from the gradual drift problem, where noisy pseudo labels are incorporated during training.
Approach: They propose a method that uses pseudo labels to assess quality on unlabeled samples . they use a relation label generation network to learn from successful and failed attempts .
Outcome: Experimental results show the proposed method can improve on two public datasets.
Learning Fine-Grained Grounded Citations for Attributed Large Language Models (2024.findings-acl)

Copied to clipboard

Challenge: despite impressive performance, large language models still struggle with hallucinations . current approaches suffer from suboptimal citation quality due to reliance on in-context learning .
Approach: They propose a framework that teaches large language models to generate fine-grained citations.
Outcome: The proposed framework outperforms all baselines on the ALCE benchmark and achieves an average improvement of 14.21% in citation quality.
Chain-of-Note: Enhancing Robustness in Retrieval-Augmented Language Models (2024.emnlp-main)

Copied to clipboard

Challenge: Standard RALMs often neglect their intrinsic knowledge due to the interference from retrieved information.
Approach: They propose a new approach to improve robustness of RALMs by generating sequential reading notes for each retrieved document.
Outcome: The proposed approach outperforms standard RALMs on four open-domain QA benchmarks.
SepSeq: A Training-Free Framework for Long Numerical Sequence Processing in LLMs (2026.findings-acl)

Copied to clipboard

Challenge: Existing large-scale large-context models suffer from performance degradation when processing long numerical sequences.
Approach: They propose a framework to mitigate attention dispersion by strategically inserting separator tokens into the model to recalibrat attention to local segments while preserving global context.
Outcome: The proposed framework improves accuracy and reduces inference token consumption by 16.4% on 9 widely-adopted LLMs.
RevCore: Review-Augmented Conversational Recommendation (2021.findings-acl)

Copied to clipboard

Challenge: Existing conversational recommendation systems lack item information when conducted on short dialogue history and unfamiliar items.
Approach: They propose a framework where reviews are seamlessly incorporated into conversational recommendation systems.
Outcome: The proposed framework yields better performance on recommendation and conversation responding.
VisualRWKV: Exploring Recurrent Neural Networks for Visual Language Models (2025.coling-main)

Copied to clipboard

Challenge: Visual Language Models (VLMs) have been gaining popularity with large language models, but few attempts have been made to incorporate efficient linear Recurrent Neural Networks (RNNs) into VLMs.
Approach: They propose a linear RNN model with a data-dependent recurrence and sandwich prompts to enhance modeling capabilities and a 2D image scanning mechanism to enrich the processing of visual sequences.
Outcome: The proposed model achieves competitive performance compared to Transformer-based models on various benchmarks.
Span-based Joint Entity and Relation Extraction with Attention-based Span-specific and Contextual Semantic Representations (2020.coling-main)

Copied to clipboard

Challenge: Existing methods treat each span token equally important, ignoring significant features.
Approach: They propose a span-based joint extraction framework with attention-based semantic representations that utilizes span-specific and contextual representations.
Outcome: The proposed model outperforms existing models on ACE2005, CoNLL2004 and ADE.
Multi-grained Named Entity Recognition (P19-1)

Copied to clipboard

Challenge: Existing approaches treat Named Entity Recognition (NER) as a sequence labeling task.
Approach: They propose a framework for Multi-Grained Named Entity Recognition where multiple entities or entity mentions in a sentence could be non-overlapping or totally nested.
Outcome: The proposed framework outperforms current state-of-the-art frameworks by 4.4% in terms of the F1 score among nested/non-overlapping NER tasks.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations