Papers by Yan Ma

57 papers
Hierarchy-aware Label Semantics Matching Network for Hierarchical Text Classification (2021.acl-long)

Copied to clipboard

Challenge: Existing methods ignore the semantic relationship between text and labels, so they cannot make full use of hierarchical information.
Approach: They propose a hierarchy-aware label semantics matching network to model the semantic relationship between text and labels in a semantic matching problem.
Outcome: The proposed model captures the text-label semantics matching relationship among coarse-grained labels and fine-grain labels in a hierarchy-aware manner.
Mention Extraction and Linking for SQL Query Generation (2020.emnlp-main)

Copied to clipboard

Challenge: Existing text-to-SQL systems take a slot-filling approach, but they are limited in capturing inter-dependencies among SQL clauses.
Approach: They propose an extraction-linking approach where a unified extractor recognizes all types of slot mentions appearing in the question sentence before a linker maps the recognized columns to the table schema to generate executable SQL queries.
Outcome: The proposed method achieves the first place on the WikiSQL benchmark.
EVA: Evolving Semantic Adversaries for Red-Teaming GUI Agents Against Environmental Injection Attacks (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods for red-teaming face a trade-off between requiring target-specific knowledge and incurring prohibitive computational costs.
Approach: They propose a framework that evolves payloads exclusively on the semantic dimension via a discovery-deployment pipeline.
Outcome: Experiments show that EVA outperforms baselines in terms of attack success rate while evolving benign seeds into successful attacks within 1.18 to 1.71 iterations.
SAC: Neural Speech Codec with Semantic-Acoustic Dual-Stream Quantization (2026.acl-long)

Copied to clipboard

Challenge: Existing speech codecs struggle to balance high-quality reconstruction with semantically rich representations, limiting their effectiveness in both generative and understanding tasks.
Approach: They propose a neural speech codec with semantic-acoustic dual-stream quantization that disentangles semantic and acousian modeling into two dedicated streams.
Outcome: The proposed codec outperforms state-of-the-art speech tokenizers in auto-propagating text-to-speech models.
Self-Evolving Multi-Agent Systems via Textual Backpropagation (2026.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) have proven effective for addressing complex, high-dimensional tasks, but current approaches rely on static, manually engineered multi-agent configurations.
Approach: They propose a framework that conceptualizes multi-agent collaboration as a layered neural network architecture.
Outcome: The proposed framework surpasses leading multi-agent baselines under the same configurations, showing consistent performance improvements.
Memory-R1: Enhancing Large Language Model Agents to Manage and Utilize Memories via Reinforcement Learning (2026.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) are stateless and limited by a finite context window, preventing them from maintaining knowledge across long conversations or evolving tasks.
Approach: They propose a reinforcement learning framework that empowers LLMs to actively manage external memory through two specialized agents.
Outcome: The proposed framework outperforms baselines and benchmarks across diverse question types, three benchmarks, and multiple model scales.
LoopCoder: Scaling Code Intelligence via Looped Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Large language models have mastered syntax-level code generation, but complex algorithmic reasoning remains a challenge.
Approach: They propose a recurrent inductive bias that aligns with the recursive nature of programming logic.
Outcome: The proposed model achieves comparable performance to standard dense models with more parameters.
CodeJudge-Eval: Can Large Language Models be Good Judges in Code Understanding? (2025.coling-main)

Copied to clipboard

Challenge: Recent advances in large language models (LLMs) have showcased impressive code generation capabilities, primarily evaluated through language-to-code benchmarks.
Approach: They propose a benchmark to assess LLMs’ code understanding abilities from the perspective of code judging rather than code generation.
Outcome: The proposed benchmark evaluates 12 well-known large language models to determine the correctness of provided code solutions.
AgenticEval: Toward Agentic and Self-Evolving Safety Evaluation of Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Existing static safety evaluation methods are ill-equipped to address dynamic nature of AI risks and evolving regulations, creating a critical safety gap.
Approach: They propose a new paradigm of agentic safety evaluation reframing evaluation as a continuous and self-evolving process rather than a one-time audit.
Outcome: The proposed framework shows a consistent decline in model safety as the evaluation hardens.
Pause or Fabricate? Training Language Models for Grounded Reasoning (2026.findings-acl)

Copied to clipboard

Challenge: Large language models implicitly fabricate information when inputs are incomplete, causing confidence but unreliable conclusions.
Approach: They propose a framework for grounded reasoning under incomplete information that decomposes reasoning into two stages . they propose stage-specific rewards to penalize hallucinations, enabling models to detect gaps, stop proactively, and resume reasoning after clarification.
Outcome: The proposed framework improves premise detection and task success by 30% . it also reduces average response length by over 20% .
Mitigating Posterior Salience Attenuation in Long-Context LLMs with Positional Contrastive Decoding (2025.acl-short)

Copied to clipboard

Challenge: Current solutions incur prohibitive training costs, leaving statistical behaviors and cost-effective approaches underexplored.
Approach: They propose a positional contrast decoding technique that contrasts long-aware attention with designed local-awn attention.
Outcome: The proposed model achieves state-of-the-art performance on long-context benchmarks.
Frustratingly Simple Few-Shot Slot Tagging (2021.findings-acl)

Copied to clipboard

Challenge: Existing fewshot methods for slot tagging are weak in encoding slot name semantics and slot dependencies.
Approach: They propose a simple and effective few-shot model for slot tagging which incorporates machine reading comprehension (MRC) using source domain and target domain data.
Outcome: The proposed model outperforms state-of-the-art methods on the SNIPS dataset.
CTC-based Non-autoregressive Textless Speech-to-Speech Translation (2024.findings-acl)

Copied to clipboard

Challenge: Existing direct speech-to-speech translation models require text supervision during training, which is not feasible for numerous unwritten languages.
Approach: They propose a non-autoregressive (NAR) model that generates discrete units from the source speech and employs a unit-based vocoder to synthesize the target.
Outcome: The proposed model achieves translation quality comparable to the autoregressive model while preserving up to 26.81 decoding speedup.
FedCoT: Federated Chain-of-Thought Distillation for Large Language Models (2025.findings-emnlp)

Copied to clipboard

Challenge: Large Language Models (LLMs) have emerged as a transformative force in artificial intelligence, demonstrating exceptional proficiency across various tasks.
Approach: They propose a federated framework for the Chain-of-Thought distillation of knowledge from LLMs to SLMs, while adhering to privacy requirements.
Outcome: The proposed framework ensures secure knowledge transfer from an LLM on a high-powered server to an SLM on resource-constrained client while adhering to privacy requirements.
Fake Alignment: Are LLMs Really Aligned Well? (2024.naacl-long)

Copied to clipboard

Challenge: Existing studies on large language models have shown that they are poorly aligned in practice.
Approach: They propose a framework to evaluate safety in large language models . they propose two new metrics to quantify fake alignment and obtain corrected performance estimation.
Outcome: The proposed framework and two metrics show that some models with purported safety are poorly aligned in practice.
Weak-to-Strong Reasoning (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing approaches to supervise large language models (LLMs) exceed human capabilities, but the effectiveness of this approach is still unexplored.
Approach: They propose a weak-to-strong reasoning framework that enables strong models to refine training data . they use supervised fine-tuning and preference optimization to optimize weak models .
Outcome: The proposed framework improves the reasoning capabilities of a language model using three weak models.
Text-Guided Multi-Scale Frequency Representation Adaptation (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for fine-tuning visual signals are limited by their size and complexity.
Approach: They propose a multi-scale frequency-based fine-tuning method that integrates textual information and performs multi-level fine- tuning of visual signals in the frequency domain.
Outcome: Extensive experiments on multimodal models, including CLIP and LLaVA, demonstrate that the proposed method significantly improves performance and efficiency with minimal cost and fast convergence within one epoch.
STORM-BORN: A Challenging Mathematical Derivations Dataset Curated via a Human-in-the-Loop Multi-Agent Framework (2025.findings-acl)

Copied to clipboard

Challenge: Existing datasets suffer from outdated and insufficient challenging content, neglecting human-like reasoning, and limited reliability due to single-LLM generation.
Approach: They propose a human-in-the-loop, multi-agent data generation framework that integrates reasoning-dense filters, multiagent collaboration, and human mathematicians’ evaluations to ensure the reliability and quality of the dataset.
Outcome: The proposed framework improves accuracy and quality of the 2,000-synthesized datasets by integrating reasoning-dense filters, multi-agent collaboration, and human mathematicians’ evaluations.
SLAM-Omni: Timbre-Controllable Voice Interaction System with Single-Stage Training (2025.findings-acl)

Copied to clipboard

Challenge: a new spoken dialogue system with single-stage training is demonstrating its low latency and high quality . SLAM-Omni achieves zero-shot timbre control by modeling spoken language with semantic tokens .
Approach: They propose a timbre-controllable, end-to-end voice interaction system with single-stage training.
Outcome: The proposed system outperforms previous models on 4 GPUs with limited data.
Is ChatGPT Good at Search? Investigating Large Language Models as Re-Ranking Agents (2023.emnlp-main)

Copied to clipboard

Challenge: Existing work utilizes generative LLMs for Information Retrieval (IR) rather than direct passage ranking.
Approach: They investigate generative LLMs such as ChatGPT and GPT-4 for relevance ranking in IR and use a test set to verify the model’s ability to rank unknown knowledge.
Outcome: The proposed model outperforms a 3B supervised model on the BEIR benchmark.
Well Begun Is Half Done: An Implicitly Augmented Generative Framework with Distribution Modification for Hierarchical Text Classification (2024.lrec-main)

Copied to clipboard

Challenge: Hierarchical Text Classification (HTC) is a challenging task which aims to extract the labels in a tree structure corresponding to a given text.
Approach: They propose an explicit-agmented-generativ-e framework with distribution modification for hierarchical text classification.
Outcome: The proposed framework improves on the initial distributions of tail classes and avoids misinterpreting predictions on unbalanced data.
Multi-Hop Knowledge Editing via Critic-Guided Multi-Agent Reasoning (2026.findings-acl)

Copied to clipboard

Challenge: Existing knowledge editing methods rely on unidirectional, feed-forward pipelines . a minor retrieval error or logical mismatch at an early hop can become a silent failure .
Approach: They propose a framework for closed-loop post-edit reasoning that uses a Critic agent to verify coherence and step-wise correctness.
Outcome: Experiments on MQuAKE-2002 and MQuADE-hard show that CARE effectively mitigates error propagation . a minor retrieval error or logical mismatch at an early hop can become a silent failure .
Control Image Captioning Spatially and Temporally (2021.acl-long)

Copied to clipboard

Challenge: Existing methods to generate image captions with user intention are still under exploration.
Approach: They propose a model that connects Contrastive constraints and Attention Guidance in a loop manner and engages explicit spatial and temporal constraints to the generating process.
Outcome: The proposed model improves performance on a trace-controlled image captioning task.
Genius: A Generalizable and Purely Unsupervised Self-Training Framework For Advanced Reasoning (2025.acl-long)

Copied to clipboard

Challenge: Existing methods for enhancing LLM reasoning rely on supervisory signals . current methods rely heavily on outcome supervision and auxiliary reward models .
Approach: They propose a gen-eralizable and purely unsupervised self-training framework to enhance LLM reasoning without supervision.
Outcome: The proposed framework improves LLM reasoning without supervision without external supervision.
CATE: A Contrastive Pre-trained Model for Metaphor Detection with Semi-supervised Learning (2021.emnlp-main)

Copied to clipboard

Challenge: Existing models for metaphor detection require a large amount of labeled data and are not linguistically-based.
Approach: They propose a ContrAstive pre-Trained modEl (CATE) for metaphor detection with semi-supervised learning using a pre-trained model to obtain a contextual representation of target words.
Outcome: The proposed model outperforms existing models on several benchmark datasets and achieves better performance against state-of-the-art models.
DRAGON: Domain-specific Robust Automatic Data Generation for RAG Optimization (2026.findings-eacl)

Copied to clipboard

Challenge: Existing retrieval-augmented generation paradigms rely heavily on public knowledge . Existing RAGs reliant on public information and often falter when faced with domain-specific queries.
Approach: They propose a framework that combines a data-construction modeling approach with a scalable synthetic data-generation pipeline to optimize domain-specific retrieval performance.
Outcome: The proposed framework optimizes domain-specific retrieval performance and bolsters retriever robustness.
SQL Generation via Machine Reading Comprehension (2020.coling-main)

Copied to clipboard

Challenge: Text-to-SQL systems can generate SQL queries given natural language questions.
Approach: They propose a method that formulates a question answering problem as a query answering problem where different slots are predicted by a unified machine reading comprehension (MRC) model.
Outcome: The proposed method can achieve competitive results on WikiSQL, suggesting it being a promising direction for text-to-SQl.
A Span-based Dynamic Local Attention Model for Sequential Sentence Classification (2021.acl-short)

Copied to clipboard

Challenge: Existing methods for sentence classification ignore latent segment structure of document, in which contiguous sentences have coherent semantics.
Approach: They propose a span-based dynamic local attention model that captures structural information by supervised dynamic local focus.
Outcome: The proposed model outperforms state-of-the-art models on two benchmark datasets.
CapArena: Benchmarking and Analyzing Detailed Image Captioning in the LLM Era (2025.findings-acl)

Copied to clipboard

Challenge: Image captioning has been a challenge for vision-language researchers for decades . current VLMs focus on tasks like visual question answering (YA) but image captioning is not as advanced as expected.
Approach: They evaluate VLMs' performance on image captioning using human annotations . they find that some metrics show high caption-level agreement with humans .
Outcome: The proposed model outperforms open-source models on image captioning . it achieves 93.4% correlation with human rankings at $4 per test .
Translation vs. Dialogue: A Comparative Analysis of Sequence-to-Sequence Modeling (2020.coling-main)

Copied to clipboard

Challenge: Existing models for machine translation and dialogue response generation require a large number of handcrafted features.
Approach: They propose to interpret a general neural model comparatively by using the seq2seq model in two mainstream NLP tasks.
Outcome: The proposed model is used in two mainstream NLP tasks and is compared with a standard model.
CODIS: Benchmarking Context-dependent Visual Comprehension for Multimodal Large Language Models (2024.acl-long)

Copied to clipboard

Challenge: Multimodal large language models have demonstrated promising results in a variety of tasks that combine vision and language.
Approach: They propose a benchmark to assess the ability of models to use contextual information in free-form text to enhance visual comprehension.
Outcome: The proposed model fails to extract and utilize contextual information to improve understanding of images.
Improving Factual Consistency of News Summarization by Contrastive Preference Optimization (2024.findings-emnlp)

Copied to clipboard

Challenge: Recent advances in news summarization have created problems with “hallucinations” that are factually inconsistent with the source text.
Approach: They propose to disentangle LLMs’ propensities to generate faithful and fake content by adopting a probing-based specific training method to improve their capacity of distinguishing two types of propensity.
Outcome: The proposed method disentangles LLMs’ propensities to generate faithful and fake content and improves their ability to distinguish between two types of propensity.
FalconCopilot: Empowering LLMs Towards Integrated Human-Machine Systems for Aviation Autonomy (2026.findings-acl)

Copied to clipboard

Challenge: Complex flight tasks require both intricate, long-horizon decision-making and precise operations.
Approach: They propose a LLM-based copilot system that addresses deficiencies in adaptability and fine-grained decision support while integrating with a high-fidelity environment.
Outcome: The proposed system shortens task completion time while attaining a level of performance approaching that of a human instructor.
EVOTOOL: Self-Evolving Tool-Use Policy Optimization in LLM Agents via Blame-Aware Mutation and Diversity-Aware Selection (2026.acl-long)

Copied to clipboard

Challenge: Existing approaches to optimize tool-use policies are monolithic and prone to entangling behaviors.
Approach: They propose a framework that decomposes agent’stool-use policy into four modules and improves them via three mechanisms.
Outcome: The proposed framework outperforms strong baselines on bothGPT-4.1 and Qwen3-8B while maintaining superior efficiency and transferability.
FlowSearch: Advancing Deep Research with Dynamic Structured Knowledge Flow (2026.acl-long)

Copied to clipboard

Challenge: FlowSearch is a multi-agent framework that actively constructs and evolves a dynamic structured knowledge flow to drive subtask execution and reasoning.
Approach: They propose a multi-agent framework that actively constructs and evolves a dynamic structured knowledge flow to drive subtask execution and reasoning.
Outcome: The proposed framework achieves competitive performance on GAIA, HLE, GPQA and TRQA benchmarks and is available to download.
LLMs know their vulnerabilities: Uncover Safety Gaps through Natural Distribution Shifts (2025.acl-long)

Copied to clipboard

Challenge: Current safety training focuses on teaching models to reject harmful queries, but recent research shows that adversarial attacks or jailbreak methods bypass these safety mechanisms.
Approach: They propose to use a new attack method to craft multi-turn toxic prompts that gradually lead LLMs to reveal unsafe content.
Outcome: The proposed method outperforms existing methods in diversity, effectiveness, and efficiency across aligned LLMs.
FedMKT: Federated Mutual Knowledge Transfer for Large and Small Language Models (2025.coling-main)

Copied to clipboard

Challenge: Recent research in large language models (LLMs) has focused on enabling clients to fine-tune their locally deployed homogeneous LLMs collaboratively or on transferring knowledge from server-based LLM to small language models at downstream clients.
Approach: They propose a parameter-efficient federated mutual knowledge transfer framework for large and small language models that allows for token alignment and selective knowledge transfer between client-side LLMs and a server-side SLM.
Outcome: The proposed framework enhances the performance of both LLMs and SLMs with clients' unique domain insights while preserving the server's LLM and client's unique domain insight.
ASCEND: A Spontaneous Chinese-English Dataset for Code-switching in Multi-turn Conversation (2022.lrec-1)

Copied to clipboard

Challenge: Code-switching is a speech phenomenon occurring when a speaker switches language during a conversation.
Approach: They propose to collect Mandarin Chinese-English code-switching corpus from read speech rather than spontaneous speech to address this phenomenon.
Outcome: ASCEND consists of 10.62 hours of clean speech, collected from 23 bilingual speakers of Chinese and English.
Efficient Paths and Dense Rewards: Probabilistic Flow Reasoning for Large Language Models (2026.acl-long)

Copied to clipboard

Challenge: Existing approaches to mitigate inference inefficiency and optimization difficulty are fragmented and constrained by inherent trade-offs.
Approach: They propose a framework that reconceptualizes discrete reasoning steps as a continuous probabilistic flow, quantifying the contribution of each step toward the ground-truth answer.
Outcome: The proposed framework achieves a superior balance between inference efficiency and reasoning performance on challenging benchmarks.
FASTMATCH: Accelerating the Inference of BERT-based Text Matching (2020.coling-main)

Copied to clipboard

Challenge: Recent pre-trained language models have shown state-of-the-art accuracies in text matching.
Approach: They propose a BERT-based text matching model where representations and interactions are decoupled . they propose generating final matching scores using a lightweight attention network .
Outcome: Experiments show that the proposed model can achieve up to 100X speed-up to BERT and RoBERTa while keeping more up to 98.7% of the performance.
CodeAttack: Revealing Safety Generalization Challenges of Large Language Models via Code Completion (2024.findings-acl)

Copied to clipboard

Challenge: Large Language Models exhibit remarkable generative capabilities but can be misused for harmful purposes.
Approach: They propose a framework that transforms natural language inputs into code inputs.
Outcome: The proposed framework bypasses the safety guardrails of all models more than 80% of the time.
Judging with Many Minds: Do More Perspectives Mean Less Prejudice? On Bias Amplification and Resistance in Multi-Agent Based LLM-as-Judge (2025.findings-emnlp)

Copied to clipboard

Challenge: LLM-as-Judge frameworks provide scalable alternative to human evaluation . but the question of how intrinsic biases manifest in these settings remains unexplored .
Approach: They conduct systematic analysis of four bias types in multi-agent LLM-as-Judge frameworks . they find debate framework amplifies biases sharply after initial debate .
Outcome: The proposed frameworks amplify biases after debate and show they are stronger in meta-judge scenarios.
MoPS: Modular Story Premise Synthesis for Open-Ended Automatic Story Generation (2024.acl-long)

Copied to clipboard

Challenge: Existing sources of story premises are limited by a lack of diversity, uneven quality, and high costs that make them difficult to scale.
Approach: They propose a method which breaks down story premises into modules like background and persona for automated design and generation.
Outcome: The proposed framework excels in diversity, fascination, completeness, and originality compared to those induced from large language models and captured from public datasets.
MODE-LSTM: A Parameter-efficient Recurrent Network with Multi-Scale for Sentence Classification (2020.emnlp-main)

Copied to clipboard

Challenge: Existing models for sentence classification use linear convolution, which may not be sufficient to model the non-consecutive dependency of the phrase and may overfit the sequential information.
Approach: They propose a model that extracts multi-scale n-gram features for understanding the semantic meaning of sentences by some key-phrases located at different positions.
Outcome: The proposed model outperforms existing models on eight benchmark datasets and is competitive against state-of-the-art models.
Improving Large Language Models in Event Relation Logical Prediction (2024.acl-long)

Copied to clipboard

Challenge: Event relation extraction tasks require rigorous logical reasoning and semantic comprehension, a challenge for narrative understanding and reasoning.
Approach: They propose three approaches to endow LLMs with event relation logic to generate more coherent answers across different scenarios.
Outcome: The proposed approach improves on a set of ERE tasks and provides insights for future work.
Understanding Gender Bias in Knowledge Base Embeddings (2022.acl-long)

Copied to clipboard

Challenge: Knowledge base (KB) embeddings have been shown to contain gender biases . authors develop two new bias measures to quantify them and trace their origins in KB .
Approach: They propose two ways to quantify gender biases in knowledge base (KB) embeddings . they use the influence function to inspect the contribution of each triple in KB to the overall group bias .
Outcome: The proposed measures are compared with real-world census data to examine gender biases.
URO-Bench: Towards Comprehensive Evaluation for End-to-End Spoken Dialogue Models (2025.findings-emnlp)

Copied to clipboard

Challenge: a lack of comprehensive evaluations for SDMs in speech-to-speech (S2S) scenarios is a major challenge for end-to end spoken dialogue models.
Approach: They propose to provide an extensive evaluation framework for end-to-end spoken dialogue models (SDMs) that includes both cognitive dimensions and paralinguistic cues .
Outcome: The proposed benchmark is divided into two difficulty levels: basic track and pro track, each comprising 20 test sets, evaluating the spoken dialogue model’s abilities in U**nderstanding, **R**easoning, and **O**ral conversation.
CC-Tuning: A Cross-Lingual Connection Mechanism for Improving Joint Multilingual Supervised Fine-Tuning (2025.acl-long)

Copied to clipboard

Challenge: Existing fine-tuning approaches that focus on English-centric training corpora often introduce implicit cross-lingual alignment, overlooking the potential for more profound, latent-level cross-linguistic interactions.
Approach: They propose a multilingual fine-tuning paradigm that explicitly establishes a cross-lingual connection mechanism at the latent level.
Outcome: The proposed model outperforms vanilla SFT and offers a strong latent-level alternative to data-level augmentation methods.
Bitnet.cpp: Efficient Edge Inference for Ternary LLMs (2025.acl-long)

Copied to clipboard

Challenge: 1-bit large language models have spurred interest in ternary LLMs, but efficient edge inference is still scarce.
Approach: They propose an inference system optimized for 1-bit large language models . they propose a new library that facilitates sub-2-bits-per-weight inference .
Outcome: The proposed inference system achieves 6.25x speed increase over full-precision baselines and 2.32x over low-bit baselines.
ItiNera: Integrating Spatial Optimization with Large Language Models for Open-domain Urban Itinerary Planning (2024.emnlp-industry)

Copied to clipboard

Challenge: Existing urban itinerary planning studies focus on traditional tourism, but they lack the precision and accuracy needed to create a personalized itinerary.
Approach: They propose an open-domain urban itinerary planning system that integrates spatial optimization with large language models to provide customized urban itineraries based on user needs.
Outcome: The proposed system can generate personalized urban itineraries based on user needs and scale with existing methods.
𝜙-Decoding: Adaptive Foresight Sampling for Balanced Inference-Time Exploration and Exploitation (2025.acl-long)

Copied to clipboard

Challenge: Existing inference-time optimization strategies address the shortsightedness of auto-regressive generation, but the vast search space leads to excessive exploration and insufficient exploitation.
Approach: They propose a decoding strategy that approximates two distributions via foresight and clustering to provide an efficient estimation of step value.
Outcome: The proposed decoding strategy outperforms strong baselines in performance and efficiency.
TextFlint: Unified Multilingual Robustness Evaluation Toolkit for Natural Language Processing (2021.acl-demo)

Copied to clipboard

Challenge: Existing approaches to textual robustness evaluation focus on slightly modifying the input data, which maintains the original meaning and results in a different prediction.
Approach: They propose a multilingual robustness evaluation toolkit for NLP that integrates universal text transformations, task-specific transformations and adversarial attack.
Outcome: The toolkit includes universal text transformation, task-specific transformation, adversarial attack, subpopulation, and their combinations to provide comprehensive robustness analyses.
RevCore: Review-Augmented Conversational Recommendation (2021.findings-acl)

Copied to clipboard

Challenge: Existing conversational recommendation systems lack item information when conducted on short dialogue history and unfamiliar items.
Approach: They propose a framework where reviews are seamlessly incorporated into conversational recommendation systems.
Outcome: The proposed framework yields better performance on recommendation and conversation responding.
DSRM: Boost Textual Adversarial Training with Distribution Shift Risk Minimization (2023.acl-long)

Copied to clipboard

Challenge: Existing adversarial training methods require multi-step gradient ascents or word substitutions to obtain adversarials, which impairs the effectiveness of adversariarial training.
Approach: They propose a procedure for instead adversarial training with only clean data that estimates the adversarials loss by perturbing the input data’s probability distribution rather than their embeddings.
Outcome: The proposed procedure reduces time consumption by up to 70% compared to current best-performing adversarial training methods.
Case2Code: Scalable Synthetic Data for Code Generation (2025.coling-main)

Copied to clipboard

Challenge: Large Language Models (LLMs) have shown outstanding breakthroughs in code generation.
Approach: They propose a case-to-code induction task that exploits the expressiveness and correctness of programs by incorporating LLMs into their training.
Outcome: The proposed task improves distribution case-to-code induction and various coding generation tasks.
MAIR: A Massive Benchmark for Evaluating Instructed Retrieval (2024.emnlp-main)

Copied to clipboard

Challenge: Existing IR benchmarks focus on a limited scope of tasks, making them insufficient for evaluating the latest IR models.
Approach: They propose a multi-task instruction-tuned IR benchmark that includes 126 distinct IR tasks across 6 domains.
Outcome: The proposed model performs better on instruction-tuned models than non-instruction-tunned models on MAIR.
Enhancing Agentic Textual Graph Retrieval with Synthetic Stepwise Supervision (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for integrating textual graphs with LLMs are limited by symbolic inference and high annotation costs.
Approach: They propose a textual graph reasoning framework that integrates textual diagrams with large language models.
Outcome: The proposed approach achieves 15.6% accuracy and 17.2% in F1 score on three common datasets.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations