Papers by Hao Guo

64 papers
Scaling Laws for Code: Every Programming Language Matters (2026.findings-acl)

Copied to clipboard

Challenge: Existing studies focus on language-agnostic settings, neglecting the inherently multilingual nature of modern software development.
Approach: They propose a proportion-dependent scaling law that prioritizes high-utility languages . they propose PLs to have varying effects during pre-training that affect model performance .
Outcome: The proposed scaling law is based on 1000+ experiments across multiple languages and models.
Failures are Treasures: Constructing a Pedagogical Bridge for Agentic Strategy Distillation (2026.findings-acl)

Copied to clipboard

Challenge: Existing knowledge distillation methods focus on imitating successful trajectories, whereas small language models are fragile and often collapsing after encountering errors.
Approach: They propose a Pedagogical Bridge for Reflective Insight and Distillation of Guiding Errors that combines reflection-in-action and reflection-on-action to enable agents to diagnose and correct critical errors while abstracting transferable strategies from contrastive student–teacher trajectories.
Outcome: Experiments show that the proposed model significantly elevates performance in large language models (SLMs) .
FLAIR: Steering LLM Mathematical Problem Solving based on A Fuzzy-Logic-AssIsted Reasoner (2026.acl-long)

Copied to clipboard

Challenge: Existing approaches to mathematical reasoning rely on static heuristics or pre-determined reasoning strategies.
Approach: They propose an adaptive framework that integrates fuzzy theory into LLM-based mathematical reasoning.
Outcome: The proposed framework outperforms state-of-the-art models while offering effective and interpretable diagnostics of intermediate problem-solving states.
CtrlA: Adaptive Retrieval-Augmented Generation via Inherent Control (2025.findings-acl)

Copied to clipboard

Challenge: Existing methods focus on detecting LLM’s confidence via statistical uncertainty.
Approach: They propose to use a representation perspective to solve adaptive RAG by enabling dynamic retrieval during generation and enabling retrieval only when the query exceeds LLM's internal knowledge.
Outcome: The proposed framework is superior to existing adaptive RAG methods on a diverse set of tasks.
Event-Radar: Event-driven Multi-View Learning for Multimodal Fake News Detection (2024.acl-long)

Copied to clipboard

Challenge: Existing methods for detecting multimedia fake news have demonstrated excellent results . however, addressing event-level inconsistency and learning from poor-quality news remains a challenge .
Approach: They propose an Event-diven fake news detection framework that integrates visual manipulation, textual emotion and multimodal inconsistency at event-level for fake news identification.
Outcome: The proposed framework performs well on three large-scale fake news detection benchmarks.
Task-Oriented Dialogue as Dataflow Synthesis (2020.tacl-1)

Copied to clipboard

Challenge: Existing approaches to task-oriented dialogue represent dialogue state as a dataflow graph . microsoft's SMCalFlow dataset features complex dialogues about events, weather, places, and people .
Approach: They propose a dataflow graph-based dialogue agent that maps each user utterance to a program that extends this graph.
Outcome: The proposed framework improves representability and predictability in natural dialogues . it uses dataflow graphs and metacomputation to map user intents to a program .
Code Representation Pre-training with Complements from Program Executions (2024.emnlp-industry)

Copied to clipboard

Challenge: Existing languages have syntactic representations of code to improve code intelligence, but they are difficult to learn from code.
Approach: They propose to embed dynamic information of programs revealed by their test cases into feature representations of code as complements.
Outcome: The proposed method yields 6%/19% mAP improvements over its masked language modeling counterparts.
LoopCoder: Scaling Code Intelligence via Looped Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Large language models have mastered syntax-level code generation, but complex algorithmic reasoning remains a challenge.
Approach: They propose a recurrent inductive bias that aligns with the recursive nature of programming logic.
Outcome: The proposed model achieves comparable performance to standard dense models with more parameters.
Multimodal Large Language Models for Text-rich Image Understanding: A Comprehensive Review (2025.findings-acl)

Copied to clipboard

Challenge: Recent advances in vision-language models have unified perception and understanding tasks within Visual Question Answering paradigms.
Approach: They propose to outline timeline, architecture, and pipeline of nearly all TIU MLLMs and review their performance on mainstream benchmarks.
Outcome: The proposed models perform well on mainstream benchmarks and are compared with other models.
Generative Annotation for ASR Named Entity Correction (2025.emnlp-main)

Copied to clipboard

Challenge: Existing named entity correction models fail to transcribe domain-speciffcnamed entities when theforms of the wrongly-transcribed words and the ground-truth entity are signiffcantly different.
Approach: They propose a method that utilizes speech sound features to retrieve candidate entities . it uses speech sound feature to annotate entityerrors in ASR transcripts .
Outcome: The proposed method can bring signiffcant improvement to entity accuracy.
Rethinking Text-to-SQL: Dynamic Multi-turn SQL Interaction for Real-world Database Exploration (2026.findings-acl)

Copied to clipboard

Challenge: Structured Query Language (SQL) is the cornerstone for data-driven decision-making.
Approach: They propose a benchmark to rigorously evaluate Large Language Models within a dynamic interaction framework.
Outcome: The proposed benchmark aims to rigorously evaluate LLMs within a dynamic interaction framework.
TeamLoRA: Boosting Low-Rank Adaptation with Expert Collaboration and Competition (2025.acl-long)

Copied to clipboard

Challenge: Existing methods for fine-tuning are resource-efficient, but performance often falls short . a new approach, TeamLoRA, integrates collaborative and competitive modules to improve performance.
Approach: They propose to introduce task-specific LoRA as domain experts to improve learning efficiency . teamLoRA integrates collaborative and competition modules to improve model learning .
Outcome: Experiments show that TeamLoRA improves performance in multi-task learning . teamLorea integrates collaborative and competitive modules to improve performance .
BTC-LLM: Efficient Sub-1-Bit LLM Quantization via Learnable Transformation and Binary Codebook (2026.acl-long)

Copied to clipboard

Challenge: Recent sparsity-aware binarization approaches can achieve sub-1-bit compression, but they face performance degradation, mask-management overhead, and limited hardware compatibility.
Approach: They propose a binary quantization framework that leverages binary pattern clustering and weight transformation to overcome performance degradation and mask-management overhead.
Outcome: The proposed framework achieves state-of-the-art compression (1.11–0.7 bits) it maintains high performance with only a 3.1% accuracy drop in zero-shot benchmarks while delivering a 1.6 speedup over FP16.
DualGuard: Dual-stream Large Language Model Watermarking Defense against Paraphrase and Spoofing Attack (2026.findings-acl)

Copied to clipboard

Challenge: Existing watermarking algorithms focus on defending against paraphrase and piggyback spoofing attacks, which can inject harmful content, compromise reliability, and undermine trust in attribution.
Approach: They propose an algorithm capable of defending against paraphrase and spoofing attacks.
Outcome: Experiments on large language models and language models show that DualGuard is the first watermarking algorithm capable of defending against both paraphrase and spoofing attacks.
Iterative Structured Pruning for Large Language Models with Multi-Domain Calibration (2026.eacl-industry)

Copied to clipboard

Challenge: Existing models with unstructured pruning often yield irregular sparsity patterns that necessitate specialized hardware or software support.
Approach: They propose a structured pruning framework that eliminates entire architectural components and maintains compatibility with standard hardware accelerators.
Outcome: The proposed model pruning framework achieves significant compression with minimal performance degradation on multiple models across diverse downstream tasks.
M3-VQA: A Benchmark for Multimodal, Multi-Entity, Multi-Hop Visual Question Answering (2026.acl-long)

Copied to clipboard

Challenge: Existing knowledge-based VQA benchmarks focus on coarse-grained categories and simple reasoning over single entities.
Approach: They propose a knowledge-based Visual Question Answering benchmark to enhance multimodality evaluation.
Outcome: The proposed benchmark improves evaluation of multimodal large language models in fine-grained multimodal entity understanding and complex multihop reasoning.
SciVQR: A Multidisciplinary Multimodal Benchmark for Advanced Scientific Reasoning Evaluation (2026.findings-acl)

Copied to clipboard

Challenge: Existing benchmarks for multimodal large language models fail to capture complexity and traceability of reasoning processes . SciVQR includes domain-specific visuals and challenges models to combine visual comprehension with reasoning.
Approach: They propose a multimodal benchmark for scientific reasoning covering 54 subfields . SciVQR includes domain-specific visuals and challenges models to combine visual comprehension with reasoning .
Outcome: SciVQR evaluates 54 subfields in mathematics, physics, chemistry, geography, astronomy, and biology . the results highlight the need for improved multi-step reasoning and integration of interdisciplinary knowledge .
PENTATRON: PErsonalized coNText-Aware Transformer for Retrieval-based cOnversational uNderstanding (2022.emnlp-industry)

Copied to clipboard

Challenge: In a large fraction of the global traffic from smart digital assistants, frictions in dialogues may be attributed to incorrect understanding of the entities in a user's query due to factors including ambiguous mentions, mispronunciation, background noise and faulty on-device signal processing.
Approach: They propose a parametric transformer-based language model to learn patterns from in-session customer-device interactions coupled with a non-parametric personalized entity index to compute the correct query.
Outcome: The proposed system improves on the existing system and shows that it can learn the correct query from in-session customer-device interactions.
PSSAT: A Perturbed Semantic Structure Awareness Transferring Method for Perturbation-Robust Slot Filling (2022.coling-1)

Copied to clipboard

Challenge: Existing slot filling models memorize inherent patterns of entities and contexts from training data.
Approach: They propose a perturbed semantic structure awareness transferring method for slot filling models . they use two MLM-based training strategies to learn contextual semantic structure and word distribution .
Outcome: The proposed method outperforms existing methods and gains strong generalization while preventing model from memorizing inherent patterns of entities and contexts.
When Personalization Legitimizes Risks: Uncovering Safety Vulnerabilities in Personalized Dialogue Agents (2026.acl-long)

Copied to clipboard

Challenge: Existing research on personalized LLM agents focuses on the effectiveness of personalized responses.
Approach: They propose a benchmark to quantify intent legitimation in personalized interactions . they propose 'detection-reflection' method that detects intent legititimation from internal representation space .
Outcome: The proposed method reduces safety degradation by using internal representation space.
Learning While Staying Curious: Entropy-Preserving Supervised Fine-Tuning via Adaptive Self-Distillation for Large Reasoning Models (2026.acl-long)

Copied to clipboard

Challenge: Recent advances establish "SFT-then-RL" as the defacto paradigm for enhancing large reasoning mod- els on automatically verifiable tasks.
Approach: They propose an entropy-preserving SFT method to enhance exploration capabilities through intrinsic curiosity.
Outcome: The proposed method outperforms the vanilla method on reasoning tasks by 2.5 points . it also outperformed the vanilla SFT by 2.9 points on out-of-distribution tasks .
Bit-by-Bit: Progressive QAT Strategy with Outlier Channel Splitting for Stable Low-Bit LLMs (2026.acl-long)

Copied to clipboard

Challenge: Existing approaches to training LLMs at ultra-low precisions suffer from convergence instability and substantial training costs.
Approach: They propose a progressive QAT framework with outlier channel splitting to address these issues . they use nested structure of integer quantization grids to enable a "train once, deploy any precision" paradigm .
Outcome: The proposed framework outperforms baselines on both Llama2/3 and W2A16, with an 11 speedup over BF16.
Contextual Rephrase Detection for Reducing Friction in Dialogue Systems (2021.emnlp-main)

Copied to clipboard

Challenge: Large-scale conversational AI based dialogue systems like Alexa, Siri, and Google Assistant, are getting more and more prevalent in real-world applications to help users across the globe.
Approach: They propose a contextual rephrase detection model ContReph to automatically identify rephrasings from multi-turn dialogues using contextual information and user-agent interaction signals.
Outcome: The proposed model outperforms the pairwise rephrase detection models by leveraging the context and user-agent interaction signals.
Capture Human Disagreement Distributions by Calibrated Networks for Natural Language Inference (2022.findings-acl)

Copied to clipboard

Challenge: Previously, it's common to disregard it as noise or as a sign of poor-quality data, as their annotations are heavily based on personal experience and opinions.
Approach: They propose to capture the human disagreement distribution from the perspective of model calibration.
Outcome: The proposed model can achieve competitive performance when well-calibrated, on divergence scores between predictive probability and the true human opinion distribution, and the accuracy.
INarIG: Iterative Non-autoregressive Instruct Generation Model For Word-Level Auto Completion (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing models for word-level autocompletion (WLAC) only use human typed sequences as prefixes in decoding module.
Approach: They propose a novel iterative nonautoregressive instruct generation model for WLAC task . it uses human typed sequences and iterating decoding with subwords to fully utilize input information.
Outcome: The proposed model is more competent in dealing with low-frequency words, and achieves state-of-the-art results on the WMT22 and benchmark datasets.
Self-Bootstrapped Visual-Language Model for Knowledge Selection and Question Answering (2024.emnlp-main)

Copied to clipboard

Challenge: a framework that leverages the visual-language model to select key knowledge retrieved by DPR and answer questions improves performance of the baseline on the open-domain Knowledge-based VQA benchmark, OK-VQA.
Approach: They propose a framework that leverages visual-language models to retrieve related knowledge . they use dense passage retrieval to retrieve knowledge related to visual-linguistics .
Outcome: The proposed framework significantly improves the baseline on the open-domain Knowledge-based VQA benchmark, OK-VQA.
Adaptive Structure Induction for Aspect-based Sentiment Analysis with Spectral Perspective (2023.findings-emnlp)

Copied to clipboard

Challenge: incorporating structure information can enhance the performance of aspect-based sentiment analysis.
Approach: They propose to use pre-trained language models to induct latent structures from a spectrum perspective.
Outcome: The proposed model shortens Aspects-sentiment Distance and improves structure induction ability.
StableToolBench-MirrorAPI: Modeling Tool Environments as Mirrors of 7,000+ Real-World APIs (2025.findings-acl)

Copied to clipboard

Challenge: Existing tool environments face challenges in balancing stability, scale, and realism, especially for benchmarking purposes.
Approach: They propose a framework that trains specialized LLMs to accurately simulate real API responses by supervised fine-tuning and chain-of-thought reasoning.
Outcome: The proposed framework achieves superior accuracy and stability compared to state-of-the-art methods on the newly constructed MirrorAPI-Bench and its integration into StableToolBench.
MdEval: Massively Multilingual Code Debugging (2026.findings-acl)

Copied to clipboard

Challenge: Existing benchmarks primarily focus on Python and are limited in terms of language diversity.
Approach: They propose a multilingual debugging benchmark that includes 3.9K test samples of 20 programming languages and introduces the debug instruction corpora MdEval-Instruct by injecting bugs into the correct multilingual queries and solutions.
Outcome: The proposed benchmark includes 3.9K test samples of 20 programming languages and covers the automated program repair task, bug localization task, and bug identification task.
LLMRouterBench: A Massive Benchmark and Unified Framework for LLM Routing (2026.findings-acl)

Copied to clipboard

Challenge: Large language model (LLM) routing assigns each query to the best suitable model from an ensemble.
Approach: They introduce a large-scale benchmark and unified framework for LLM routing . they find that many routing methods exhibit similar performance under unified evaluation .
Outcome: The proposed benchmark provides comprehensive metrics for both performance-oriented and performance-cost trade-off routing.
CGF: Constrained Generation Framework for Query Rewriting in Conversational AI (2022.emnlp-industry)

Copied to clipboard

Challenge: Large-scale conversational AI agents such as Alexa, Siri and Google Assistant help millions of users to perform a lot of tasks.
Approach: They propose a Constrained Generation Framework for query rewriting at global and personalized levels.
Outcome: The proposed framework significantly boosts the query rewriting performance.
SciVerse: Unveiling the Knowledge Comprehension and Visual Reasoning of LMMs on Multi-modal Scientific Problems (2025.findings-acl)

Copied to clipboard

Challenge: SciVerse is a multi-modal scientific evaluation benchmark to assess large multi-models . it examines the scientific knowledge comprehension, multi-mod content interpretation and Chain-of-Thought reasoning . authors examine the scientific proficiency of LMMs in scientific domains based on their work .
Approach: They propose a multi-modal scientific evaluation benchmark to thoroughly assess Large Multi-modal Models across 5,735 test instances in five different versions.
Outcome: The proposed evaluation reveals critical limitations in LMMs' scientific proficiency and provides new insights into future developments.
Overcoming Catastrophic Forgetting During Domain Adaptation of Seq2seq Language Generation (2022.naacl-main)

Copied to clipboard

Challenge: Existing work on lifelong learning requires incremental memory space to learn a model . existing work on experience replay or elastic weighted consolidation requires incremental space .
Approach: They propose a framework that leverages a recall optimization mechanism to memorize parameters of previous tasks via regularization and a domain drift estimation algorithm to compensate the drift between different domains in the embedding space.
Outcome: The proposed framework outperforms SOTA models on paraphrase and dialog response generation tasks.
M-Ped: Multi-Prompt Ensemble Decoding for Large Language Models (2025.findings-emnlp)

Copied to clipboard

Challenge: a new ensemble decoding approach enhances the performance of Large Language Models.
Approach: They propose a multi-prompt ensemble decoding approach to enhance LLM performance . they submit n variations of prompts with X to LLMs in batch mode to decode and derive probability distributions .
Outcome: The proposed method improves pass@k rates, LENS metrics and BLEU scores on diverse NLP tasks.
CCTVBench: Contrastive Consistency Traffic VideoQA Benchmark for Multimodal LLMs (2026.findings-acl)

Copied to clipboard

Challenge: Existing Vision-language models are prone to hallucinating nonexistent entities or events and missing subtle but critical visual cues.
Approach: They propose a Traffic VideoQA Benchmark that enforces a single structured decision pattern over each video question quadruple and provides actionable diagnostics that decompose failures into positive omission, positive swap, negative hallucination, mutual-exclusivity violation.
Outcome: The proposed model detects true hazards when an accident occurs, and rejects plausible-but-false hypotheses under near-identical counterfactual scenes.
Multi-View Incongruity Learning for Multimodal Sarcasm Detection (2025.coling-main)

Copied to clipboard

Challenge: Existing methods for multimodal sarcasm detection rely on spurious correlations, demonstrating poor generalizability beyond training environments.
Approach: They propose a method that integrates multimodal incongruities via contrastive learning for multimodal sarcasm detection by using three views to drive multi-view learning.
Outcome: The proposed method outperforms existing methods on benchmark datasets and shows that it is more generalizable than existing methods.
JanusMM: A Benchmark for Self-Deprecation Understanding in Real-World Multimodal Conversations (2026.acl-long)

Copied to clipboard

Challenge: Multimodal large language models (MLLMs) are a common communicative strategy in human society, often using image-text interplay to express emotions and intentions.
Approach: They propose to evaluate multimodal large language models (MLLMs)' understanding of self-deprecation in real-world conversations using 2,016 bilingual memes.
Outcome: The proposed framework evaluates MLLMs' understanding of self-deprecation in real-world conversations.
Long-form Hallucination Detection with Self-elicitation (2025.findings-acl)

Copied to clipboard

Challenge: Existing methods for hallucination detection tend to decompose text into isolated statements, unable to understand contextual semantics.
Approach: They propose a framework to leverage self-generated thoughts derived from prior statements as catalysts to elicit the expression of intrinsic knowledge and understand contextual semantics.
Outcome: The proposed framework enables self-elicitation to elicit expressions of knowledge and understand semantics.
StableToolBench: Towards Stable Large-Scale Benchmarking on Tool Learning of Large Language Models (2024.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) have witnessed remarkable advancements in recent years, prompting the exploration of tool learning.
Approach: They propose a virtual API server and stable evaluation system to assess the stability of large-scale real-time APIs.
Outcome: The proposed benchmarks demonstrate the stability of the proposed system and its caching system.
MAS-Bench: A Unified Benchmark for Shortcut-Augmented Hybrid Mobile GUI Agents (2026.acl-long)

Copied to clipboard

Challenge: Shortcuts such as APIs and deep-links have emerged as efficient complements to flexible GUI operations, but systematic evaluation of GUI–shortcut hybrid agents remains underexplored.
Approach: They propose a benchmark that evaluates GUI-shortcut hybrid agents with a specific focus on the mobile domain.
Outcome: MAS-Bench evaluates agent's ability to generate shortcuts by discovering and creating reusable, low-cost workflows.
DEIE: Benchmarking Document-level Event Information Extraction with a Large-scale Chinese News Dataset (2024.lrec-main)

Copied to clipboard

Challenge: Existing event-based datasets mainly target sentence-level tasks . current models struggle with "document" annotation, a key feature of the current model .
Approach: They propose a large-scale document-level event information extraction dataset with over 56,000+ events and 242,000+ arguments.
Outcome: The proposed dataset has over 56,000+ events and 242,000+ arguments.
Training Verifier to Assessing Complex Real-World Tool-Use Trajectories (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods for training effective AI agents often resort to synthetic data generation.
Approach: They propose a plug-and-play framework for data quality control in tool-use scenarios . they construct a tool-verify dataset and release a benchmark to assess its performance .
Outcome: The proposed framework surpasses Qwen2.5-72B-Instruct on Tool-V-Bench and the previous APIGen-MT dataset.
Linking Adaptive Structure Induction and Neuron Filtering: A Spectral Perspective for Aspect-based Sentiment Analysis (2024.lrec-main)

Copied to clipboard

Challenge: incorporating structure information can improve the performance of aspect-based sentiment analysis.
Approach: They propose a method to conduct neuron-level manipulations on word representations in the frequency domain.
Outcome: The proposed method can achieve or come close to state-of-the-art in ABSA.
Purging the Gray Zone: Latent-Geometric Denoising for Precise Knowledge Boundary Awareness (2026.findings-acl)

Copied to clipboard

Challenge: Existing abstention fine-tuning methods cause models to suffer from label noise near the decision boundaries.
Approach: They propose a latent space representation perspective for abstention fine-tuning . they propose 'geometric denoising' framework that constructs a truth hyperplane .
Outcome: The proposed framework significantly enhances model truthfulness and demonstrates strong generalization in out-of-distribution scenarios.
Text Style Transfer Back-Translation (2023.acl-long)

Copied to clipboard

Challenge: Current methods require large amount of bilingual training data, which is challenging and sometimes impossible task.
Approach: They propose a method to modify the style of inputs by modifying the source side of BT data.
Outcome: The proposed method significantly improves translation quality against popular BT benchmarks on high-resource and low-resourced language pairs.
A Novel Paradigm Boosting Translation Capabilities of Large Language Models (2024.findings-naacl)

Copied to clipboard

Challenge: Existing studies on LLMs focused on supervised fine-tuning but their effectiveness has been limited.
Approach: They propose a paradigm consisting of three stages: Secondary Pre-training using extensive monolingual data, Continual Pre- training with interlinear text format documents, and Leveraging source-language consistent instruction for supervised fine-tuning.
Outcome: The proposed approach surpasses previous work and achieves superior performance compared to models such as NLLB-54B(CITATION) and GPT3.5-text-davinci-003.
Self-Critique Guided Iterative Reasoning for Multi-hop Question Answering (2025.findings-acl)

Copied to clipboard

Challenge: Large language models (LLMs) have demonstrated remarkable reasoning capabilities, but they still face challenges in knowledge-intensive multi-hop reasoning.
Approach: They propose a method that uses self-critique feedback to guide iterative reasoning by enabling iteration and self-evaluation of its intermediate reasoning steps.
Outcome: The proposed method surpasses the previous SOTA by 8.6% on three multi-hop reasoning datasets.
DVD: Dynamic Contrastive Decoding for Knowledge Amplification in Multi-Document Question Answering (2024.emnlp-main)

Copied to clipboard

Challenge: Large language models (LLMs) generate information with hallucinations due to uneven retrieval quality and irrelevant contents.
Approach: They propose a decoding strategy which dynamically amplifies knowledge from selected documents during the generation phase.
Outcome: The proposed method outperforms other decoding strategies on ALCE-ASQA, NQ, TQA and PopQA benchmarks.
Understanding Programs by Exploiting (Fuzzing) Test Cases (2023.findings-acl)

Copied to clipboard

Challenge: Semantic understanding of programs has attracted great attention in the community . large language models (LLMs) are capable of learning contextual information from data at scale .
Approach: They propose to incorporate a relationship between inputs and possible outputs into learning for achieving a deeper semantic understanding of programs.
Outcome: The proposed method outperforms current state-of-the-art on two programming tasks and outperformed current state of the art by large margins.
QaRL: Rollout-Aligned Quantization-Aware RL for Fast and Stable Training under Training–Inference Mismatch (2026.findings-acl)

Copied to clipboard

Challenge: Recent work has shown that reinforcement learning with simple rule-based reward functions (RLVR) can induce emergent reasoning behaviors and yield gains in challenging domains such as math problem solving.
Approach: They propose a rollout-alignment-quantization-aware RL which aligns training-side forward with the quantized rollout to minimize mismatch.
Outcome: The proposed approach outperforms quantized-rollout training by +5.5 on Qwen3-30B-A3B MoE for math problems while maintaining low-bit throughput.
LCMA-SRT: Language-Conditional Mixture-of-Experts Adapters for Joint Multilingual Speech Recognition and Translation (2026.acl-long)

Copied to clipboard

Challenge: Existing hierarchical transducers suffer from negative transfer and unstable target-language generation, while training separate models for each direction is computationally prohibitive.
Approach: They propose a hierarchical transducer with language-conditional Mixture-of-Experts adapters to improve multilingual joint automatic speech recognition and speech translation.
Outcome: Experiments on Europarl-ST (9 languages, 72 directions) show that LCMA-SRT improves both ASR and ST within a single joint model, reducing average WER and improving BLEU and COMET over strong hierarchical transducer baselines.
Enhancing Large Language Models for Document-Level Translation Post-Editing Using Monolingual Data (2025.coling-main)

Copied to clipboard

Challenge: Large Language Models (LLMs) have excellent performance in many tasks, but they still face challenges in document translation.
Approach: They propose a method that leverages the capabilities of Large Language Models to optimize document translation using only monolingual data.
Outcome: The proposed method improves translation quality and improves contextual consistency in document translation using only monolingual data.
NORMSAGE: Multi-Lingual Multi-Cultural Norm Discovery from Conversations On-the-Fly (2023.emnlp-main)

Copied to clipboard

Challenge: Existing methods to understand acceptable behavior have focused on a single culture and manually built datasets from non-conversational settings.
Approach: They propose a framework to automatically extract culture-specific norms from multi-lingual conversations.
Outcome: The proposed framework extracts culture-specific norms from multi-lingual conversations.
Combining the Best of Both Worlds: A Method for Hybrid NMT and LLM Translation (2025.findings-acl)

Copied to clipboard

Challenge: Large language models have advantages over neural machine translation systems, but they suffer from high computational costs and significant latency.
Approach: They propose a scheduling policy that optimizes translation result while ensuring fast speed and as little LLM usage as possible.
Outcome: The proposed model achieves optimal translation performance with less LLM usage on multilingual test sets.
VEG: Verbal 𝜖-greedy for Semantic Exploration in Multi-Turn RL Agents (2026.acl-industry)

Copied to clipboard

Challenge: Standard RL approaches suffer from reward sparsity and mode-seeking behavior . lack of diversity hinders exploration necessary for optimal learning .
Approach: They propose a framework that leverages external feedback as a dynamic control variable to explicitly balance exploration and exploitation within the semantic space.
Outcome: Experiments on Tau Bench and SearchQA show that the proposed framework outperforms standard RL baselines.
The Program Testing Ability of Large Language Models for Code (2024.emnlp-industry)

Copied to clipboard

Challenge: Recent development of large language models (LLMs) for code shows promise in achieving code intelligence.
Approach: They explore the ability of large language models to generate automated test cases . they show +11.77% and +4.22% higher code pass rates on HumanEval+ .
Outcome: The proposed models show higher pass rates on humanEval+ compared with the current state-of-the-art models.
LeTS: Learning to Think-and-Search via Process-and-Outcome Reward Hybridization (2025.emnlp-main)

Copied to clipboard

Challenge: Recent research focuses on integrating reasoning capabilities into the realm of retrieval-augmented generation (RAG) via outcome-supervised reinforcement learning (RL).
Approach: They propose a process-level reward module to mitigate the unawareness of intermediate reasoning steps in outcome-level supervision without additional annotation.
Outcome: The proposed framework can boost LLMs’ reasoning ability by integrating external knowledge sources through retrieval-augmented generation (RAG) The proposed model can mitigate the unawareness of intermediate reasoning steps in outcome-level supervision without additional annotation.
Improving Contextual Query Rewrite for Conversational AI Agents through User-preference Feedback Learning (2023.emnlp-industry)

Copied to clipboard

Challenge: Contextual query rewriting (CQR) is a crucial component in Conversational AI agents, leveraging contextual information from previous user-agent conversations to improve comprehension of current user intent.
Approach: They propose a framework to enhance the CQR model's capability in generating user preference-aligned rewrites.
Outcome: The proposed framework improves the CQR model's ability to generate user preference-aligned rewrites.
CFinBench: A Comprehensive Chinese Financial Benchmark for Large Language Models (2025.naacl-long)

Copied to clipboard

Challenge: Large language models (LLMs) have achieved remarkable performance on various NLP tasks, yet their potential in more challenging task like finance, has not been fully explored.
Approach: They propose a benchmark to assess the financial knowledge of large language models (LLMs) in China.
Outcome: The proposed benchmark is the most comprehensive evaluation benchmark to date for LLMs in finance.
PAIGE: Personalized Adaptive Interactions Graph Encoder for Query Rewriting in Dialogue Systems (2022.emnlp-industry)

Copied to clipboard

Challenge: Existing methods to fix faulty queries are limited in their ability to fix them.
Approach: They propose a Personalized Adaptive Interactions Graph Encoder that integrates user's affinities and query semantics to refine utterance embeddings.
Outcome: The proposed Query Rewriting (QR) techniques improve the rewrite accuracy of state-of-the-art baselines by 12.5–17.5% while having nearly ten times fewer parameters.
Unveil: Unified Visual-Textual Integration and Distillation for Multi-modal Document Retrieval (2025.acl-long)

Copied to clipboard

Challenge: Document retrieval in real-world scenarios faces significant challenges due to diverse document formats and modalities.
Approach: They propose a visual-textual embedding framework that integrates textual and visual features for robust document representation.
Outcome: The proposed visual-textual embedding framework surpasses existing methods while preserving semantic fidelity.
DataArc-SynData-Toolkit: A Unified Closed-Loop Framework for Multi-Path, Multimodal, and Multilingual Data Synthesis (2026.acl-demo)

Copied to clipboard

Challenge: Existing synthetic data tools are limited by convoluted workflows, fragmented data standards, and limited scalability across modalities.
Approach: They develop an open-source framework that aims to reduce the technical barrier to synthetic data generation and subsequent model training.
Outcome: The proposed framework achieves an optimal balance between generation efficiency and data quality.
LONG2RAG: Evaluating Long-Context & Long-Form Retrieval-Augmented Generation with Key Point Recall (2024.findings-emnlp)

Copied to clipboard

Challenge: Retrieval-augmented generation (RAG) is a promising approach to address limitations of fixed knowledge in large language models.
Approach: They propose a benchmark and a metric to assess LLMs' ability to generate long-form responses that exploit retrieved information.
Outcome: The proposed benchmarks lack a comprehensive evaluation method to assess LLMs' ability to generate long-form responses that effectively exploits retrieved information.
GMN: Generative Multi-modal Network for Practical Document Information Extraction (2022.naacl-main)

Copied to clipboard

Challenge: Document Information Extraction (DIE) has attracted increasing attention due to its various advanced applications in the real world.
Approach: They propose a multi-modal generation method without predefined label categories for real-world scenarios using a spatial encoder and modal-aware mask module.
Outcome: The proposed method can deal with complex documents that are hard to serialize into sequential order.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations