Papers by Weihua Luo

43 papers
Multiscale Collaborative Deep Models for Neural Machine Translation (2020.acl-main)

Copied to clipboard

Challenge: Neural machine translation models with deeper neural networks are difficult to train.
Approach: They propose a MultiScale Collaborative framework to boost gradient back-propagation . they let each encoder block learn a fine-grained representation and enhance it .
Outcome: The proposed framework outperforms baseline models on translation tasks with three translation directions and achieves a BLEU score of 30.56 on the English-to-German task.
Context-Interactive Pre-Training for Document Machine Translation (2021.naacl-main)

Copied to clipboard

Challenge: Document machine translation typically suffers from a lack of document-level bilingual data.
Approach: They propose a document machine translation model that incorporates contextual information into the training signals by capturing cross-sentence dependency within the target document and cross sentence translation to make better use of contextual information.
Outcome: The proposed model outperforms baselines on three benchmark datasets and significantly outperformed previous approaches.
Bridging Subword Gaps in Pretrain-Finetune Paradigm for Natural Language Generation (2021.acl-long)

Copied to clipboard

Challenge: Existing methods to pretrain language models are limited by one-size-fits-all vocabulary . embeddings of mismatch tokens can be efficiently initialized in downstream tasks .
Approach: They propose to extend pretrain-finetune pipeline with an embedding transfer step . plug-and-play embeddable generator is introduced to generate any input token .
Outcome: The proposed approach allows for more efficient and better performed NLG models.
Attention Focusing for Neural Machine Translation by Bridging Source and Target Embeddings (P18-1)

Copied to clipboard

Challenge: Neural machine translation uses source and target word embeddings to improve translation quality . source and targeted word embeds are at the two ends of a long information processing procedure .
Approach: They propose a method to shorten the distance between source and target words in neural machine translation by bridging source and targeting word embeddings.
Outcome: The proposed method shortens the distance between source and target words in neural machine translation and strengthens their association.
From Insight to Action: A Novel Framework for Interpretability-Guided Data Selection in Large Language Models (2026.acl-long)

Copied to clipboard

Challenge: Recent research in mechanistic interpretability has revealed that Large Language models contain disentangled, human-understandable components.
Approach: They propose a framework that first identifies causal task features through frequency recall and interventional filtering, then selects “Feature-Resonant Data” that maximally activates task features for fine-tuning.
Outcome: The proposed framework outperforms existing models on mathematical reasoning, summarization, and translation tasks while using only 50% of the data.
G2: Guided Generation for Enhanced Output Diversity in LLMs (2025.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to enhance output diversity but compromise quality of outputs.
Approach: They propose a training-free plug-and-play method that enhances output diversity while preserving generation quality.
Outcome: The proposed method enhances output diversity while maintaining an optimal balance between diversity and quality.
Towards Enhancing Faithfulness for Neural Machine Translation (2020.emnlp-main)

Copied to clipboard

Challenge: Neural machine translation (NMT) has achieved great success due to the ability to generate high-quality sentences.
Approach: They propose a training strategy with a multi-task learning paradigm to build a faithfulness enhanced NMT model.
Outcome: The proposed model can generate high-quality sentences that are very close to natural language.
DetectRL-X: Towards Reliable Multilingual and Real-World LLM-Generated Text Detection (2026.acl-long)

Copied to clipboard

Challenge: Existing detectors are limited in their ability to detect large language models generated content in multilingual environments.
Approach: They propose a multilingual benchmark to evaluate advanced detectors across 8 dimensions to better align with real-world applications.
Outcome: The proposed benchmark encompasses 8 languages commonly used in commercial contexts and collects human-written texts from 6 domains highly susceptible to LLM misuse.
G-Transformer for Document-Level Machine Translation (2021.acl-long)

Copied to clipboard

Challenge: Existing work extends translation unit from single sentence to multiple sentences.
Approach: They propose to introduce locality assumption as an inductive bias into Transformer and reduce the hypothesis space of attention from target to source.
Outcome: The proposed model achieves state-of-the-art BLEU scores on three benchmark datasets.
Bilingual Dictionary Based Neural Machine Translation without Using Parallel Sentences (2020.acl-main)

Copied to clipboard

Challenge: a monolingual speaker can learn to translate by looking up a bilingual dictionary . a novel task of machine translation (MT) is based on no parallel sentences but can refer to a ground-truth bilingual dictionary and large-scale monolingual corpora.
Approach: They propose a task of machine translation that uses a bilingual dictionary and large-scale monolingual corpora to translate a monolingual speaker.
Outcome: The proposed task is based on a bilingual dictionary and large scale monolingual corpora, while being independent on parallel sentences.
Uncertainty-Aware Semantic Augmentation for Neural Machine Translation (2020.emnlp-main)

Copied to clipboard

Challenge: Existing methods for neural machine translation only observe one source sentence at training time . this discrepancy in data distribution leads to a formidable learning challenge .
Approach: They propose an uncertainty-aware semantic augmentation approach to capture universal semantic information among multiple source sentences and enhance hidden representations with this information.
Outcome: The proposed approach outperforms baseline and existing methods on translation tasks.
ComfyUI-R1: Exploring Reasoning Models for Workflow Generation (2026.findings-acl)

Copied to clipboard

Challenge: ComfyUI-R1 is the first large reasoning model for automated workflow generation.
Approach: They propose a large reasoning model for automated workflow generation that builds on curated knowledge bases and a two-stage framework to fine-tune models for cold start and reinforcement learning for incentivizing reasoning capability.
Outcome: The proposed model achieves 97% format validity rate, high pass rate, node-level and graph-level F1 scores, surpassing prior state-of-the-art methods that employ leading closed-source models such as GPT-4o and Claude series.
Zero-Shot Cross-Lingual Abstractive Sentence Summarization through Teaching Generation and Attention (P19-1)

Copied to clipboard

Challenge: Abstractive Sentence Summarization (ASSUM) is a monolingual task that focuses on grasping the core idea of the source sentence and presenting it as the summary.
Approach: They propose to use monolingual ASSUM to train a cross-lingual ASL system . they propose to train the system on summary word generation and attention .
Outcome: Experiments show that the proposed method improves on the monolingual ASSUM task.
Beyond Black-Box Interventions: Latent Probing for Faithful Retrieval-Augmented Generation (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches to improve contextual faithfulness treat the LLM as a black box, generating responses that are inconsistent with the provided context.
Approach: They propose a framework for faithful RAG that operates in three stages: (i) fine-grained knowledge pruning to filter irrelevant context, (ii) latent conflict probing to identify hard conflicts in the model’s latent space, and (iv) conflict-aware attention to modulate attention heads toward faithful context integration.
Outcome: Experiments show that ProbeRAG significantly improves both accuracy and contextual faithfulness.
Table-as-Search: Agentic Information Seeking is Table Completion (2026.findings-acl)

Copied to clipboard

Challenge: Current Information Seeking (InfoSeeking) agents struggle to maintain focus and coherence during long-horizon exploration, as tracking search states within one plain-text context is inherently fragile.
Approach: They propose a structured planning framework that reformulates the InfoSeeking task as a Table Completion task.
Outcome: The proposed framework outperforms state-of-the-art frameworks across three kinds of benchmarks, including multi-agent framework and commercial systems.
Modeling Coherence for Neural Machine Translation with Dynamic and Topic Caches (C18-1)

Copied to clipboard

Challenge: Current neural machine translation systems translate a text sentence-by-sentence, ignoring cross-sentent links and dependencies.
Approach: They propose a cache-based approach to modeling coherence for neural machine translation . they capture contextual information either from recently translated sentences or the entire document .
Outcome: The proposed model improves on state-of-the-art translation models on many languages . it captures contextual information from recently translated sentences or the entire document .
Domain Transfer based Data Augmentation for Neural Query Translation (2020.coling-main)

Copied to clipboard

Challenge: Query translation (QT) is a critical factor in successful cross-lingual information retrieval (CLIR).
Approach: They propose to extend query translation (QT) with a domain transfer procedure to revise synthetic candidates to search-aware examples.
Outcome: The proposed method outperforms baselines and domain transfer methods on translation quality and retrieval accuracy.
Adaptive Nearest Neighbor Machine Translation (2021.acl-short)

Copied to clipboard

Challenge: kNN-MT uses pre-trained NMT model with token-level k-nearest-neighbor retrieval to improve translation accuracy.
Approach: They propose a method that combines a pre-trained NMT model with token-level k-nearest-neighbor retrieval to improve translation accuracy.
Outcome: The proposed method outperforms the existing model on four benchmark datasets and is open-source.
Breaking the Corpus Bottleneck for Context-Aware Neural Machine Translation with Cross-Task Pre-training (2021.acl-long)

Copied to clipboard

Challenge: Context-aware neural machine translation (NMT) remains challenging due to the lack of large-scale document-level parallel corpora.
Approach: They propose to use large-scale parallel datasets and source-side monolingual documents to improve context-aware neural machine translation.
Outcome: The proposed model can be used to translate both sentences and documents on four translation tasks.
M2PO: Multi-Perspective Multi-Pair Preference Optimization for Machine Translation (2026.acl-long)

Copied to clipboard

Challenge: prevailing methods for machine translation are often hindered by misleading reward signals.
Approach: They propose a framework that aligns large language models to human preferences . they propose 'M2PO' to correct the bias towards partial errors .
Outcome: The proposed framework outperforms open-source models and achieves parity with proprietary models.
ComfyUI-Copilot: An Intelligent Assistant for Automated Workflow Development (2025.acl-demo)

Copied to clipboard

Challenge: ComfyUI-Copilot is a large language model-powered plugin for AI-driven art creation.
Approach: They propose a large language model-powered plugin to enhance the usability of ComfyUI.
Outcome: The new plugin improves the usability and efficiency of ComfyUI . it offers intelligent node and model recommendations and automated one-click workflow construction.
Marco-Bench-MIF: On Multilingual Instruction-Following Capability of Large Language (2025.acl-long)

Copied to clipboard

Challenge: Existing datasets for instruction-following are monolingual and centered on English . existing data are unable to capture linguistic and cultural subtle differences .
Approach: They propose an extension of IFEval to a localized multilingual version called Marco-Bench-MIF . their benchmark addresses linguistic constraints and cultural references via translation and verification .
Outcome: The proposed extension of IFEval to a localized multilingual version covers 30 languages with varying levels of localization.
ComfyFlow: Benchmarking LLMs for AIGC Workflow Generation (2026.findings-acl)

Copied to clipboard

Challenge: Large language models (LLMs) have shown promising advances in tackling human-level tasks, but generating workflows for collaborative AI systems remains a critical and challenging step.
Approach: They propose a benchmark to evaluate LLMs’ ability to generate executable and instruction-following AIGC workflows in ComfyUI.
Outcome: The proposed benchmarks show that LLMs can generate executable and instruction-following AIGC workflows in ComfyUI.
Iterative Domain-Repaired Back-Translation (2020.emnlp-main)

Copied to clipboard

Challenge: Existing studies show that NMT models perform poorly in specific domains when in-domain parallel corpora are scarce or nonexistent.
Approach: They propose an iterative domain-repaired back-translation framework to refine translations in bilingual data by round-trip translating monolingual sentences.
Outcome: The proposed framework achieves 15.79 and 4.47 BLEU improvements over unadapted models and back-translation in domain-specific translations.
Language-aware Interlingua for Multilingual Neural Machine Translation (2020.acl-main)

Copied to clipboard

Challenge: Existing multilingual neural machine translation models fail to capture diversity and specificity of different languages, resulting in inferior performance against individual models that are sufficiently trained.
Approach: They propose to integrate a language-aware interlingua into an Encoder-Decoder architecture to learn a semantic representation from the semantic spaces of different languages while allowing for language-specific specialization of a particular language pair.
Outcome: The proposed model achieves remarkable improvements over state-of-the-art multilingual NMT models and produces comparable performance with strong individual models.
Combining Static Word Embeddings and Contextual Representations for Bilingual Lexicon Induction (2021.findings-acl)

Copied to clipboard

Challenge: Bilingual Lexicon Induction (BLI) aims to map words in one language to their translations in another.
Approach: They propose a mechanism to combine static word embeddings and contextual representations to utilize the advantages of both paradigms.
Outcome: The proposed method improves performance on supervised and unsupervised BLI benchmarks on all language pairs by average improving 3.2 points over baselines.
HSCodeComp: A Realistic and Expert-level Agent Benchmark for Hierarchical Rule Application (2026.acl-long)

Copied to clipboard

Challenge: Existing agent benchmarks neglect hierarchical rule application in real-world domains . a critical gap persists in numerous real-life professional domains where decision-making is governed by expert-written rules.
Approach: They propose a benchmark requiring agents to assign a unique 10-digit Harmonized System (HS) Code to products by aligning their fuzzy attributes with strict tariff classification rules.
Outcome: The proposed benchmarks lack hierarchical rule application capability in real-world domains . the proposed benchmark is based on e-commerce and is open-source .
Learning to Generalize to More: Continuous Semantic Augmentation for Neural Machine Translation (2022.acl-long)

Copied to clipboard

Challenge: Neural machine translation (NMT) tasks require large amounts of parallel data to augment training.
Approach: They propose a data augmentation paradigm that augments each training instance with an adjacency semantic region that could cover adequate variants of literal expression under the same meaning.
Outcome: The proposed paradigm improves on the state-of-the-art in supervised neural machine translation tasks.
Scaling Beyond Context: A Survey of Multimodal Retrieval-Augmented Generation for Document Understanding (2026.acl-long)

Copied to clipboard

Challenge: Document understanding is critical for applications from financial analysis to scientific discovery.
Approach: They propose a taxonomy based on domain, retrieval modality, and granularity and review advances involving graph structures and agentic frameworks.
Outcome: The proposed model enables holistic retrieval and reasoning across all modalities, unlocking comprehensive document intelligence.
Contrastive Attention Mechanism for Abstractive Sentence Summarization (D19-1)

Copied to clipboard

Challenge: Existing attention mechanisms for abstractive sentence summarization are based on rule-based methods and large-scale training corpora.
Approach: They propose a contrastive attention mechanism that extends the sequence-to-sequence framework for abstractive sentence summarization task.
Outcome: The proposed mechanism improves the state-of-the-art on the abstractive sentence summarization task.
MirrorCAPTCHA: Wild CAPTCHA, Wild Distribution, Wild Web-based Platform Meet Multimodal LLM Agents (2026.acl-long)

Copied to clipboard

Challenge: Existing agent benchmarks fail to evaluate an agent's real-world capacity to handle CAPTCHA . Existing benchmarks ignore this practical challenge, failing to evaluate agents' ability to handle complex visual CAPTchas.
Approach: They propose a benchmark annotated with Weighted Pass Rate and a new metric to measure agent's ability to handle CAPTCHA.
Outcome: The proposed benchmark outperforms current state-of-the-art closed-source models on mirrorCAPTCHA and achieves 9.4% higher average weighted pass rate and 2.13% higher average Completion degree.
Incentivizing Parametric Knowledge via Reinforcement Learning with Verifiable Rewards for Cross-Cultural Entity Translation (2026.acl-long)

Copied to clipboard

Challenge: Current systems often fall short of this goal in settings where translation hinges on culturally grounded entities such as books, films, places, songs and idioms.
Approach: They propose a framework that anchors supervision on a verifiable, entity-level reward signal and incorporates lightweight structural gates to stabilize optimization.
Outcome: The proposed framework improves on XC-Translate and shows that it can learn a robust reasoning process rather than imitating reference translations.
HCRE: LLM-based Hierarchical Classification for Cross-Document Relation Extraction with a Prediction-then-Verification Strategy (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches to cross-document relation extraction (RE) focus on identifying relations between head and tail entities from single sentence or document.
Approach: They propose a hierarchical relation tree-based LLM-based hierarchic classification model for cross-document relation extraction (HCRE) based on predefined relations, the model can perform hierarchically classification level by level.
Outcome: The proposed model outperforms existing baselines and validates its effectiveness.
SARA: Unlocking Multilingual Knowledge in Mixture-of-Experts via Semantically Anchored Routing Alignment (2026.findings-acl)

Copied to clipboard

Challenge: Low-resource language tokens are often routed to different experts than those activated by high-resourced inputs, which hinders their efficacy in multilingual contexts.
Approach: They propose a framework to transfer specialized capabilities from high-resource languages as anchors to low-resourced languages by using a symmetric Jensen-Shannon constraint.
Outcome: The proposed framework outperforms standard instruction tuning on 5 low-resource languages and 3 benchmarks.
LayAlign: Enhancing Multilingual Reasoning in Large Language Models via Layer-Wise Adaptive Fusion and Alignment Strategy (2025.findings-naacl)

Copied to clipboard

Challenge: Large language models (LLMs) are pretrained on multilingual corpora but exhibit suboptimal performance on low-resource languages.
Approach: They propose a framework that integrates representations from all encoder layers and an adaptive fusion-enhanced attention mechanism to enable layer-wise interaction between the LLM and the multilingual encoder.
Outcome: Experiments on multilingual reasoning tasks show that the proposed framework outperforms baselines.
Code-Switching for Enhancing NMT with Pre-Specified Translation (N19-1)

Copied to clipboard

Challenge: Existing methods to constrain NMT use placeholder tags for lexicon words and hard constraints during decoding.
Approach: They propose to use placeholder tags to replace lexicon words with target translations . they use a data augmentation method to make code-switched training data .
Outcome: The proposed method improves translation quality without hurting unconstrained words.
Marco-o1 v2: Towards Widening The Distillation Bottleneck for Reasoning Models (2025.acl-long)

Copied to clipboard

Challenge: Recent efforts to distill large reasoning models into smaller lightweight models have shown competitive performances.
Approach: They propose to distill long Chain-of-Thought data to improve SFT and RL methods by constructing data from scratch using Monte Carlo Tree Search.
Outcome: The proposed method significantly improves reasoning performance on various benchmarks such as math (GSM8K, MATH, AIME).
Rethinking Zero-shot Neural Machine Translation: From a Perspective of Latent Variables (2021.findings-emnlp)

Copied to clipboard

Challenge: Existing methods to achieve zero-shot translation suffer from spurious correlations between output language and language invariant semantics.
Approach: They propose a method that denoizes the autoencoder objective based on pivot language into traditional training objective to improve translation accuracy on zero-shot directions.
Outcome: The proposed method eliminates spurious correlations and outperforms state-of-the-art methods on two benchmark machine translation datasets.
Towards User-Driven Neural Machine Translation (2021.acl-long)

Copied to clipboard

Challenge: a good translation should implicitly mirror user traits rather than translate the original content semantically.
Approach: They propose a framework that captures user traits from historical inputs . they propose 'user-driven' NMT to model user behavior under a zero-shot learning fashion .
Outcome: The proposed framework can capture user traits from historical inputs under zero-shot learning fashion.
A Unified Agentic Framework for Evaluating Conditional Image Generation (2025.acl-long)

Copied to clipboard

Challenge: Conditional image generation is a popular and personalization-oriented task, but there are challenges in developing task-agnostic, reliable, and explainable evaluation metrics.
Approach: They propose a unified agentic framework for comprehensive evaluation of conditional image generation tasks.
Outcome: The proposed framework achieves a high correlation with human assessments on seven prominent image generation tasks.
CodeM: Less Data Yields More Versatility via Ability Matrix (2024.findings-acl)

Copied to clipboard

Challenge: Recent efforts to train code large language models have been booming recently . however, this will incur significant costs in constructing data and training model considering the countless downstream scenarios.
Approach: They propose a data construction strategy which decouples code LLMs’ abilities into two dimensions and constructs a lightweight training corpus that only covers a subset of target scenarios.
Outcome: The proposed model can train a multilingual multitasking model using less data and training data.
Factorized Transformer for Multi-Domain Neural Machine Translation (2020.findings-emnlp)

Copied to clipboard

Challenge: Multi-domain Neural Machine Translation (MMT) is a challenging task due to the extreme diversity of cross-domain wording and phrasing style, and the imperfections of training data distribution.
Approach: They propose a factorized NMT model that divides domain-shared knowledge into domain-specific ones that are private for each constituent domain.
Outcome: The proposed model achieves state-of-the-art performance and opens up new perspectives for multi-domain and open-domain applications.
Non-Parametric Unsupervised Domain Adaptation for Neural Machine Translation (2021.findings-emnlp)

Copied to clipboard

Challenge: kNN-MT is a non-parametric method that uses nearest neighbor retrieval to translate out-of-domain sentences, rare words, etc.
Approach: They propose a framework that directly uses in-domain monolingual sentences to build an effective datastore for k-nearest-neighbor retrieval.
Outcome: The proposed framework improves translation accuracy with target-side monolingual data while achieving comparable performance with back-translation.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations