Papers by Weihua Luo
Copied to clipboard
| Challenge: | Neural machine translation models with deeper neural networks are difficult to train. |
| Approach: | They propose a MultiScale Collaborative framework to boost gradient back-propagation . they let each encoder block learn a fine-grained representation and enhance it . |
| Outcome: | The proposed framework outperforms baseline models on translation tasks with three translation directions and achieves a BLEU score of 30.56 on the English-to-German task. |
Copied to clipboard
| Challenge: | Document machine translation typically suffers from a lack of document-level bilingual data. |
| Approach: | They propose a document machine translation model that incorporates contextual information into the training signals by capturing cross-sentence dependency within the target document and cross sentence translation to make better use of contextual information. |
| Outcome: | The proposed model outperforms baselines on three benchmark datasets and significantly outperformed previous approaches. |
Copied to clipboard
| Challenge: | Existing methods to pretrain language models are limited by one-size-fits-all vocabulary . embeddings of mismatch tokens can be efficiently initialized in downstream tasks . |
| Approach: | They propose to extend pretrain-finetune pipeline with an embedding transfer step . plug-and-play embeddable generator is introduced to generate any input token . |
| Outcome: | The proposed approach allows for more efficient and better performed NLG models. |
Copied to clipboard
| Challenge: | Neural machine translation uses source and target word embeddings to improve translation quality . source and targeted word embeds are at the two ends of a long information processing procedure . |
| Approach: | They propose a method to shorten the distance between source and target words in neural machine translation by bridging source and targeting word embeddings. |
| Outcome: | The proposed method shortens the distance between source and target words in neural machine translation and strengthens their association. |
Copied to clipboard
| Challenge: | Recent research in mechanistic interpretability has revealed that Large Language models contain disentangled, human-understandable components. |
| Approach: | They propose a framework that first identifies causal task features through frequency recall and interventional filtering, then selects “Feature-Resonant Data” that maximally activates task features for fine-tuning. |
| Outcome: | The proposed framework outperforms existing models on mathematical reasoning, summarization, and translation tasks while using only 50% of the data. |
Copied to clipboard
| Challenge: | Existing approaches to enhance output diversity but compromise quality of outputs. |
| Approach: | They propose a training-free plug-and-play method that enhances output diversity while preserving generation quality. |
| Outcome: | The proposed method enhances output diversity while maintaining an optimal balance between diversity and quality. |
Copied to clipboard
| Challenge: | Neural machine translation (NMT) has achieved great success due to the ability to generate high-quality sentences. |
| Approach: | They propose a training strategy with a multi-task learning paradigm to build a faithfulness enhanced NMT model. |
| Outcome: | The proposed model can generate high-quality sentences that are very close to natural language. |
Copied to clipboard
| Challenge: | Existing detectors are limited in their ability to detect large language models generated content in multilingual environments. |
| Approach: | They propose a multilingual benchmark to evaluate advanced detectors across 8 dimensions to better align with real-world applications. |
| Outcome: | The proposed benchmark encompasses 8 languages commonly used in commercial contexts and collects human-written texts from 6 domains highly susceptible to LLM misuse. |
Copied to clipboard
| Challenge: | Existing work extends translation unit from single sentence to multiple sentences. |
| Approach: | They propose to introduce locality assumption as an inductive bias into Transformer and reduce the hypothesis space of attention from target to source. |
| Outcome: | The proposed model achieves state-of-the-art BLEU scores on three benchmark datasets. |
Copied to clipboard
| Challenge: | a monolingual speaker can learn to translate by looking up a bilingual dictionary . a novel task of machine translation (MT) is based on no parallel sentences but can refer to a ground-truth bilingual dictionary and large-scale monolingual corpora. |
| Approach: | They propose a task of machine translation that uses a bilingual dictionary and large-scale monolingual corpora to translate a monolingual speaker. |
| Outcome: | The proposed task is based on a bilingual dictionary and large scale monolingual corpora, while being independent on parallel sentences. |
Copied to clipboard
| Challenge: | Existing methods for neural machine translation only observe one source sentence at training time . this discrepancy in data distribution leads to a formidable learning challenge . |
| Approach: | They propose an uncertainty-aware semantic augmentation approach to capture universal semantic information among multiple source sentences and enhance hidden representations with this information. |
| Outcome: | The proposed approach outperforms baseline and existing methods on translation tasks. |
Copied to clipboard
| Challenge: | ComfyUI-R1 is the first large reasoning model for automated workflow generation. |
| Approach: | They propose a large reasoning model for automated workflow generation that builds on curated knowledge bases and a two-stage framework to fine-tune models for cold start and reinforcement learning for incentivizing reasoning capability. |
| Outcome: | The proposed model achieves 97% format validity rate, high pass rate, node-level and graph-level F1 scores, surpassing prior state-of-the-art methods that employ leading closed-source models such as GPT-4o and Claude series. |
Copied to clipboard
| Challenge: | Abstractive Sentence Summarization (ASSUM) is a monolingual task that focuses on grasping the core idea of the source sentence and presenting it as the summary. |
| Approach: | They propose to use monolingual ASSUM to train a cross-lingual ASL system . they propose to train the system on summary word generation and attention . |
| Outcome: | Experiments show that the proposed method improves on the monolingual ASSUM task. |
Copied to clipboard
| Challenge: | Existing approaches to improve contextual faithfulness treat the LLM as a black box, generating responses that are inconsistent with the provided context. |
| Approach: | They propose a framework for faithful RAG that operates in three stages: (i) fine-grained knowledge pruning to filter irrelevant context, (ii) latent conflict probing to identify hard conflicts in the model’s latent space, and (iv) conflict-aware attention to modulate attention heads toward faithful context integration. |
| Outcome: | Experiments show that ProbeRAG significantly improves both accuracy and contextual faithfulness. |
Copied to clipboard
| Challenge: | Current Information Seeking (InfoSeeking) agents struggle to maintain focus and coherence during long-horizon exploration, as tracking search states within one plain-text context is inherently fragile. |
| Approach: | They propose a structured planning framework that reformulates the InfoSeeking task as a Table Completion task. |
| Outcome: | The proposed framework outperforms state-of-the-art frameworks across three kinds of benchmarks, including multi-agent framework and commercial systems. |
Copied to clipboard
| Challenge: | Current neural machine translation systems translate a text sentence-by-sentence, ignoring cross-sentent links and dependencies. |
| Approach: | They propose a cache-based approach to modeling coherence for neural machine translation . they capture contextual information either from recently translated sentences or the entire document . |
| Outcome: | The proposed model improves on state-of-the-art translation models on many languages . it captures contextual information from recently translated sentences or the entire document . |
Copied to clipboard
| Challenge: | Query translation (QT) is a critical factor in successful cross-lingual information retrieval (CLIR). |
| Approach: | They propose to extend query translation (QT) with a domain transfer procedure to revise synthetic candidates to search-aware examples. |
| Outcome: | The proposed method outperforms baselines and domain transfer methods on translation quality and retrieval accuracy. |
Copied to clipboard
| Challenge: | kNN-MT uses pre-trained NMT model with token-level k-nearest-neighbor retrieval to improve translation accuracy. |
| Approach: | They propose a method that combines a pre-trained NMT model with token-level k-nearest-neighbor retrieval to improve translation accuracy. |
| Outcome: | The proposed method outperforms the existing model on four benchmark datasets and is open-source. |
Copied to clipboard
| Challenge: | Context-aware neural machine translation (NMT) remains challenging due to the lack of large-scale document-level parallel corpora. |
| Approach: | They propose to use large-scale parallel datasets and source-side monolingual documents to improve context-aware neural machine translation. |
| Outcome: | The proposed model can be used to translate both sentences and documents on four translation tasks. |
Copied to clipboard
| Challenge: | prevailing methods for machine translation are often hindered by misleading reward signals. |
| Approach: | They propose a framework that aligns large language models to human preferences . they propose 'M2PO' to correct the bias towards partial errors . |
| Outcome: | The proposed framework outperforms open-source models and achieves parity with proprietary models. |
Copied to clipboard
| Challenge: | ComfyUI-Copilot is a large language model-powered plugin for AI-driven art creation. |
| Approach: | They propose a large language model-powered plugin to enhance the usability of ComfyUI. |
| Outcome: | The new plugin improves the usability and efficiency of ComfyUI . it offers intelligent node and model recommendations and automated one-click workflow construction. |
Copied to clipboard
| Challenge: | Existing datasets for instruction-following are monolingual and centered on English . existing data are unable to capture linguistic and cultural subtle differences . |
| Approach: | They propose an extension of IFEval to a localized multilingual version called Marco-Bench-MIF . their benchmark addresses linguistic constraints and cultural references via translation and verification . |
| Outcome: | The proposed extension of IFEval to a localized multilingual version covers 30 languages with varying levels of localization. |
Copied to clipboard
| Challenge: | Large language models (LLMs) have shown promising advances in tackling human-level tasks, but generating workflows for collaborative AI systems remains a critical and challenging step. |
| Approach: | They propose a benchmark to evaluate LLMs’ ability to generate executable and instruction-following AIGC workflows in ComfyUI. |
| Outcome: | The proposed benchmarks show that LLMs can generate executable and instruction-following AIGC workflows in ComfyUI. |
Copied to clipboard
| Challenge: | Existing studies show that NMT models perform poorly in specific domains when in-domain parallel corpora are scarce or nonexistent. |
| Approach: | They propose an iterative domain-repaired back-translation framework to refine translations in bilingual data by round-trip translating monolingual sentences. |
| Outcome: | The proposed framework achieves 15.79 and 4.47 BLEU improvements over unadapted models and back-translation in domain-specific translations. |
Copied to clipboard
| Challenge: | Existing multilingual neural machine translation models fail to capture diversity and specificity of different languages, resulting in inferior performance against individual models that are sufficiently trained. |
| Approach: | They propose to integrate a language-aware interlingua into an Encoder-Decoder architecture to learn a semantic representation from the semantic spaces of different languages while allowing for language-specific specialization of a particular language pair. |
| Outcome: | The proposed model achieves remarkable improvements over state-of-the-art multilingual NMT models and produces comparable performance with strong individual models. |
Copied to clipboard
| Challenge: | Bilingual Lexicon Induction (BLI) aims to map words in one language to their translations in another. |
| Approach: | They propose a mechanism to combine static word embeddings and contextual representations to utilize the advantages of both paradigms. |
| Outcome: | The proposed method improves performance on supervised and unsupervised BLI benchmarks on all language pairs by average improving 3.2 points over baselines. |
Copied to clipboard
| Challenge: | Existing agent benchmarks neglect hierarchical rule application in real-world domains . a critical gap persists in numerous real-life professional domains where decision-making is governed by expert-written rules. |
| Approach: | They propose a benchmark requiring agents to assign a unique 10-digit Harmonized System (HS) Code to products by aligning their fuzzy attributes with strict tariff classification rules. |
| Outcome: | The proposed benchmarks lack hierarchical rule application capability in real-world domains . the proposed benchmark is based on e-commerce and is open-source . |
Copied to clipboard
| Challenge: | Neural machine translation (NMT) tasks require large amounts of parallel data to augment training. |
| Approach: | They propose a data augmentation paradigm that augments each training instance with an adjacency semantic region that could cover adequate variants of literal expression under the same meaning. |
| Outcome: | The proposed paradigm improves on the state-of-the-art in supervised neural machine translation tasks. |
Copied to clipboard
| Challenge: | Document understanding is critical for applications from financial analysis to scientific discovery. |
| Approach: | They propose a taxonomy based on domain, retrieval modality, and granularity and review advances involving graph structures and agentic frameworks. |
| Outcome: | The proposed model enables holistic retrieval and reasoning across all modalities, unlocking comprehensive document intelligence. |
Copied to clipboard
| Challenge: | Existing attention mechanisms for abstractive sentence summarization are based on rule-based methods and large-scale training corpora. |
| Approach: | They propose a contrastive attention mechanism that extends the sequence-to-sequence framework for abstractive sentence summarization task. |
| Outcome: | The proposed mechanism improves the state-of-the-art on the abstractive sentence summarization task. |
Copied to clipboard
| Challenge: | Existing agent benchmarks fail to evaluate an agent's real-world capacity to handle CAPTCHA . Existing benchmarks ignore this practical challenge, failing to evaluate agents' ability to handle complex visual CAPTchas. |
| Approach: | They propose a benchmark annotated with Weighted Pass Rate and a new metric to measure agent's ability to handle CAPTCHA. |
| Outcome: | The proposed benchmark outperforms current state-of-the-art closed-source models on mirrorCAPTCHA and achieves 9.4% higher average weighted pass rate and 2.13% higher average Completion degree. |
Copied to clipboard
| Challenge: | Current systems often fall short of this goal in settings where translation hinges on culturally grounded entities such as books, films, places, songs and idioms. |
| Approach: | They propose a framework that anchors supervision on a verifiable, entity-level reward signal and incorporates lightweight structural gates to stabilize optimization. |
| Outcome: | The proposed framework improves on XC-Translate and shows that it can learn a robust reasoning process rather than imitating reference translations. |
Copied to clipboard
| Challenge: | Existing approaches to cross-document relation extraction (RE) focus on identifying relations between head and tail entities from single sentence or document. |
| Approach: | They propose a hierarchical relation tree-based LLM-based hierarchic classification model for cross-document relation extraction (HCRE) based on predefined relations, the model can perform hierarchically classification level by level. |
| Outcome: | The proposed model outperforms existing baselines and validates its effectiveness. |
Copied to clipboard
| Challenge: | Low-resource language tokens are often routed to different experts than those activated by high-resourced inputs, which hinders their efficacy in multilingual contexts. |
| Approach: | They propose a framework to transfer specialized capabilities from high-resource languages as anchors to low-resourced languages by using a symmetric Jensen-Shannon constraint. |
| Outcome: | The proposed framework outperforms standard instruction tuning on 5 low-resource languages and 3 benchmarks. |
Copied to clipboard
| Challenge: | Large language models (LLMs) are pretrained on multilingual corpora but exhibit suboptimal performance on low-resource languages. |
| Approach: | They propose a framework that integrates representations from all encoder layers and an adaptive fusion-enhanced attention mechanism to enable layer-wise interaction between the LLM and the multilingual encoder. |
| Outcome: | Experiments on multilingual reasoning tasks show that the proposed framework outperforms baselines. |
Copied to clipboard
| Challenge: | Existing methods to constrain NMT use placeholder tags for lexicon words and hard constraints during decoding. |
| Approach: | They propose to use placeholder tags to replace lexicon words with target translations . they use a data augmentation method to make code-switched training data . |
| Outcome: | The proposed method improves translation quality without hurting unconstrained words. |
Copied to clipboard
| Challenge: | Recent efforts to distill large reasoning models into smaller lightweight models have shown competitive performances. |
| Approach: | They propose to distill long Chain-of-Thought data to improve SFT and RL methods by constructing data from scratch using Monte Carlo Tree Search. |
| Outcome: | The proposed method significantly improves reasoning performance on various benchmarks such as math (GSM8K, MATH, AIME). |
Copied to clipboard
| Challenge: | Existing methods to achieve zero-shot translation suffer from spurious correlations between output language and language invariant semantics. |
| Approach: | They propose a method that denoizes the autoencoder objective based on pivot language into traditional training objective to improve translation accuracy on zero-shot directions. |
| Outcome: | The proposed method eliminates spurious correlations and outperforms state-of-the-art methods on two benchmark machine translation datasets. |
Copied to clipboard
| Challenge: | a good translation should implicitly mirror user traits rather than translate the original content semantically. |
| Approach: | They propose a framework that captures user traits from historical inputs . they propose 'user-driven' NMT to model user behavior under a zero-shot learning fashion . |
| Outcome: | The proposed framework can capture user traits from historical inputs under zero-shot learning fashion. |
Copied to clipboard
| Challenge: | Conditional image generation is a popular and personalization-oriented task, but there are challenges in developing task-agnostic, reliable, and explainable evaluation metrics. |
| Approach: | They propose a unified agentic framework for comprehensive evaluation of conditional image generation tasks. |
| Outcome: | The proposed framework achieves a high correlation with human assessments on seven prominent image generation tasks. |
Copied to clipboard
| Challenge: | Recent efforts to train code large language models have been booming recently . however, this will incur significant costs in constructing data and training model considering the countless downstream scenarios. |
| Approach: | They propose a data construction strategy which decouples code LLMs’ abilities into two dimensions and constructs a lightweight training corpus that only covers a subset of target scenarios. |
| Outcome: | The proposed model can train a multilingual multitasking model using less data and training data. |
Copied to clipboard
| Challenge: | Multi-domain Neural Machine Translation (MMT) is a challenging task due to the extreme diversity of cross-domain wording and phrasing style, and the imperfections of training data distribution. |
| Approach: | They propose a factorized NMT model that divides domain-shared knowledge into domain-specific ones that are private for each constituent domain. |
| Outcome: | The proposed model achieves state-of-the-art performance and opens up new perspectives for multi-domain and open-domain applications. |
Copied to clipboard
| Challenge: | kNN-MT is a non-parametric method that uses nearest neighbor retrieval to translate out-of-domain sentences, rare words, etc. |
| Approach: | They propose a framework that directly uses in-domain monolingual sentences to build an effective datastore for k-nearest-neighbor retrieval. |
| Outcome: | The proposed framework improves translation accuracy with target-side monolingual data while achieving comparable performance with back-translation. |