Papers by Haoyang Huang
MentalSeek-Dx: Towards Progressive Hypothetico-Deductive Reasoning for Real-world Psychiatric Diagnosis (2026.acl-long)
Copied to clipboard
Xiao Sun, null Ymyang, Xinyi Jiang, Yu Tian, Junnan Zhu, Jiang Zhong, Qin Lei, Jingwang Huang, Haoyang Zeng, Xinyu Zhou, Xin Xiao, Kaiwen Wei
| Challenge: | Mental health disorders represent a burgeoning global public health challenge . lack of ecological validity and fine-grained diagnostic supervision limits their utility . |
| Approach: | They propose a medical-specialized LLM trained to internalize clinical reasoning process through supervised trajectory construction and curriculum-based reinforcement learning. |
| Outcome: | The proposed model achieves state-of-the-art with only 14B parameters, establishing a clinically grounded framework for reliable psychiatric diagnosis. |
Unicoder: A Universal Language Encoder by Pre-training with Multiple Cross-lingual Tasks (D19-1)
Copied to clipboard
| Challenge: | Existing models that can handle cross-lingual tasks with limited or no training data are insensitive to different languages. |
| Approach: | They propose to use Unicoder to train models in one language and apply it to other languages. |
| Outcome: | Experiments show that Unicoder learns the mappings among different languages from more perspectives. |
Respond in my Language: Mitigating Language Inconsistency in Response Generation based on Large Language Models (2024.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) show strong instruction understanding ability across multiple languages, but are easily biased towards English in instruction tuning. |
| Approach: | They propose to use a model with Pseudo-Inconsistent Penalization to prevent the model from generating English responses when given non-English language prompts during training and prior Enhanced decoding to improve the language consistency of the model. |
| Outcome: | The proposed methods significantly improve the language consistency of the model without multilingual data. |
Multilingual Agreement for Multilingual Neural Machine Translation (2021.acl-short)
Copied to clipboard
| Challenge: | Existing models that only use auxiliary languages to encourage multilingual agreement ignore the relationships between different language pairs. |
| Approach: | They propose a multilingual agreement-based method which explicitly models the agreement between different translation directions by randomly substituting some fragments of the source language with their counterpart translations of auxiliary languages. |
| Outcome: | The proposed method improves on the multilingual translation task of 10 language pairs. |
Revamping Multilingual Agreement Bidirectionally via Switched Back-translation for Multilingual Neural Machine Translation (2024.findings-eacl)
Copied to clipboard
| Challenge: | Current multilingual agreement (MA) methods require parallel data between multiple language pairs, which is not always realistic and optimize the agreement in an ambiguous direction, which hampers the translation performance. |
| Approach: | They propose a novel multilingual agreement framework that optimizes agreement bidirectionally with the Kullback-Leibler Divergence loss. |
| Outcome: | The proposed method improves strong baselines on the task of multilingual neural machine translation with three benchmarks: TED Talks, News, and Europarl. |
Not All Languages Are Created Equal in LLMs: Improving Multilingual Capability by Cross-Lingual-Thought Prompting (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models (LLMs) demonstrate impressive multilingual capability, but their performance varies substantially across different languages. |
| Approach: | They propose a generic template prompt that stimulates cross-lingual and logical reasoning skills to enhance task performance across languages. |
| Outcome: | The proposed method improves multilingual capability across languages and covers high-resource and low-resourced languages. |
GanLM: Encoder-Decoder Pre-training with an Auxiliary Discriminator (2023.acl-long)
Copied to clipboard
Jian Yang, Shuming Ma, Li Dong, Shaohan Huang, Haoyang Huang, Yuwei Yin, Dongdong Zhang, Liqun Yang, Furu Wei, Zhoujun Li
| Challenge: | Existing pre-training methods underutilize the benefits of language understanding for generation. |
| Approach: | They propose a GAN-style model for encoder-decoder pre-training with an auxiliary discriminator. |
| Outcome: | The proposed model outperforms existing pre-trained models and achieves state-of-the-art performance. |
FinanceReasoning: Benchmarking Financial Numerical Reasoning More Credible, Comprehensive and Challenging (2025.acl-long)
Copied to clipboard
Zichen Tang, Haihong E, Ziyan Ma, Haoyang He, Jiacheng Liu, Zhongjun Yang, Zihua Rong, Rongjin Li, Kun Ji, Qing Huang, Xinyang Hu, Yang Liu, Qianhe Zheng
| Challenge: | Compared to existing benchmarks, FinanceReasoning provides three key advancements: (1) credibility; (2) comprehensiveness; (3) numerical precision; (4) complexity; (5) complexity; and (6) complexity. |
| Approach: | They propose a benchmark to evaluate the reasoning capabilities of large reasoning models (LRMs) in financial numerical reasoning problems. |
| Outcome: | The proposed benchmark exceeds existing benchmarks in 67.8% of financial concepts and formulas and is credible, comprehensive, and challenging. |
Hierarchical Context-aware Network for Dense Video Event Captioning (2021.acl-long)
Copied to clipboard
| Challenge: | Existing technologies for dense video event captioning generate fine-grained captions for all events in a long untrimmed video. |
| Approach: | They propose a hierarchical context-aware network for dense video event captioning to capture context from various aspects. |
| Outcome: | The proposed model outperforms the existing model on youcook2 and activitynet . it generates coherent captions for events in a long untrimmed video . |
TRIP: Accelerating Document-level Multilingual Pre-training via Triangular Document-level Pre-training on Parallel Data Triplets (2023.findings-emnlp)
Copied to clipboard
Hongyuan Lu, Haoyang Huang, Shuming Ma, Dongdong Zhang, Wai Lam, Zhaochuan Gao, Anthony Aue, Arul Menezes, Furu Wei
| Challenge: | Existing approaches to multilingual sequence-to-sequence pre-training rely on monolingual corpora and sometimes synthetic document-level bilingual corporata. |
| Approach: | They propose to leverage document-level trilingual parallel corpora to improve sequence-to-sequence multilingual pre-training by using a novel method called Grafting. |
| Outcome: | The proposed method achieves strong state-of-the-art (SOTA) scores on three multilingual document-level machine translation benchmarks and one cross-lingual abstractive summarization benchmark. |
LVP-M3: Language-aware Visual Prompt for Multilingual Multimodal Machine Translation (2022.emnlp-main)
Copied to clipboard
| Challenge: | Recent advances struggle to train a separate model for each language pair, which is costly and unaffordable when the number of languages increases in the real world. |
| Approach: | They propose to train different MMT models to support translations between different languages. |
| Outcome: | The proposed model is able to handle the above issues by providing a shared semantic space for multiple languages. |
BlonDe: An Automatic Evaluation Metric for Document-level Machine Translation (2022.naacl-main)
Copied to clipboard
Yuchen Jiang, Tianyu Liu, Shuming Ma, Dongdong Zhang, Jian Yang, Haoyang Huang, Rico Sennrich, Ryan Cotterell, Mrinmaya Sachan, Ming Zhou
| Challenge: | Standard evaluation metrics, e.g., BLEU, TER and METEOR, focus on the quality of translations at the sentence level and do not consider discourse-level features. |
| Approach: | They propose to use a metric to take discourse coherence into consideration by categorizing discourse-related spans and calculating the similarity-based F1 measure of categorized spans. |
| Outcome: | The proposed metric possesses better selectivity and interpretability at the document-level, and is more sensitive to document- level nuances. |
Language-Specific Neurons: The Key to Multilingual Capabilities in Large Language Models (2024.acl-long)
Copied to clipboard
Tianyi Tang, Wenyang Luo, Haoyang Huang, Dongdong Zhang, Xiaolei Wang, Xin Zhao, Furu Wei, Ji-Rong Wen
| Challenge: | Despite the impressive multilingual capabilities demonstrated by LLMs, the understanding of how these abilities develop and function remains nascent. |
| Approach: | They propose a novel detection method to pinpoint language-specific neurons within LLMs by selectively activating or deactivating these neurons. |
| Outcome: | The proposed method can “steer” the output language of LLMs by selectively activating or deactivating language-specific neurons. |
Chain-of-Dictionary Prompting Elicits Translation in Large Language Models (2024.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) have shown surprisingly good performance in multilingual neural machine translation . yet, they struggle with translating low-resource languages. |
| Approach: | They propose a framework that chained multilingual dictionaries to elicit translation abilities for LLMs . they show that CoD can significantly improve LLM translation by evoking more information . |
| Outcome: | The proposed framework improves on ChatGPT and InstructGPT's translation abilities. |
Not All Metrics Are Guilty: Improving NLG Evaluation by Diversifying References (2024.naacl-long)
Copied to clipboard
Tianyi Tang, Hongyuan Lu, Yuchen Jiang, Haoyang Huang, Dongdong Zhang, Xin Zhao, Tom Kocmi, Furu Wei
| Challenge: | Existing evaluation benchmarks with limited references may not accurately reflect the quality of the model’s hypotheses. |
| Approach: | They propose a method to enrich evaluation benchmarks by diversifying the expression of a single reference into multiple high-quality ones to cover the semantic space of the reference sentence as much as possible. |
| Outcome: | The proposed method can enhance evaluation benchmarks by diversifying the expression of reference into multiple high-quality ones to cover the semantic space of the reference sentence as much as possible. |
Improving the Robustness of Deep Reading Comprehension Models by Leveraging Syntax Prior (D19-58)
Copied to clipboard
| Challenge: | Recent studies indicate that the current machine reading comprehension systems suffer from weak robustness against adversarial samples. |
| Approach: | They propose to take sentence syntax as the leverage in the answer predicting process and exploit the syntactic elements of a question to improve the generalization and robustness of MRC models. |
| Outcome: | The proposed method improves generalization and robustness against adversarial samples, with performance well-maintained. |
Improving Multilingual Neural Machine Translation with Auxiliary Source Languages (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Prior work has shown that translating from multiple source languages improves translation quality. |
| Approach: | They propose to exploit multiple source sentences from auxiliary languages to improve multilingual translation in a more common scenario by using synthetic multi-source corpora. |
| Outcome: | Extensive experiments on Chinese/English-Japanese and a large-scale multilingual translation benchmark show that the proposed model outperforms the baseline model significantly by +4.0 BLEU. |