Papers by Yujie Yang
HTMuon: Improving Muon via Heavy-Tailed Spectral Correction (2026.findings-acl)
Copied to clipboard
| Challenge: | Muon’s orthogonalized update rule suppresses the emergence of heavy-tailed weight spectra and over-emphasizes the training along noise-dominated directions. |
| Approach: | They propose to preserve Muon's ability to capture parameter interdependencies while producing heavier-tailed updates and inducing heavier-tail weight spectra. |
| Outcome: | The proposed algorithm suppresses the emergence of heavy-tailed weight spectra and over-emphasizes training along noise-dominated directions. |
GLM: General Language Model Pretraining with Autoregressive Blank Infilling (2022.acl-long)
Copied to clipboard
| Challenge: | Existing pretraining frameworks do not perform well for all tasks of three main categories, such as natural language understanding (NLU), unconditional generation, and conditional generation. |
| Approach: | They propose a general language model based on autoregressive blank infilling to address this challenge. |
| Outcome: | The proposed model outperforms BERT, T5, and GPT on a wide range of tasks across NLU, conditional and unconditional generation tasks. |
ChildMandarin: A Comprehensive Mandarin Speech Dataset for Young Children Aged 3-5 (2025.acl-long)
Copied to clipboard
Jiaming Zhou, Shiyao Wang, Shiwan Zhao, Jiabei He, Haoqin Sun, Hui Wang, Cheng Liu, Aobo Kong, Yujie Guo, Xi Yang, Yequan Wang, Yonghua Lin, Yong Qin
| Challenge: | Automatic speech recognition systems have advanced significantly with models like Whisper, Conformer, and self-supervised frameworks such as Wav2vec 2.0. |
| Approach: | They propose to use Mandarin speech datasets to analyze pronunciation and tone of children aged 3 to 5 and evaluate their models on speaker verification (SV) They find that the datasets are more robust than those used by adult speech recognition systems and are open-source and available for all academic purposes. |
| Outcome: | The proposed dataset includes 41.25 hours of speech with carefully crafted manual transcriptions, collected from 397 speakers across various provinces in China, with balanced gender representation. |
A Learning-Exploring Method to Generate Diverse Paraphrases with Multi-Objective Deep Reinforcement Learning (2020.coling-main)
Copied to clipboard
| Challenge: | Paraphrase generation is of great importance for many downstream tasks in natural language processing. |
| Approach: | They propose a method to generate sentences as learning objectives from the learned data distribution and employ reinforcement learning to combine these new learning objectives for model training. |
| Outcome: | The proposed method gains significant diversity and improves generation quality over state-of-the-art datasets. |
Hierarchical Enhancement Framework for Aspect-based Argument Mining (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods have primarily treated ABAM as a nested named entity recognition problem, overlooking the need for tailored strategies to effectively address the specific challenges of ABA M tasks. |
| Approach: | They propose a layer-based Hierarchical Enhancement Framework (HEF) for Aspect-Based Argument Mining and introduce three new components to improve the performance and accuracy. |
| Outcome: | Experiments on multiple datasets and tasks verify the effectiveness of the proposed framework and components. |
Legal Fact Prediction: The Missing Piece in Legal Judgment Prediction (2025.emnlp-main)
Copied to clipboard
Junkai Liu, Yujie Tong, Hui Huang, Bowen Zheng, Yiran Hu, Peicheng Wu, Chuan Xiao, Makoto Onizuka, Muyun Yang, Shuyuan Zheng
| Challenge: | Existing studies use legal facts to predict judgments, but legal facts are difficult to obtain in early stages of litigation. |
| Approach: | They propose a legal fact prediction task that takes evidence from trial as input to make predictions in the absence of ground-truth legal facts. |
| Outcome: | The proposed task can predict court rulings without ground-truth legal facts . the first benchmark dataset, LFPBench, is used to evaluate the task . |
HGAdapter: Hypergraph-based Adapters in Language Models for Code Summarization and Clone Detection (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Pre-trained language models (PLMs) are increasingly being applied to code-related tasks. |
| Approach: | They propose a hypergraph-based adapter to capture high-order data correlations in code tokens . they improve hypergraph neural networks and combine it with adapter tuning to propose adapter . |
| Outcome: | The proposed adapter can encode high-order data correlations and be inserted into PLMs to enhance performance. |
ResearchBench: Benchmarking LLMs in Scientific Discovery via Inspiration-Based Task Decomposition (2026.findings-acl)
Copied to clipboard
Yujie Liu, Zonglin Yang, Tong Xie, Jinjie Ni, Ben Gao, Yuqiang Li, Shixiang Tang, Wanli Ouyang, Erik Cambria, Dongzhan Zhou
| Challenge: | Large language models have shown potential in assisting scientific research, yet their ability to discover high-quality research hypotheses remains unexamined due to the lack of a dedicated benchmark. |
| Approach: | They propose a benchmark for evaluating large language models on a sufficient set of scientific discovery sub-tasks. |
| Outcome: | The proposed framework extracts critical components from papers across 12 disciplines with expert validation confirming its accuracy. |
BMAM: Brain-inspired Multi-Agent Memory Framework (2026.findings-acl)
Copied to clipboard
| Challenge: | Language-model-based agents operating over extended interactions face persistent challenges in preserving temporally grounded information and maintaining behavioral consistency across sessions. |
| Approach: | They propose a general-purpose memory architecture that decomposes agent memory into six components that operate at complementary time scales. |
| Outcome: | BMAM outperforms memory-augmented baselines on LoCoMo benchmarks with 78.45% accuracy . a targeted refinement of the temporal-trigger heuristics raises LongMemEval multi-session accuracy from 45.2% to 56.4%. |
Evaluating Cognitive-Behavioral Fixation via Multimodal User Viewing Patterns on Social Media (2025.emnlp-main)
Copied to clipboard
| Challenge: | Digital media platforms often contribute to cognitive-behavioral fixation, a phenomenon in which users exhibit sustained and repetitive engagement with narrow content domains. |
| Approach: | They propose a multimodal topic extraction module and a cognitive-behavioral fixation quantification module that collaboratively enable adaptive, hierarchical, and interpretable assessment of user behavior. |
| Outcome: | The proposed framework lays the groundwork for scalable computational analysis of cognitive fixation. |
RAP-ID: Mechanistic Prompt Injection Detection via Impostor Behavior Analysis (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing defenses rely on externally deployed guardrail models or response inspection . current defenses depend on external guardrails or response inspecting . |
| Approach: | They propose a mechanistic, train-free detection framework that operates exclusively on internal state dynamics during the initial forward pass. |
| Outcome: | The proposed framework achieves competitive performance with significant overall improvements compared to heuristic methods. |
FewNLU: Benchmarking State-of-the-Art Methods for Few-Shot Natural Language Understanding (2022.acl-long)
Copied to clipboard
Yanan Zheng, Jing Zhou, Yujie Qian, Ming Ding, Chonghua Liao, Li Jian, Ruslan Salakhutdinov, Jie Tang, Sebastian Ruder, Zhilin Yang
| Challenge: | Existing evaluation protocols for few-shot natural language understanding (NLU) tasks are inconsistent and hinder fair comparison and measuring progress. |
| Approach: | They propose an evaluation framework that improves previous evaluation procedures in three key aspects, i.e., test performance, dev-test correlation, and stability. |
| Outcome: | The proposed framework improves evaluation procedures in three key aspects, i.e., performance, dev-test correlation, and stability. |
Sparse Brains are Also Adaptive Brains: Cognitive-Load-Aware Dynamic Activation for LLMs (2026.findings-eacl)
Copied to clipboard
| Challenge: | Existing sparsity methods lack adaptivity to contextual or model structural demands or incur prohibitive computational overhead. |
| Approach: | They propose a Cognitive-Load-Aware Dynamic Activation framework that synergizes statistical sparsity with semantic adaptability. |
| Outcome: | The proposed framework achieves 20% average speedup with less than 2% accuracy degradation outperforming Griffin and TT. |
Syntactically-Informed Unsupervised Paraphrasing with Non-Parallel Data (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies on syntactically controlled paraphrase generation rely on large-scale parallel data. |
| Approach: | They propose a syntactically-informed unsupervised paraphrasing model based on conditional variational auto-encoder which can generate texts in a specified syntastic structure. |
| Outcome: | The proposed model can generate diverse paraphrases with specified syntactic structure using non-parallel data. |
DenseSSM: State Space Models with Dense Hidden Connection for Efficient Large Language Models (2025.naacl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) face excessive computational and memory requirements due to the commonly used Transformer architecture. |
| Approach: | They propose a method to enhance the flow of hidden information between layers in large language models by selectively integrating shallow-layer hidden states into deeper layers. |
| Outcome: | The proposed method maintains parallelizability and inference efficiency of SSMs while significantly boosting performance on public benchmarks. |
AEGIS: A Holistic Benchmark for Evaluating Forensic Analysis of AI-Generated Academic Images (2026.acl-long)
Copied to clipboard
Bo Zhang, Tzu-Yen Ma, Zichen Tang, Junpeng Ding, Zirui Wang, Yizhuo Zhao, Peilin Gao, Zijie Xi, Zixin Ding, Haiyang Sun, Haocheng Gao, Yuan Liu, Liangjia Wang, Yiling Huang, Yujie Wang, Yuyue Zhang, Ronghui Xi, Yuanze Li, Jiacheng Liu, Zhongjun Yang, Haihong E
| Challenge: | AEGIS examines whether current models can effectively audit AI-generated images in academic papers. |
| Approach: | They propose a holistic benchmark for forensic analysis of AI-Generated academic ImageS that reveals limitations in academic image forensics. |
| Outcome: | AEGIS compared with existing benchmarks on seven academic categories and features key advances in forensic analysis. |
Few-Shot Document-Level Event Argument Extraction (2023.acl-long)
Copied to clipboard
| Challenge: | Event argument extraction (EAE) has been well studied at the sentence level but under-explored at the document level. |
| Approach: | They propose a Few-Shot Document-Level Event Argument Extraction benchmark to capture event arguments that actually spread across sentences in documents. |
| Outcome: | The proposed task is very challenging with low performance and limited learning process . argument extraction depends on context from multiple sentences and learning process limited to very few examples . |
Long Text Generation with Topic-aware Discrete Latent Variable Model (2022.emnlp-main)
Copied to clipboard
| Challenge: | Recent work focuses on the modeling of discourse relation, resulting in discrete codes learning shallow semantics. |
| Approach: | They propose a topic-aware latent code-guided text generation model that encourages discrete codes to model information about topics. |
| Outcome: | The proposed model generates more topic-relevant and coherent texts. |
Learning Structural Information for Syntax-Controlled Paraphrase Generation (2022.findings-naacl)
Copied to clipboard
| Challenge: | Syntax-controlled paraphrase generation aims to produce paraphrase conform to given syntactic patterns. |
| Approach: | They propose a model that captures parent-child and sibling relations and a syntax encoder to capture alignment relations. |
| Outcome: | The proposed model achieves state-of-the-art in terms of semantic and syntactic quality on two popular benchmark datasets. |
CTAP for Chinese:A Linguistic Complexity Feature Automatic Calculation Platform (2022.lrec-1)
Copied to clipboard
| Challenge: | Existing tools to analyze linguistic complexity are limited and different because of different research purposes. |
| Approach: | They propose to integrate Chinese component into CTAP to analyze linguistic complexity . they propose to use 196 linguistic complex indexes to calculate linguistic characteristics . |
| Outcome: | The proposed indexes are compared with three linguistic complexity tools for Chinese . the proposed index sets include four levels of 196 linguistic complex indexe . |