Papers by Yang Junjie

45 papers
Muse: Towards Reproducible Long-Form Song Generation with Fine-Grained Style Control (2026.findings-acl)

Copied to clipboard

Challenge: Recent commercial systems such as Suno demonstrate strong capabilities in long-form song generation, but academic research remains non-reproducible due to the lack of publicly available training data.
Approach: They propose a system for long-form song generation with fine-grained style conditioning that includes a licensed synthetic dataset and a song generation model, Muse.
Outcome: The proposed system achieves competitive performance on phoneme error rate, text–music style similarity, and audio aesthetic quality while enabling controllable segment-level generation across different musical structures.
DentalGPT: Incentivizing Multimodal Reasoning in Dentistry (2026.findings-acl)

Copied to clipboard

Challenge: Current multimodal large language models (MLLMs) show limited understanding of dental images.
Approach: They propose a dental-specialized multimodal large language model trained via staged multimodal alignment and reinforcement learning.
Outcome: The proposed model outperforms state-of-the-art models on disease classification and dental VQA tasks.
FinToolSyn: A forward synthesis Framework for Financial Tool-Use Dialogue Data with Dynamic Tool Retrieval (2026.findings-acl)

Copied to clipboard

Challenge: Existing data synthesis methods rely on static tools to generate queries . this approach fails to capture the implicit, event-driven nature of real-world needs .
Approach: They propose a forward synthesis framework to generate high-quality financial dialogues . they construct a repository of 43,066 tools and synthesize over 148k dialogue instances .
Outcome: Experiments show that models trained on FinToolSyn achieve a 21.06% improvement . the framework is designed to generate high-quality financial dialogues .
TableVista: Benchmarking Multimodal Table Reasoning under Visual and Structural Complexity (2026.findings-acl)

Copied to clipboard

Challenge: TableVista evaluates multimodal table reasoning under visual and structural complexity . current models struggle to maintain reasoning consistency when structural complexity combined with visually integrated presentations.
Approach: They propose a benchmark for evaluating multimodal table reasoning under visual and structural complexity.
Outcome: The proposed model performs poorly on visual and structural complexity.
Repairing Catastrophic-Neglect in Text-to-Image Diffusion Models via Attention-Guided Feature Enhancement (2024.findings-emnlp)

Copied to clipboard

Challenge: Text-to-Image Diffusion models generate high-quality images from textual descriptions, but they often produce images that do not fully align with the input prompts, resulting in semantic inconsistencies.
Approach: They propose an automated repair approach to address catastrophic-neglect in T2I DMs.
Outcome: The proposed model achieves 10.1%-16.3% higher Correct Rate in image generation compared to baselines.
AgentGym2: Benchmarking Large Language Model Agents in De-Idealized Real-World Environments (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks evaluate agents in simplified, idealized settings, relying on pre-packaged tool interfaces, overlooking critical steps, and assume inputs are clean and fully specified.
Approach: They propose a framework that evaluates language agents in simplified, idealized settings . they show that even SOTA systems like Gemini and GPT-5 struggle on AgentGym2 .
Outcome: Experiments on 15 proprietary and open-source models show that even SOTA systems like Gemini and GPT-5 struggle on AgentGym2 .
WebClipper: Efficient Evolution of Web Agents with Graph-based Trajectory Pruning (2026.acl-long)

Copied to clipboard

Challenge: Open-source web agents rely on long tool-call trajectories with cyclic reasoning loops and exploration of unproductive branches.
Approach: They propose a framework that compresses web agent trajectories via graph-based pruning.
Outcome: The proposed framework reduces tool-call rounds by 20% while improving accuracy and efficiency while maintaining the same level of performance as existing models.
ToolBeHonest: A Multi-level Hallucination Diagnostic Benchmark for Tool-Augmented Large Language Models (2024.emnlp-main)

Copied to clipboard

Challenge: Currently, tool-augmented large language models (LLMs) only achieve total scores of 45.3 and 37.0, respectively, on a scale of 100.
Approach: They propose a multi-level diagnostic process to assess the LLM's hallucinations through two perspectives: depth and breadth.
Outcome: The proposed diagnostic process assesses the hallucinations of large language models through two perspectives: depth and breadth.
Learning to Plan for Retrieval-Augmented Large Language Models from Knowledge Graphs (2024.findings-emnlp)

Copied to clipboard

Challenge: Recent studies have attempted to enhance the performance of large language models (LLMs) in complex question-answering (QA) tasks by combining step-wise planning with external retrieval.
Approach: They propose a framework for enhancing LLMs’ planning capabilities by using planning data derived from knowledge graphs (KGs).
Outcome: The proposed framework improves LLMs’ planning capabilities by using knowledge graphs (KGs) the proposed framework is compared with existing frameworks on multiple datasets and shows that it is effective for large language models.
JailbreakRadar: Comprehensive Assessment of Jailbreak Attacks Against LLMs (2025.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) have been used to mitigate misuse and to align with human values.
Approach: They propose to use large-scale evaluations of various jailbreak attacks to identify key patterns and test them under eight advanced defenses.
Outcome: The proposed attacks achieve high success rates but are easy to mitigate by defenses.
Beyond Demographics: Aligning Role-playing LLM-based Agents Using Human Belief Networks (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing large language models can be prompted to role-play as individuals with particular demographic traits, but results are often human-like.
Approach: They found that seeding LLM-based agents with a single belief improved alignment . they say that role-playing based on demographic information does not improve alignment a .
Outcome: The proposed approach improves LLM alignment with human behavior . seeding agents with a single belief improves alignment for topics related to the belief network .
Document-level Multi-aspect Sentiment Classification by Jointly Modeling Users, Aspects, and Overall Ratings (C18-1)

Copied to clipboard

Challenge: Existing approaches focus on text information, but authors and overall ratings are ignored, both of which are proved to be significant on interpreting the sentiments of different aspects.
Approach: They propose a hierarchical user-aspect rating network model to consider user preference and overall ratings jointly.
Outcome: The proposed model can predict aspects of a product in two real-world datasets.
STAD: Self-Training with Ambiguous Data for Low-Resource Relation Extraction (2022.coling-1)

Copied to clipboard

Challenge: Existing approaches for low-resource relation extraction use only confident instances and uncertain instances.
Approach: They propose a self-training approach for low-resource relation extraction using auto-annotated instances.
Outcome: The proposed method improves on two widely used datasets with low-resource settings.
Agentic Episodic Control (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods for reinforcement learning (RL) are limited by poor data efficiency and weak generalization.
Approach: They propose a novel architecture that integrates large language models into episodic RL.
Outcome: The proposed architecture achieves 2–6 higher data efficiency than baselines and is the only method to solve complex tasks like UnlockLocal with over 90% success.
Zero-Shot Learners for Natural Language Understanding via a Unified Multiple Choice Perspective (2022.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to zero-shot learning are format-agnostic and can address new learning tasks without additional training.
Approach: They propose a new paradigm for zero-shot learning that is format agnostic and compatible with any format and applicable to a list of language tasks.
Outcome: The proposed model shows state-of-the-art performance on several benchmarks and produces satisfactory results on tasks such as text classification and commonsense reasoning.
MulDimIF: A Multi-Dimensional Constraint Framework for Evaluating and Improving Instruction Following in Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Existing research has focused on constraint categories, offering little guidance for improving instruction following abilities.
Approach: They propose a multi-dimensional constraint framework that allows for instruction following . they construct 9,106 code-verifiable samples and evaluate 18 LLMs .
Outcome: The proposed framework improves instruction following performance without compromising general performance.
MIRTT: Learning Multimodal Interaction Representations from Trilinear Transformers for Visual Question Answering (2021.findings-emnlp)

Copied to clipboard

Challenge: Existing bilinear methods focus on inter-modality information between images and questions . existing models focus on the interaction between images, questions, and images .
Approach: They propose a trilinear interaction framework that incorporates attention mechanisms for capturing inter-modality and intra-modal relationships.
Outcome: The proposed model outperforms bilinear models on the Visual7W Telling task and VQA-1.0 Multiple Choice task and outperformed baselines on the VQA, TDIUC and GQA datasets.
Beyond Boundaries: Learning a Universal Entity Taxonomy across Datasets and Languages for Open Named Entity Recognition (2025.coling-main)

Copied to clipboard

Challenge: Current Large Language Models struggle with complex entity taxonomies in open domains and lack NER capabilities.
Approach: They propose a dataset to guide LLMs' generalization in Open NER under a universal entity taxonomy.
Outcome: The proposed model outperforms GPT-4 in 3 out-of-domain benchmarks across 15 datasets and 6 languages.
Play Guessing Game with LLM: Indirect Jailbreak Attack with Implicit Clues (2024.findings-acl)

Copied to clipboard

Challenge: Existing jailbreak attacks primarily utilize scenario camouflage techniques, however their explicit mention of malicious intent will be easily recognized and defended by LLMs.
Approach: They propose an indirect jailbreak attack approach, Puzzler, which can bypass LLM’s defensive strategies and obtain malicious response by implicitly providing LLMs with some clues about the original malicious query.
Outcome: The proposed approach can bypass the LLM’s defensive strategies and obtain malicious response by implicitly providing LLMs with some clues about the original malicious query.
Measuring Data Diversity for Instruction Tuning: A Systematic Analysis and A Reliable Metric (2025.acl-long)

Copied to clipboard

Challenge: Existing studies have explored various diversity-aware data selection methods to construct high-quality datasets and enhance model performance.
Approach: They propose to use data diversity to measure instruction tuning of large language models.
Outcome: The proposed diversity metric outperforms existing methods on simulated and real-world data and shows that it captures diversity variations and achieves a 0.97 correlation with instruction tuning.
Benchmarking Machine Translation with Cultural Awareness (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing studies on terminology translation focus on breaking language barriers rather than cultural barriers.
Approach: They propose a parallel corpus enriched with CSI annotations in 6 language pairs for investigating Cultural-Aware Machine Translation.
Outcome: The proposed corpus is enriched with CSI annotations in 6 languages and measures translation quality.
Mimicking the Familiar: Dynamic Command Generation for Information Theft Attacks in LLM Tool-Learning System (2025.acl-long)

Copied to clipboard

Challenge: Existing approaches to attack Large Language Model (LLM) tool-learning systems are black-box oriented and rely on static commands that cannot adapt flexibly to the changes in user queries and the invocation chain.
Approach: They propose a dynamic attack comment generation approach for information theft attacks in LLM tool-learning systems that mimics the familiar by inferring the information utilized by upstream tools.
Outcome: The proposed approach outperforms baselines with +13.2% ASRTheft and can be generalized to new tool-learning systems to expose their information leakage risks.
Learning to Detect Noisy Labels Using Model-Based Features (2022.findings-emnlp)

Copied to clipboard

Challenge: Existing approaches to reduce label noise rely on heuristics and sample losses.
Approach: They propose a method that transfers the noise distribution to a clean set and trains a model to distinguish noisy labels from clean ones using model-based features.
Outcome: Empirically, the proposed approach improves over strong baselines on a wide range of tasks including text classification and speech recognition.
EEE-QA: Exploring Effective and Efficient Question-Answer Representations (2024.lrec-main)

Copied to clipboard

Challenge: Current approaches to question answering rely on pre-trained language models like RoBERTa.
Approach: They propose a pooling approach that embeds all answer candidates with the question . they also propose enabling cross-reference between answer choices .
Outcome: The proposed methods improve throughput and memory efficiency with little sacrifice in performance.
Retrieval-Augmented Generation with Hierarchical Knowledge (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing RAG methods do not utilize hierarchical knowledge in human cognition, which limits the capabilities of RAG systems.
Approach: They propose a graph-based approach that utilizes hierarchical knowledge to enhance the semantic understanding and structure capturing capabilities of RAG systems.
Outcome: The proposed approach achieves significant performance improvements over the state-of-the-art methods.
Vulnerability of Text-to-Image Models to Prompt Template Stealing: A Differential Evolution Approach (2025.findings-acl)

Copied to clipboard

Challenge: Prompt trading has emerged as a significant intellectual property concern in recent years, where vendors entice users by showcasing sample images before selling prompt templates that can generate similar images.
Approach: They propose a prompt-stealing benchmark consisting of 50 templates and 450 images organized into Easy and Hard difficulty levels.
Outcome: The proposed method outperforms baseline methods with an average improvement of over 10%.
LegalAgentBench: Evaluating LLM Agents in Legal Domain (2025.acl-long)

Copied to clipboard

Challenge: Existing general-domain benchmarks do not capture complexity of real-world judicial cognition and decision-making.
Approach: They propose a benchmark specifically designed to evaluate LLM Agents in the legal domain.
Outcome: The proposed benchmark includes 17 corpora from real-world legal scenarios and provides 37 tools for interacting with external knowledge.
TL-Training: A Task-Feature-Based Framework for Training Large Language Models in Tool Use (2025.findings-emnlp)

Copied to clipboard

Challenge: a new approach to training large language models (LLMs) overlooks task-specific characteristics in tool use, leading to performance bottlenecks.
Approach: They propose a task-feature-based framework that mitigates the effects of suboptimal training data . they use a dataset to train large-scale LLMs and a reward mechanism tailored to error categories .
Outcome: The proposed framework matches or surpasses open- and closed-source LLMs in tool-use performance using only 1,217 training data points.
GroupRank: A Groupwise Paradigm for Effective and Efficient Passage Reranking with LLMs (2026.findings-acl)

Copied to clipboard

Challenge: Existing rankers excel in lexical-matching scenarios, while they struggle with complex queries requiring deep reasoning.
Approach: They propose a new paradigm that balances flexibility and context awareness to unlock the full potential of groupwise reranking.
Outcome: The proposed approach achieves a state-of-the-art 65.2 NDCG@10 on BRIGHT and surpasses baselines by 2.1 points on R2MED while delivering a 6.4 inference speedup.
UniEX: An Effective and Efficient Framework for Unified Information Extraction via a Span-extractive Perspective (2023.acl-long)

Copied to clipboard

Challenge: Existing approaches for information extraction (IE) are limited by the number of subtasks and the isolation of the subtask.
Approach: They propose a new paradigm for universal information extraction that is compatible with any schema format and applicable to a list of IE tasks.
Outcome: The proposed framework outperforms generative universal IE models on 14 benchmarks with the supervised setting and the state-of-the-art performance in low-resource scenarios.
One Shot Dominance: Knowledge Poisoning Attack on Retrieval-Augmented Generation Systems (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing knowledge poisoning attacks against RAG systems require multiple poisoned documents or can only function effectively on simplistic queries.
Approach: They propose a more realistic knowledge poisoning attack that poisons only a single document while remaining effective for complex multi-hop questions involving complex relationships between multiple elements.
Outcome: The proposed attack achieves success by poisoning only a single document while remaining effective for complex multi-hop questions involving complex relationships between multiple elements.
ProFit: Leveraging High-Value Signals in SFT via Probability-Guided Token Selection (2026.findings-acl)

Copied to clipboard

Challenge: Traditional fine-tuning ignores one-to-many nature of language, leading to overfitting . authors propose a method to fine- tune LLMs by leveraging tokens.
Approach: They propose a method to fine-tune Large Language Models by leveraging tokens to mask low-probability tokens.
Outcome: The proposed method outperforms baselines on general reasoning and mathematical benchmarks.
Supervised Optimism Correction: Be Confident When LLMs Are Sure (2025.findings-acl)

Copied to clipboard

Challenge: Recent advances in Large Language Models (LLMs) have demonstrated remarkable success across diverse tasks such as instruction following, code generation, and medical diagnosis.
Approach: They propose a supervised fine-tuning-based auxiliary loss for Q-value estimations during supervised refinement.
Outcome: The proposed method outperforms beam search on GSM8K, MATH, and GAOKAO on reasoning benchmarks.
Solving Math Word Problems via Cooperative Reasoning induced Language Models (2023.acl-long)

Copied to clipboard

Challenge: Large-scale pre-trained language models (PLMs) can be used to solve math word problems, but they lack fast adaptivity as humans.
Approach: They propose a cooperative reasoning-induced PLM for solving the math word problem . they use system 1 as the generator and system 2 as the verifier to generate reasoning paths .
Outcome: The proposed model improves on several mathematical reasoning datasets and achieves 9.6% improvement over baselines.
Towards Scalable Lightweight GUI Agents via Multi-role Orchestration (2026.findings-acl)

Copied to clipboard

Challenge: Advanced GUI agents suffer from prohibitive deployment costs on resource-constrained devices.
Approach: They propose a lightweight GUI agent with GUI-specific knowledge and task scalability . LAMO-3B supports monolithic execution and MAS-style orchestration .
Outcome: The proposed GUI agent LAMO-3B supports monolithic execution and MAS-style orchestration.
Analyzing the Effects of Supervised Fine-Tuning on Model Knowledge from Token and Parameter Levels (2025.emnlp-main)

Copied to clipboard

Challenge: Large language models (LLMs) acquire substantial world knowledge during pretraining, which is further shaped by post-training techniques such as supervised fine-tuning (SFT).
Approach: They evaluate closed-book question answering (CBQA) performance across five LLMs from the LLaMA-2 and LLama-3 families and examine the impact of supervised fine-tuning on model knowledge.
Outcome: The proposed model performance is 14% worse than models fine-tuned on 1,920 samples and 12% worse on 240 samples.
Chain-of-Reasoning: Towards Unified Mathematical Reasoning in Large Language Models via a Multi-Paradigm Perspective (2025.acl-long)

Copied to clipboard

Challenge: Existing work shows that LLMs rely on single-paradigm reasoning that limits their effectiveness across diverse tasks.
Approach: They propose a new framework that integrates multiple reasoning paradigms to enable synergistic collaboration.
Outcome: The proposed model outperforms current SOTA models in theorem proving tasks and the MATH benchmark in arithmetic tasks.
APEX: Learning Adaptive Priorities for Multi-Objective Alignment in Vision-Language Generation (2026.findings-acl)

Copied to clipboard

Challenge: APEX optimizes for text-to-image generation by combining learning potential, conflict penalty, and progress need.
Approach: They propose an algorithm that stabilizes heterogeneous rewards and dynamically schedules objectives . they propose a method that achieves better Pareto trade-offs across four heterogenous objectives based on P3 Adaptive Priorities .
Outcome: The proposed algorithm achieves better pareto trade-offs across four heterogeneous objectives while maintaining competitive OCR accuracy.
Towards Robust Neural Machine Translation (P18-1)

Copied to clipboard

Challenge: Small perturbations in the input can severely distort intermediate representations and thus impact translation quality of neural machine translation models.
Approach: They propose adversarial stability training to make encoder and decoder robust to perturbations by enabling them to behave similarly for the original input and its perturbed counterpart.
Outcome: The proposed approach improves translation quality and robustness over strong models on Chinese-English, English-German and English-French translation tasks.
Simulating Opinion Dynamics with Networks of LLM-based Agents (2024.findings-naacl)

Copied to clipboard

Challenge: Existing approaches to simulating opinion dynamics often over-simplify human behavior . authors propose refining LLMs with real-world discourse to better simulate evolution of beliefs .
Approach: They propose to use large language models to simulate opinion dynamics in groups of simulated agents . they found that LLM agents produce more accurate information than ABMs .
Outcome: The proposed model can be used to better simulate opinion dynamics in real-world discourses.
A.S.E: A Repository-Level Benchmark for Evaluating Security in AI-Generated Code (2026.findings-acl)

Copied to clipboard

Challenge: Existing security evaluation benchmarks lack relevance to real-world AI programming tasks . current LLMs struggle with secure coding, research shows .
Approach: They propose a repository-level evaluation benchmark to assess security of AI-generated code.
Outcome: The proposed framework mirrors real-world AI programming tasks and offers valuable insights into the state of AI code generation.
HoLLMwood: Unleashing the Creativity of Large Language Models in Screenwriting via Role Playing (2024.findings-emnlp)

Copied to clipboard

Challenge: Generative AI has demonstrated unprecedented creativity in the field of computer vision, yet such phenomena have not been observed in the realm of literary creation.
Approach: They propose a framework for unleashing the creativity of large language models (LLMs) they assign LLMs to different roles involved in real-world scenario, they write .
Outcome: The proposed framework outperforms baselines in terms of coherence, relevance, interestingness and overall quality on automatically generated screenplays.
Modeling Semantic Compositionality with Sememe Knowledge (P19-1)

Copied to clipboard

Challenge: Semantic compositionality (SC) is defined as the phenomenon that the meaning of a complex linguistic unit can be composed of the meanings of its constituents.
Approach: They propose to incorporate sememes into SC models and employ them in learning multiword expressions.
Outcome: The proposed models achieve significant performance boost compared to baseline methods without sememe knowledge.
Reconstruct Your Previous Conversations! Comprehensively Investigating Privacy Leakage Risks in Conversations with GPT Models (2024.emnlp-main)

Copied to clipboard

Challenge: Existing GPT models allow users to interact with them for multiple rounds to optimize the task execution.
Approach: They propose a conversation reconstruction attack targeting the contents of previous conversations between GPT models and benign users, i.e., the benign users’ input contents during their interaction with GPT.
Outcome: The proposed attacks demonstrate that GPT-4's defense mechanisms are ineffective against these attacks.
OntoGuard: Enforcing Action Admissibility for LLM Agents in Complex Interactive Environments (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches to large language models (LLMs) are limited by their ability to enforce environmental and behavioral admissibility.
Approach: They propose an ontological framework to guard LLM agents by enforcing environmental and behavioral admissibility.
Outcome: Experiments on ScienceWorld and VirtualHome show that OntoGuard can enforce environmental and behavioral admissibility while preventing invalid actions.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations