Papers by Junjie Chen

46 papers
Muse: Towards Reproducible Long-Form Song Generation with Fine-Grained Style Control (2026.findings-acl)

Copied to clipboard

Challenge: Recent commercial systems such as Suno demonstrate strong capabilities in long-form song generation, but academic research remains non-reproducible due to the lack of publicly available training data.
Approach: They propose a system for long-form song generation with fine-grained style conditioning that includes a licensed synthetic dataset and a song generation model, Muse.
Outcome: The proposed system achieves competitive performance on phoneme error rate, text–music style similarity, and audio aesthetic quality while enabling controllable segment-level generation across different musical structures.
DentalGPT: Incentivizing Multimodal Reasoning in Dentistry (2026.findings-acl)

Copied to clipboard

Challenge: Current multimodal large language models (MLLMs) show limited understanding of dental images.
Approach: They propose a dental-specialized multimodal large language model trained via staged multimodal alignment and reinforcement learning.
Outcome: The proposed model outperforms state-of-the-art models on disease classification and dental VQA tasks.
CRITICTOOL: Evaluating Self-Critique Capabilities of Large Language Models in Tool-Calling Error Scenarios (2025.emnlp-main)

Copied to clipboard

Challenge: a number of tools are used to perform complex tasks, but the tool utilization process can cause errors.
Approach: They propose a critique evaluation benchmark for tool learning that analyzes function-calling errors on tool evaluation benchmarks.
Outcome: The proposed critique evaluation benchmark holds diverse tool-use errors with varying complexities, which better reflects real-world scenarios.
TableVista: Benchmarking Multimodal Table Reasoning under Visual and Structural Complexity (2026.findings-acl)

Copied to clipboard

Challenge: TableVista evaluates multimodal table reasoning under visual and structural complexity . current models struggle to maintain reasoning consistency when structural complexity combined with visually integrated presentations.
Approach: They propose a benchmark for evaluating multimodal table reasoning under visual and structural complexity.
Outcome: The proposed model performs poorly on visual and structural complexity.
AgentGym2: Benchmarking Large Language Model Agents in De-Idealized Real-World Environments (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks evaluate agents in simplified, idealized settings, relying on pre-packaged tool interfaces, overlooking critical steps, and assume inputs are clean and fully specified.
Approach: They propose a framework that evaluates language agents in simplified, idealized settings . they show that even SOTA systems like Gemini and GPT-5 struggle on AgentGym2 .
Outcome: Experiments on 15 proprietary and open-source models show that even SOTA systems like Gemini and GPT-5 struggle on AgentGym2 .
ToolBeHonest: A Multi-level Hallucination Diagnostic Benchmark for Tool-Augmented Large Language Models (2024.emnlp-main)

Copied to clipboard

Challenge: Currently, tool-augmented large language models (LLMs) only achieve total scores of 45.3 and 37.0, respectively, on a scale of 100.
Approach: They propose a multi-level diagnostic process to assess the LLM's hallucinations through two perspectives: depth and breadth.
Outcome: The proposed diagnostic process assesses the hallucinations of large language models through two perspectives: depth and breadth.
Improving Discriminative Capability of Reward Models in RLHF Using Contrastive Learning (2024.emnlp-main)

Copied to clipboard

Challenge: Current methods rely on ranking losses to teach reward model to assess preferences, but they are susceptible to noise and ambiguous data, often failing to deeply understand human intentions.
Approach: They propose a method that incorporates contrastive learning into the reward modeling process to enhance generalization and stabilize the reinforcement learning training process.
Outcome: The proposed method enhances generalization of the reward model, stabilizes the reinforcement learning training process, and improves the final alignment with human preferences.
Learning to Plan for Retrieval-Augmented Large Language Models from Knowledge Graphs (2024.findings-emnlp)

Copied to clipboard

Challenge: Recent studies have attempted to enhance the performance of large language models (LLMs) in complex question-answering (QA) tasks by combining step-wise planning with external retrieval.
Approach: They propose a framework for enhancing LLMs’ planning capabilities by using planning data derived from knowledge graphs (KGs).
Outcome: The proposed framework improves LLMs’ planning capabilities by using knowledge graphs (KGs) the proposed framework is compared with existing frameworks on multiple datasets and shows that it is effective for large language models.
DEFT: Demystifying VLN Failures via a Unified Dual-View Explainability Framework for LLM-based Agents (2026.acl-long)

Copied to clipboard

Challenge: Existing interpretability methods isolate temporal criticality from feature salience, creating an alignment gap and failing to account for the behavioral instability of black-box agents.
Approach: They propose a unified dual-view framework that jointly analyzes when a decision is pivotal and what visual evidence grounds it.
Outcome: Extensive experiments on MatterPort3D show that DEFT outperforms baselines in both temporal and feature fidelity.
Improving Relation Extraction with Relational Paraphrase Sentences (2020.coling-main)

Copied to clipboard

Challenge: Existing annotated data is expensive and non-scalable, limiting performance of relation extraction models.
Approach: They propose to enrich relation expressions by relational paraphrase sentences by annotating human-annotated data.
Outcome: The proposed model improves performance even on a strong baseline.
ArchiDocGen: Multi-Agent Framework for Expository Document Generation in the Architectural Industry (2025.acl-industry)

Copied to clipboard

Challenge: drafting method statements is labor-intensive and time-consuming . traditional methods involve using static templates filled in manually by engineers .
Approach: They propose a framework that automates method statement generation by using multi-agent collaboration.
Outcome: The proposed framework achieves 4.38 ContentScore, excelling in specialization, completeness, organization, and clarity.
AdapterDistillation: Non-Destructive Task Composition with Knowledge Distillation (2023.emnlp-industry)

Copied to clipboard

Challenge: Recent work on learning from multiple tasks has shown that adding an extra fusion layer to implement knowledge composition is non-scalable for some applications.
Approach: They propose a two-stage knowledge distillation algorithm to extract task specific knowledge by using local data to train a student adapter.
Outcome: Experiments on frequently asked question retrieval in task-oriented dialog systems validate the efficiency of AdapterDistillation.
MENTOR: Efficient Autoregressive Image Generation with Balanced Multimodal Control (2026.findings-acl)

Copied to clipboard

Challenge: Recent text-to-image models achieve impressive visual quality but still face challenges in precise controllability, balancing multimodal inputs, and high training cost for multimodal image generation.
Approach: They propose an autoregressive framework with a two-stage training paradigm for controllable multimodal image generation.
Outcome: Extensive experiments on DreamBench++ and DreamBech show that the proposed framework achieves a strong balance between textual and visual guidance for controllable image generation.
STAD: Self-Training with Ambiguous Data for Low-Resource Relation Extraction (2022.coling-1)

Copied to clipboard

Challenge: Existing approaches for low-resource relation extraction use only confident instances and uncertain instances.
Approach: They propose a self-training approach for low-resource relation extraction using auto-annotated instances.
Outcome: The proposed method improves on two widely used datasets with low-resource settings.
Agentic Episodic Control (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods for reinforcement learning (RL) are limited by poor data efficiency and weak generalization.
Approach: They propose a novel architecture that integrates large language models into episodic RL.
Outcome: The proposed architecture achieves 2–6 higher data efficiency than baselines and is the only method to solve complex tasks like UnlockLocal with over 90% success.
MulDimIF: A Multi-Dimensional Constraint Framework for Evaluating and Improving Instruction Following in Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Existing research has focused on constraint categories, offering little guidance for improving instruction following abilities.
Approach: They propose a multi-dimensional constraint framework that allows for instruction following . they construct 9,106 code-verifiable samples and evaluate 18 LLMs .
Outcome: The proposed framework improves instruction following performance without compromising general performance.
APIRecX: Cross-Library API Recommendation via Pre-Trained Language Model (2021.emnlp-main)

Copied to clipboard

Challenge: API recommendation tools can help programmers use APIs by recommending which APIs to be used next given the APIs that have been written.
Approach: They propose a cross-library API recommendation approach that uses BPE to split API calls in each sequence and pre-train a GPT based language model.
Outcome: The proposed APIRecX can recommend APIs that are previously regarded as OOV . it can migrate knowledge of existing libraries to a new library and recommend API that is previously viewed as OVO .
QFinZero: A Unified Financial Toolchain for LLM-Based Trading Agents (2026.acl-demo)

Copied to clipboard

Challenge: Existing trading systems rely on fragmented and task-specific APIs, resulting in inconsistent schemas and limited reproducibility.
Approach: They propose a unified trading environment for large language model (LLM) agents that standardizes three core capabilities . they argue that such a standardized trading environment is essential for scalable research on LLM-based financial agents.
Outcome: The proposed trading environment reduces engineering overhead and supports reproducible evaluation through comprehensive logging and deterministic replay.
PHMOSpell: Phonological and Morphological Knowledge Guided Chinese Spelling Check (2021.acl-long)

Copied to clipboard

Challenge: False gram and phonological errors make Chinese spelling check difficult . a novel end-to-end trainable model outperforms existing methods .
Approach: They propose a trainable Chinese spelling check model that integrates phonological and visual information into a pre-trained language model.
Outcome: The proposed model outperforms existing state-of-the-art models on three benchmarks.
Data Augmentation using LLMs: Data Perspectives, Learning Paradigms and Challenges (2024.findings-acl)

Copied to clipboard

Challenge: Data augmentation (DA) is a key technique for enhancing model performance by diversifying training examples without the need for additional data collection.
Approach: They examine various strategies that utilize LLMs for data augmentation, including a novel exploration of learning paradigms where LLM-generated data is used for diverse forms of further training.
Outcome: The proposed approach addresses the primary open challenges faced by LLMs in the field of large language models and aims to serve as a comprehensive guide for researchers and practitioners.
Language Model Based Unsupervised Dependency Parsing with Conditional Mutual Information and Grammatical Constraints (2024.naacl-long)

Copied to clipboard

Challenge: Existing methods for unsupervised dependency parsing use difficult to interpret dependence scores.
Approach: They propose to use Conditional Mutual Information (CMI) to measure bi-lexical dependence and incorporate grammatical constraints into unsupervised parsing.
Outcome: The proposed model outperforms state-of-the-art models and grammar-based models in five languages and eight datasets.
Improving Mongolian-Chinese Neural Machine Translation with Morphological Noise (P19-2)

Copied to clipboard

Challenge: Existing models for Mongolian-Chinese translation are based on recurrent, convolutional neural networks or completely eliminate recurrence connections.
Approach: They propose a adversarial training model to alleviate the UNK problem in Mongolian-Chinese machine translation by adding a screener to the model to emphasize the added Mongolian morphological noise.
Outcome: The proposed model reduces training time and improves accuracy in Mongolian-Chinese translation tasks.
Learning to Detect Noisy Labels Using Model-Based Features (2022.findings-emnlp)

Copied to clipboard

Challenge: Existing approaches to reduce label noise rely on heuristics and sample losses.
Approach: They propose a method that transfers the noise distribution to a clean set and trains a model to distinguish noisy labels from clean ones using model-based features.
Outcome: Empirically, the proposed approach improves over strong baselines on a wide range of tasks including text classification and speech recognition.
CalibraEval: Calibrating Prediction Distribution to Mitigate Selection Bias in LLMs-as-Judges (2025.acl-long)

Copied to clipboard

Challenge: Empirical evaluations of large language models demonstrate that they improve performance in a wide range of tasks.
Approach: They propose a label-free method for mitigating selection bias during inference by reformulating debiasing as an optimization task.
Outcome: The proposed method mitigates selection bias and improves performance compared to existing methods.
LoRE: Enhancing Search Relevance with Progressive Chain-of-Thought and Preference Alignment (2026.findings-acl)

Copied to clipboard

Challenge: E-commerce search relevance is a critical component of retrieval systems.
Approach: They propose a large-generative model for search relevance that trains reasoning knowledge, multi-modal understanding and rule awareness into three core competencies.
Outcome: The proposed model outperforms GPT-5 in Macro-F1 and achieves 27% online gain.
EEE-QA: Exploring Effective and Efficient Question-Answer Representations (2024.lrec-main)

Copied to clipboard

Challenge: Current approaches to question answering rely on pre-trained language models like RoBERTa.
Approach: They propose a pooling approach that embeds all answer candidates with the question . they also propose enabling cross-reference between answer choices .
Outcome: The proposed methods improve throughput and memory efficiency with little sacrifice in performance.
GUICourse: From General Vision Language Model to Versatile GUI Agent (2025.acl-long)

Copied to clipboard

Challenge: Graphical User Interfaces (GUIs) are a pivotal medium for human-computer interaction.
Approach: They propose a series of datasets for training visual-based GUI agents using general VLMs.
Outcome: The proposed GUICourse datasets show that even a small-sized GUI agent performs better on GUI tasks.
Retrieval-Augmented Generation with Hierarchical Knowledge (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing RAG methods do not utilize hierarchical knowledge in human cognition, which limits the capabilities of RAG systems.
Approach: They propose a graph-based approach that utilizes hierarchical knowledge to enhance the semantic understanding and structure capturing capabilities of RAG systems.
Outcome: The proposed approach achieves significant performance improvements over the state-of-the-art methods.
LegalAgentBench: Evaluating LLM Agents in Legal Domain (2025.acl-long)

Copied to clipboard

Challenge: Existing general-domain benchmarks do not capture complexity of real-world judicial cognition and decision-making.
Approach: They propose a benchmark specifically designed to evaluate LLM Agents in the legal domain.
Outcome: The proposed benchmark includes 17 corpora from real-world legal scenarios and provides 37 tools for interacting with external knowledge.
Seeing the Whole Elephant: A Benchmark for Failure Attribution in LLM-based Multi-Agent Systems (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks rely on partially observable traces that capture only agent outputs . lack of full execution traces obscures many failure causes, authors argue .
Approach: They propose a benchmark that allows attribution under full execution observability . they find full traces improve attribution accuracy by up to 76.5% over a partial-observation counterpart .
Outcome: The proposed benchmark improves attribution accuracy by up to 76.5% over a partial-observation counterpart.
Modeling Syntactic-Semantic Dependency Correlations in Semantic Role Labeling Using Mixture Models (2022.acl-long)

Copied to clipboard

Challenge: Existing methods for SRL identify semantic dependencies that specify the semantic role of arguments in relation to predicates.
Approach: They propose a mixture model-based end-to-end method to model syntactic-semantic dependency correlation in Semantic Role Labeling.
Outcome: The proposed method improves performance in English, German, and Spanish . it achieves small but statistically significant improvement over baseline methods .
TempParaphraser: “Heating Up” Text to Evade AI-Text Detection through Paraphrasing (2025.emnlp-main)

Copied to clipboard

Challenge: Existing detectors that perform well on benchmark datasets have weaknesses that can be exploited to manipulate AI-text.
Approach: They propose a framework that simulates high-temperature sampling effects through multiple normal-temperaturing generations, effectively evading detection.
Outcome: The proposed framework reduces detector accuracy by an average of 82.5% while preserving high text quality.
Supervised Optimism Correction: Be Confident When LLMs Are Sure (2025.findings-acl)

Copied to clipboard

Challenge: Recent advances in Large Language Models (LLMs) have demonstrated remarkable success across diverse tasks such as instruction following, code generation, and medical diagnosis.
Approach: They propose a supervised fine-tuning-based auxiliary loss for Q-value estimations during supervised refinement.
Outcome: The proposed method outperforms beam search on GSM8K, MATH, and GAOKAO on reasoning benchmarks.
Entity Relation Extraction as Dependency Parsing in Visually Rich Documents (2021.emnlp-main)

Copied to clipboard

Challenge: Existing studies on key information extraction from visually rich documents focus on labeling the text within bounding boxes, while relations between words are unexplored.
Approach: They propose to use a dependency parsing model to extract semantic entities from visually rich documents by combining entity labeling and relation extraction tasks.
Outcome: The proposed model achieves 65.96% F1 score on the FUNSD dataset.
Where Did It Go Wrong? Capability-Oriented Failure Attribution for Vision-and-Language Navigation Agents (2026.findings-acl)

Copied to clipboard

Challenge: Existing testing methods are system-level and provide limited insight into which capability deficiencies cause task failures.
Approach: They propose a capability-oriented testing approach that enables failure detection and attribution by seed selection and mutation.
Outcome: The proposed method detects more failure cases and pinpoints capability-level deficiencies than state-of-the-art baselines, providing more interpretable and actionable guidance for improving embodied agents.
Field Embedding: A Unified Grain-Based Framework for Word Representation (2021.naacl-main)

Copied to clipboard

Challenge: Current methods focus on learning word embeddings while linguistic information is discarded after the learning.
Approach: They propose a framework field embedding to jointly learn word and grain embedds by incorporating morphological, phonetic, and syntactical linguistic fields.
Outcome: The proposed framework integrates morphological, phonetic, and syntactical linguistic fields to learn word embeddings and grain embedds.
Towards Scalable Lightweight GUI Agents via Multi-role Orchestration (2026.findings-acl)

Copied to clipboard

Challenge: Advanced GUI agents suffer from prohibitive deployment costs on resource-constrained devices.
Approach: They propose a lightweight GUI agent with GUI-specific knowledge and task scalability . LAMO-3B supports monolithic execution and MAS-style orchestration .
Outcome: The proposed GUI agent LAMO-3B supports monolithic execution and MAS-style orchestration.
Feedback-Driven Tool-Use Improvements in Large Language Models via Automated Build Environments (2026.findings-acl)

Copied to clipboard

Challenge: Currently, there are no efficient reinforcement learning (RL) frameworks specifically designed for tool use.
Approach: They propose an automated environment construction pipeline that incorporates scenario decomposition, document generation, function integration, complexity scaling, and localized deployment to enable high-quality training environments without external tools.
Outcome: The proposed framework significantly improves the models’ tool-use performance without degrading their general capabilities.
APEX: Learning Adaptive Priorities for Multi-Objective Alignment in Vision-Language Generation (2026.findings-acl)

Copied to clipboard

Challenge: APEX optimizes for text-to-image generation by combining learning potential, conflict penalty, and progress need.
Approach: They propose an algorithm that stabilizes heterogeneous rewards and dynamically schedules objectives . they propose a method that achieves better Pareto trade-offs across four heterogenous objectives based on P3 Adaptive Priorities .
Outcome: The proposed algorithm achieves better pareto trade-offs across four heterogeneous objectives while maintaining competitive OCR accuracy.
ToolHop: A Query-Driven Benchmark for Evaluating Large Language Models in Multi-Hop Tool Use (2025.acl-long)

Copied to clipboard

Challenge: Effective evaluation of multi-hop tool use is critical for analyzing the understanding, reasoning, and function-calling capabilities of large language models.
Approach: They propose a dataset that provides rigorous evaluation of multi-hop tool use.
Outcome: The proposed model achieves 49.04% accuracy across five model families.
Unsupervised Parsing by Searching for Frequent Word Sequences among Sentences with Equivalent Predicate-Argument Structures (2024.findings-acl)

Copied to clipboard

Challenge: Unsupervised constituency parsing focuses on identifying word sequences that form a syntactic unit (i.e., constituents) in target sentences.
Approach: They propose a frequency-based parser that computes the span-overlap score as the word sequence’s frequency in the PAS-equivalent sentence set and identifies the constituent structure by finding a constituent tree with the maximum span- overlap score.
Outcome: The proposed method outperforms existing unsupervised parsers in eight out of ten languages and is more accurate than previous methods.
Concise and Organized Perception Facilitates Reasoning in Large Language Models (2025.findings-naacl)

Copied to clipboard

Challenge: Extensive experimental results on several popular logical benchmarks (ProofWriter, PrOntoQA, PrONtoQA-OOD, and FOLIO) and mathematical benchmark (DI-GSM) show that COP significantly outperforms previous state-of-the-art methods.
Approach: They propose a reasoning approach called Concise and Organized Perception (COP) that carefully analyzes the given statements to identify the most pertinent information while eliminating redundancy efficiently.
Outcome: The proposed approach outperforms state-of-the-art methods on several popular logical benchmarks and mathematical benchmarks.
A.S.E: A Repository-Level Benchmark for Evaluating Security in AI-Generated Code (2026.findings-acl)

Copied to clipboard

Challenge: Existing security evaluation benchmarks lack relevance to real-world AI programming tasks . current LLMs struggle with secure coding, research shows .
Approach: They propose a repository-level evaluation benchmark to assess security of AI-generated code.
Outcome: The proposed framework mirrors real-world AI programming tasks and offers valuable insights into the state of AI code generation.
HoLLMwood: Unleashing the Creativity of Large Language Models in Screenwriting via Role Playing (2024.findings-emnlp)

Copied to clipboard

Challenge: Generative AI has demonstrated unprecedented creativity in the field of computer vision, yet such phenomena have not been observed in the realm of literary creation.
Approach: They propose a framework for unleashing the creativity of large language models (LLMs) they assign LLMs to different roles involved in real-world scenario, they write .
Outcome: The proposed framework outperforms baselines in terms of coherence, relevance, interestingness and overall quality on automatically generated screenplays.
Modeling Semantic Compositionality with Sememe Knowledge (P19-1)

Copied to clipboard

Challenge: Semantic compositionality (SC) is defined as the phenomenon that the meaning of a complex linguistic unit can be composed of the meanings of its constituents.
Approach: They propose to incorporate sememes into SC models and employ them in learning multiword expressions.
Outcome: The proposed models achieve significant performance boost compared to baseline methods without sememe knowledge.
Towards Accurate and Consistent Evaluation: A Dataset for Distantly-Supervised Relation Extraction (2020.coling-main)

Copied to clipboard

Challenge: Distant Supervision (DS) generates large-scale annotated data but has wrong labels that result in incorrect evaluation scores during testing.
Approach: They build a dataset using DS-generated data as training data and hire annotators to label test data.
Outcome: The proposed dataset NYTH has a much larger test set and performs more accurate and consistent evaluation.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations