Papers by Junjie Chen
Copied to clipboard
| Challenge: | Recent commercial systems such as Suno demonstrate strong capabilities in long-form song generation, but academic research remains non-reproducible due to the lack of publicly available training data. |
| Approach: | They propose a system for long-form song generation with fine-grained style conditioning that includes a licensed synthetic dataset and a song generation model, Muse. |
| Outcome: | The proposed system achieves competitive performance on phoneme error rate, text–music style similarity, and audio aesthetic quality while enabling controllable segment-level generation across different musical structures. |
Copied to clipboard
| Challenge: | Current multimodal large language models (MLLMs) show limited understanding of dental images. |
| Approach: | They propose a dental-specialized multimodal large language model trained via staged multimodal alignment and reinforcement learning. |
| Outcome: | The proposed model outperforms state-of-the-art models on disease classification and dental VQA tasks. |
Copied to clipboard
| Challenge: | a number of tools are used to perform complex tasks, but the tool utilization process can cause errors. |
| Approach: | They propose a critique evaluation benchmark for tool learning that analyzes function-calling errors on tool evaluation benchmarks. |
| Outcome: | The proposed critique evaluation benchmark holds diverse tool-use errors with varying complexities, which better reflects real-world scenarios. |
Copied to clipboard
| Challenge: | TableVista evaluates multimodal table reasoning under visual and structural complexity . current models struggle to maintain reasoning consistency when structural complexity combined with visually integrated presentations. |
| Approach: | They propose a benchmark for evaluating multimodal table reasoning under visual and structural complexity. |
| Outcome: | The proposed model performs poorly on visual and structural complexity. |
Copied to clipboard
| Challenge: | Existing benchmarks evaluate agents in simplified, idealized settings, relying on pre-packaged tool interfaces, overlooking critical steps, and assume inputs are clean and fully specified. |
| Approach: | They propose a framework that evaluates language agents in simplified, idealized settings . they show that even SOTA systems like Gemini and GPT-5 struggle on AgentGym2 . |
| Outcome: | Experiments on 15 proprietary and open-source models show that even SOTA systems like Gemini and GPT-5 struggle on AgentGym2 . |
Copied to clipboard
| Challenge: | Currently, tool-augmented large language models (LLMs) only achieve total scores of 45.3 and 37.0, respectively, on a scale of 100. |
| Approach: | They propose a multi-level diagnostic process to assess the LLM's hallucinations through two perspectives: depth and breadth. |
| Outcome: | The proposed diagnostic process assesses the hallucinations of large language models through two perspectives: depth and breadth. |
Copied to clipboard
| Challenge: | Current methods rely on ranking losses to teach reward model to assess preferences, but they are susceptible to noise and ambiguous data, often failing to deeply understand human intentions. |
| Approach: | They propose a method that incorporates contrastive learning into the reward modeling process to enhance generalization and stabilize the reinforcement learning training process. |
| Outcome: | The proposed method enhances generalization of the reward model, stabilizes the reinforcement learning training process, and improves the final alignment with human preferences. |
Copied to clipboard
| Challenge: | Recent studies have attempted to enhance the performance of large language models (LLMs) in complex question-answering (QA) tasks by combining step-wise planning with external retrieval. |
| Approach: | They propose a framework for enhancing LLMs’ planning capabilities by using planning data derived from knowledge graphs (KGs). |
| Outcome: | The proposed framework improves LLMs’ planning capabilities by using knowledge graphs (KGs) the proposed framework is compared with existing frameworks on multiple datasets and shows that it is effective for large language models. |
Copied to clipboard
| Challenge: | Existing interpretability methods isolate temporal criticality from feature salience, creating an alignment gap and failing to account for the behavioral instability of black-box agents. |
| Approach: | They propose a unified dual-view framework that jointly analyzes when a decision is pivotal and what visual evidence grounds it. |
| Outcome: | Extensive experiments on MatterPort3D show that DEFT outperforms baselines in both temporal and feature fidelity. |
Copied to clipboard
| Challenge: | Existing annotated data is expensive and non-scalable, limiting performance of relation extraction models. |
| Approach: | They propose to enrich relation expressions by relational paraphrase sentences by annotating human-annotated data. |
| Outcome: | The proposed model improves performance even on a strong baseline. |
Copied to clipboard
| Challenge: | drafting method statements is labor-intensive and time-consuming . traditional methods involve using static templates filled in manually by engineers . |
| Approach: | They propose a framework that automates method statement generation by using multi-agent collaboration. |
| Outcome: | The proposed framework achieves 4.38 ContentScore, excelling in specialization, completeness, organization, and clarity. |
Copied to clipboard
| Challenge: | Recent work on learning from multiple tasks has shown that adding an extra fusion layer to implement knowledge composition is non-scalable for some applications. |
| Approach: | They propose a two-stage knowledge distillation algorithm to extract task specific knowledge by using local data to train a student adapter. |
| Outcome: | Experiments on frequently asked question retrieval in task-oriented dialog systems validate the efficiency of AdapterDistillation. |
Copied to clipboard
| Challenge: | Recent text-to-image models achieve impressive visual quality but still face challenges in precise controllability, balancing multimodal inputs, and high training cost for multimodal image generation. |
| Approach: | They propose an autoregressive framework with a two-stage training paradigm for controllable multimodal image generation. |
| Outcome: | Extensive experiments on DreamBench++ and DreamBech show that the proposed framework achieves a strong balance between textual and visual guidance for controllable image generation. |
Copied to clipboard
| Challenge: | Existing approaches for low-resource relation extraction use only confident instances and uncertain instances. |
| Approach: | They propose a self-training approach for low-resource relation extraction using auto-annotated instances. |
| Outcome: | The proposed method improves on two widely used datasets with low-resource settings. |
Copied to clipboard
| Challenge: | Existing methods for reinforcement learning (RL) are limited by poor data efficiency and weak generalization. |
| Approach: | They propose a novel architecture that integrates large language models into episodic RL. |
| Outcome: | The proposed architecture achieves 2–6 higher data efficiency than baselines and is the only method to solve complex tasks like UnlockLocal with over 90% success. |
Copied to clipboard
| Challenge: | Existing research has focused on constraint categories, offering little guidance for improving instruction following abilities. |
| Approach: | They propose a multi-dimensional constraint framework that allows for instruction following . they construct 9,106 code-verifiable samples and evaluate 18 LLMs . |
| Outcome: | The proposed framework improves instruction following performance without compromising general performance. |
Copied to clipboard
| Challenge: | API recommendation tools can help programmers use APIs by recommending which APIs to be used next given the APIs that have been written. |
| Approach: | They propose a cross-library API recommendation approach that uses BPE to split API calls in each sequence and pre-train a GPT based language model. |
| Outcome: | The proposed APIRecX can recommend APIs that are previously regarded as OOV . it can migrate knowledge of existing libraries to a new library and recommend API that is previously viewed as OVO . |
Copied to clipboard
| Challenge: | Existing trading systems rely on fragmented and task-specific APIs, resulting in inconsistent schemas and limited reproducibility. |
| Approach: | They propose a unified trading environment for large language model (LLM) agents that standardizes three core capabilities . they argue that such a standardized trading environment is essential for scalable research on LLM-based financial agents. |
| Outcome: | The proposed trading environment reduces engineering overhead and supports reproducible evaluation through comprehensive logging and deterministic replay. |
Copied to clipboard
| Challenge: | False gram and phonological errors make Chinese spelling check difficult . a novel end-to-end trainable model outperforms existing methods . |
| Approach: | They propose a trainable Chinese spelling check model that integrates phonological and visual information into a pre-trained language model. |
| Outcome: | The proposed model outperforms existing state-of-the-art models on three benchmarks. |
Copied to clipboard
| Challenge: | Data augmentation (DA) is a key technique for enhancing model performance by diversifying training examples without the need for additional data collection. |
| Approach: | They examine various strategies that utilize LLMs for data augmentation, including a novel exploration of learning paradigms where LLM-generated data is used for diverse forms of further training. |
| Outcome: | The proposed approach addresses the primary open challenges faced by LLMs in the field of large language models and aims to serve as a comprehensive guide for researchers and practitioners. |
Copied to clipboard
| Challenge: | Existing methods for unsupervised dependency parsing use difficult to interpret dependence scores. |
| Approach: | They propose to use Conditional Mutual Information (CMI) to measure bi-lexical dependence and incorporate grammatical constraints into unsupervised parsing. |
| Outcome: | The proposed model outperforms state-of-the-art models and grammar-based models in five languages and eight datasets. |
Copied to clipboard
| Challenge: | Existing models for Mongolian-Chinese translation are based on recurrent, convolutional neural networks or completely eliminate recurrence connections. |
| Approach: | They propose a adversarial training model to alleviate the UNK problem in Mongolian-Chinese machine translation by adding a screener to the model to emphasize the added Mongolian morphological noise. |
| Outcome: | The proposed model reduces training time and improves accuracy in Mongolian-Chinese translation tasks. |
Copied to clipboard
| Challenge: | Existing approaches to reduce label noise rely on heuristics and sample losses. |
| Approach: | They propose a method that transfers the noise distribution to a clean set and trains a model to distinguish noisy labels from clean ones using model-based features. |
| Outcome: | Empirically, the proposed approach improves over strong baselines on a wide range of tasks including text classification and speech recognition. |
Copied to clipboard
| Challenge: | Empirical evaluations of large language models demonstrate that they improve performance in a wide range of tasks. |
| Approach: | They propose a label-free method for mitigating selection bias during inference by reformulating debiasing as an optimization task. |
| Outcome: | The proposed method mitigates selection bias and improves performance compared to existing methods. |
Copied to clipboard
| Challenge: | E-commerce search relevance is a critical component of retrieval systems. |
| Approach: | They propose a large-generative model for search relevance that trains reasoning knowledge, multi-modal understanding and rule awareness into three core competencies. |
| Outcome: | The proposed model outperforms GPT-5 in Macro-F1 and achieves 27% online gain. |
Copied to clipboard
| Challenge: | Current approaches to question answering rely on pre-trained language models like RoBERTa. |
| Approach: | They propose a pooling approach that embeds all answer candidates with the question . they also propose enabling cross-reference between answer choices . |
| Outcome: | The proposed methods improve throughput and memory efficiency with little sacrifice in performance. |
Copied to clipboard
| Challenge: | Graphical User Interfaces (GUIs) are a pivotal medium for human-computer interaction. |
| Approach: | They propose a series of datasets for training visual-based GUI agents using general VLMs. |
| Outcome: | The proposed GUICourse datasets show that even a small-sized GUI agent performs better on GUI tasks. |
Copied to clipboard
| Challenge: | Existing RAG methods do not utilize hierarchical knowledge in human cognition, which limits the capabilities of RAG systems. |
| Approach: | They propose a graph-based approach that utilizes hierarchical knowledge to enhance the semantic understanding and structure capturing capabilities of RAG systems. |
| Outcome: | The proposed approach achieves significant performance improvements over the state-of-the-art methods. |
Copied to clipboard
| Challenge: | Existing general-domain benchmarks do not capture complexity of real-world judicial cognition and decision-making. |
| Approach: | They propose a benchmark specifically designed to evaluate LLM Agents in the legal domain. |
| Outcome: | The proposed benchmark includes 17 corpora from real-world legal scenarios and provides 37 tools for interacting with external knowledge. |
Copied to clipboard
| Challenge: | Existing benchmarks rely on partially observable traces that capture only agent outputs . lack of full execution traces obscures many failure causes, authors argue . |
| Approach: | They propose a benchmark that allows attribution under full execution observability . they find full traces improve attribution accuracy by up to 76.5% over a partial-observation counterpart . |
| Outcome: | The proposed benchmark improves attribution accuracy by up to 76.5% over a partial-observation counterpart. |
Copied to clipboard
| Challenge: | Existing methods for SRL identify semantic dependencies that specify the semantic role of arguments in relation to predicates. |
| Approach: | They propose a mixture model-based end-to-end method to model syntactic-semantic dependency correlation in Semantic Role Labeling. |
| Outcome: | The proposed method improves performance in English, German, and Spanish . it achieves small but statistically significant improvement over baseline methods . |
Copied to clipboard
| Challenge: | Existing detectors that perform well on benchmark datasets have weaknesses that can be exploited to manipulate AI-text. |
| Approach: | They propose a framework that simulates high-temperature sampling effects through multiple normal-temperaturing generations, effectively evading detection. |
| Outcome: | The proposed framework reduces detector accuracy by an average of 82.5% while preserving high text quality. |
Copied to clipboard
| Challenge: | Recent advances in Large Language Models (LLMs) have demonstrated remarkable success across diverse tasks such as instruction following, code generation, and medical diagnosis. |
| Approach: | They propose a supervised fine-tuning-based auxiliary loss for Q-value estimations during supervised refinement. |
| Outcome: | The proposed method outperforms beam search on GSM8K, MATH, and GAOKAO on reasoning benchmarks. |
Copied to clipboard
| Challenge: | Existing studies on key information extraction from visually rich documents focus on labeling the text within bounding boxes, while relations between words are unexplored. |
| Approach: | They propose to use a dependency parsing model to extract semantic entities from visually rich documents by combining entity labeling and relation extraction tasks. |
| Outcome: | The proposed model achieves 65.96% F1 score on the FUNSD dataset. |
Copied to clipboard
| Challenge: | Existing testing methods are system-level and provide limited insight into which capability deficiencies cause task failures. |
| Approach: | They propose a capability-oriented testing approach that enables failure detection and attribution by seed selection and mutation. |
| Outcome: | The proposed method detects more failure cases and pinpoints capability-level deficiencies than state-of-the-art baselines, providing more interpretable and actionable guidance for improving embodied agents. |
Copied to clipboard
| Challenge: | Current methods focus on learning word embeddings while linguistic information is discarded after the learning. |
| Approach: | They propose a framework field embedding to jointly learn word and grain embedds by incorporating morphological, phonetic, and syntactical linguistic fields. |
| Outcome: | The proposed framework integrates morphological, phonetic, and syntactical linguistic fields to learn word embeddings and grain embedds. |
Copied to clipboard
| Challenge: | Advanced GUI agents suffer from prohibitive deployment costs on resource-constrained devices. |
| Approach: | They propose a lightweight GUI agent with GUI-specific knowledge and task scalability . LAMO-3B supports monolithic execution and MAS-style orchestration . |
| Outcome: | The proposed GUI agent LAMO-3B supports monolithic execution and MAS-style orchestration. |
Copied to clipboard
| Challenge: | Currently, there are no efficient reinforcement learning (RL) frameworks specifically designed for tool use. |
| Approach: | They propose an automated environment construction pipeline that incorporates scenario decomposition, document generation, function integration, complexity scaling, and localized deployment to enable high-quality training environments without external tools. |
| Outcome: | The proposed framework significantly improves the models’ tool-use performance without degrading their general capabilities. |
Copied to clipboard
| Challenge: | APEX optimizes for text-to-image generation by combining learning potential, conflict penalty, and progress need. |
| Approach: | They propose an algorithm that stabilizes heterogeneous rewards and dynamically schedules objectives . they propose a method that achieves better Pareto trade-offs across four heterogenous objectives based on P3 Adaptive Priorities . |
| Outcome: | The proposed algorithm achieves better pareto trade-offs across four heterogeneous objectives while maintaining competitive OCR accuracy. |
Copied to clipboard
| Challenge: | Effective evaluation of multi-hop tool use is critical for analyzing the understanding, reasoning, and function-calling capabilities of large language models. |
| Approach: | They propose a dataset that provides rigorous evaluation of multi-hop tool use. |
| Outcome: | The proposed model achieves 49.04% accuracy across five model families. |
Copied to clipboard
| Challenge: | Unsupervised constituency parsing focuses on identifying word sequences that form a syntactic unit (i.e., constituents) in target sentences. |
| Approach: | They propose a frequency-based parser that computes the span-overlap score as the word sequence’s frequency in the PAS-equivalent sentence set and identifies the constituent structure by finding a constituent tree with the maximum span- overlap score. |
| Outcome: | The proposed method outperforms existing unsupervised parsers in eight out of ten languages and is more accurate than previous methods. |
Copied to clipboard
| Challenge: | Extensive experimental results on several popular logical benchmarks (ProofWriter, PrOntoQA, PrONtoQA-OOD, and FOLIO) and mathematical benchmark (DI-GSM) show that COP significantly outperforms previous state-of-the-art methods. |
| Approach: | They propose a reasoning approach called Concise and Organized Perception (COP) that carefully analyzes the given statements to identify the most pertinent information while eliminating redundancy efficiently. |
| Outcome: | The proposed approach outperforms state-of-the-art methods on several popular logical benchmarks and mathematical benchmarks. |
Copied to clipboard
| Challenge: | Existing security evaluation benchmarks lack relevance to real-world AI programming tasks . current LLMs struggle with secure coding, research shows . |
| Approach: | They propose a repository-level evaluation benchmark to assess security of AI-generated code. |
| Outcome: | The proposed framework mirrors real-world AI programming tasks and offers valuable insights into the state of AI code generation. |
Copied to clipboard
| Challenge: | Generative AI has demonstrated unprecedented creativity in the field of computer vision, yet such phenomena have not been observed in the realm of literary creation. |
| Approach: | They propose a framework for unleashing the creativity of large language models (LLMs) they assign LLMs to different roles involved in real-world scenario, they write . |
| Outcome: | The proposed framework outperforms baselines in terms of coherence, relevance, interestingness and overall quality on automatically generated screenplays. |
Copied to clipboard
| Challenge: | Semantic compositionality (SC) is defined as the phenomenon that the meaning of a complex linguistic unit can be composed of the meanings of its constituents. |
| Approach: | They propose to incorporate sememes into SC models and employ them in learning multiword expressions. |
| Outcome: | The proposed models achieve significant performance boost compared to baseline methods without sememe knowledge. |
Copied to clipboard
| Challenge: | Distant Supervision (DS) generates large-scale annotated data but has wrong labels that result in incorrect evaluation scores during testing. |
| Approach: | They build a dataset using DS-generated data as training data and hire annotators to label test data. |
| Outcome: | The proposed dataset NYTH has a much larger test set and performs more accurate and consistent evaluation. |