Papers by Chong Chen

41 papers
UniCodec: Unified Audio Codec with Single Domain-Adaptive Codebook (2025.acl-long)

Copied to clipboard

Challenge: Existing neural audio codecs are not capable of handling multi-domain audio data . et al., 2023) integrate speech modality with text-based large language models .
Approach: They propose a unified audio codec with a single codebook to support multi-domain audio data . they propose combining a mix-of-experts strategy and a partitioned domain-adaptive codebook method .
Outcome: The proposed codec outperforms existing codecs on acoustic and semantic representation capabilities.
Multimodal Fusion and Coherence Modeling for Video Topic Segmentation (2025.findings-acl)

Copied to clipboard

Challenge: Traditional video topic segmentation methods struggle to discern topical transitions . supervised approaches have improved performance on video action or scene segmentation .
Approach: They propose a new task for video topic segmentation that enhances multimodality alignment and fusion by exploring different architectures using Cross-Attention and Mixture of Experts.
Outcome: The proposed model improves on educational videos, in the form of lectures . it combines cross-attention and mixture of experts to strengthen multimodality alignment and fusion .
We-Math: Does Your Large Multimodal Model Achieve Human-like Mathematical Reasoning? (2025.acl-long)

Copied to clipboard

Challenge: Existing benchmarks focus more on end-to-end performance, but neglect the underlying principles of knowledge acquisition and generalization.
Approach: They propose a benchmark specifically designed to explore the problem-solving principles by decomposing 6.5K visual math problems into 10.9K step-level questions for evaluation.
Outcome: The proposed benchmark covers 6.5K visual math problems and 10.9K step-level questions spanning 5 layers of knowledge granularity and 67 hierarchical knowledge concepts.
RealSec-bench: A Benchmark for Evaluating Secure Code Generation in Real-World Repositories (2026.findings-acl)

Copied to clipboard

Challenge: Existing benchmarks for large language models fail to capture complex interplay between functionality and security.
Approach: They propose a benchmark for secure code generation constructed from real-world, high-risk Java repositories.
Outcome: The proposed benchmarks highlight the gap between functional and secure code generation in LLMs.
Are U a Joke Master? Pun Generation via Multi-Stage Curriculum Learning towards a Humor LLM (2024.findings-acl)

Copied to clipboard

Challenge: Existing research has demonstrated that the ability of large language models (LLMs) to generate humorous sentences is limited to producing 25 unique jokes.
Approach: They propose a multi-stage curriculum preference learning framework to optimize both pun structure preferences and humor preferences by a Chinese Pun dataset.
Outcome: The proposed method significantly outperforms baseline models on Chinese and English benchmark datasets.
Improving Long Document Topic Segmentation Models With Enhanced Coherence Modeling (2023.emnlp-main)

Copied to clipboard

Challenge: Recent supervised neural models have greatly promoted the development of topic segmentation, but the deeper relationship between coherence and topic segmenting is underexplored.
Approach: They propose to use topic-aware Sentence Structure Prediction and Contrastive Semantic Similarity Learning to capture coherence from logical structure and semantic similarity perspectives to further improve topic segmentation performance.
Outcome: The proposed approach outperforms state-of-the-art methods on WIKI-727K and achieves an average relative reduction of 4.3% on Pk on WikiSection.
S+PAGE: A Speaker and Position-Aware Graph Neural Network Model for Emotion Recognition in Conversation (2022.aacl-main)

Copied to clipboard

Challenge: Emotion recognition in conversation (ERC) is a task arousing increasing interest in many fields.
Approach: They propose a novel GNN-based ERC model that captures speaker and position information.
Outcome: The proposed model captures speaker and position-aware conversation structure information.
MDERank: A Masked Document Embedding Rank Approach for Unsupervised Keyphrase Extraction (2022.findings-acl)

Copied to clipboard

Challenge: Keyphrase extraction (KPE) extracts phrases in a document that provide a concise summary of the core content.
Approach: They propose an unsupervised keyphrase extraction method that ranks candidates by similarity between embeddings of source document and masked document.
Outcome: The proposed method outperforms state-of-the-art methods on six benchmarks . it achieves average 3.53 improvement over the existing method .
TS-Align: A Teacher-Student Collaborative Framework for Scalable Iterative Finetuning of Large Language Models (2024.findings-emnlp)

Copied to clipboard

Challenge: Mainstream approaches to aligning large language models heavily rely on human preference data.
Approach: They propose a framework that fine-tunes a policy model using pairwise feedback data automatically mined from its outputs.
Outcome: The proposed framework outperforms the base model with an average win rate of 69.7% across seven conversational or instruction-following datasets.
Decoding Matters: Addressing Amplification Bias and Homogeneity Issue in Recommendations for Large Language Models (2024.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to adapt Large Language Models (LLMs) for recommendation encounter significant challenges such as amplification bias and homogeneity.
Approach: They propose a new decoding approach called Debiasing-Diversifying Decoding (D3) that disables length normalization for ghost tokens to alleviate amplification bias and incorporates a text-free assistant model to encourage tokens less frequently generated by LLMs for counteracting recommendation homogeneity.
Outcome: Extensive experiments on real-world datasets demonstrate the proposed approach’s effectiveness in enhancing accuracy and diversity.
DEMO: A Statistical Perspective for Efficient Image-Text Matching (2024.naacl-long)

Copied to clipboard

Challenge: Image-text matching is a problem that seeks to connect vision and language through semantic understanding.
Approach: They propose a deep unsupervised hashing-based approach for image-text matching . they characterize each image using multiple augmented views, which are considered as samples .
Outcome: The proposed approach achieves superior performance on image-text matching datasets compared with state-of-the-art methods.
GALA: Geometric Data Selection with Strategic Prospecting for Large Language Model Self-training (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches to self-training are based on reject sampling and lack quality reasoning paths.
Approach: They propose a framework for self-training using a generate-and-filter paradigm . they propose to identify diverse and informative samples from redundant data and exploit them more strategically.
Outcome: The proposed framework exploits informative samples from redundant data and improves reasoning trajectory prospecting.
PEMV: Improving Spatial Distribution for Emotion Recognition in Conversations Using Proximal Emotion Mean Vectors (2025.findings-naacl)

Copied to clipboard

Challenge: Existing research focuses on the analysis of contextual structure in dialogue and the interactions between different emotions.
Approach: They propose a method that generates Proximal Emotion Mean Vectors (PEMVs) based on emotion feature queues to optimize the spatial representation of text features.
Outcome: The proposed method achieves state-of-the-art performance on three widely used benchmark datasets.
DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Models (2024.acl-long)

Copied to clipboard

Challenge: Mixture-of-Experts (MoE) architectures face challenges in ensuring expert specialization . despite the promising performance, scaling language models to an extremely large scale is associated with exceedingly high computational costs.
Approach: They propose an architecture that allows for ultimate expert specialization by segmenting experts into mN ones and activating mK from them.
Outcome: The proposed architecture achieves comparable performance with GShard with 2B parameters and computation.
Global Adaptive Momentum Meets Local Personalized Perturbation: Efficient Federated LLM Fine-Tuning with Zeroth-Order Gradients (2026.acl-long)

Copied to clipboard

Challenge: federated fine-tuning of large language models provides privacy-preserving approach to deploying pervasive generative AI services.
Approach: They propose a federated framework for fine-tuning large language models . they propose unified optimization and local personalized perturbation for ZO gradients .
Outcome: The proposed framework outperforms existing methods for integrating ZO gradients in federated learning over diverse heterogeneous data settings.
HyperCore: Hyperbolic and Co-graph Representation for Automatic ICD Coding (2020.acl-main)

Copied to clipboard

Challenge: Existing methods for ICD coding ignore Code Hierarchy and Code Co-occurrence . cost of manual coding estimated to be $25 billion per year in the US .
Approach: They propose a hyperbolic representation method to leverage the code hierarchy and a graph convolutional network to utilize the code co-occurrence.
Outcome: The proposed model outperforms state-of-the-art methods on two widely used datasets.
Reading Order Matters: Information Extraction from Visually-rich Documents by Token Path Prediction (2023.emnlp-main)

Copied to clipboard

Challenge: Recent advances in multimodal pre-trained models have significantly improved information extraction from visually-rich documents (VrDs).
Approach: They propose a method to predict token sequences within visually-rich documents by a simple prediction head.
Outcome: The proposed method can be used to predict token mentions as token sequences within documents.
A Symbolic Adversarial Learning Framework for Evolving Fake News Generation and Detection (2025.emnlp-main)

Copied to clipboard

Challenge: Rapid LLM advancements heighten fake news risks by enabling the automatic generation of increasingly sophisticated misinformation.
Approach: They propose a framework that implements an adversarial training paradigm by an agent symbolic learning optimization process rather than numerical updates.
Outcome: The proposed framework generates sophisticated fake news that degrades state-of-the-art detection performance by 53.4% in Chinese and 34.2% in English on average.
TheoremExplainAgent: Towards Video-based Multimodal Explanations for LLM Theorem Understanding (2025.acl-long)

Copied to clipboard

Challenge: Understanding domain-specific theorems requires more than text-based reasoning . current evaluations of theoretical models are based on textual cues .
Approach: They propose an agentic approach for generating long-form theorem explanation videos using Manim animations.
Outcome: The proposed agent generates long-form theorem explanation videos using Manim animations . the agent achieves a success rate of 93.8% and an overall score of 0.77 .
Can LLMs be Good Graph Judge for Knowledge Graph Construction? (2025.emnlp-main)

Copied to clipboard

Challenge: Existing methods for converting unstructured text into structured Knowledge Graphs (KGs) have limitations such as large amount of noise, inaccurate knowledge, and hallucination .
Approach: They propose a GraphJudge framework to reduce noise in real-world documents . they propose Graphjudge to fine-tune a LLM as a graph judge to enhance quality .
Outcome: The proposed framework eliminates noise in real-world documents and improves the quality of generated KGs.
OmniFlatten: An End-to-end GPT Model for Seamless Voice Conversation (2025.acl-long)

Copied to clipboard

Challenge: Full-duplex spoken dialogue systems allow simultaneous bidirectional communication . low latency and natural interactions in full-duplice systems remains a challenge .
Approach: They propose a multi-stage post-training scheme that adapts a text large language model into a speech-text dialogue LLM.
Outcome: The proposed model can model human conversation behaviors with low latency and natural interactions with low delay.
Mitigating Judgment Preference Bias in Large Language Models through Group-Based Polling (2026.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) are used as automatic evaluators to provide accurate and reliable assessments.
Approach: They propose a framework that integrates LLM-based judgment models into a multi-agent system and simulates the interactive client-server polling mechanism.
Outcome: The proposed framework outperforms supervised models trained on annotated judgment data while requiring no human-labeled annotations.
Integrating Audio, Visual, and Semantic Information for Enhanced Multimodal Speaker Diarization on Multi-party Conversation (2025.acl-long)

Copied to clipboard

Challenge: Mainstream speaker diarization systems rely only on acoustic information, making it challenging in complex aural environments.
Approach: They propose a multimodal approach that integrates audio, visual, and semantic cues to enhance speaker diarization.
Outcome: The proposed approach outperforms state-of-the-art methods on multi-party conversations . it integrates audio-visual-semantic cues into the clustering process for acoustic speaker embeddings .
Boost Transformer-based Language Models with GPU-Friendly Sparsity and Quantization (2023.findings-acl)

Copied to clipboard

Challenge: Existing studies have shown that transformer-based language models can achieve state-of-the-art performance on various natural language processing tasks.
Approach: They propose a GPU-friendly 2:4 fine-grained structured sparsity and quantization scheme to maximize the GPU's acceleration constraints.
Outcome: The proposed scheme achieves state-of-the-art compression on TLM model of various encoder and decoder blocks with negligible accuracy degradation on SQuAD, GLUE, CNN-DM & XSum and WikiText benchmarking tasks.
Enhancing Recommendation Explanations through User-Centric Refinement (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing explanations for user reviews often fail to meet user-centric aspects, reducing their usefulness to users.
Approach: They propose a paradigm that refines initial explanations generated by existing models during the inference stage to enhance their quality in multiple aspects.
Outcome: The proposed model improves explanations generated by existing models during the inference stage to enhance their quality in multiple aspects.
GenesisFunc: Multi-Agent Data Generation for Accurate and Generalizable Function-Calling (2026.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) extend their capabilities through function-calling (FC) however, obtaining and annotating real function-called data is challenging, and synthetic data from existing pipelines suffers from unreliable APIs, limited tool scalability, insufficient diversity, and weak quality control.
Approach: They propose a pipeline for generating FC training data using reliable tools and a multi-agent framework that supports a dialogue generation system that produces conversations spanning diverse scenarios.
Outcome: The proposed pipeline outperforms open-source models in in-domain FC performance and out-of-domain generalization while reaching FC capabilities comparable to some of the latest API-based models.
LEAF: Large Language Diffusion Model for Time Series Forecasting (2025.findings-emnlp)

Copied to clipboard

Challenge: Recent work has applied large language models (LLMs) into time series forecasting, but they lack an understanding of holistic temporal patterns with potential error accumulation.
Approach: They propose a framework that marries Larg e Langu age Diffusion Model with time series forecasting (LEAF) they propose converting time series into tokens and adopting language diffusion models to capture temporal dependencies.
Outcome: The proposed framework generates future predictions with a diffusion model from a holistic view.
Ditto: A Simple and Efficient Approach to Improve Sentence Embeddings (2023.emnlp-main)

Copied to clipboard

Challenge: Prior studies diagnose the anisotropy problem in sentence embeddings from pre-trained language models without fine-tuning.
Approach: They propose an unsupervised method that weights words with model-based importance estimations and computes the weighted average of word representations from pre-trained models as sentence embeddings.
Outcome: Empirical evaluations show that the proposed method can alleviate the anisotropy problem and improve various pre-trained models on the STS benchmarks.
Clinical-Coder: Assigning Interpretable ICD-10 Codes to Chinese Clinical Notes (2020.acl-demos)

Copied to clipboard

Challenge: Existing methods of automatic coding prediction have been successful, but the interpretability of predicted codes is a challenge.
Approach: They propose an online system that can predict ICD codes for Chinese clinical notes by using a Dilated Convolutional Attention network with N-gram Matching mechanism.
Outcome: The proposed system is able to provide supporting information in clinical decision making.
Modeling Layout Reading Order as Ordering Relations for Visually-rich Document Understanding (2024.emnlp-main)

Copied to clipboard

Challenge: Existing models of layout reading order do not convey the complete reading order information in the layout.
Approach: They propose to model layout reading order as ordering relations over layout elements . they propose a reading-order-relation-enhancing pipeline to improve model performance .
Outcome: The proposed model outperforms existing models on a visual-rich document dataset and on eight cross-domain VrD-IE/QA tasks without targeted optimization.
V-Oracle: Making Progressive Reasoning in Deciphering Oracle Bones for You and Me (2025.acl-long)

Copied to clipboard

Challenge: Deciphering oracle bone scripts using AI technology is not an overnight task due to the evolution of written language over millennia.
Approach: They propose a framework that utilizes Large Multi-modal Models (LMMs) for interpreting Oracle Bone Script (OBS).
Outcome: The proposed framework provides quantitative analyses and superior deciphering capability.
Beat LLMs at Their Own Game: Zero-Shot LLM-Generated Text Detection via Querying ChatGPT (2023.emnlp-main)

Copied to clipboard

Challenge: Large language models (LLMs) are capable of performing tasks but are likely to be misused.
Approach: They propose a zero-shot black-box method to detect LLM-generated texts . they revise the text to be detected using the ChatGPT model .
Outcome: The proposed method can detect LLM-generated texts with a zero-shot black-box model . it is based on intuition that the model will make fewer revisions to LLMs than to human-written texts .
LCQMC:A Large-scale Chinese Question Matching Corpus (C18-1)

Copied to clipboard

Challenge: Existing methods for question answering system lack large-scale question matching corpora . lack of large-sized question matching results in problem solving .
Approach: They propose a large-scale Chinese question matching corpus which is released to the public . they use a search engine to collect large-sized question pairs related to high-frequency words .
Outcome: The proposed corpus is more general than paraphrase corpus as it focuses on intent matching rather than paraphrasing.
Automatic ICD Coding via Interactive Shared Representation Networks with Self-distillation Mechanism (2021.acl-long)

Copied to clipboard

Challenge: Existing methods for ICD coding ignore the long-tail of code frequency or noisy clinical notes.
Approach: They propose to use an interactive shared representation network to model code co-occurrences while focusing on the clinical note's noteworthy part and extract valuable information through a self-distillation learning mechanism to solve the long-tail problem.
Outcome: The proposed model reduces the long-tail of code frequency and noise in clinical notes and extracts valuable information through a self-distillation learning mechanism.
TableRAG: A Retrieval Augmented Generation Framework for Heterogeneous Document Reasoning (2025.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to retrievalaugmented generation (RAG) are limited when applied to heterogeneous documents . flattening tables and chunking strategies disrupt tabular structure, leads to information loss, and undermines reasoning capabilities of LLMs in multi-hop, global queries.
Approach: They propose a SQL-based framework that unifies textual understanding and complex manipulations over tabular data.
Outcome: The proposed framework outperforms baselines on public datasets and HeteQA on heterogeneous document question answering.
Refining and Synthesis: A Simple yet Effective Data Augmentation Framework for Cross-Domain Aspect-based Sentiment Analysis (2024.findings-acl)

Copied to clipboard

Challenge: Aspect-based Sentiment Analysis (ABSA) data augmentation has attracted increasing attention in recent years due to data sparsity.
Approach: They propose a framework to augment ABSA data using pseudo labels for target domain . they refine generated labeled data using a natural language inference filter .
Outcome: The proposed framework outperforms 7 strong baselines on 4 kinds of ABSA tasks.
SciFlow-Bench: Evaluating Structure-Aware Scientific Diagram Generation via Inverse Parsing (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks for scientific diagram generation rely on image-centric metrics or evaluation of intermediate symbolic representations rather than final rendered images.
Approach: They propose a structure-first benchmark for evaluating scientific diagram generation from pixel-level outputs.
Outcome: The proposed benchmark evaluates scientific diagram generation directly from pixel-level outputs.
Multi-Domain Neural Machine Translation with Word-Level Adaptive Layer-wise Domain Mixing (2020.acl-main)

Copied to clipboard

Challenge: Existing multi-domain neural machine translation models lack adaptation to individual domains.
Approach: They propose a multi-domain neural machine translation model with individual modules for each domain . they use word-level, adaptive and layer-wise domain mixing to achieve this .
Outcome: The proposed model outperforms existing models in several NMT tasks.
LLM×MapReduce: Simplified Long-Sequence Processing using Large Language Models (2025.acl-long)

Copied to clipboard

Challenge: Existing studies have focused on extending the context length of large language models (LLMs) due to their quadratic computational complexity and a lack of high-quality long training examples, most LLMs are trained with a limited window size.
Approach: They propose a training-free framework that enables large language models to effectively process long texts using a divide-and-conquer strategy for comprehensive document understanding.
Outcome: The proposed framework outperforms open-source and commercial long-context LLMs and is compatible with several models.
What Factors Influence LLMs’ Judgments? A Case Study on Question Answering (2024.lrec-main)

Copied to clipboard

Challenge: Existing studies indicate that Large Language Models perform at a level comparable to humans with advantages of speed and cost-effectiveness in different fields.
Approach: They propose to introduce four unexplored factors and a new dimension of question difficulty to provide a more comprehensive understanding of LLMs’ judgments across varying question intricacies.
Outcome: The proposed dimensions of question difficulty and answer quantity provide valuable insights into optimizing LLMs’ performance as judges.
scRAG: Hybrid Retrieval-Augmented Generation for LLM-based Cross-Tissue Single-Cell Annotation (2025.findings-acl)

Copied to clipboard

Challenge: Large language models (LLMs) have demonstrated impressive potential in a wide range of fields, including biology, genomics and healthcare.
Approach: They propose a framework that integrates advanced LLM-based RAG techniques into cross-tissue single-cell annotation.
Outcome: The proposed framework outperforms baseline models, generalist models, domain-specific methods, and trained classifiers on a cross-tissue dataset.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations