Papers by Feiteng Fang

13 papers
OmniCharacter: Towards Immersive Role-Playing Agents with Seamless Speech-Language Personality Interaction (2025.acl-long)

Copied to clipboard

Challenge: Existing methods focus on replicating dialogues in textual form, neglecting the role’s voice traits as a crucial effect in interaction, which tends to be more immersive experiences in realistic scenarios.
Approach: They propose a first seamless speech-language personality interaction model to achieve immersive RPAs with low latency.
Outcome: The proposed model exhibits role-specific personality traits and vocal traits throughout the interaction, enabling a mixture of speech and language responses.
CLHA: A Simple Yet Effective Contrastive Learning Framework for Human Alignment (2024.lrec-main)

Copied to clipboard

Challenge: Large language models (LLMs) have attracted considerable attention from academic and industrial communities due to their outstanding performance in various natural language processing tasks.
Approach: They propose a Contrastive Learning Framework for Human Alignment to evaluate the noise within the data and dynamically adjust the training process.
Outcome: The proposed framework surpasses other algorithms in terms of reward model scores, automatic evaluations, and human assessments on the widely used dataset "Helpful and Harmless"
Enhancing Noise Robustness of Retrieval-Augmented Language Models with Adaptive Adversarial Training (2024.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) exhibit substantial capabilities yet face challenges such as hallucination, outdated knowledge, and untraceable reasoning processes.
Approach: They propose a retrieval-augmented generation approach that leverages adaptive adversarial training to dynamically adjust the model’s training process in response to retrieval noises.
Outcome: The proposed approach improves the performance of the LLaMA-2 7B model under diverse noise conditions.
Expanding before Inferring: Enhancing Factuality in Large Language Models through Premature Layers Interpolation (2025.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to generating factually inconsistent outputs are resource-intensive.
Approach: They propose a plug-and-play intervention designed to enhance factuality by inserting premature layers formed through mathematical interpolation with adjacent layers.
Outcome: The proposed intervention reduces hallucinations while outperforming baselines on four datasets.
Act-Adaptive Margin: Dynamically Calibrating Reward Models for Subjective Ambiguity (2026.acl-long)

Copied to clipboard

Challenge: Existing approaches to reward modeling in reinforcement learning tasks are limited when dealing with ambiguous preferences.
Approach: They propose to use AAM to dynamically calibrate preference margins using the Bradley-Terry model's internal parameter knowledge to improve reward modeling in subjective tasks.
Outcome: The proposed approach improves reward modeling by dynamically calibrating preference margins using the model’s internal parameter knowledge.
SrDetection: A Self-Referential Framework for Data Leakage Detection in Code Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods for evaluating code large language models assume access to proprietary training corpora or use external reference sets with manually tuned, non-generalizable thresholds.
Approach: They propose a framework for self-referential leakage detection for gray-box and black-box settings.
Outcome: The proposed framework improves average F1 by 21.52 points in the gray-box setting and 14.46 points in black-box settings over strong baselines.
Beyond Quantity: Trajectory Diversity Scaling for Code Agents (2026.findings-acl)

Copied to clipboard

Challenge: Code large language models (LLMs) are becoming tool-interactive agents . quantity-centric scaling exhibits an early bottleneck that underutilizes trajectory data . et al.: a new approach to scale trajectory diversity improves tool-use generalization .
Approach: They propose a Trajectory Diversity Scaling-based data synthesis framework for code agents that scales performance through diversity rather than raw volume.
Outcome: Experiments on general tool-use benchmarks and code agent tasks show that TDScaling improves tool-user generalization and inherent coding proficiency.
Can MLLMs Understand the Deep Implication Behind Chinese Images? (2025.acl-long)

Copied to clipboard

Challenge: MLLMs perform poorly on traditional culture images, indicating limitations in understanding high-level semantics and lacking a deep knowledge base of Chinese traditional culture.
Approach: They propose to use Chinese images to assess MLLMs' higher-order perception and understanding of Chinese visual content.
Outcome: The proposed model incorporates images that represent Chinese traditional culture, such as famous Chinese traditional paintings, to ensure the authenticity of the Chinese context.
CPO: Addressing Reward Ambiguity in Role-playing Dialogue via Comparative Policy Optimization (2025.findings-emnlp)

Copied to clipboard

Challenge: Comparative Policy Optimization (CPO) redefines the reward evaluation paradigm by shifting from sample-wise scoring to comparative group-wise score.
Approach: They propose a method to optimize subjective tasks by shifting from sample-wise to comparative group-wise scoring.
Outcome: The proposed framework shifts from sample-wise scoring to comparative group-wise score . it minimizes contextual bias and enables more robust and fair performance evaluation.
DEFT: Distribution-guided Efficient Fine-Tuning for Human Alignment (2024.findings-emnlp)

Copied to clipboard

Challenge: Experimental results show that the methods enhanced by DEFT outperform the original methods in both alignment capability and generalization ability, with significantly reduced training time.
Approach: They propose a distribution-based alignment framework that integrates data filtering and distributional guidance to improve alignment efficiency and generalization ability.
Outcome: The proposed framework outperforms existing methods in alignment capability and generalization ability with significantly reduced training time.
Reverse Preference Optimization for Complex Instruction Following (2025.findings-acl)

Copied to clipboard

Challenge: Existing methods for identifying and evaluating preference pairs with multiple constraints are noisy.
Approach: They propose a method that dynamically reverses constraints to ensure the chosen response is perfect.
Outcome: The proposed method reduces noise in preference pairs by reversing constraints to ensure the chosen response is perfect.
COIG-CQIA: Quality is All You Need for Chinese Instruction Fine-tuning (2025.findings-naacl)

Copied to clipboard

Challenge: Existing datasets for Chinese instruction tuning are not well-aligned with Chinese users’ interaction patterns.
Approach: They propose to use Chinese instruction tuning datasets to improve instruction fine-tuning for Chinese users.
Outcome: The proposed dataset shows that Chinese models achieve competitive performance in diverse benchmarks.
LIME: Less Is More for MLLM Evaluation (2025.findings-acl)

Copied to clipboard

Challenge: Existing MLLM benchmarks and unified evaluation frameworks cannot accurately and efficiently reflect the ability of MLMLs.
Approach: They propose a semi-automated benchmark curated using a pipeline that filters out uninformative samples and eliminates answer leakage by focusing on tasks that require image-based understanding.
Outcome: The proposed benchmark reduces the number of samples by 76% and evaluation time by 77% while it can more effectively distinguish different models’ abilities.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations