Papers by Yuxin Zhang

33 papers
Leveraging Unit Language Guidance to Advance Speech Modeling in Textless Speech-to-Speech Translation (2025.findings-acl)

Copied to clipboard

Challenge: Existing textless speech-to-speech translation models have two main challenges: 1) learning cross-modal features and 2) learning alignment of difference languages in long sequences.
Approach: They propose a unit language to overcome two main modeling challenges . they propose task prompt modeling to utilize the unit language in guiding the modeling process.
Outcome: The proposed language improves over a strong baseline and achieves comparable performance to models trained with text.
PaddleSpeech: An Easy-to-Use All-in-One Speech Toolkit (2022.naacl-demo)

Copied to clipboard

Challenge: PaddleSpeech is an open-source speech toolkit that supports speech-to-text and text-to speech tasks.
Approach: They describe the design philosophy and core architecture of PaddleSpeech to support several essential speech-to-text and text-to speech tasks.
Outcome: The proposed framework achieves competitive or state-of-the-art performance on various speech datasets and implements the most popular methods.
A Multimodal In-Context Tuning Approach for E-Commerce Product Description Generation (2024.lrec-main)

Copied to clipboard

Challenge: Existing methods for generating product descriptions from images are inaccurate and generic . e-commerce product descriptions are important for content marketing and increasing engagement .
Approach: They propose a new setting for generating product descriptions from images, augmented by marketing keywords.
Outcome: The proposed approach improves the accuracy and diversity of product descriptions by up to 3.3% on Rouge-L and 9.4% on D-5.
Layer-wise Fusion with Modality Independence Modeling for Multi-modal Emotion Recognition (2023.acl-long)

Copied to clipboard

Challenge: Existing studies focus on developing models that exploit the unification of multiple modalities.
Approach: They propose to maintain modality independence by using a multi-modal transformer model that fuses all modalities.
Outcome: The proposed model outperforms state-of-the-art models in multi-modal emotion recognition.
UniSonate: A Unified Model for Speech, Music, and Sound Effect Generation with Text Instructions (2026.acl-long)

Copied to clipboard

Challenge: Generative audio modeling has been fragmented into specialized tasks such as text-to-speech (TTS), text- to-music (TTM), and text-ta (TTA) specialized models require reference audio for timbre cloning and strict phoneme alignment, whereas TTA models generate unstructured textures from open-ended captions.
Approach: They propose a unified flow-matching framework capable of synthesizing speech, music, sound effects . they propose 'token injection mechanism' that projects unstructured environmental sounds into structured temporal latent space .
Outcome: The proposed framework achieves state-of-the-art performance in instruction-based TTS and TTM while maintaining competitive fidelity in TTA.
A Mixed-Language Multi-Document News Summarization Dataset and a Graphs-Based Extract-Generate Model (2025.naacl-long)

Copied to clipboard

Challenge: Existing research on news summarization focuses on single-language single-document (SLSD), single-linguistic multi-document or cross-language multi-doc (CLSD) however, in real-world scenarios, news articles often involve multiple documents in different languages, i.e., mixed-language MLMD.
Approach: They propose a mixed-language multi-document news summarization dataset with four different languages and 10,992 source document cluster and target summary pairs.
Outcome: The proposed dataset contains four different languages and 10,992 source document cluster and target summary pairs.
AnnaAgent: Dynamic Evolution Agent System with Multi-Session Memory for Realistic Seeker Simulation (2025.findings-acl)

Copied to clipboard

Challenge: Existing models of seeker simulations are limited by the cost and ethical concerns of involving real seekers in mental health research.
Approach: They propose an emotional and cognitive dynamic agent system equipped with tertiary memory to enable dynamic control of the simulator's configurations.
Outcome: The proposed system achieves more realistic seeker simulation compared to baselines.
Recontextualizing Revitalization: A Mixed Media Approach to Reviving the Nüshu Language (2025.emnlp-main)

Copied to clipboard

Challenge: Nüshu is an endangered language from Jiangyong County, Hunan, China, and the world’s only known writing system created and used exclusively by women.
Approach: They propose to use NüshuStrokes to record all 397 Unicode Nü Shu characters in sequential handwriting by an expert calligrapher.
Outcome: Evaluating five state-of-the-art Chinese Optical Character Recognition systems on NüshuVision lowers CER to 0.67, a modest but meaningful improvement over previous datasets.
Improved Universal Sentence Embeddings with Prompt-based Contrastive Learning and Energy-based Learning (2022.findings-emnlp)

Copied to clipboard

Challenge: Existing contrastive methods for learning universal sentence embeddings have limitations due to their over-parameterization and poor performance under domain shift settings.
Approach: They propose to integrate an Energy-based Hinge loss to enhance the pairwise discriminative power of contrastive learning for sentence embeddings by combining PLMs with energy-based learning.
Outcome: Empirical results show that the proposed method improves on seven standard semantic textual similarity tasks and a domain-shifted STS task.
GenPT: Beyond Self-Report for Reliable LLM Psychometrics via Generative Projective Testing (2026.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) inherit contamination from training corpora, directional bias under social-desirability framing, and limited responsiveness to context beyond the item text.
Approach: They propose a paradigm that reformulates TAT, Rorschach, and SCT with newly generated stimuli and organises assessment as a three-stage pipeline.
Outcome: The proposed paradigm reformulates TAT, Rorschach, and SCT with newly generated stimuli and organises assessment as a three-stage pipeline.
Layer-aware Dual-directional Modulation for Low-resource Machine Translation (2026.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) have demonstrated excellent performance in Machine Translation (MT) however, a performance gap persists between high-resource and low-resourced languages due to imbalanced pre-training data.
Approach: They propose a layer-wise metric to quantify the activation divergence between high- and low-resource languages.
Outcome: The proposed model outperforms standard LoRA fine-tuning on Chinese-to-seven low-resource language translations.
A Multi-Modal Knowledge Graph for Classical Chinese Poetry (2022.findings-emnlp)

Copied to clipboard

Challenge: Existing studies in classical Chinese poetry area focus on generation and analysis of poetry.
Approach: They propose to integrate the visual information of words in classical Chinese poetry into a multi-modal knowledge graph.
Outcome: The proposed model bridges the semantic gap between two modalities and achieves state-of-the-art performance on the poetry-image retrieval task.
DecompileBench: A Comprehensive Benchmark for Evaluating Decompilers in Real-World Scenarios (2025.findings-acl)

Copied to clipboard

Challenge: Existing approaches focus on syntactic correctness through synthetic micro-benchmarks or subjective human ratings, despite semantic fidelity and usability.
Approach: They propose a framework that enables effective evaluation of decompilers in reverse engineering workflows . they compare six industrial-strength decompils and six recent LLM-powered approaches .
Outcome: The proposed framework outperforms commercial tools in code understandability despite lower functionality correctness . it shows that it can transform human-centric reverse engineering workflows .
SAIS: Supervising and Augmenting Intermediate Steps for Document-Level Relation Extraction (2022.naacl-main)

Copied to clipboard

Challenge: Existing methods for relation extraction only implicitly learn to model relevant contexts and entity types while being trained for RE.
Approach: They propose to explicitly teach the model to capture relevant contexts and entity types by supervising and augmenting intermediate steps (SAIS) for RE.
Outcome: The proposed method outperforms the runner-up method on three benchmarks by 5.04% . textual contexts and entity types are the major information sources that lead to the success of previous approaches.
Global and Local Hierarchy-aware Contrastive Framework for Implicit Discourse Relation Recognition (2023.findings-acl)

Copied to clipboard

Challenge: Existing methods to integrate whole hierarchical information of senses into discourse relation representations for multi-level sense recognition ignore static hierarchic structure containing all senses and ignore hierarchically sense label sequence corresponding to each instance.
Approach: They propose to use a GlObal and Local Hierarchy-aware Contrastive Framework to model two kinds of hierarchies with the aid of multi-task learning and contrastive learning to learn better representations of discourse relation relationships.
Outcome: The proposed method outperforms current state-of-the-art models at all hierarchical levels on PDTB 2.0 and PDTP 3.0 datasets.
TEF: Causality-Aware Taxonomy Expansion via Front-Door Criterion (2025.coling-main)

Copied to clipboard

Challenge: Existing research still faces spurious query-anchor matching due to unobserved factors.
Approach: They propose a model that uses the front-door criteria to decompose the expansion process into a parser module and a connector to isolate confounding effects.
Outcome: Extensive experiments on three benchmarks validate the effectiveness of the proposed model.
Let’s Reason Formally: Natural-Formal Hybrid Reasoning Enhances LLM’s Math Capability (2025.emnlp-main)

Copied to clipboard

Challenge: Recent work has focused on improving the mathematical reasoning capabilities of Large Language Models (LLMs).
Approach: They propose an end-to-end framework to integrate FL into NL math reasoning . they propose a problem alignment method that reformulates QA and existence problems .
Outcome: The proposed framework achieves 89.80% and 84.34% accuracy rates on the MATH-500 and the AMC benchmarks.
NeuSym-RAG: Hybrid Neural Symbolic Retrieval with Multiview Structuring for PDF Question Answering (2025.acl-long)

Copied to clipboard

Challenge: Existing approaches to retrieval augmented generation neglect PDF structure and layout . individual PDFs often exceed prompt limits and user queries may span multiple documents.
Approach: They propose a hybrid neural symbolic retrieval framework which combines both paradigms in an interactive process.
Outcome: The proposed framework organizes semi-structured PDF content into relational database and vectorstore . it defeats both RAG and structured baselines on three PDF-based QA datasets .
Crowd Comparative Reasoning: Unlocking Comprehensive Evaluations for LLM-as-a-Judge (2025.acl-long)

Copied to clipboard

Challenge: Existing methods rely on majority voting or criteria expansion to capture detailed and detailed details, often leading to incomplete outcomes.
Approach: They propose a method which introduces additional crowd responses to compare with the candidate responses, thereby exposing deeper and more comprehensive details within the candidate answers.
Outcome: Experiments show that the proposed method improves evaluation reliability and achieves an average gain of 6.7% across five benchmarks.
SFTMix: Elevating Language Model Instruction Tuning with Mixup Recipe (2026.acl-long)

Copied to clipboard

Challenge: Efforts to improve instruction tuning often focus on higher-quality supervised fine-tuning datasets, typically requiring data filtering with proprietary LLMs or human annotation.
Approach: They propose a Mixup-based recipe that elevates LLM instruction tuning without relying on well-curated datasets.
Outcome: The proposed model improves instruction-following and healthcare-specific tasks with consistent improvements across LLM families and SFT datasets.
RiTeK: A Dataset for Large Language Models Complex Reasoning over Textual Knowledge Graphs in Medicine (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods for retrieving medical textual knowledge Graphs struggle to perform well, a study finds . existing methods struggle to provide accurate answers to complex questions, he says .
Approach: They synthesize user queries integrating diverse topological structures, relational information, and complex textual descriptions.
Outcome: a new dataset for medical textual knowledge graphs shows that existing methods struggle to perform well . main bottlenecks lie in the scarcity of existing medical TKGs and the limited expressiveness of their topological structures .
Training Long-Context LLMs Efficiently via Chunk-wise Optimization (2025.findings-acl)

Copied to clipboard

Challenge: Recent advances in long-context large language models have demonstrated superior retrieval quality compared to retrievalaugmented generation (RAG) approaches.
Approach: They propose a memory-efficient training paradigm that partitions lengthy inputs into manageable chunks.
Outcome: The proposed model expands maximum sequence length from 1K to 16K tokens on a single RTX 3090 GPU, while SpaCO achieves accelerated training speed.
Parameter-Aware Contrastive Knowledge Editing: Tracing and Rectifying based on Critical Transmission Paths (2025.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) encode vast amounts of knowledge in their parameters, but the acquired knowledge can be incorrect or outdated over time, necessitating rectification after pre-training.
Approach: They propose a method that captures key information flows that influence model predictions . they propose 'critical transmission paths' to improve model editing .
Outcome: The proposed method improves on two prominent datasets and three widely used LLMs.
Breaking Consensus Bias: Unsupervised Reinforcement Learning for Machine Translation (2026.findings-acl)

Copied to clipboard

Challenge: Existing RL approaches for MT face fixed references or the production of homogeneous references leading to mode collapse in unsupervised settings.
Approach: They propose an Entropy-Driven Unsupervised RL framework for machine translation that leverages entropy for supervision construction and self-evolution.
Outcome: The proposed framework outperforms supervised and unsupervised baselines in multiple language pairs.
Never Lost in the Middle: Mastering Long-Context Question Answering with Position-Agnostic Decompositional Training (2024.acl-long)

Copied to clipboard

Challenge: Large language models suffer from severe hallucinations, compromising performance in knowledge-oriented QA, dialogue, and writing.
Approach: They propose to enhance the information searching and reflection ability of large language models by training them in position-agnostic multi-step QA tasks to improve their model's accuracy.
Outcome: The proposed model improves in multi-doc QA and other benchmarks by 13.7% absolute gain in shuffled settings, by 21.5% in passage retrieval task.
Evolving Agentic Workflow Driven by Human-Agent Collaboration (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches to generate agentic workflows using large language models are limited by high manual design costs, inefficient agentic search, and poor dynamic adaptability to new tasks and human preferences.
Approach: They propose an evolutionary framework for generating agentic workflows through human-agent collaboration using evolutionary algorithms that mutate and cross over their structures, prompts, and LLM backbones.
Outcome: The proposed framework surpasses other automated baselines by 27.34% while achieving comparable performance to o1-preview at only one-fourth of the cost.
CSI: An Investigative Multi-Agent Framework for Explainable Short Video Fake News Detection (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods for short video fake news detection rely on black-box MSLMs with poor explainability and superficial understanding or on specific prompt strategies for Multimodal Large Language Models (MLLMs)
Approach: They propose a multi-agent framework called CSI for short video fake news detection.
Outcome: The proposed framework provides rigorous explanations while achieving state-of-the-art performance on two real-world datasets.
A Multi-Modal Context Reasoning Approach for Conditional Inference on Joint Textual and Visual Clues (2023.acl-long)

Copied to clipboard

Challenge: Existing methods for conditional inference on joint textual and visual clues lack multimodal context reasoning capability.
Approach: They propose a multi-modal context reasoning approach that embeds textual semantics and objective image information into the pretrained language model to perform context reasoning.
Outcome: The proposed approach improves on two data sets and shows 4.8% gain on the PMR.
ABC-Bench: Benchmarking Agentic Backend Coding in Real-World Development (2026.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) have redefined the role of AI in software engineering . current benchmarks focus on localized code generation, but neglect dynamic, full-process requirements of real-world engineering.
Approach: They propose a benchmark to evaluate agentic backend coding within a realistic, executable workflow.
Outcome: The ABC-Bench benchmark evaluates agentic backend coding within a realistic, executable workflow.
Deep-Reporter: Deep Research for Grounded Multimodal Long-Form Generation (2026.acl-long)

Copied to clipboard

Challenge: Recent agentic search frameworks are text-centric, overlooking multimodal evidence . a pressing task is multimodal long-form generation, a new paper argues .
Approach: They propose a unified agentic framework for grounded multimodal long-form generation.
Outcome: The proposed framework is based on a unified agentic framework for grounded multimodal long-form generation.
Visibility as Survival: Generalizing NLP for Native Alaskan Language Identification (2025.findings-acl)

Copied to clipboard

Challenge: Indigenous languages are largely invisible in commercial language identification systems, a stark reality exemplified by Google Translate’s LangID tool, which excludes all 150 Indigenous languages of North America.
Approach: They propose a framework that shows how large language models and specialized classifiers can effectively identify these languages with minimal data.
Outcome: The proposed framework shows that large language models and specialized classifiers can effectively identify these languages with minimal data.
Safety Alignment via Constrained Knowledge Unlearning (2025.acl-long)

Copied to clipboard

Challenge: Existing defense mechanisms have not fully deleted harmful knowledge in large language models (LLMs) Existing methods to address safety alignment have not completely deleted harmful information in LLMs.
Approach: They propose a safety alignment strategy that uses scoring neurons to identify useful knowledge in LLMs and pruning the gradients of neurons in U to preserve beneficial information.
Outcome: The proposed method significantly improves model safety while maintaining utility compared to existing methods.
A Neural Divide-and-Conquer Reasoning Framework for Image Retrieval from Linguistically Complex Text (2023.acl-long)

Copied to clipboard

Challenge: Pretrained Vision-Language Models (VLMs) have achieved remarkable performance in image retrieval from text, but their performance drops drastically when confronted with linguistically complex texts.
Approach: They propose an end-to-end Neural Divide-and-Conquer Reasoning framework for linguistically complex texts that they struggle to comprehend.
Outcome: The proposed framework significantly improves performance in complex image-text reasoning problem.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations