Papers by Tianyu Ding

7 papers
L2Dir: Integrating L_2-Norm and Directional Alignment for Unsupervised Contrastive Representation Learning in Multimodal Retrieval (2026.acl-long)

Copied to clipboard

Challenge: Existing approaches to multimodal representation learning focus on directional alignment and embedding magnitudes (L2-norm) however, these methods often fail to account for the intrinsic role of L2-norm in the contrastive process.
Approach: They propose a plug-and-play framework that optimizes L2-norm alignment and Directional consistency jointly.
Outcome: The proposed framework achieves consistent and significant performance gains over established baselines across 95 tasks using UniIR and VLM2Vec-V2 frameworks.
VocalRep: Structure-Aware Vocal Representations for Multimodal Generation (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches to vocal separation are optimized for signal-level reconstruction, but they overlook structural disentanglement required for downstream generation tasks.
Approach: They propose a structure-aware learning framework to disentangle vocals, harmonies, and accompaniment . they combine global vocal identity conditioning with ranking-based objectives .
Outcome: The proposed framework disentangles lead vocals, harmonies, and accompaniment while enforcing role consistency across long-form audio.
CoT-VTM: Visual-to-Music Generation with Chain-of-Thought Reasoning (2025.findings-acl)

Copied to clipboard

Challenge: Existing methods for visual-to-music generation lack large-scale, high-quality visual-music paired datasets and lack of direct semantic correspondence between visuals and music.
Approach: They propose a framework that distills Chain-of-Thought reasoning to enable visual-to-music generation without paired data.
Outcome: The proposed framework achieves optimal performance on image-to-music and video-to music tasks.
Discriminatively-Tuned Generative Classifiers for Robust Natural Language Inference (2020.emnlp-main)

Copied to clipboard

Challenge: Recent work has shown advantages of generative classifiers in terms of data efficiency and robustness.
Approach: They propose a generative classifier for natural language inference (NLI) they compare it to discriminative models and large-scale pretrained models like BERT .
Outcome: The proposed classifier outperforms discriminative and pretrained baselines across several challenging NLI experimental settings, including small training sets, imbalanced label distributions, and label noise.
COIG-P: A High-Quality and Large-Scale Chinese Preference Dataset for Alignment with Human Values (2026.findings-eacl)

Copied to clipboard

Challenge: Existing Chinese preference datasets suffer from limited scale, restricted domain coverage, and insufficiently rigorous data validation.
Approach: They propose an LLM-based data annotation pipeline with no human intervention to annotate Chinese preference datasets.
Outcome: The proposed pipeline outperforms existing Chinese preference datasets on AlignBench and Chinese Reward Benchmark.
AutoUE: Automated Generation of 3D Games in Unreal Engine via Multi-Agent Systems (2026.findings-acl)

Copied to clipboard

Challenge: Recent advances in Large Language Models (LLMs) and generative models have motivated studies on automated game generation from natural language descriptions.
Approach: They propose a novel multi-agent system, AutoUE, which coordinates multiple agents to end-to-end generate 3D games, covering model retrieval, scene generation, gameplay and interaction code synthesis, and automated game testing for evaluation.
Outcome: The proposed system covers model retrieval, scene generation, gameplay and interaction code synthesis, and automated game testing for evaluation.
LLaTiSA: Towards Difficulty-Stratified Time Series Reasoning from Visual Perception to Semantics (2026.findings-acl)

Copied to clipboard

Challenge: Current research hinders the development of unified Time Series Reasoning Models (TSRMs) time series data are a fundamental modality for capturing the temporal dynamics of complex systems.
Approach: They propose a time series reasoning model that integrates visualized patterns with precision-calibrated numerical tables to enhance the temporal perception of Vision-Language Models.
Outcome: The proposed model outperforms existing models and exhibits robust out-of-distribution generalization across diverse tasks and real-world scenarios.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations