Papers by Aoxiong Yin
T2S-GPT: Dynamic Vector Quantization for Autoregressive Sign Language Production from Text (2024.acl-long)
Copied to clipboard
| Challenge: | Existing vector quantization methods are fixed-length encodings, overlooking the uneven information density in sign language. |
| Approach: | They propose a two-stage sign language production paradigm that encodes sign language sequences into discrete codes and autoregressively generates sign languages from text. |
| Outcome: | The proposed model can dynamically adjust the encoding length based on the information density in sign language to achieve accurate and compact encoded enccoding. |
TransFace: Unit-Based Audio-Visual Speech Synthesizer for Talking Head Translation (2024.findings-acl)
Copied to clipboard
Xize Cheng, Rongjie Huang, Linjun Li, Zehan Wang, Tao Jin, Aoxiong Yin, Chen Feiyang, Xinyu Duan, Baoxing Huai, Zhou Zhao
| Challenge: | Existing methods for talking head translation rely on cascading, resulting in delays and cascadic errors. |
| Approach: | They propose a model for talking head translation, TransFace, which can translate audio-visual speech into audio-visual speech in other languages. |
| Outcome: | The proposed model can translate audio-visual speech into audio-visual speech in other languages. |
3DRP-Net: 3D Relative Position-aware Network for 3D Visual Grounding (2023.emnlp-main)
Copied to clipboard
| Challenge: | 3D visual grounding aims to localize the desired objects in a 3D point cloud by a free-form language description. |
| Approach: | They propose a relation-aware framework which captures relative spatial relationships between objects and enhances object attributes. |
| Outcome: | The proposed framework outperforms state-of-the-art methods on three benchmarks . it captures relative spatial relationships between objects and enhances object attributes . |