Papers by Yiqi Huang
Browse and Concentrate: Comprehending Multimodal Content via Prior-LLM Context Fusion (2024.acl-long)
Copied to clipboard
Ziyue Wang, Chi Chen, Yiqi Zhu, Fuwen Luo, Peng Li, Ming Yan, Ji Zhang, Fei Huang, Maosong Sun, Yang Liu
| Challenge: | Multimodal Large Language Models (MLLMs) lack understanding of multi-image and interleaved inputs due to the visual features encoded by frozen encoders before being fed into the LLM backbone. |
| Approach: | They propose a two phase paradigm to enable in-depth multimodal context fusion prior to feeding the features into LLMs. |
| Outcome: | The proposed paradigm boosts the performance on 7 multi-image scenarios, contributing to increments on average accuracy by 2.13% and 7.60% against strong MLLMs baselines with 3B and 11B LLMs, respectively. |
Traffic-R1: Reinforced LLMs Bring Human-Like Reasoning to Traffic Signal Control Systems (2026.acl-long)
Copied to clipboard
| Challenge: | Rapid urbanization and surging vehicle ownership intensify congestion . rapid urbanization drives crash rates, slow emergency response, and burden transit-poor communities . |
| Approach: | They introduce a 3B-parameter foundation model with human-like reasoning for Traffic signal control (TSC) they use reinforcement learning and network communication to convert LLM into a traffic-control model that operates like a human traffic agent. |
| Outcome: | The proposed model outperforms baselines and training-intensive RL controllers on a simulated traffic environment and reduces queue lengths by more than 5%. |
InfiMM-WebMath-40B: Advancing Multimodal Pre-Training for Enhanced Mathematical Reasoning (2025.findings-emnlp)
Copied to clipboard
Xiaotian Han, Yiren Jian, Xuefeng Hu, Haogeng Liu, Yiqi Wang, Qihang Fan, Yuang Ai, Huaibo Huang, Ran He, Zhenheng Yang, Quanzeng You
| Challenge: | InfiMM-WebMath-40B is a dataset of interleaved image-text documents . it consists of 24 million web pages, 85 million image URLs, and 40 billion text tokens . |
| Approach: | InfiMM-WebMath-40B is a high-quality dataset of interleaved image-text documents . it contains 24 million web pages, 85 million image URLs, and 40 billion text tokens . |
| Outcome: | InfiMM-WebMath-40B is a high-quality dataset of interleaved image-text documents . it consists of 24 million web pages, 85 million image URLs, and 40 billion text tokens . |
MeetDot: Videoconferencing with Live Translation Captions (2021.emnlp-demo)
Copied to clipboard
Arkady Arkhangorodsky, Christopher Chu, Scot Fang, Yiqi Huang, Denglin Jiang, Ajay Nagesh, Boliang Zhang, Kevin Knight
| Challenge: | MeetDot is a videoconferencing system with live translation captions overlaid on screen . currently, the system supports speech and captions in 4 languages . |
| Approach: | They propose a videoconferencing system with live translation captions overlaid on screen . the system supports speech and captions in 4 languages and combines automatic speech recognition and machine translation in a cascade . |
| Outcome: | The proposed system supports speech and captions in 4 languages and has very tight latency requirements to have acceptable call quality. |