Papers by Siqi Ouyang
Hierarchical Policy Optimization for Simultaneous Translation of Unbounded Speech (2026.acl-long)
Copied to clipboard
| Challenge: | Existing synthesis methods cannot guarantee data quality. |
| Approach: | They propose a hierarchical reward that balances translation quality and latency objectives by combining supervised fine-tuning data with supervised inputs. |
| Outcome: | The proposed model can reuse key-value caches across both modalities and eliminate redundant feature recomputation. |
CA*: Addressing Evaluation Pitfalls in Computation-Aware Latency for Simultaneous Speech Translation (2025.findings-naacl)
Copied to clipboard
| Challenge: | Existing metrics for Simultaneous speech translation (SimulST) are inaccurately measuring latency in unsegmented streaming settings. |
| Approach: | They propose to modify existing metrics to correctly measure computation-aware latency for SimulST systems, addressing limitations present in existing metrics. |
| Outcome: | The proposed model is based on a real-time, lowlatency scenario where the model starts generating the textual translation before the entire audio input is processed. |
Pre-trained Language Models Can be Fully Zero-Shot Learners (2023.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to pre-trained language models require fine-tuning on labeled datasets or manually constructing proper prompts. |
| Approach: | They propose a nonparametric prompting PLM for fully zero-shot language understanding . they compare it to previous methods for text classification and text entailment . |
| Outcome: | The proposed method outperforms previous methods on diverse tasks. |
Translation Canvas: An Explainable Interface to Pinpoint and Analyze Translation Systems (2024.emnlp-demo)
Copied to clipboard
| Challenge: | Existing tools for evaluation of translation models focus on high-level metrics like BLEU or COMET scores, which are time-consuming and prone to error. |
| Approach: | They propose a toolkit that provides a detailed analysis of translation models and a user-friendly interface. |
| Outcome: | The toolkit shows superior performance over COMET and SacreBLEU packages under enjoybility and understandbility criteria. |
Anticipating Future with Large Language Model for Simultaneous Machine Translation (2025.naacl-long)
Copied to clipboard
Siqi Ouyang, Oleksii Hrinchuk, Zhehuai Chen, Vitaly Lavrukhin, Jagadeesh Balam, Lei Li, Boris Ginsburg
| Challenge: | Existing methods only use the partial utterance that has already arrived at the input and the generated hypothesis. |
| Approach: | They propose to use a large language model to predict future source words and opportunistically translate without introducing too much risk. |
| Outcome: | The proposed method outperforms baselines on four language directions and achieves the best translation quality-latency trade-off by up to 5 BLEU points at the same latency. |
Mending the Holes: Mitigating Reward Hacking in Reinforcement Learning for Multilingual Translation (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for training large language models rely heavily on high-quality parallel data, which are often scarce or unavailable for low-resource languages. |
| Approach: | They propose a reinforcement training method using only monolingual text to elevate LLMs’ translation capabilities on massive low-resource languages while retaining their performance on high-resourced languages. |
| Outcome: | The proposed model outperforms LLaMAX, one of the strongest open-source multilingual LLMs on 1,414 language directions on Flores-101 dataset. |
AutoPlan: Automatic Planning of Interactive Decision-Making Tasks With Large Language Models (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for making decisions in grounded environments require costly gradient computation or lengthy in-context demonstrations. |
| Approach: | They propose an approach to guide LLM-based agents to accomplish interactive decision-making tasks by using an LLM prompt and a task-solving plan. |
| Outcome: | The proposed approach outperforms human-written demonstrations on ALFWorld and HotpotQA by 8%. |
WACO: Word-Aligned Contrastive Learning for Speech Translation (2023.acl-long)
Copied to clipboard
| Challenge: | Existing ST methods perform poorly when only a limited amount of parallel data are available for training. |
| Approach: | They propose a Word-Aligned COntrastive learning method for low-resource speech-to-text translation that bridges word-level representations for both speech and text modalities via contrastive learning. |
| Outcome: | The proposed method outperforms the best baseline by 9+ BLEU points with only 1-hour parallel ST data. |
InfiniSST: Simultaneous Translation of Unbounded Speech with Large Language Model (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing models for simultaneous speech translation assume pre-segmented speech, limiting their real-world applicability. |
| Approach: | They propose a multi-turn dialogue task that can translate unbounded streaming speech . they construct translation trajectories and robust segments from MuST-C with multi-latency augmentation during training and develop a cache management strategy to facilitate efficient inference. |
| Outcome: | The proposed approach reduces computation-aware latency by 0.5 to 1 second while maintaining the same translation quality compared to baselines. |