Papers by Benjamin Hsu
Reasoning with Memory: Adaptive Information Management for Retrieval-Augmented Generation (2026.findings-acl)
Copied to clipboard
| Challenge: | Multi-hop reasoning remains a fundamental challenge for Retrieval-Augmented Generation systems. |
| Approach: | They propose a framework that provides a dynamic cognitive workspace for multi-hop reasoning . it uses an explicit working memory that persists across retrieval cycles and is continuously updated . |
| Outcome: | The proposed framework achieves state-of-the-art performance over existing systems on eight QA benchmarks. |
RAMP: Retrieval and Attribute-Marking Enhanced Prompting for Attribute-Controlled Translation (2023.acl-short)
Copied to clipboard
| Challenge: | Attribute-controlled translation (ACT) is a subtask of machine translation that involves controlling stylistic or linguistic attributes (like formality and gender) of outputs. |
| Approach: | They propose a new approach to attribute-controlled translation that leverages multilingual language models to perform ACT in few-shot and zero-shot settings. |
| Outcome: | The proposed approach improves generation accuracy over the standard prompting approach in both zero-shot and few-shot settings. |
CoCoA-MT: A Dataset and Benchmark for Contrastive Controlled MT with Application to Formality (2022.findings-naacl)
Copied to clipboard
| Challenge: | Specific problems arise when translating from English into languages with formality markers, such as “Are you sure?” . Using wrong or inconsistent tone may be perceived as inappropriate or jarring for users of certain cultures and demographics. |
| Approach: | They propose to train formality-controlled models by fine-tuning on labeled contrastive data and a metric to evaluate them. |
| Outcome: | The proposed model achieves high accuracy (82% in-domain and 73% out-of-domain) while maintaining overall quality. |
MT-GenEval: A Counterfactual and Contextual Dataset for Evaluating Gender Accuracy in Machine Translation (2022.emnlp-main)
Copied to clipboard
Anna Currey, Maria Nadejde, Raghavendra Reddy Pappagari, Mia Mayer, Stanislas Lauly, Xing Niu, Benjamin Hsu, Georgiana Dinu
| Challenge: | Existing benchmarks have limited diversity in terms of gender phenomena, sentence structure, or language coverage. |
| Approach: | They propose a benchmark to evaluate gender accuracy in translation from English into eight widely-spoken languages. |
| Outcome: | The proposed benchmark provides realistic, gender-balanced, counterfactual data in eight language pairs where the gender of individuals is unambiguous in the input segment. |
Contrastive Representation Learning for Cross-Document Coreference Resolution of Events and Entities (2022.naacl-main)
Copied to clipboard
| Challenge: | Identifying related entities and events within and across documents is fundamental to natural language understanding. |
| Approach: | They propose an approach to entity and event coreference resolution using contrastive representation learning. |
| Outcome: | The proposed method achieves state-of-the-art results on key metrics on the ECB+ corpus and is competitive on others. |
On Generative Spoken Language Modeling from Raw Audio (2021.tacl-1)
Copied to clipboard
Kushal Lakhotia, Eugene Kharitonov, Wei-Ning Hsu, Yossi Adi, Adam Polyak, Benjamin Bolte, Tu-Anh Nguyen, Jade Copet, Alexei Baevski, Abdelrahman Mohamed, Emmanuel Dupoux
| Challenge: | Using a set of metrics to evaluate the learned representations, we aim to create a system that learns from natural interactions as infants learn their first language. |
| Approach: | They propose a task of learning acoustic and linguistic characteristics from raw audio and a set of metrics to evaluate the learned representations at acustic, linguistic and encoding levels. |
| Outcome: | The proposed models evaluate the learned representations at acoustic and linguistic levels for both encoding and generation. |
M3T: A New Benchmark Dataset for Multi-Modal Document-Level Machine Translation (2024.naacl-short)
Copied to clipboard
Benjamin Hsu, Xiaoyu Liu, Huayang Li, Yoshinari Fujinuma, Maria Nadejde, Xing Niu, Ron Litman, Yair Kittenplon, Raghavendra Pappagari
| Challenge: | Document translation is a challenge for machine translation systems that focus on textual content at the sentence level, ignoring global context and visual layout structure. |
| Approach: | They propose a benchmark dataset to evaluate document-level NMT systems . they use visual cues to preserve reading order and contiguous blocks of text . |
| Outcome: | The proposed benchmarks assess document-level NMT systems on the comprehensive task of translating semi-structured documents. |