Papers by Katsuhito Sudoh
Automatic Machine Translation Evaluation using Source Language Inputs and Cross-lingual Language Model (2020.acl-main)
Copied to clipboard
| Challenge: | Existing methods for machine translation evaluation use source sentences as pseudo references instead of word symbols. |
| Approach: | They propose an automatic machine translation evaluation method that uses source sentences as pseudo references instead of source sentences. |
| Outcome: | The proposed method achieves higher correlation with human judgments than baseline evaluation method that uses only hypothesis and reference sentences. |
LLMs Are Zero-Shot Context-Aware Simultaneous Translators (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing SiMT systems operate on a sentence level, disregarding the context established by previous sentences or the broader context implied by previous words. |
| Approach: | They show that open-source LLMs perform on par with or better than some state-of-the-art baselines in simultaneous machine translation tasks, zero-shot. |
| Outcome: | The proposed models perform on par with or better than state-of-the-art baselines in simultaneous machine translation tasks, zero-shot. |
Incorporating Noisy Length Constraints into Transformer with Length-aware Positional Encodings (2020.coling-main)
Copied to clipboard
| Challenge: | Neural Machine Translation suffers from an under-translation problem due to limited modeling of output sequence lengths. |
| Approach: | They propose a method to train a Transformer model using length constraints based on positional encoding. |
| Outcome: | The proposed method outperforms a vanilla Transformer in an English-to-Japanese translation by 3.22 points . the noise injection improved robustness for length prediction errors, especially within the window size. |
Evaluating the IWSLT2023 Speech Translation Tasks: Human Annotations, Automatic Metrics, and Segmentation (2024.lrec-main)
Copied to clipboard
Matthias Sperber, Ondřej Bojar, Barry Haddow, Dávid Javorský, Xutai Ma, Matteo Negri, Jan Niehues, Peter Polák, Elizabeth Salesky, Katsuhito Sudoh, Marco Turchi
| Challenge: | a meta-analysis of human evaluation for speech translation has not been conducted . noisy data and segmentation mismatches are challenges for automatic metrics . |
| Approach: | They propose an evaluation strategy based on automatic resegmentation and direct assessment with segment context. |
| Outcome: | The proposed evaluation strategy is robust and scores well-correlated with other types of human judgements. |
Evaluating the Robustness of Discrete Prompts (2023.eacl-main)
Copied to clipboard
| Challenge: | Existing methods that generate discrete prompts from a small set of training instances have reported superior performance, but manual writing prompts that generalize well is challenging due to several reasons. |
| Approach: | They propose to use discrete prompts to learn lexical constructs that would not be encountered in manually-written prompts. |
| Outcome: | The proposed method is robust against perturbations to NLI inputs but sensitive to other types of perturbations such as shuffling and deletion of prompt tokens. |
NAIST-SIC-Aligned: An Aligned English-Japanese Simultaneous Interpretation Corpus (2024.lrec-main)
Copied to clipboard
| Challenge: | Simultaneous interpretation data is a task where an utterance is translated in real-time. |
| Approach: | They propose to use an automatically-aligned parallel English-Japanese SI dataset to make it suitable for model training. |
| Outcome: | The proposed model improves translation quality and latency over baselines. |
Improving Spoken Language Understanding by Wisdom of Crowds (2020.coling-main)
Copied to clipboard
| Challenge: | Existing systems that use statistical approaches to improve spoken language understanding (SLU) lack of training data is an important problem, especially for new system tasks. |
| Approach: | They propose to use crowdsourcing and knowledge community websites to augment the spoken language understanding system by collecting paraphrasing variations for new system tasks and augmented them using similar questions from a knowledge community website. |
| Outcome: | The proposed architecture augmented more than 120,000 samples to improve accuracies even with small seed data. |
Reflection-based Word Attribute Transfer (2020.acl-srw)
Copied to clipboard
| Challenge: | Existing word embeddings represent analogic relations to change attributes, such as gender, such that king is male. |
| Approach: | They propose a method for word attribute transfer based on reflection mappings without such an analogy operation. |
| Outcome: | The proposed method can transfer attributes of the given words without changing the words that do not have the target attributes. |
TransLLaMa: LLM-based Simultaneous Translation System (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Decoder-only large language models have limited applications in simultaneous machine translation . naively translating each source word immediately results in compromised target quality . |
| Approach: | a study shows that a pre-trained open-source LLM can control input segmentation directly by generating a special "wait" token. |
| Outcome: | a new open-source model can control input segmentation directly by generating a special "wait" token. |
Subspace Representations for Soft Set Operations and Sentence Similarities (2024.naacl-long)
Copied to clipboard
| Challenge: | Embedding-based word representations are crucial for capturing the semantic meanings of individual words. |
| Approach: | They propose to embed word sets and corresponding set operations within pre-trained word embedding spaces. |
| Outcome: | The proposed representations outperform vector-based representations in sentence similarity and set retrieval tasks. |
Findings of the Third Workshop on Neural Generation and Translation (D19-56)
Copied to clipboard
Hiroaki Hayashi, Yusuke Oda, Alexandra Birch, Ioannis Konstas, Andrew Finch, Minh-Thang Luong, Graham Neubig, Katsuhito Sudoh
| Challenge: | The 3rd Workshop on Neural Machine Translation and Generation (WNGT) was held in concert with the annual conference of the Empirical Methods in Natural Language Processing (EMNLP 2019). |
| Approach: | They describe the results of the third workshop on Neural Generation and Translation held in concert with the annual conference of the Empirical Methods in Natural Language Processing (EMNLP 2019). |
| Outcome: | The results of the 3rd Workshop on Neural Machine Translation and Generation (WNGT) were summarized in Sections 3 and 4. |