Papers by Takuro Niitsuma
A Japanese News Simplification Corpus with Faithfulness (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing simplified corpora lack faithfulness to original text, resulting in errors in translation. |
| Approach: | They propose to simplify Japanese newspaper articles to prioritize faithfulness over automated models. |
| Outcome: | The proposed corpus preserves the original text, surpassing existing corpora. |
Investigating Web Corpus Filtering Methods for Language Model Development in Japanese (2024.naacl-srw)
Copied to clipboard
| Challenge: | a high quality web corpus is essential for large language models to be developed . strong filtering methods can lead to lesser performance in downstream tasks . |
| Approach: | They build classifiers and language models that can process large amounts of corpora quickly enough for pretraining LLMs. |
| Outcome: | The proposed method is the most accurate and leads to lesser performance in downstream tasks. |