Papers with MASS
FASPell: A Fast, Adaptable, Simple, Powerful Chinese Spell Checker Based On DAE-Decoder Paradigm (D19-55)
Copied to clipboard
| Challenge: | Existing spell checkers for Chinese are based on denoising autoencoder and decoder paradigms that require a small amount of data to be effective. |
| Approach: | They propose a Chinese spell checker based on a new paradigm which consists of a denoising autoencoder and a decoder. |
| Outcome: | The proposed spell checker is faster, more Adaptable to simplified and traditional Chinese texts and has a much simpler structure to be as much Powerful in error detection and correction. |
GLGE: A New General Language Generation Evaluation Benchmark (2021.findings-acl)
Copied to clipboard
Dayiheng Liu, Yu Yan, Yeyun Gong, Weizhen Qi, Hang Zhang, Jian Jiao, Weizhu Chen, Jie Fu, Linjun Shou, Ming Gong, Pengcheng Wang, Jiusheng Chen, Daxin Jiang, Jiancheng Lv, Ruofei Zhang, Winnie Wu, Ming Zhou, Nan Duan
| Challenge: | Multi-task benchmarks focus on a range of Natural Language Understanding (NLU) tasks without considering the Natural Language Generation (NLG) models. |
| Approach: | They propose a multi-task benchmark for evaluating the generalization capabilities of NLG models across eight language generation tasks. |
| Outcome: | The proposed benchmarks are based on GLUE and Su-perGLUE for English and several other languages. |
Language-Aware Multilingual Machine Translation with Self-Supervised Learning (2023.findings-eacl)
Copied to clipboard
| Challenge: | Multilingual machine translation (MMT) is a challenging multitask optimization problem because of lack of a framework to learn language-specific parameters. |
| Approach: | They propose a self-supervised learning task that denies monolingual data to MMT . they then propose 'intra-distillation' task that co-trains with MMT task . |
| Outcome: | The proposed approach outperforms three state-of-the-art methods on 8-language and 15-language benchmarks. |
JASS: Japanese-specific Sequence to Sequence Pre-training for Neural Machine Translation (2020.lrec-1)
Copied to clipboard
| Challenge: | Neural machine translation (NMT) requires large parallel corpora for training robust and high quality models. |
| Approach: | They propose a Japanese-specific sequence to sequence pre-training alternative to MASS for NMT . they use Japanese as the source or target language to train their models . |
| Outcome: | The proposed approach can give competitive results over MASS and BRSS, and significantly surpass the individual methods. |
Bridging the Data Gap between Training and Inference for Unsupervised Neural Machine Translation (2022.acl-long)
Copied to clipboard
| Challenge: | Experimental results show that backtranslation improves UNMT performance by reducing the data gap between training and inference. |
| Approach: | They propose an online method to remedy the source discrepancy between training and inference . they use pseudo parallel data with translated source and translated target to mimic inference scenario . |
| Outcome: | The proposed method outperforms baselines on several widely-used language pairs by remedying the style and content gaps. |
PALM: Pre-training an Autoencoding&Autoregressive Language Model for Context-conditioned Generation (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing techniques for natural language understanding and generation use autoencoding and/or autoregressive objectives to train models. |
| Approach: | They propose a self-supervised pre-training scheme that pre-trains an autoencoding and autoregressive language model on a large unlabeled corpus for generating new text conditioned on context. |
| Outcome: | The proposed scheme achieves state-of-the-art results on a variety of language generation benchmarks covering generative question answering, abstractive summarization and conversational response generation. |
MASS: Deep Research for Social Sciences with Memory-Augmented Social Simulation (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing systems rely heavily on literature retrieval and synthesis, resulting research lacking insight and creativity in social science. |
| Approach: | They propose a method that leverages highly realistic social simulations to the creativity of LLMs-generated research. |
| Outcome: | The proposed model shows a 6.81% improvement in quality over foundation LLMs and 17.19% gain in Insight over strong baselines. |
End-to-End Optimization of LLM-Driven Multi-Agent Search Systems via Heterogeneous-Group-Based Reinforcement Learning (2026.acl-long)
Copied to clipboard
| Challenge: | Existing multi-agent reinforcement learning methods depend on large critic networks to evaluate joint actions, leading to instability and high memory costs. |
| Approach: | They propose a method to optimize large language models for agent-specific roles . they propose combining agent-based frameworks with retrieval-augmented generation . |
| Outcome: | Experiments show that multi-agent group policy optimization outperforms baselines in task performance and computational efficiency. |