Transfer Fine-tuning for Quality Estimation of Text Simplification (2024.lrec-main)
Copied to clipboard
| Challenge: | Experimental results show that quality estimation of text simplification models can be improved on a small labeled corpus. |
| Approach: | They propose a method to train quality estimation of text simplification on a small-scale labeled corpus prior to fine-tuning pre-trained language models. |
| Outcome: | The proposed method improves quality estimation of text simplification on a small-scale labeled corpus. |
Similar Papers
Controlling Pre-trained Language Models for Grade-Specific Text Simplification (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to text simplification control output complexity at corpus level disregarding complexity of individual inputs and considering only one level of output complexity. |
| Approach: | They propose a method that predicts edit operations required for a specific grade level . they say this approach improves the quality of the simplified outputs over corpus-level heuristics . |
| Outcome: | The proposed method improves the readability of simplified outputs over corpus-level search-based heuristics. |
Language Models for German Text Simplification: Overcoming Parallel Data Scarcity through Style-specific Pre-training (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to train automatic text simplification systems for languages other than English are limited by the lack of parallel data. |
| Approach: | They propose to use German Easy Language as a corpus of automatic text simplification systems to fine-tune language models to the style characteristics of the language. |
| Outcome: | The proposed language models adapt to the style characteristics of Easy Language and output more accessible texts. |
Are we Estimating or Guesstimating Translation Quality? (2020.acl-main)
Copied to clipboard
| Challenge: | A carefully engineered ensemble of pre-trained multilingual language models won the QE shared task at WMT19. |
| Approach: | They propose to use pre-trained multilingual language models to train quality estimation for machine translation. |
| Outcome: | A carefully engineered ensemble of pre-trained language models wins the QE shared task at WMT19. |
Quality Estimation without Human-labeled Data (2021.eacl-main)
Copied to clipboard
Yi-Lin Tuan, Ahmed El-Kishky, Adithya Renduchintala, Vishrav Chaudhary, Francisco Guzmán, Lucia Specia
| Challenge: | Quality estimation aims to measure the quality of translated content without access to a reference translation. |
| Approach: | They propose a method that uses synthetic training data to train supervised quality estimation models. |
| Outcome: | The proposed model outperforms models trained on human-annotated data for sentence and word-level prediction. |
“A Little is Enough”: Few-Shot Quality Estimation based Corpus Filtering improves Machine Translation (2023.findings-acl)
Copied to clipboard
| Challenge: | Quality Estimation (QE) is the task of evaluating the quality of a translation when reference translation is unavailable. |
| Approach: | They propose a Quality Estimation based Filtering approach to extract high-quality parallel data from the pseudo-parallel corpus. |
| Outcome: | The proposed approach improves the machine translation system performance by up to 1.8 BLEU points over the baseline model. |
Classification-based Quality Estimation: Small and Efficient Models for Real-world Applications (2021.emnlp-main)
Copied to clipboard
| Challenge: | Sentence-level Quality estimation (QE) is traditionally a regression task . but large multilingual contextualized language models are expensive and infeasible for real-world applications. |
| Approach: | They evaluate several model compression techniques for QE and find they are inefficient . they argue that a full model parameterization is required to achieve SoTA results . |
| Outcome: | The proposed models are poorly expressive in a regression task, the authors argue . they show that reframing QE as a classification problem and evaluating models would improve their performance in real-world applications. |
PreQuEL: Quality Estimation of Machine Translation Outputs in Advance (2022.emnlp-main)
Copied to clipboard
| Challenge: | A PreQuEL system predicts how well a given sentence will be translated without recourse to the actual translation. |
| Approach: | They propose a task that uses a model to predict how well a given sentence will be translated . they show that the model is sensitive to syntactic and semantic distinctions . |
| Outcome: | The proposed model improves on the Quality-Estimation task and on challenge sets and languages. |
Self-Supervised Quality Estimation for Machine Translation (2021.emnlp-main)
Copied to clipboard
Yuanhang Zheng, Zhixing Tan, Meng Zhang, Mieradilijiang Maimaiti, Huanbo Luan, Maosong Sun, Qun Liu, Yang Liu
| Challenge: | Training QE models require massive parallel data with hand-crafted quality annotations, which are time-consuming and labor-intensive to obtain. |
| Approach: | They propose a self-supervised method to evaluate machine-translated sentences without references by recovering masked target words. |
| Outcome: | The proposed method outperforms previous unsupervised methods on several QE tasks in different language pairs and domains. |
Knowledge Distillation for Quality Estimation (2021.findings-acl)
Copied to clipboard
Amit Gajbhiye, Marina Fomicheva, Fernando Alva-Manchego, Frédéric Blain, Abiola Obamuyide, Nikolaos Aletras, Lucia Specia
| Challenge: | Recent success in Quality Estimation stems from the use of multilingual pre-trained models, where large models lead to impressive results. |
| Approach: | They propose to transfer knowledge from a strong QE teacher model to a much smaller model with a different, shallower architecture. |
| Outcome: | The proposed model performs better than distilled models with 8x fewer parameters. |
Teaching the Pre-trained Model to Generate Simple Texts for Text Simplification (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing strategies to teach pre-trained models to generate simple texts are inadequate. |
| Approach: | They propose a continued pre-training strategy to teach pre-trained models to generate simple texts by randomly masking text spans in ordinary texts. |
| Outcome: | The proposed strategy improves on lexical simplification, sentence simplification and document-level simplification tasks over existing models. |