Evaluating LLMs for Portuguese Sentence Simplification with Linguistic Insights (2025.acl-long)
Copied to clipboard
Arthur Mariano Rocha De Azevedo Scalercio, Elvis A. De Souza, Maria José Bocorny Finatto, Aline Paes
| Challenge: | Sentence simplification (SS) aims to make sentences more straightforward to read and understand without changing its key points. |
| Approach: | They compare 26 state-of-the-art LLMs in Portuguese SS with two simplification models trained explicitly for this task and language. |
| Outcome: | The proposed models outperform open-source models in Portuguese SS . the models are compared against two simplification models trained for Portuguese . |
Similar Papers
Enhancing Sentence Simplification in Portuguese: Leveraging Paraphrases, Context, and Linguistic Features (2024.findings-acl)
Copied to clipboard
| Challenge: | Automated text simplification requires (paired) datasets that are scarce in languages other than English. |
| Approach: | They propose a method that leverages paraphrases, context, and linguistic attributes to overcome the absence of paired texts in Portuguese. |
| Outcome: | The proposed model surpasses the current state-of-the-art while competing with a Large Language Model. |
BLESS: Benchmarking Large Language Models on Sentence Simplification (2023.emnlp-main)
Copied to clipboard
Tannon Kew, Alison Chi, Laura Vásquez-Rodríguez, Sweta Agrawal, Dennis Aumiller, Fernando Alva-Manchego, Matthew Shardlow
| Challenge: | BLESS is a performance benchmark of the most recent state-of-the-art Large Language Models (LLMs) on the task of text simplification (TS). |
| Approach: | They present a performance benchmark of the most recent state-of-the-art Large Language Models (LLMs) on the task of text simplification (TS). |
| Outcome: | The proposed benchmarks show that the most recent state-of-the-art LLMs perform better on the task of text simplification (TS). |
Text Simplification from Professionally Produced Corpora (L18-1)
Copied to clipboard
| Challenge: | Existing approaches to Text Simplification rely on the Wikipedia-Simple Wikipedia parallel corpus, which is used for many tasks. |
| Approach: | They propose to use the Newsela corpus to extract 550, 644 complex-simple sentence pairs from the corpus and introduce a lexical simplifier that uses the corpu to generate candidate simplifications. |
| Outcome: | The proposed model outperforms state-of-the-art approaches and generates candidate simplifications from the newsela corpus. |
Using Eye-tracking Data to Predict the Readability of Brazilian Portuguese Sentences in Single-task, Multi-task and Sequential Transfer Learning Approaches (2020.coling-main)
Copied to clipboard
Sidney Evaldo Leal, João Marcos Munguba Vieira, Erica dos Santos Rodrigues, Elisângela Nogueira Teixeira, Sandra Aluísio
| Challenge: | Sentence complexity assessment is a relatively new task in Natural Language Processing. |
| Approach: | They propose to use Brazilian Portuguese to evaluate sentences with linguistic features to improve readability. |
| Outcome: | The proposed model reaches the state-of-the-art for Brazilian Portuguese with 97.8% accuracy with linguistic features. |
A Nontrivial Sentence Corpus for the Task of Sentence Readability Assessment in Portuguese (C18-1)
Copied to clipboard
| Challenge: | Effective textual communication depends on readers being proficient enough to comprehend texts . when meaning is not well conveyed, many losses and damages may occur . |
| Approach: | They propose automatic evaluation of sentence readability task in Portuguese to improve readability. |
| Outcome: | The proposed method correctly identifies the ranking of sentence pairs with an accuracy of 74.2%. |
ALEXSIS-PT: A New Resource for Portuguese Lexical Simplification (2022.coling-1)
Copied to clipboard
| Challenge: | Lexical simplification (LS) is the task of replacing complex words with simpler alternatives to make texts more accessible to various target populations. |
| Approach: | They propose to use a Brazilian Portuguese multi-candidate dataset to test LS systems. |
| Outcome: | The proposed model outperforms existing models on Brazilian Portuguese and Brazilian newspaper articles. |
Let’s Simplify Step by Step: Guiding LLM Towards Multilingual Unsupervised Proficiency-Controlled Sentence Simplification (2026.findings-eacl)
Copied to clipboard
| Challenge: | Large language models demonstrate limited capability in proficiency-controlled sentence simplification when simplifying across large readability levels. |
| Approach: | They propose a framework that decomposes complex simplifications into manageable steps through dynamic path planning, semantic-aware exemplar selection, and chain-of-thought generation with conversation history for coherent reasoning. |
| Outcome: | The proposed framework reduces computational steps while improving simplification effectiveness on five languages across two benchmarks. |
Replace, Paraphrase or Fine-tune? Evaluating Automatic Simplification for Medical Texts in Spanish (2024.lrec-main)
Copied to clipboard
Leonardo Campillos-Llanos, Ana Rosa Terroba, Rocío Bartolomé, Ana Valverde-Mateos, Cristina González, Adrián Capllonch-Carrión, Jonathan Heras
| Challenge: | lexicon-based simplification methods can help patients understand medical documents . but they must ensure that the content is transmitted rigorously and not creating wrong information. |
| Approach: | They tested automatic simplification techniques using a Spanish lexicon of technical and laymen terms. |
| Outcome: | The proposed methods improve the quantitative results and the human evaluation of medical documents. |
Comparing human and language models sentence processing difficulties on complex structures (2026.acl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) that converse with humans are a reality, but do LLMs experience human-like processing difficulties? |
| Approach: | They systematically compare human and LLM sentence comprehension across seven challenging linguistic structures. |
| Outcome: | The proposed model achieves near perfect accuracy on non-GP structures, but struggles on GP structures. |
Revisiting non-English Text Simplification: A Unified Multilingual Benchmark (2023.acl-long)
Copied to clipboard
| Challenge: | Recent advances in English automatic text simplification have pushed the frontier of multilingual text simulating. |
| Approach: | They propose to use multilingual evaluation benchmarks to evaluate multilingual text simplification models in English and other languages. |
| Outcome: | The proposed benchmark outperforms pre-trained models in Russian in zero-shot cross-lingual transfer to low-resource languages. |