| Challenge: | Existing studies on sentential paraphrase detection focus on finer grained paraphrases, i.e., phrasal paraphrase. |
| Approach: | They propose to use the SPADE to evaluate syntactic phrase alignment in paraphrasal sentences. |
| Outcome: | The proposed method is compared with humans and provides benchmarks to show its performance. |
Similar Papers
Using Paraphrases to Study Properties of Contextual Embeddings (2022.naacl-main)
Copied to clipboard
| Challenge: | Previously, paraphrases have been used to probe whether compositionality is accurately captured by BERT, but we believe they can be used to explore many other questions. |
| Approach: | They propose to use paraphrases as a unique source of data to analyze contextualized embeddings, with a particular focus on BERT. |
| Outcome: | The proposed analysis of paraphrases and paraphrase representations using the Paraphrase Database shows that BERT handles polysemous words, but different representations in many cases. |
Essentia: Mining Domain-specific Paraphrases with Word-Alignment Graphs (D19-53)
Copied to clipboard
| Challenge: | Existing methods for mining general-purpose paraphrases are often based on statistical methods, but domain-specific corpora are too small to fit statistical methods. |
| Approach: | They propose a method to mine paraphrases from a small set of sentences that roughly share the same topic or intent. |
| Outcome: | The proposed method obtains high quality paraphrases as evaluated by crowd workers. |
Neural semi-Markov CRF for Monolingual Word Alignment (2021.acl-long)
Copied to clipboard
| Challenge: | Experimental results show that our proposed model outperforms all previous approaches for monolingual word alignment. |
| Approach: | They propose a neural semi-Markov CRF alignment model which unifies word and phrase alignments through variable-length spans. |
| Outcome: | The proposed model outperforms existing models on in-domain and out-of-domain evaluations and a QA-based benchmark with human annotations. |
Task-Oriented Paraphrase Analytics (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing studies on paraphrasing have applied different criteria to the task . authors have previously unmasked related tasks as paraphrases . |
| Approach: | They propose a taxonomy to organize 25 identified paraphrasing tasks . authors propose to use classifiers to identify tasks that a given paraphrased instance fits . |
| Outcome: | The proposed taxonomy identifies 25 paraphrasing tasks that fit the proposed task. |
Neural Network Alignment for Sentential Paraphrases (P19-1)
Copied to clipboard
| Challenge: | a monolingual alignment system is ill-suited for word- or short phrase-based alignments. |
| Approach: | They propose a monolingual alignment system for long, sentence- or clause-level alignments . they show that systems designed for word- or short phrase-based alignment are ill-suited for longer alignments. |
| Outcome: | The proposed system outperforms state-of-the-art systems on long alignments . it achieves significantly higher recall on aligning phrases of four or more words . |
PropSegmEnt: A Large-Scale Corpus for Proposition-Level Segmentation and Entailment Recognition (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing systems for Natural Language Inference (NLI) only recognize textual entailment relations on sentence-level . however, even a simple sentence often contains multiple propositions, i.e. distinct units of meaning conveyed by the sentence . |
| Approach: | They propose a system to recognize whether one text is textually entailed by another . they use a corpus of over 45K propositions annotated by human raters to study the textual entailment relation of each proposition in a sentence individually. |
| Outcome: | The proposed dataset can be used to understand the compositionality of NLI labels. |
ParaTag: A Dataset of Paraphrase Tagging for Fine-Grained Labels, NLG Evaluation, and Data Augmentation (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing datasets only annotate a binary label for each sentence pair. Existing models only annnotate binary labels for each phrase pair. |
| Approach: | They propose a novel binary paraphrase classification task that annotates the degree of paraphrase between sentences and a new annotation schema that labels the minimum spans of tokens in a sentence that don't have the corresponding paraphrases in the other sentence. |
| Outcome: | The proposed dataset can be used to train an automatic scorer for language generation evaluation. |
RuPAWS: A Russian Adversarial Dataset for Paraphrase Identification (2022.lrec-1)
Copied to clipboard
Nikita Martynov, Irina Krotova, Varvara Logacheva, Alexander Panchenko, Olga Kozlova, Nikita Semenov
| Challenge: | Existing datasets for paraphrase identification lack challenging sentence pairs with high word overlap. |
| Approach: | They propose to use a dataset for Russian paraphrase detection that includes examples from PAWS translated to the Russian language and manually annotated by native speakers. |
| Outcome: | The proposed model performs well on both datasets while maintaining accuracy on the ParaPhraser benchmark. |
PARAPHRASUS: A Comprehensive Benchmark for Evaluating Paraphrase Detection Models (2025.coling-main)
Copied to clipboard
| Challenge: | prevailing notion of paraphrase is simplistic, offering only limited view of vast spectrum of paraphrasing phenomena. |
| Approach: | They propose a benchmarking tool for paraphrase detection that provides a fine-grained evaluation lens. |
| Outcome: | The proposed benchmark enables rapid calibration of models to specific strictness levels. |
A Multilingual Dataset for Evaluating Parallel Sentence Extraction from Comparable Corpora (L18-1)
Copied to clipboard
| Challenge: | BUCC Shared Task aims to extract parallel sentences from comparable corporad . resulting corpus contains about 3.5 million distinct sentences in english, french, german, Russian, and Chinese . |
| Approach: | They present challenges faced to build a parallel sentences dataset from comparable corporad . they emphasize issues faced to include Chinese as one of the languages . |
| Outcome: | The 2017 BUCC Shared Task was a first for this task . the dataset contains 3.5 million sentences in English, French, German, Russian, and Chinese . |