Semantic Equivalence Detection: Are Interrogatives Harder than Declaratives? (L18-1)
Copied to clipboard
| Challenge: | Semantic Text Similarity (STS) tasks are often not seen as similar to semantic equivalence detection tasks. |
| Approach: | They propose to assess the performance of different approaches to STS over different types of textual segments. |
| Outcome: | The proposed methods differ in performance over different types of textual segments, including declaratives and interrogatives, under conditions of comparability. |
Similar Papers
A Multi-Domain Framework for Textual Similarity. A Case Study on Question-to-Question and Question-Answering Similarity Tasks (L18-1)
Copied to clipboard
| Challenge: | Community Question Answering websites are becoming popular and useful source of information for users. |
| Approach: | They propose to use community question answering forum to detect similar questions . they use question-answering similarity task to provide correct answers . |
| Outcome: | The proposed framework provides the first framework on the evaluation of similar questions and question-answering detection on a multi-domain corpora. |
Multi-View Domain Adapted Sentence Embeddings for Low-Resource Unsupervised Duplicate Question Detection (D19-1)
Copied to clipboard
| Challenge: | Stack Exchange has fewer than 160 user-labeled duplicates, and 25% have fewer. |
| Approach: | They propose a framework that combines sentence encoders with unlabeled data to solve the problem of duplicate question detection in Community Question Answering forums. |
| Outcome: | The proposed framework outperforms BM25, a single-view system and a supervised domain-adversarial DQD method on the CQADupStack corpus and on Stack Exchange forums. |
Matching Varying-Length Texts via Topic-Informed and Decoupled Sentence Embeddings (2024.findings-naacl)
Copied to clipboard
| Challenge: | Existing approaches to matching text with non-comparable lengths are limited due to truncation issues. |
| Approach: | They propose a model that decouples sentences and embeds them into natural sentences for matching texts of significantly different lengths. |
| Outcome: | The proposed model matches texts of significantly different lengths across three well-studied datasets. |
What can Large Language Models Capture about Code Functional Equivalence? (2025.findings-naacl)
Copied to clipboard
| Challenge: | SeqCoBench is a benchmark to assess how Code-LLMs can capture code semantics. |
| Approach: | They propose a benchmark to assess how Code-LLMs capture code semantics . they use seqCoBench to evaluate whether they can discern semantically equivalent or different pairs of programs . |
| Outcome: | The proposed benchmarks show that they can capture code semantics better than classical match-based retrieval scores. |
Improving Paraphrase Detection with the Adversarial Paraphrasing Task (2021.acl-long)
Copied to clipboard
| Challenge: | a new adversarial method of paraphrase identification is being used to identify paraphrases based on word overlap and syntax . authors propose a dataset that generates semantically equivalent but lexically and syntactically disparate paraphrase pairs . |
| Approach: | They propose an adversarial method for paraphrase identification that uses word overlap and syntax to identify paraphrases. |
| Outcome: | The proposed method improves paraphrase detection accuracy and speed of generation of datasets. |
Toward Interpretable Semantic Textual Similarity via Optimal Transport-based Contrastive Sentence Learning (2022.acl-long)
Copied to clipboard
| Challenge: | Existing studies have shown that a pretrained language model can capture sentence similarity but there is no interpretation method for the sentence similarities. |
| Approach: | They propose a pretrained language model that captures sentence similarity between embeddings and a transport-based distance measure that leverages semantically-aligned token pairs. |
| Outcome: | The proposed framework outperforms baselines on both STS and interpretable-STS benchmarks and provides interpretation consistent with human judgement. |
An Intent-based and Annotation-free Method for Duplicate Question Detection in CQA Forums (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for detecting duplicate questions in CQA rely on generic text-pair matching models, overlooking the intent behind the questions. |
| Approach: | They propose a new intent-based duplication detector that leverages intent information to address the problem of duplicate question detection in CQA. |
| Outcome: | The proposed detector leverages the characteristics of CQA forums and extracts training labels to recognize and match intents without human annotation. |
Don’t paraphrase, detect! Rapid and Effective Data Collection for Semantic Parsing (D19-1)
Copied to clipboard
| Challenge: | a major hurdle on the road to conversational interfaces is the difficulty in collecting data that maps language utterances to logical forms . crowdsourcing and crowdsourcing have been used to generate pseudo-language paired with logical form . however, this data collection method often leads to low performance on real data . |
| Approach: | They propose a method that uses crowdsourcing to map language utterances to logical forms . they quantify the effects of mismatches between the true and induced distributions . |
| Outcome: | The proposed method leads to 70.6 accuracy on the true distribution, compared to 51.3 in paraphrase-based data collection. |
Evaluating LLMs’ Capability to Identify Lexical Semantic Equivalence: Probing with the Word-in-Context Task (2025.coling-main)
Copied to clipboard
| Challenge: | Existing methods to evaluate the capability of large language models to identify lexical semantic equivalence are not currently being used. |
| Approach: | They propose to use the Word-in-Context (WiC) task to determine whether the meanings of a target word remain identical across different contexts to evaluate their capability. |
| Outcome: | The proposed method outperforms other LLMs in the Word-in-Context (WiC) task. |
A Multilingual Dataset for Evaluating Parallel Sentence Extraction from Comparable Corpora (L18-1)
Copied to clipboard
| Challenge: | BUCC Shared Task aims to extract parallel sentences from comparable corporad . resulting corpus contains about 3.5 million distinct sentences in english, french, german, Russian, and Chinese . |
| Approach: | They present challenges faced to build a parallel sentences dataset from comparable corporad . they emphasize issues faced to include Chinese as one of the languages . |
| Outcome: | The 2017 BUCC Shared Task was a first for this task . the dataset contains 3.5 million sentences in English, French, German, Russian, and Chinese . |