PropSegmEnt: A Large-Scale Corpus for Proposition-Level Segmentation and Entailment Recognition (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing systems for Natural Language Inference (NLI) only recognize textual entailment relations on sentence-level . however, even a simple sentence often contains multiple propositions, i.e. distinct units of meaning conveyed by the sentence . |
| Approach: | They propose a system to recognize whether one text is textually entailed by another . they use a corpus of over 45K propositions annotated by human raters to study the textual entailment relation of each proposition in a sentence individually. |
| Outcome: | The proposed dataset can be used to understand the compositionality of NLI labels. |
Similar Papers
DocNLI: A Large-scale Dataset for Document-level Natural Language Inference (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing studies focus on sentence-level inference, which limits its application in downstream NLP problems. |
| Approach: | They propose to construct a large-scale dataset for document-level NLI that can be used to study NLP problems. |
| Outcome: | The proposed model performs well on popular sentence-level benchmarks and generalizes well to out-of-domain NLP tasks that rely on inference at document granularity. |
ContractNLI: A Dataset for Document-level Natural Language Inference for Contracts (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Contract review is a time-consuming procedure that costs companies millions of dollars each year . linguistic characteristics of contracts, such as negations by exceptions, contribute to the difficulty of this task . |
| Approach: | They propose a document-level natural language inference (NLI) task for contracts . they annotate and release the largest corpus to date consisting of 607 annotated contracts a linguistically rich system is proposed . |
| Outcome: | The proposed system is based on a contract review task that includes 607 annotated contracts. |
A Broad-Coverage Challenge Corpus for Sentence Understanding through Inference (N18-1)
Copied to clipboard
| Challenge: | et al., 1996, show that many of the most actively studied problems in NLP depend in large part on natural language understanding (NLU). |
| Approach: | They propose a dataset for machine learning that uses ten different genres of English to evaluate sentences for their meanings. |
| Outcome: | The multi-genre natural language inference corpus is one of the largest available for natural language understanding. |
Scalable and Domain-General Abstractive Proposition Segmentation (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Several recent studies have demonstrated the utility of proposition segmentation for downstream tasks. |
| Approach: | They propose a scalable, yet accurate, proposition segmentation model that can be supervised by LLMs. |
| Outcome: | The proposed model improves on training on annotated datasets and shows that it is easy to use. |
Beyond Recognising Entailment: Formalising Natural Language Inference from an Argumentative Perspective (2024.acl-long)
Copied to clipboard
| Challenge: | Existing methods for recognizing textual entailment lack a standardized definition of inference, making it difficult to compare methods trained on different datasets. |
| Approach: | They propose a rigorous approach to align entailment recognition with argumentation theory by using a tool to assist humans in annotating arguments according to the PTA. |
| Outcome: | The proposed model is based on a human-trained dataset and provides insights into non-expert annotator training. |
Entailed Between the Lines: Incorporating Implication into NLI (2025.acl-long)
Copied to clipboard
Shreya Havaldar, Hamidreza Alvari, John Palowitch, Mohammad Javad Hosseini, Senaka Buthpitiya, Alex Fabrikant
| Challenge: | True Emotions, social cues, insults, and a myriad of other messages are conveyed implicitly, often even more so than explicitly. |
| Approach: | They propose a dataset to help LLMs understand implied entailment . |
| Outcome: | The proposed dataset enables LLMs to understand implied entailment and can generalize this understanding across datasets and domains. |
Collecting Diverse Natural Language Inference Problems for Sentence Representation Evaluation (D18-1)
Copied to clipboard
Adam Poliak, Aparajita Haldar, Rachel Rudinger, J. Edward Hu, Ellie Pavlick, Aaron Steven White, Benjamin Van Durme
| Challenge: | a plethora of new natural language inference datasets has been created in recent years . however, these datasets do not provide clear insight into what type of reasoning or inference a model may be performing. |
| Approach: | They propose to recast 13 existing natural language inference datasets into a common structure. |
| Outcome: | The proposed datasets provide insight into how well a sentence representation captures distinct types of reasoning. |
CLAUSE-ATLAS: A Corpus of Narrative Information to Scale up Computational Literary Analysis (2024.lrec-main)
Copied to clipboard
| Challenge: | XIX and XX century English novels annotated automatically contain 41,715 labeled clauses . a new approach to analyze novels based on clauses captures structural patterns within books, as well as qualitative differences between them. |
| Approach: | They propose to use a corpus of XIX and XX century English novels annotated automatically to study stories as sequences of eventive, subjective and contextual information. |
| Outcome: | The proposed method captures structural patterns within books, as well as qualitative differences between them. |
Stretching Sentence-pair NLI Models to Reason over Long Documents and Clusters (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Recent advances in modeling and datasets demonstrate promising performance for NLI. |
| Approach: | They explore the direct zero-shot applicability of NLI models to real applications . they analyze the robustness of models to longer and out-of-domain inputs . |
| Outcome: | The proposed models are robust to longer and out-of-domain inputs and can perform on full documents. |
Benchmarking Query-Conditioned Natural Language Inference (2025.findings-acl)
Copied to clipboard
| Challenge: | Query-conditioned natural language inference (QC-NLI) is a new approach to detect inconsistencies in large language models. |
| Approach: | They propose a task of Query-Conditioned Natural Language Inference to determine the semantic relationship between two documents conditioned on a query. |
| Outcome: | The proposed task is based on a query-conditioned natural language inference (QC-NLI) it is used to determine the relationship between the premise and hypothesis given a given query. |