PASTA: Table-Operations Aware Fact Verification via Sentence-Table Cloze Pre-training (2022.emnlp-main)
Copied to clipboard
| Challenge: | Table-based fact verification has attracted a lot of attention recently due to the lack of datasets that can be used to pre-train language models to be aware of common table operations. |
| Approach: | They propose a table-based fact verification tool that pre-trains language models to be aware of common table operations such as aggregating a column or comparing tuples. |
| Outcome: | The proposed method outperforms previous methods on two table-based fact verification datasets TabFact and SEM-TAB- FACTS. |
Similar Papers
Structural Encoding and Pre-training Matter: Adapting BERT for Table-Based Fact Verification (2021.eacl-main)
Copied to clipboard
| Challenge: | Existing research on fact verification focuses on unstructured textual evidence, but it is still underexplored. |
| Approach: | They propose to use a table-based language model to verify textual statements . they use cell embeddings and numerical information to improve accuracy . |
| Outcome: | The proposed method outperforms the state-of-the-art model on question answering tasks even without modeling numerical information. |
Table-based Fact Verification with Self-adaptive Mixture of Experts (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing research focuses on table-based fact verification, but a new trend is extending the scope to structured evidence. |
| Approach: | They propose a mixture-of-experts neural network to recognize and execute different types of reasoning . they use a management module to decide the contribution of each expert network to the verification result . |
| Outcome: | The proposed method achieves 85.1% accuracy on the TabFact dataset, comparable with the previous state-of-the-art models. |
PASTA: A Dataset for Modeling PArticipant STAtes in Narratives (2023.tacl-1)
Copied to clipboard
Sayontan Ghosh, Mahnaz Koupaee, Isabella Chen, Francis Ferraro, Nathanael Chambers, Niranjan Balasubramanian
| Challenge: | Existing models that understand narratives should infer these implicit states and their causal relationships with the narrative's explicit events. |
| Approach: | They propose a dataset that contains inferable participant states, a counterfactual perturbation to each state and the changes to the story that would be necessary if the counterfact was true. |
| Outcome: | The proposed model can reason about the impact of changes to the story that would be necessary if the counterfactual were true. |
Table Fact Verification with Structure-Aware Transformer (2020.emnlp-main)
Copied to clipboard
| Challenge: | Pre-trained models cannot be used to encode semi-structured data because of their nature. |
| Approach: | They propose a Structure-Aware Transformer which injects table structural information into mask . method could combine symbolic and linguistic reasoning, they propose . |
| Outcome: | The proposed method outperforms baseline on a large scale table verification dataset. |
Dual-Channel Evidence Fusion for Fact Verification over Texts and Tables (2022.naacl-main)
Copied to clipboard
| Challenge: | Existing fact extraction and verification tasks only consider evidence of a single format . Existing models convert evidence into either sentences or tables, thus losing context information . |
| Approach: | They propose a Dual Channel Unified Format fact verification model which unifies various evidence into parallel streams, i.e., natural language sentences and a global evidence table, simultaneously. |
| Outcome: | The proposed model outperforms existing models in two formats by a large margin . it makes the most of existing tables and tables to absorb evidence of two formats . |
CONCRETE: Improving Cross-lingual Fact-checking with Cross-lingual Retrieval (2022.coling-1)
Copied to clipboard
| Challenge: | Existing fact-checking approaches focus on claims made in English due to data scarcity issue in other languages. |
| Approach: | They propose a fact-checking framework augmented with cross-lingual retrieval that aggregates evidence retrieved from multiple languages through a cross-linguistic retriever. |
| Outcome: | The proposed framework achieves 2.23% absolute F1 improvement over previous systems on a X-Fact dataset. |
Exploring Listwise Evidence Reasoning with T5 for Fact Verification (2021.acl-short)
Copied to clipboard
| Challenge: | Existing methods for fact verification use pretrained sequence-to-sequence transformers for sentence selection and label prediction. |
| Approach: | They propose a framework for fact verification that leverages pretrained sequence-to-sequence transformer models for sentence selection and label prediction. |
| Outcome: | The proposed framework scores higher than the second place approach on the blind test set . the proposed framework can be useful for a broader range of NLP tasks, the authors say . |
PLOG: Table-to-Logic Pretraining for Logical Table-to-Text Generation (2022.emnlp-main)
Copied to clipboard
| Challenge: | Logical table-to-text generation requires models to derive logical-level facts from table records via logical inference. |
| Approach: | They propose a pretrained logical form generator framework to improve generation fidelity . they use a dataset to test the logical inference accuracy of the framework . |
| Outcome: | The proposed framework outperforms baselines on LOGICNLG and CONTLOG on two benchmarks. |
Enhancing Structured Evidence Extraction for Fact Verification (2023.emnlp-main)
Copied to clipboard
| Challenge: | Open-domain fact verification requires extracting and integrating both structured and unstructured evidence to verify a claim. |
| Approach: | They propose a method to enhance the extraction of structured evidence by leveraging the row and column semantics of tables. |
| Outcome: | The proposed method achieves evidence recall of 60.01% on the test set, higher than the previous state-of-the-art method. |
RePanda: Pandas-powered Tabular Verification and Reasoning (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods for fact-checking tabular data rely on black-box models with opaque reasoning. |
| Approach: | They propose a structured fact verification approach that translates claims into executable pandas queries. |
| Outcome: | The proposed method outperforms existing methods and demonstrates strong OOD robustness. |