Papers by Michael Witbrock
TaKG: A New Dataset for Paragraph-level Table-to-Text Generation Enhanced with Knowledge Graphs (2022.findings-aacl)
Copied to clipboard
| Challenge: | Existing table-to-text generation benchmarks have some limitations, such as E2E and ToTTo focusing on singlesentence generation tasks. |
| Approach: | They propose a new table-to-text generation dataset called TaKG that uses a set of knowledge graphs to enhance table input. |
| Outcome: | The proposed model outperforms existing models for short-text generation tasks and shows reliable performance on long-text generated across a variety of metrics. |
Abstract Meaning Representation-Based Logic-Driven Data Augmentation for Logical Reasoning (2024.findings-acl)
Copied to clipboard
Qiming Bao, Alex Peng, Zhenyun Deng, Wanjun Zhong, Gael Gendron, Timothy Pistotti, Neset Tan, Nathan Young, Yang Chen, Yonghua Zhu, Paul Denny, Michael Witbrock, Jiamou Liu
| Challenge: | Empirical evidence shows that our proposed method improves performance across seven downstream tasks. |
| Approach: | They propose a logic-driven data augmentation approach that converts text into AMR graphs and converts them back into text to create augmented data. |
| Outcome: | The proposed method leads on the ReClor leaderboard and improves on seven downstream tasks. |
An Interface for Annotating Science Questions (D18-2)
Copied to clipboard
Michael Boratko, Harshit Padigela, Divyendra Mikkilineni, Pritish Yuvraj, Rajarshi Das, Andrew McCallum, Maria Chang, Achille Fokoue, Pavan Kapanipathi, Nicholas Mattei, Ryan Musa, Kartik Talamadupula, Michael Witbrock
| Challenge: | a new interface for human annotation of science question-answer pairs with their knowledge and reasoning types is proposed . the interface is based on previous work on the ARC dataset, but does not provide clear definitions of these types of knowledge. |
| Approach: | They propose an interface for human annotation of science question-answer pairs with their respective knowledge and reasoning types. |
| Outcome: | The proposed interface improves the classification of science questions in a preliminary study involving 10 participants. |
Prompt-based Conservation Learning for Multi-hop Question Answering (2022.coling-1)
Copied to clipboard
| Challenge: | Existing multi-hop QA methods fail to answer a large fraction of sub-questions even if their parent questions are answered correctly. |
| Approach: | They propose a Prompt-based Conservation Learning framework that acquires new knowledge from multi-hop QA tasks while conserving old knowledge learned on single-hop tasks. |
| Outcome: | The proposed framework acquires new knowledge from multi-hop QA tasks while conserving old knowledge learned on single-hop tasks, mitigating forgetting. |
Multi2Claim: Generating Scientific Claims from Multi-Choice Questions for Scientific Fact-Checking (2023.eacl-main)
Copied to clipboard
Neset Tan, Trung Nguyen, Josh Bensemann, Alex Peng, Qiming Bao, Yang Chen, Mark Gahegan, Michael Witbrock
| Challenge: | Existing scientific fact-checking datasets are limited due to expertise bottleneck . multi2Claim pipeline is a tool to convert multiple-choice questions into fact- checking data . |
| Approach: | They propose a pipeline for automatically converting multiple-choice questions into fact-checking data . they generate two large-scale datasets for scientific-fact-checker tasks . success at this task can help the reader understand scientific topics and promote science . |
| Outcome: | The proposed pipeline improves performance on two large-scale scientific fact-checking datasets. |
Graph Enhanced Cross-Domain Text-to-SQL Generation (D19-53)
Copied to clipboard
| Challenge: | Existing deep learning approaches for semantic parsing do not generalize to unseen data sets . existing benchmarks have shown text-to-SQL parsers do not generally perform well to unsen SQL queries. |
| Approach: | They propose a new cross-domain learning scheme to perform text-to-SQL translation . they demonstrate its use on a large-scale cross- domain text- to-Sql data set Spider . |
| Outcome: | The proposed learning scheme improves on a large-scale text-to-SQL data set. |
AbductionRules: Training Transformers to Explain Unexpected Inputs (2022.findings-acl)
Copied to clipboard
| Challenge: | AbductionRules is a set of natural language datasets designed to train and test generalisable abduction over natural-language knowledge bases. |
| Approach: | They propose to train and test generalisable abduction over natural-language knowledge bases by using natural language datasets to fine tune pre-trained Transformers. |
| Outcome: | The proposed models learned generalisable abduction techniques but also exploited the structure of the datasets. |
Can Large Language Models Learn Independent Causal Mechanisms? (2024.emnlp-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) perform poorly on complex reasoning tasks, such as abstract, causal, or logical reasoning. |
| Approach: | They propose to use two concepts from causality to learn ICMs within LLMs to improve out-of-distribution performance on abstract and causal reasoning tasks. |
| Outcome: | The proposed model outperforms existing models on abstract and causal reasoning tasks and is more robust to fine-tuning. |