Machine Comprehension Improves Domain-Specific Japanese Predicate-Argument Structure Analysis (D19-58)
Copied to clipboard
| Challenge: | a lack of gold datasets and knowledge about PAS analysis makes it difficult to create accurate PAS analyses. |
| Approach: | They construct a Japanese blog-QA dataset and a reading comprehension QA dataset using crowdsourcing. |
| Outcome: | The proposed method is most effective, pre-training model to acquire domain knowledge and fine-tuning model based on PAS-QA dataset. |
Similar Papers
Neural Adversarial Training for Semi-supervised Japanese Predicate-argument Structure Analysis (P18-1)
Copied to clipboard
| Challenge: | Japanese predicate-argument structure analysis involves zero anaphora resolution . state-of-the-art models for PAS analysis achieve an accuracy of around 50% for zero pronouns . |
| Approach: | They propose a Japanese PAS analysis model based on semi-supervised adversarial training with a raw corpus. |
| Outcome: | The proposed model outperforms existing models for Japanese PAS analysis . the model is based on semi-supervised adversarial training with a raw corpus . |
Multi-Task Learning for Japanese Predicate Argument Structure Analysis (N19-1)
Copied to clipboard
| Challenge: | Recent work ignores event-nouns or builds a single model for solving both tasks . however, there are interactions between predicates and event-nons, making it difficult to target only predicate. |
| Approach: | They propose a multi-task learning method that targets event-nouns . their results improve performance of both PASA and ENASA tasks . |
| Outcome: | The proposed model improves both PASA and ENASA tasks compared to a single-task model . it is the first work to employ neural networks in ENASA . |
Probing Neural Network Comprehension of Natural Language Arguments (P19-1)
Copied to clipboard
| Challenge: | Argument Reasoning Comprehension Task (ARCT) focuses on inferences, not just discovering warrants. |
| Approach: | They propose to build an adversarial dataset on which all models achieve random accuracy. |
| Outcome: | The proposed dataset provides a more robust assessment of argument comprehension and should be adopted as the standard in future work. |
Learning to Explain: Datasets and Models for Identifying Valid Reasoning Chains in Multihop Question-Answering (2020.emnlp-main)
Copied to clipboard
| Challenge: | despite rapid progress in multihop question-answering, models still have trouble explaining why an answer is correct. |
| Approach: | They propose three explanation datasets in which explanations from corpus facts are annotated . they first annotate multiple candidate explanations for each answer, then use crowd-sourcing perturbations to test generalization . |
| Outcome: | The proposed datasets improve explanation quality but still behind the upper bound . the proposed dataset can be used to improve explanations using a BERT-based classifier . |
Generalizing Question Answering System with Pre-trained Language Model Fine-tuning (D19-58)
Copied to clipboard
| Challenge: | Existing methods focus on improving in-domain performance, leaving open the question of how they can generalize to out-of-domain and unseen RC tasks. |
| Approach: | They propose a multi-task learning framework that learns the shared representation across different tasks and builds on a large pre-trained language model and fine-tuned on multiple RC datasets. |
| Outcome: | The proposed framework improves the BERT-Large baseline by 8.39 and 7.22 respectively. |
Distance-Free Modeling of Multi-Predicate Interactions in End-to-End Japanese Predicate-Argument Structure Analysis (C18-1)
Copied to clipboard
| Challenge: | Existing models for analyzing PASs in Japanese are lacking in identifying elliptical arguments. |
| Approach: | They propose to extend the input and last layers of a bidirectional recurrent neural network model to capture the potential interactions among multiple PASs. |
| Outcome: | The proposed models improve prediction accuracy on a benchmark corpus and achieve state-of-the-art on standardized corpus. |
Self-Teaching Machines to Read and Comprehend with Large-Scale Multi-Subject Question-Answering Data (2021.findings-emnlp)
Copied to clipboard
| Challenge: | despite considerable progress, most machine reading comprehension tasks lack sufficient training data to fully exploit powerful deep neural network models. |
| Approach: | They propose to use QA data to generate more training data for machine reading comprehension tasks by crowdsourcing . they first collect a large-scale multiple-choice QA dataset for Chinese, ExamQA, and then use incomplete, yet relevant snippets returned by a web search engine as the context for each QA instance. |
| Outcome: | The proposed model improves a Chinese MRC task with +5.1% accuracy and +3.8% exact match. |
What do Models Learn from Question Answering Datasets? (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing models have outperformed humans on question answering datasets, but they have yet to outperform humans on the task of question answering itself. |
| Approach: | They evaluate BERT-based question answering models on their generalizability to out-of-domain examples, responses to missing or incorrect data, and ability to handle question variations. |
| Outcome: | The proposed models outperform human baselines on the widely-used SQuAD 1.1 and SQu AD 2.0 datasets. |
Leveraging pre-trained language models for linguistic analysis: A case of argument structure constructions (2024.emnlp-main)
Copied to clipboard
| Challenge: | Argument structure constructions (ASCs) are lexicogrammatical patterns at the clausal level. |
| Approach: | They evaluate the effectiveness of pre-trained language models in identifying argument structure constructions . they use supervised training with RoBERTa and prompt-guided annotation with GPT-4 . |
| Outcome: | The proposed model outperforms the gold-standard model on three methods . the results show that the model performs better on gold-standardized data . |
Quoref: A Reading Comprehension Dataset with Questions Requiring Coreferential Reasoning (D19-1)
Copied to clipboard
| Challenge: | Existing reading comprehension benchmarks do not contain complex coreferential phenomena . obtaining questions focused on such phenomena is difficult because of lexical cues . |
| Approach: | They propose to use a crowdsourced dataset to examine the ability of models to resolve coreference among entities in Wikipedia paragraphs. |
| Outcome: | The proposed model performs significantly worse than humans on the reading comprehension benchmark . paragraphs and other longer texts typically make multiple references to the same entities . |