Papers by Yawei Sun
TableGPT: Few-shot Table-to-Text Generation with Table Structure Reconstruction and Content Matching (2020.coling-main)
Copied to clipboard
| Challenge: | Recent studies show that pre-trained language models can produce informative and fluent text with the help of large-scale datasets, but they suffer insufficient learning problem with limited training data. |
| Approach: | They propose to use table transformation module with template to rewrite structured table in natural language as input for GPT-2 and exploit multi-task learning with two auxiliary tasks to preserve table’s structural information. |
| Outcome: | The proposed model outperforms existing systems on most few-shot settings. |
AdaLoGN: Adaptive Logic Graph Network for Reasoning-Based Machine Reading Comprehension (2022.acl-long)
Copied to clipboard
| Challenge: | Existing methods and limitations for machine reading comprehension are insufficient for logical reasoning over text. |
| Approach: | They propose a neural-symbolic approach which passes messages over a graph representing logical relations between text units to predict an answer. |
| Outcome: | The proposed approach outperforms existing methods on ReClor and LogiQA. |
Reading Comprehension with Graph-based Temporal-Casual Reasoning (C18-1)
Copied to clipboard
| Challenge: | Existing methods for reading comprehension tasks ignore semantic relations between sentences or use sliding window scanning over the words of the passage without sentence breaks. |
| Approach: | They propose a method to integrate information from multiple sentences to answer complex questions. |
| Outcome: | Experiments on RACE and MCTest show that the proposed approach improves state-of-the-art methods on simple factoid questions. |