Papers by Michele Banko
Keeping Notes: Conditional Natural Language Generation with a Scratchpad Encoder (P19-1)
Copied to clipboard
| Challenge: | Qualitative assessments in the form of human judgements (question generation), attention visualization (MT), and sample output (summarization) provide further evidence of the ability of Scratchpad to generate fluent and expressive output. |
| Approach: | They propose to use the encoder as a "scratchpad" memory to keep track of what has been generated and guide future generation. |
| Outcome: | The proposed mechanism improves the fluency of seq2seq models on three well-studied natural language generation tasks. |
Practical Transformer-based Multilingual Text Classification (2021.naacl-industry)
Copied to clipboard
| Challenge: | XNLI does not reflect the data availability and task variety of industry applications. |
| Approach: | They compare transformer-based text classification methods to multilingual models in five different languages . they use a task- and domain-adaptive pretraining and data augmentation technique . |
| Outcome: | The proposed methods outperform monolingual models on two tasks in five languages . the results show that practical modifications can improve model performance without labeling . |
Improving Knowledge Base Construction from Robust Infobox Extraction (N19-2)
Copied to clipboard
| Challenge: | Existing knowledge bases are incomplete, resulting in poor answers and incompleteness. |
| Approach: | They propose a method to extract Wikipedia infobox tables to populate an existing KB. |
| Outcome: | The proposed method improves accuracy and completeness of the final KB significantly compared to DBpedia's baseline method. |