Papers by Dmitrii Aksenov
Abstractive Text Summarization based on Language Model Conditioning and Locality Modeling (2020.lrec-1)
Copied to clipboard
Dmitrii Aksenov, Julian Moreno-Schneider, Peter Bourgonje, Robert Schwarzenberg, Leonhard Hennig, Georg Rehm
| Challenge: | Abstractive summarization is an NLP task with many real-world applications. |
| Approach: | They propose to use a pre-trained language model to train a Transformer-based neural model . they propose a new method of BERT-windowing to allow chunk-wise processing of texts longer than the BERT window size . |
| Outcome: | The proposed model outperforms baseline models on CNN/Daily Mail dataset and shows its superiority on German dataset. |