Papers by Theodosia Togia
Biomedical relation extraction with pre-trained language representations and minimal task-specific architecture (D19-57)
Copied to clipboard
| Challenge: | Using a pre-trained BERT-Base model, we learn domain-specific language representations using biomedical text. |
| Approach: | They propose a system that extends BERT, a state-of-the-art language model, which learns contextual language representations from a large unlabelled corpus. |
| Outcome: | The proposed model outperforms a baseline model while relying on an extremely simple setup with no specially engineered features. |