BioNLP-OST 2019 RDoC Tasks: Multi-grain Neural Relevance Ranking Using Topics and Attention Based Query-Document-Sentence Interactions (D19-57)
Copied to clipboard
| Challenge: | Our best systems achieved 1st rank and scored 0.86 mAP and 0.58 macro average accuracy in Task-1 and Task-2 respectively. |
| Approach: | They propose to use attention-based supervised neural topic model and SVM for retrieval and ranking of PubMed abstracts and to use BM25 and other relevance measures for re-ranking. |
| Outcome: | The proposed system scored 0.86 mAP and 0.58 macro average accuracy in the RDoC Tasks of BioNLP-OST 2019 . |
Similar Papers
RDoC Task at BioNLP-OST 2019 (D19-57)
Copied to clipboard
| Challenge: | BioNLP-OST is an international competition organized to facilitate development and sharing of computational tasks of biomedical text mining and solutions to them. |
| Approach: | They propose a new mental health informatics task that is composed of two subtasks: information retrieval and sentence extraction. |
| Outcome: | The proposed task performed well on both tasks, but there are still challenges. |
Deep Relevance Ranking Using Enhanced Document-Query Interactions (D18-1)
Copied to clipboard
| Challenge: | Document relevance ranking is the task of ranking documents from a large collection using the query and the text of each document only. |
| Approach: | They propose to use convolutional n-gram matching to inject rich context-sensitive encodings into their models, inspired by PACRR's convolution-based ngram matching features. |
| Outcome: | The proposed models outperform baselines, DRMM, and PACRR on the BIOASQ and TREC ROBUST questions and document inputs. |
Integration of Deep Learning and Traditional Machine Learning for Knowledge Extraction from Biomedical Literature (D19-57)
Copied to clipboard
| Challenge: | BB system is among the top two systems in five of all six subtasks . knowledge about microbial diversity is crucial for the study of microbiome and bacteria . |
| Approach: | They present a system that uses word embedding and lexical features to perform entities recognition, normalization and relation extraction. |
| Outcome: | The proposed system achieves state-of-the-art in five of six subtasks and is among the top two in five. |
Literature Retrieval for Precision Medicine with Neural Matching and Faceted Summarization (2020.findings-emnlp)
Copied to clipboard
| Challenge: | IR for precision medicine often involves looking for multiple pieces of evidence that characterize a patient case. |
| Approach: | They propose a document reranking approach that combines neural query-document matching and text summarization toward such retrieval scenarios. |
| Outcome: | The proposed approach achieves state-of-the-art performance on NIST's TREC-PM track dataset. |
EARA: Improving Biomedical Semantic Textual Similarity with Entity-Aligned Attention and Retrieval Augmentation (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods to measure semantic similarity between biomedical texts are inefficient due to too many biomedically-related entities. |
| Approach: | They propose an entity-aligned, attention-based and retrieval-augmented PLM that aligns the same type of fine-grained entity information in each sentence pair with an entity alignment matrix with an auxiliary loss. |
| Outcome: | The proposed model can achieve state-of-the-art on both in-domain and out-of domain datasets. |
TAN-NTM: Topic Attention Networks for Neural Topic Modeling (2021.acl-long)
Copied to clipboard
| Challenge: | Topic models have been widely used to learn text representations and gain insight into document corpora. |
| Approach: | They propose a framework which processes document as a sequence of tokens through a LSTM whose contextual outputs are attended in a topic-aware manner. |
| Outcome: | The proposed model improves on two downstream tasks: document classification and topic guided keyphrase generation. |
Retrieving Support to Rank Answers in Open-Domain Question Answering (2025.emnlp-main)
Copied to clipboard
| Challenge: | a novel question answering architecture retrieves content relevant to the combined pair . previous work on automatic claim verification has shown hallucinations . |
| Approach: | They propose a question-answer architecture that prioritizes supporting evidence . it retrieves paragraphs that directly substantiate the correctness of a with respect to q . |
| Outcome: | The proposed approach can be used by large language models to retrieve explanatory paragraphs that ground their reasoning. |
Training a Ranking Function for Open-Domain Question Answering (N18-4)
Copied to clipboard
| Challenge: | Recent advances in machine reading have inspired researchers to combine Information Retrieval with machine reading to tackle open-domain QA. |
| Approach: | They propose two neural network rankers that assign scores to different passages based on their likelihood of containing the answer to a given question. |
| Outcome: | The proposed models achieve human level performance in open-domain QA compared to reading comprehension-style QA because it is difficult to retrieve the pieces of paragraphs that contain the answer to the question. |
Biomedical relation extraction with pre-trained language representations and minimal task-specific architecture (D19-57)
Copied to clipboard
| Challenge: | Using a pre-trained BERT-Base model, we learn domain-specific language representations using biomedical text. |
| Approach: | They propose a system that extends BERT, a state-of-the-art language model, which learns contextual language representations from a large unlabelled corpus. |
| Outcome: | The proposed model outperforms a baseline model while relying on an extremely simple setup with no specially engineered features. |
A Novel Perspective to Look At Attention: Bi-level Attention-based Explainable Topic Modeling for News Classification (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing deep learning models have the attention mechanism to improve performance, but the inherent characteristics of deep learning model complexity and the flexibility of the attention structure make them difficult to explain. |
| Approach: | They propose a two-tier attention architecture to decouple the complexity of explanation and the decision-making process by using large-scale news corpora. |
| Outcome: | The proposed model can achieve competitive performance with state-of-the-art models and illustrates its appropriateness from an explainability perspective. |