Papers by Manvel Avetisian
Uncertainty Estimation of Transformer Predictions for Misclassification Detection (2022.acl-long)
Copied to clipboard
Artem Vazhentsev, Gleb Kuzmin, Artem Shelmanov, Akim Tsvigun, Evgenii Tsymbalov, Kirill Fedyanin, Maxim Panov, Alexander Panchenko, Gleb Gusev, Mikhail Burtsev, Manvel Avetisian, Leonid Zhukov
| Challenge: | Uncertainty estimation (UE) of model predictions is crucial step for a variety of tasks such as active learning, misclassification detection, adversarial attack detection, etc. |
| Approach: | They propose to modify UE methods for Transformer models for misclassification detection in named entity recognition and text classification tasks to improve model expressiveness and computational performance. |
| Outcome: | The proposed methods outperform computationally intensive methods on misclassification detection tasks and are based on a large dataset of simulated datasets. |
Medical Crossing: a Cross-lingual Evaluation of Clinical Entity Linking (2022.lrec-1)
Copied to clipboard
Anton Alekseev, Zulfat Miftahutdinov, Elena Tutubalina, Artem Shelmanov, Vladimir Ivanov, Vladimir Kokh, Alexander Nesterov, Manvel Avetisian, Andrei Chertok, Sergey Nikolenko
| Challenge: | Existing approaches to medical entity linking are limited in terms of data volume and languages. |
| Approach: | They propose to use clinical reports, clinical guidelines, and medical research papers to evaluate cross-lingual medical entity linking. |
| Outcome: | The proposed model outperforms existing models on clinical reports, clinical guidelines, and medical research papers. |
RuCCoN: Clinical Concept Normalization in Russian (2022.findings-acl)
Copied to clipboard
Alexandr Nesterov, Galina Zubkova, Zulfat Miftahutdinov, Vladimir Kokh, Elena Tutubalina, Artem Shelmanov, Anton Alekseev, Manvel Avetisian, Andrey Chertok, Sergey Nikolenko
| Challenge: | a new dataset for clinical concept normalization in Russian is available for download . ehrs contains over 16,028 entity mentions manually linked to over 2,409 unique concepts . |
| Approach: | They present a dataset for clinical concept normalization in Russian manually annotated by medical professionals. |
| Outcome: | The proposed dataset contains 16,028 entity mentions manually linked to over 2,409 unique concepts from the Russian language part of the UMLS ontology. |
Towards Computationally Feasible Deep Active Learning (2022.findings-naacl)
Copied to clipboard
Akim Tsvigun, Artem Shelmanov, Gleb Kuzmin, Leonid Sanochkin, Daniil Larionov, Gleb Gusev, Manvel Avetisian, Leonid Zhukov
| Challenge: | Active learning (AL) is a technique for reducing the amount of annotation required for training machine learning models. |
| Approach: | They propose two techniques that reduce the amount of time required for AL . they use pseudo-labeling and distilled models to train a successor model . |
| Outcome: | The proposed algorithm reduces the time and computational overhead required to train an acquisition model and estimate uncertainty on instances in the unlabeled pool. |