Papers with self-learning
Self-Improving for Zero-Shot Named Entity Recognition with Large Language Models (2024.naacl-short)
Copied to clipboard
| Challenge: | Existing studies exploring the performance of large language models on named entity recognition tasks have focused on training task-specific LLMs for NER. |
| Approach: | They propose a training-free self-improving framework that utilizes an unlabeled corpus to stimulate the self-learning ability of LLMs. |
| Outcome: | The proposed framework improves performance on the named entity recognition task by using an unlabeled corpus. |
Doctor Recommendation in Online Health Forums via Expertise Learning (2022.acl-long)
Copied to clipboard
| Challenge: | Currently, manual doctor allocations are used to handle large volumes of queries, limiting the efficiency to help patients in sheer quantities. |
| Approach: | They propose to use patient queries to model doctor recommendation using their profiles and past dialogues to estimate their capabilities. |
| Outcome: | The proposed model outperforms baseline models on a Chinese online health forum, outperforming baseline models. |
Multilingual Knowledge Graph Completion via Ensemble Knowledge Transfer (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for learning missing facts in knowledge graphs are limited by insufficiency of alignment information and inconsistency of described facts. |
| Approach: | They propose a framework for embedding learning and ensemble knowledge transfer across KGs. |
| Outcome: | The proposed framework improves state-of-the-art methods on language-specific KGs. |
Boosting Scientific Concepts Understanding: Can Analogy from Teacher Models Empower Student Models? (2024.emnlp-main)
Copied to clipboard
| Challenge: | Analogical reasoning plays a critical role in human cognition, enabling us to understand new concepts by associating them with familiar ones. |
| Approach: | They propose to use free-form analogies to aid students in understanding scientific concepts . they also show that analogies generated by student LMs can improve their own performance . |
| Outcome: | The proposed model can help students understand scientific concepts, the authors show . |
Active Learning for Abstractive Text Summarization (2022.findings-emnlp)
Copied to clipboard
Akim Tsvigun, Ivan Lysenko, Danila Sedashov, Ivan Lazichny, Eldar Damirov, Vladimir Karlov, Artemy Belousov, Leonid Sanochkin, Maxim Panov, Alexander Panchenko, Mikhail Burtsev, Artem Shelmanov
| Challenge: | Abstractive text summarization (ATS) requires a long document and short summaries. |
| Approach: | They propose a query strategy for AL in abstractive text summarization that uses uncertainty estimation to reduce model performance. |
| Outcome: | The proposed query strategy improves ROUGE and consistency scores for annotated datasets . it also increases the performance of the model, compared to passive annotation. |
Maximum Bayes Smatch Ensemble Distillation for AMR Parsing (2022.naacl-main)
Copied to clipboard
| Challenge: | AMR parsing has experienced an unprecendented increase in performance in the last three years due to a mixture of effects including architecture improvements and transfer learning. |
| Approach: | They propose to combine Smatch-based ensembling techniques with ensemble distillation to overcome this diminishing returns of silver data. |
| Outcome: | The proposed technique can produce gains rivaling those of human annotated data for QALD-9 and achieve a new state-of-the-art for BioAMR. |
Enhancing EEG-to-Text Decoding through Transferable Representations from Pre-trained Contrastive EEG-Text Masked Autoencoder (2024.acl-long)
Copied to clipboard
| Challenge: | EEG-based language decoding is still in its nascent stages, despite promising applications in brain-computer interfaces. |
| Approach: | They propose a novel EEG-text Masked Autoencoder that orchestrates compound self-supervised learning across and within EEG and text through a dedicated multi-stream encoder. |
| Outcome: | The proposed model outperforms baseline framework in ROUGE-1 F1 and BLEU-4 scores and an LLM (specifically BART) to improve downstream tasks involving EEG and text. |
Beyond Offline Mapping: Learning Cross-lingual Word Embeddings through Context Anchoring (2021.acl-long)
Copied to clipboard
| Challenge: | Recent research on cross-lingual word embeddings has been dominated by unsupervised mapping approaches that align monolingual embedders. |
| Approach: | They propose an unsupervised mapping approach that fixes fixed embeddings and learns new ones for the source language that are aligned with them. |
| Outcome: | The proposed method outperforms conventional mapping methods on bilingual lexicon induction and obtains competitive results in the downstream XNLI task. |
A Simple and Effective Approach to Robust Unsupervised Bilingual Dictionary Induction (2020.coling-main)
Copied to clipboard
| Challenge: | Recent work has questioned the robustness of unsupervised bilingual dictionary induction methods on distant language pairs. |
| Approach: | They propose an iterative dimension reduction method to bridge this gap . they propose a method that initializes and self-learning and inducing a dictionary . |
| Outcome: | The proposed method achieves 13.64 55.53% accuracy between English and four distant languages. |
Classification-Based Self-Learning for Weakly Supervised Bilingual Lexicon Induction (2020.acl-main)
Copied to clipboard
| Challenge: | Effective projection-based cross-lingual word embedding induction relies on the iterative self-learning procedure. |
| Approach: | They propose a classification-based approach to self-learning that allows for integration of diverse features into the iterative process. |
| Outcome: | The proposed method improves bilingual lexicon induction on a weakly supervised setup with 28 language pairs. |