A Unified Model for Reverse Dictionary and Definition Modelling (2022.aacl-short)
Copied to clipboard
| Challenge: | Using neural networks, we argue that both tasks can be learned and dealt with concurrently, based on the intuition that a word and its definition share the same meaning. |
| Approach: | They build a dual-way neural dictionary to retrieve words given definitions and produce definitions for queried words. |
| Outcome: | The proposed model achieves high scores on previous benchmarks without extra resources. |
Similar Papers
How to represent a word and predict it, too: Improving tied architectures for language modelling (D18-1)
Copied to clipboard
| Challenge: | Recent state-of-the-art models use word embeddings as input and output mappings instead of tied models. |
| Approach: | They propose to decouple hidden state from word embedding prediction . they extend their proposed modification to word2vec models . |
| Outcome: | The proposed architectures achieve comparable or better results compared to previous models without tying . the proposed architecture reduces parameters, enabling more compact models and faster learning. |
Dual Reconstruction: a Unifying Objective for Semi-Supervised Neural Machine Translation (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Iterative Back-Translation and Dual Learning use different objectives and heuristic gradient approximation strategies, and have not been extensively compared. |
| Approach: | They propose a dual reconstruction objective that provides a unified view of Iterative Back-Translation and Dual Learning. |
| Outcome: | The proposed method is more effective than Dual Learning on German-English and Turkish-English tasks. |
Auto-Encoding Dictionary Definitions into Consistent Word Embeddings (D18-1)
Copied to clipboard
| Challenge: | Monolingual dictionaries are widespread and semantically rich resources. |
| Approach: | They propose a model that learns to compute word embeddings by processing dictionary definitions and trying to reconstruct them. |
| Outcome: | The proposed model shows strong performance when trained exclusively on dictionary data and generalizes in one shot. |
Conditional Generators of Words Definitions (P18-2)
Copied to clipboard
| Challenge: | Existing definition modeling techniques for word embeddings only take into account words with multiple meanings. |
| Approach: | They propose a model that takes into account word ambiguities and polysemy and proposes a solution using latent variable modeling and soft attention mechanisms. |
| Outcome: | The proposed model improves on word ambiguity and polysemy and can be used for word sense disambiguation tasks. |
On the Importance of Distinguishing Word Meaning Representations: A Case Study on Reverse Dictionary Mapping (N19-1)
Copied to clipboard
| Challenge: | Sense representations target meaning conflation deficiency but their potential impact has not been investigated in downstream NLP applications. |
| Approach: | They propose to use a reverse dictionary system to address meaning conflation deficiency . they propose to integrate senses into the system to improve semantic understanding . |
| Outcome: | The proposed approach can improve the performance of a downstream NLP application. |
Semi-Supervised Learning for Neural Keyphrase Generation (D18-1)
Copied to clipboard
| Challenge: | Existing models for keyphrase generation only use labeled data, which is limited to resource-rich domains. |
| Approach: | They propose semi-supervised keyphrase generation methods by leveraging labeled data and large-scale unlabeled samples for learning. |
| Outcome: | The proposed methods outperform state-of-the-art models trained with labeled data and large-scale unlabeled samples for learning. |
Towards Unified Task Embeddings Across Multiple Models: Bridging the Gap for Prompt-Based Large Language Models and Beyond (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing task embedding methods rely on fine-tuned, task-specific language models, which hinders their adaptability to prompt-guided Large Language Models (LLMs). |
| Approach: | They propose a framework for unified task embedding that harmonizes task embeds from various models within a single vector space. |
| Outcome: | The proposed framework harmonizes task embeddings from various models within a single vector space. |
How Helpful is Inverse Reinforcement Learning for Table-to-Text Generation? (2021.acl-short)
Copied to clipboard
| Challenge: | Existing approaches to Table-to-Text generation suffer from issues such as missing information, repetition and repetition. |
| Approach: | They propose to use Inverse Reinforcement Learning (IRL) to solve the Table-to-Text task . they use multiple interpretable unsupervised reward components that are combined linearly to form a composite reward function. |
| Outcome: | The proposed task outperforms strong RL baselines marginally in the Table-to-Text task. |
Bridging the Defined and the Defining: Exploiting Implicit Lexical Semantic Relations in Definition Modeling (D19-1)
Copied to clipboard
| Challenge: | Existing definition modeling methods do not utilize lexical semantic relations between defined words and defining words. |
| Approach: | They propose definition modeling methods that use lexical semantic relations . they use unsupervised pattern-based word-pair embeddings that represent semantic relations of word pairs . |
| Outcome: | The proposed methods improve definition generation and learning embeddings from definitions. |
A Multi-task Approach to Learning Multilingual Representations (P18-2)
Copied to clipboard
| Challenge: | Using a multi-task model, we learn word and sentence embeddings in a single task. |
| Approach: | They propose a multi-task modeling approach that trains a skip-gram model and a cross-lingual sentence similarity model to learn word and sentence embeddings together. |
| Outcome: | The proposed model can learn word and sentence embeddings in a multilingual distributed representations of text using a cross-lingual sentence similarity model. |