Multilingual Extraction and Categorization of Lexical Collocations with Graph-aware Transformers (2022.starsem-1)
Copied to clipboard
| Challenge: | lexical collocations exhibit varying degrees of frozenness due to their varying degree of frozenncy. |
| Approach: | They propose a sequence tagging BERT-based model enhanced with a graph-aware transformer architecture and evaluate the task of collocation recognition in context. |
| Outcome: | The proposed model encoding syntactic dependencies is useful, and provides insights on differences in collocation typification in English, Spanish and French. |
Similar Papers
Exploring Semantics in Pretrained Language Model Attention (2024.starsem-1)
Copied to clipboard
| Challenge: | Abstract Meaning Representations (AMRs) encode the semantics of sentences in the form of graphs. |
| Approach: | They propose to use attention heads of two LMs to detect semantic relations encoded in AMRs. |
| Outcome: | The proposed models detect semantic relations without fine tuning, using both unsupervised and supervised learning techniques. |
Incorporating EDS Graph for AMR Parsing (2021.starsem-1)
Copied to clipboard
| Challenge: | AMR is abstract and conceptual, while EDS is low level, closer to the lexical structures of the given sentences. |
| Approach: | They propose to add EDS graphs as additional semantic features to AMR parsers by adding transition-based parser to add LSTM layer and GCN layer. |
| Outcome: | The proposed parser adds EDS graphs as additional semantic features to boost performance . Currently the parsing accuracies for AMR are in low 80s, while they can be improved by adding more information from EDS. |
Fine-tuning BERT with Focus Words for Explanation Regeneration (2020.starsem-1)
Copied to clipboard
| Challenge: | Existing approaches to explain the correct answer in multiple-choice QA are low in F-scores and lack of performance. |
| Approach: | They introduce a lightweight focus feature in a transformer-based NLP model and examine performance improvements. |
| Outcome: | The proposed model achieves the highest scores, second only to a computationally intensive system. |
Multilingual Neural Semantic Parsing for Low-Resourced Languages (2021.starsem-1)
Copied to clipboard
| Challenge: | a large amount of training data is needed to understand multilingual semantic parsing models. |
| Approach: | They propose to use machine translation to bootstrap multilingual training data from English data. |
| Outcome: | The proposed model outperforms existing models on human-written sentences and the state-of-the-art models on the public NLMaps dataset. |
MASSIVE Multilingual Abstract Meaning Representation: A Dataset and Baselines for Hallucination Detection (2024.starsem-1)
Copied to clipboard
| Challenge: | Abstract Meaning Representation (AMR) is a semantic formalism that captures the core meaning of an utterance. |
| Approach: | They propose to use AMR to map meanings of 1,685 utterances to 50+ languages to build a dataset 20 times larger than existing resources. |
| Outcome: | The proposed dataset covers more languages, has more utterances, and has localized or translated entities for each language. |
Speedy Gonzales: A Collection of Fast Task-Specific Models for Spanish (2024.starsem-1)
Copied to clipboard
| Challenge: | Large language models (LLMs) are a common and successful approach to language and retrieval tasks. |
| Approach: | They evaluate the available large language models in Spanish and then use knowledge distillation to refine and distill them. |
| Outcome: | The proposed models are fine-tuned and distilled on knowledge distillation and are available on huggingface.co/dccuchile. |
How Are Idioms Processed Inside Transformer Language Models? (2023.starsem-1)
Copied to clipboard
| Challenge: | idioms are prevalent in natural language, but how do they be processed? |
| Approach: | They analyze the embeddings of idiomatic and literal expressions across all layers of the networks at both the sentence and word levels. |
| Outcome: | The proposed models represent idioms distinctively compared to literal language, the study finds . |
One Semantic Parser to Parse Them All: Sequence to Sequence Multi-Task Learning on Semantic Parsing Datasets (2021.starsem-1)
Copied to clipboard
| Challenge: | Existing semantic parsing datasets lack a single standard for meaning representations . lack of a standard led to the creation of plethora of datasets requiring expert annotators . |
| Approach: | They propose to use multi-task learning to unify different datasets and train a single model for them. |
| Outcome: | The proposed architectures yield better parsing accuracies and composition generalization than single-task models. |
Semantics-aware Attention Improves Neural Machine Translation (2022.starsem-1)
Copied to clipboard
| Challenge: | Existing attempts to integrate semantic structures into NMT Transformers have failed . |
| Approach: | They propose two parameter-free methods for injecting semantic information into Transformers, using a Scene-Aware Self-Attention (SASA) head and a Scenario-Award Cross-Action (SACrA) head. |
| Outcome: | The proposed methods improve on the vanilla Transformer and syntax-aware models for four language pairs and show an additional gain when using both semantic and syntactic structures in some language pairs. |
JSEEGraph: Joint Structured Event Extraction as Graph Parsing (2023.starsem-1)
Copied to clipboard
| Challenge: | Existing approaches model event extraction using simplified datasets or sequence-labeling-based encodings. |
| Approach: | They propose a graph-based event extraction framework that explicitly encodes entities and events in a single semantic graph. |
| Outcome: | The proposed framework can handle nested event structures and solve different IE tasks jointly. |