Adding Syntactic Annotations to Flickr30k Entities Corpus for Multimodal Ambiguous Prepositional-Phrase Attachment Resolution (L18-1)
Copied to clipboard
| Challenge: | Using visual features extracted from an image, we propose to study the joint processing of image and language features for the Preposition-Phrase attachment disambiguation task. |
| Approach: | They propose to add syntactic annotations to the captions of the Flickr30k Entities corpus to study the joint processing of image and language features for the Preposition-Phrase attachment disambiguation task. |
| Outcome: | The proposed framework is based on the captions of the Flickr30k Entities corpus and is automatically projected on their French and German translations. |
Similar Papers
A Visually-Grounded Parallel Corpus with Phrase-to-Region Linking (2020.lrec-1)
Copied to clipboard
| Challenge: | Existing multimodal corpora lack the ability to be used in multilingual or non-English scenarios. |
| Approach: | They extend a Flickr30k Entities image-caption dataset with Japanese translations to provide a multilingual corpus. |
| Outcome: | The proposed dataset is the first multilingual image-caption dataset with Japanese translations. |
They Exist! Introducing Plural Mentions to Coreference Resolution and Entity Linking (C18-1)
Copied to clipboard
| Challenge: | Unlike singular mentions each of which represents one entity, plural mentions stand for multiple entities. |
| Approach: | They propose a novel coreference resolution algorithm that selectively creates clusters to handle both singular and plural mentions and a deep learning-based entity linking model that jointly handles both types of mentions through multi-task learning. |
| Outcome: | The proposed model outperforms existing models designed for singular mentions and plural mentions. |
CorefUD 1.0: Coreference Meets Universal Dependencies (2022.lrec-1)
Copied to clipboard
| Challenge: | Recent advances in standardization for annotated language resources have led to successful large scale efforts, such as the Universal Dependencies (UD) project for multilingual syntactically annotized data. |
| Approach: | They propose a multilingual collection of corpora and a standardized format for coreference resolution compatible with morphosyntactic annotations in the UD framework. |
| Outcome: | The proposed framework is compatible with morphosyntactic annotations and includes facilities for related tasks such as named entity recognition. |
Bridging resolution: Task definition, corpus resources and rule-based experiments (C18-1)
Copied to clipboard
| Challenge: | Recent work on bridging resolution has been based on the corpus ISNotes, as this was the only corpus available with unrestricted bridling annotations. |
| Approach: | They propose a rule-based system to resolve bridging annotations in ISNotes corpus and apply it to new corpora. |
| Outcome: | The proposed system achieves state-of-the-art performance on ISNotes corpus, but low performance on in-domain corpora. |
Aligning Multilingual Word Embeddings for Cross-Modal Retrieval Task (D19-66)
Copied to clipboard
| Challenge: | Existing methods to learn multimodal multilingual embeddings for text and image retrieval tasks are limited to English. |
| Approach: | They propose a new approach to learn multimodal multilingual embeddings for matching images and captions in two languages by combing two existing objective functions and adapting alignment between existing languages. |
| Outcome: | The proposed model achieves state-of-the-art in retrieval and caption-caption tasks while adapting existing language alignments. |
Aligning Multilingual Word Embeddings for Cross-Modal Retrieval Task (D19-64)
Copied to clipboard
| Challenge: | Existing methods to learn multimodal multilingual embeddings for text and image retrieval tasks are limited to English. |
| Approach: | They propose a new approach to learn multimodal multilingual embeddings for matching images and captions in two languages by combing two existing objective functions and adapting alignment between existing languages. |
| Outcome: | The proposed model achieves state-of-the-art in retrieval and caption-caption tasks while adapting existing language alignments. |
Conundrums in Entity Coreference Resolution: Making Sense of the State of the Art (2020.emnlp-main)
Copied to clipboard
| Challenge: | despite significant progress on entity coreference resolution, there is a general lack of understanding of what has been improved. |
| Approach: | They present an empirical analysis of entity coreference resolvers to provide an understanding of what has been improved. |
| Outcome: | The proposed model improves the performance of entity coreference resolvers. |
AMR Beyond the Sentence: the Multi-sentence AMR corpus (C18-1)
Copied to clipboard
| Challenge: | Abstract Meaning Representation (AMR) is limited to capturing the semantics of individual sentences. |
| Approach: | They propose a corpus that annotates coreference and similar phenomena on top of existing AMRs. |
| Outcome: | The proposed corpus is compared with existing corpora on sentence-level semantics . it shows that it can be used for information extraction and question answering . |
DocAMR: Multi-Sentence AMR Representation and Evaluation (2022.naacl-main)
Copied to clipboard
Tahira Naseem, Austin Blodgett, Sadhana Kumaravel, Tim O’Gorman, Young-Suk Lee, Jeffrey Flanigan, Ramón Astudillo, Radu Florian, Salim Roukos, Nathan Schneider
| Challenge: | Abstract Meaning Representation (AMR) graphs are compared to gold graphs by the Smatch metric, but lack a well-defined representation and evaluation. |
| Approach: | They propose an algorithm for deriving a unified graph representation using a super-sentential annotation method. |
| Outcome: | The proposed algorithm avoids the pitfalls of over-merging and lacks coherence from under merging. |
Towards a unified framework for bilingual terminology extraction of single-word and multi-word terms (C18-1)
Copied to clipboard
| Challenge: | Existing methods for extracting bilingual terminology from comparable corpora are limited to a set of syntactic patterns. |
| Approach: | They propose a framework for aligning bilingual terms independently of term lengths . they introduce some enhancements to the context-based and neural network based approaches . |
| Outcome: | The proposed framework improves the performance of the context-based and neural network based approaches and can be adapted in specialized domains. |