Papers by Johannes Heinecke
Investigating the Effect of Relative Positional Embeddings on AMR-to-Text Generation with Structural Adapters (2023.eacl-main)
Copied to clipboard
| Challenge: | Recent approaches to text generation from Abstract Meaning Representation (AMR) have been based on neural-centered encoderdecoder architectures. |
| Approach: | They propose a structure-aware adapter which injects the input graph connectivity within PLMs using Graph Neural Networks. |
| Outcome: | The proposed adapter is robust to a variety of approaches and can be used to generate Graph-to-Text representations. |
Knowledge Extraction From Texts Based on Wikidata (2022.naacl-industry)
Copied to clipboard
| Challenge: | Existing knowledge extraction pipelines for English are not suitable for enterprise use. |
| Approach: | They propose a knowledge extraction pipeline for English which can be further used for building an entreprise-specific knowledge base. |
| Outcome: | The proposed pipeline can be used to build an entreprise-specific knowledge base. |
CALOR-QUEST : generating a training corpus for Machine Reading Comprehension models from shallow semantic annotations (D19-58)
Copied to clipboard
Frederic Bechet, Cindy Aloui, Delphine Charlet, Geraldine Damnati, Johannes Heinecke, Alexis Nasr, Frederic Herledan
| Challenge: | Recent large corpora of triplets have opened the door to supervised machine learning approaches for Question-Answering. |
| Approach: | They propose to generate questions from the semantic Frame analysis of large corpora using a CALOR-QUEST resource in French and use it to improve machine reading comprehension. |
| Outcome: | The proposed method generates questions from the semantic Frame analysis of large corpora and then tests them on the CALOR-QUEST resource in French. |
Handling Normalization Issues for Part-of-Speech Tagging of Online Conversational Text (L18-1)
Copied to clipboard
Géraldine Damnati, Jeremy Auguste, Alexis Nasr, Delphine Charlet, Johannes Heinecke, Frédéric Béchet
| Challenge: | a new approach to POS tagging noisy user generated text is proposed . word embeddings are trained on a noisy corpus to address both normalization and POS. |
| Approach: | They propose to use word embeddings to normalize text before tagging it, while a gated neural network based tagger handles the remaining errors. |
| Outcome: | The proposed approach normalizes some errors before tagging, while a gated neural network handles the remaining errors. |
Cross-lingual and Cross-domain Evaluation of Machine Reading Comprehension with Squad and CALOR-Quest Corpora (2020.lrec-1)
Copied to clipboard
| Challenge: | a recent study has shown that language mismatch and domain mismatch can affect performance of a machine reading task . a factor between language mismatched and domain-mismatched has the strongest influence on performance . |
| Approach: | They compare the cross-language and cross-domain capabilities of BERT on a machine reading comprehension task on two corpora: SQuAD and a new French Machine Reading dataset. |
| Outcome: | The proposed model matches human performance on a machine reading comprehension task with BERT on Chinese and French documents with interesting results. |
Hyperbolic Temporal Knowledge Graph Embeddings with Relational and Time Curvatures (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing knowledge Graph models for Link Prediction are insensitive to time. |
| Approach: | They propose a time-aware extension of ATTH model which defines curvature of a Riemannian manifold as the product of both relation and time. |
| Outcome: | The proposed model can achieve competitive or even better performance than the state-of-the-art model on Temporal KGs, albeit its nontemporality. |