Papers by Jonas Luehrs
Contrastive Learning Using Graph Embeddings for Domain Adaptation of Language Models in the Process Industry (2025.emnlp-industry)
Copied to clipboard
| Challenge: | Recent trends in NLP utilize knowledge graphs to enhance pretrained language models by incorporating additional knowledge from the graph structures to learn domain-specific terminology or relationships between documents that might otherwise be overlooked. |
| Approach: | They propose to use graph-aware neighborhood contrastive learning methodology SciNCL to enhance pretrained language models by incorporating additional knowledge from graph structures. |
| Outcome: | The proposed graph-aware neighborhood contrastive learning methodology outperforms a state-of-the-art mE5-large text encoder on the process industry text embedding benchmark while having 3 times fewer parameters. |