On the Continued Value of Universal Dependencies in the Era of Large Language Models (2026.acl-long)
Copied to clipboard
| Challenge: | a growing belief that explicit linguistic representations are no longer necessary is questioned in large language models . a recent study examines whether and in what ways this cross-lingual syntactic framework can still benefit LLMs . |
| Approach: | They use Universal Dependencies (UD) to examine whether and in what ways it can still benefit LLMs. |
| Outcome: | The proposed model outperforms its syntax-agnostic counterparts in a cross-lingual evaluation task. |
Similar Papers
75 Languages, 1 Model: Parsing Universal Dependencies Universally (D19-1)
Copied to clipboard
| Challenge: | UDify is a multilingual multi-task model that can predict universal part-of-speech, morphological features, lemmas, and dependency trees. |
| Approach: | They evaluate UDify, a multilingual multi-task model capable of predicting universal part-of-speech, morphological features, lemmas, and dependency trees simultaneously for all 124 Universal Dependencies treebanks across 75 languages. |
| Outcome: | The proposed model can predict universal part-of-speech, morphological features, lemmas, and dependency trees for all 124 treebanks across 75 languages. |
How Do Large Language Models Capture the Ever-changing World Knowledge? A Review of Recent Advances (2023.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) are impressive in solving tasks, but they can quickly be outdated after deployment. |
| Approach: | They provide a review of recent advances in aligning deployed large language models with the ever-changing world knowledge. |
| Outcome: | The proposed models can be used to perform various tasks directly through in-context learning or for further fine-tuning for domain-specific uses. |
Contribution of Linguistic Typology to Universal Dependency Parsing: An Empirical Investigation (2024.emnlp-main)
Copied to clipboard
| Challenge: | UD is a global initiative to create a standard annotation for the dependency syntax of human languages. |
| Approach: | They propose a typologically motivated transformation of UD that emphasizes information packaging over lexical semantics. |
| Outcome: | The proposed scheme differs from previous attempts to create a universal annotation for human languages. |
What Does Parameter-free Probing Really Uncover? (2024.acl-short)
Copied to clipboard
| Challenge: | Probing large language models (LLMs) has been criticized for using pre-defined label-laden target labels. |
| Approach: | They extend a parameter-free probing technique called perturbed masking applied to BERT to examine the relationship between UD and BERT. |
| Outcome: | The proposed method is compared to the UD formalism for English and shows that it lacks correlations with linguistic theory. |
How Universal are Universal Dependencies? Exploiting Syntax for Multilingual Clause-level Sentiment Detection (2020.lrec-1)
Copied to clipboard
| Challenge: | a new method for clause-level sentiment detection is proposed for multilingual use cases. |
| Approach: | They propose a pipeline method that makes the most of syntactic structures based on Universal Dependencies. |
| Outcome: | The proposed method achieves high precision in sentiment detection for 17 languages . it avoids machine-learning approaches that may cause obstacles to its use cases . |
Memory-enhanced Large Language Model for Cross-lingual Dependency Parsing via Deep Hierarchical Syntax Understanding (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Experimental results show that our approach can significantly improve the parsing accuracy of all baseline models, leading to new state-of-the-art results. |
| Approach: | They propose a deep hierarchical syntax understanding approach to improve the cross-lingual semantic memory capability of large language models by implicitly aligning linguistic knowledge between source and target languages. |
| Outcome: | The proposed approach improves the cross-lingual semantic memory capability of large language models by combining implicit multi-task fine-tuning and explicit label bank guiding. |
Is Translation All You Need? A Study on Solving Multilingual Tasks with Large Language Models (2025.naacl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) have demonstrated multilingual capabilities, yet they are mostly English-centric due to the imbalanced training corpora. |
| Approach: | They extend the evaluation to real-world user queries and non-English-centric LLMs . they show that translation into English can boost LLM performance on NLP tasks . |
| Outcome: | The proposed evaluation extends to user queries and non-English-centric LLMs . it shows that translation into English can boost performance on NLP tasks, but not universally optimal . |
Injecting Domain-Specific Knowledge into Large Language Models: A Comprehensive Survey (2025.findings-emnlp)
Copied to clipboard
| Challenge: | specialized LLMs are often limited in domain-specific applications that require specialized knowledge. |
| Approach: | They provide a comprehensive overview of four key methods to enhance large language models by integrating domain-specific knowledge. |
| Outcome: | The proposed methods are categorized into four key approaches: dynamic knowledge injection, static knowledge embedding, modular adapters, and prompt optimization. |
UCxn: Typologically-Informed Annotation of Constructions Atop Universal Dependencies (2024.lrec-main)
Copied to clipboard
Leonie Weissweiler, Nina Böbel, Kirian Guiller, Santiago Herrera, Wesley Samuel Scivetti, Arthur Lorenzi, Nurit Melnik, Archna Bhatia, Hinrich Schütze, Lori Levin, Amir Zeldes, Joakim Nivre, William Croft, Nathan Schneider
| Challenge: | Grammatical constructions that convey meaning through a particular combination of several morphosyntactic elements are not labeled holistically. |
| Approach: | They propose to augment UD annotations with a ‘UCxn’ annotation layer for such meaning-bearing grammatical constructions and to approach this in a typologically informed way so that morphosyntactic strategies can be compared across languages. |
| Outcome: | The proposed annotation layer could be used to annotate meaning-bearing constructions across languages and to compare them across languages. |
Data and Model Centric Approaches for Expansion of Large Language Models to New languages (2025.emnlp-tutorials)
Copied to clipboard
| Challenge: | Existing LLMs mainly support English alongside a handful of high resource languages . this leaves a major gap for most low-resource languages despite increasing pace of research . |
| Approach: | This tutorial examines approaches to expand the language coverage of LLMs . they look at tokenizer training, pre-training, instruction tuning, alignment, evaluation, etc. |
| Outcome: | This tutorial examines approaches to expand the language coverage of LLMs . it provides an efficient and viable path to bring LLM technologies to low-resource languages . |