Papers by Shoval Sadde
The Possible, the Plausible, and the Desirable: Event-Based Modality Detection for Language Processing (2021.acl-long)
Copied to clipboard
| Challenge: | Existing studies restrict modal expressions to a closed syntactic class . modal sense labels are vastly different across different studies, lacking an accepted standard . |
| Approach: | They propose a task where modal expressions can be words of any syntactic class and sense labels are drawn from a comprehensive taxonomy which harmonizes the modal concepts contributed by the different studies. |
| Outcome: | The proposed task is based on the Georgetown Gradable Modal Expressions corpus . it detects and classifies fine-grained modal concepts and associates them with modified events . |
LM-Debugger: An Interactive Tool for Inspection and Intervention in Transformer-Based Language Models (2022.emnlp-demos)
Copied to clipboard
| Challenge: | Transformer-based language models (LMs) are opaque and unexplained, causing problems for endusers and developers who wish to debug or fix their behaviour. |
| Approach: | They propose an interactive debugger tool for transformer-based LMs that provides a fine-grained interpretation of the model's internal prediction process and a powerful framework for intervening in LM behavior. |
| Outcome: | The proposed tool provides a fine-grained interpretation of the model's internal prediction construction process, and a powerful framework for intervening in LM behavior. |
Large Scale Substitution-based Word Sense Induction (2022.acl-long)
Copied to clipboard
| Challenge: | Word forms are ambiguous, and derive meaning from the context in which they appear . word sense induction can be performed over a corpus-derived sense inventory . |
| Approach: | They propose a word-sense induction method based on pre-trained masked language models . they train a static word embeddings algorithm on the sense-tagged corpus . |
| Outcome: | The proposed method outperforms existing senseful embeddings methods on Wikipedia and on an outlier detection dataset. |
Syntactic Search by Example (2020.acl-demos)
Copied to clipboard
| Challenge: | a new system allows a user to search a large linguistically annotated corpus using syntactic patterns over dependency graphs. |
| Approach: | They propose a query language that allows a user to search a large linguistically annotated corpus using syntactic patterns over dependency graphs. |
| Outcome: | The proposed system searches the English wikipedia and English pubmed abstracts at a rapid speed. |
What’s Wrong with Hebrew NLP? And How to Make it Right (D19-3)
Copied to clipboard
| Challenge: | Sub-optimal performance of many morphologically rich languages (MRLs) is due to errors in early morphology disambiguation decisions, that cannot be recovered later on in the pipeline, yielding incoherent annotations on the whole. |
| Approach: | They propose to use a joint morpho-syntactic infrastructure for processing Modern Hebrew texts to provide rich and expressive annotations. |
| Outcome: | The proposed pipelines are based on a morpho-syntactic infrastructure for processing Modern Hebrew texts. |