Papers by Grzegorz Chrupała
Putting Natural in Natural Language Processing (2023.findings-acl)
Copied to clipboard
| Challenge: | human language is firstly spoken and only secondarily written. |
| Approach: | aaron carroll: human language is firstly spoken and only secondarily written . carroll says the field of NLP has overwhelmingly focused on processing written language . he says the focus is on a subset of human language which is convenient to work with . |
| Outcome: | the ACL 2023 theme track urges the community to check the reality of the progress in NLP . |
Analyzing analytical methods: The case of phonology in neural models of spoken language (2020.acl-main)
Copied to clipboard
| Challenge: | Recent studies have focused on the strengths and weaknesses of various methods for analyzing phonology representations. |
| Approach: | They propose to use diagnostic classifiers and representational similarity analysis to quantify to what extent phonemes and phoneme sequences are encoded. |
| Outcome: | The proposed method is based on two commonly applied techniques . it shows that global-scope methods yield more consistent and interpretable results . |
Quantifying Context Mixing in Transformers (2023.eacl-main)
Copied to clipboard
| Challenge: | Self-attention weights and their transformed variants have been used for analyzing token-to-token interactions in Transformer-based models, but they are not faithful to the models’ decisions as they are only one part of an encoder block. |
| Approach: | They propose a new context mixing score customized for Transformers that provides us with a deeper understanding of how information is mixed at each encoder layer. |
| Outcome: | The proposed score outperforms other methods in linguistically informed rationales, probing, and faithfulness analysis. |
Correlating Neural and Symbolic Representations of Language (P19-1)
Copied to clipboard
| Challenge: | a popular technique for analyzing neural representations involves predicting information of interest from the activation patterns. |
| Approach: | They propose to use Representational Similarity Analysis and Tree Kernels to quantify how strongly activation patterns correspond to symbolic representations. |
| Outcome: | The proposed methods show that they exhibit the expected pattern of results on a synthetic language. |
Learning to Understand Child-directed and Adult-directed Speech (2020.acl-main)
Copied to clipboard
| Challenge: | linguistic properties of child-directed speech differ from adult-directed in many ways . linguistic differences between CDS and ADS are retained, but the acoustic properties are similar. |
| Approach: | They compare the task performance of models trained on adult-directed speech and child-directed language . they propose that CDS is optimized for learnability, but not for comprehension . |
| Outcome: | The proposed model trains on adult-directed speech and child-directed language . the model generalizes better on the training register and on synthesized speech . |
Textual Supervision for Visually Grounded Spoken Language Understanding (2020.findings-emnlp)
Copied to clipboard
| Challenge: | a new approach to spoken language understanding extracts semantic information directly from speech without relying on transcriptions. |
| Approach: | They propose to use textual supervision to train visually-grounded models of spoken language understanding without relying on transcriptions. |
| Outcome: | The proposed model improves when enough text is available, the study shows . compared with pipeline-based models, the pipeline approach performs better when enough data is available . |
Symbolic Inductive Bias for Visually Grounded Learning of Spoken Language (P19-1)
Copied to clipboard
| Challenge: | Existing approaches to processing spoken language are to first automatically transcribe it into text, but there is an alternative: end-to-end learning. |
| Approach: | They propose to use multitask learning to exploit existing transcribed speech within the end-to-end setting by matching spoken captions with corresponding images, speech with text, and text with images. |
| Outcome: | The proposed model improves image retrieval performance compared to training the speech/image task in isolation. |
Homophone Disambiguation Reveals Patterns of Context Mixing in Speech Transformers (2023.emnlp-main)
Copied to clipboard
| Challenge: | 'context mixing' is a feature of Transformers that is used to build up representations of acoustic and linguistic structure in speech models. |
| Approach: | They propose to use a French spelling quirk to probe context mixing in speech models to find out how to translate spoken words into written equivalents. |
| Outcome: | The proposed model incorporates cues to identify correct transcription, whereas encoder-decoder models relegate task to decoder modules. |
Revisiting the Hierarchical Multiscale LSTM (C18-1)
Copied to clipboard
| Challenge: | Hierarchical Multiscale LSTM model learns structure from character input . high complexity of architecture, training and implementations might hinder its applicability . |
| Approach: | They propose to reproduce and ablate hierarchical multiscale LSTM language model and show that simplifying certain aspects of the architecture can improve its performance. |
| Outcome: | The proposed model performs better when simplified and linguistic units are learned by different levels of the model. |
Adversarial Stylometry in the Wild: Transferable Lexical Substitution Attacks on Author Profiling (2021.eacl-main)
Copied to clipboard
| Challenge: | Written language contains stylistic cues that can be exploited to automatically infer a variety of potentially sensitive author information. |
| Approach: | They propose to use a transformer-based extension of a lexical replacement attack to attack written language by rewriting an author's text. |
| Outcome: | The proposed framework achieves high transferability when trained on a weakly labeled corpus—decreasing target model performance below chance. |
Style Obfuscation by Invariance (C18-1)
Copied to clipboard
| Challenge: | obfuscation-by-transfer is a method of obliging writing style using sequence models . a side effect of this approach is the frequent major alterations to the semantic content of the input . |
| Approach: | They propose obfuscation-by-invariance and investigate to what extent models trained to be explicitly style-independent preserve semantics. |
| Outcome: | The proposed model performs better than models trained to be explicitly style-invariant, while human evaluation shows a trade-off between the level of obfuscation and the quality of the output. |
Cyberbullying Classifiers are Sensitive to Model-Agnostic Perturbations (2022.lrec-1)
Copied to clipboard
| Challenge: | toxicity classifiers rely on lexical cues, so creative language use can be detrimental to utility of current corpora and state-of-the-art models. |
| Approach: | They propose to use model-agnostic adversarial behavior to enhance toxic content classification models. |
| Outcome: | The proposed model-agnostic adversarial behavior and augmentation for cyberbullying detection are robust against word-level perturbations at a slight trade-off in overall task performance. |
Encoding of lexical tone in self-supervised models of spoken language (2024.naacl-long)
Copied to clipboard
| Challenge: | Existing research on representations of phonetic and phonological information has focused on segmental features such as phonemes. |
| Approach: | They propose to analyze the tone encoding capabilities of self-supervised Spoken Language Models, using Mandarin and Vietnamese as case studies. |
| Outcome: | The proposed models encode lexical tone even when trained on non-tonal languages. |
Learning English with Peppa Pig (2022.tacl-1)
Copied to clipboard
| Challenge: | Current approaches to model or simulate the acquisition of spoken language via grounding in perception are not generalizable to real-life situations that humans or adaptive artificial agents experience. |
| Approach: | They propose to use a dataset based on the children’s cartoon Peppa Pig to train a bi-modal architecture that learns aspects of the visual semantics of spoken language. |
| Outcome: | The proposed model learns to represent speech and visual data in a joint vector space. |