Papers with SOM
Explicitly Modeling Syntax in Language Models with Incremental Parsing and a Dynamic Oracle (2021.naacl-main)
Copied to clipboard
| Challenge: | Failing to capture the structure of input language could lead to generalization problems and over-parametrization. |
| Approach: | They propose a new syntax-aware language model that explicitly models the structure with an incremental parser and maintains the conditional probability setting of a standard language model. |
| Outcome: | The proposed model can achieve strong results in language modeling, parsing, and syntactic generalization tests while using fewer parameters than other models. |
Building the Directed Semantic Graph for Coherent Long Text Generation (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for conditional long text generation ignore the coherence issue of the generated texts. |
| Approach: | They propose a two-stage approach to generate coherent long text based on short input text . they first build a document-level path for each output text with each sentence embedding as its node . |
| Outcome: | The proposed approach is superior to state-of-the-art approaches on three real-world datasets. |
Bringing Order to Chaos: A Non-Sequential Approach for Browsing Large Sets of Found Audio Data (L18-1)
Copied to clipboard
| Challenge: | a new approach to search for sound in large archives is being developed . speech and speech technology researchers struggle to access large amounts of data . |
| Approach: | They propose a method for fast and efficient non-sequential browsing of sound in large archives that we know little about . they combine audio browsing through massively multi-object sound environments and an unsupervised dimensionality reduction algorithm to search for sound in public archives. |
| Outcome: | The proposed method is shown to combine well, resulting in rapid and interpretable observations. |