Richard Futrell, Edward Gibson, Harry J. Tily, Idan Blank, Anastasia Vishnevetsky, Steven Piantadosi, Evelina Fedorenko
| Challenge: | Existing corpora of naturalistic text do not contain the low-frequency syntactic constructions needed to distinguish between theories. |
| Approach: | They propose to compare models of language processing by comparing their ability to predict behavioral and neural measures of processing difficulty to corpora of naturalistic text. |
| Outcome: | The proposed corpus contains low-frequency syntactic constructions while sounding fluent to native speakers. |
Similar Papers
The DReaM Corpus: A Multilingual Annotated Corpus of Grammars for the World’s Languages (2020.lrec-1)
Copied to clipboard
| Challenge: | Until recently, language descriptions were available in paper form only, with indexes as the only search aid. |
| Approach: | They propose to digitize a multilingual corpus of language descriptions and annotate it with various meta, word, and text attributes to make searching and analysis easier and more useful. |
| Outcome: | The proposed corpus is searchable through a couple of well-established corpus infrastructures. |
The ACQDIV Corpus Database and Aggregation Pipeline (2020.lrec-1)
Copied to clipboard
| Challenge: | ACQDIV corpus database and aggregation pipeline aims to identify universal cognitive processes that allow children to acquire any language. |
| Approach: | They present the ACQDIV corpus database and aggregation pipeline . the tool aims to identify universal cognitive processes that allow children to acquire any language . |
| Outcome: | The ACQDIV corpus database and aggregation pipeline is a tool developed by the European Research Council . the database represents 15 corpora from 14 typologically maximally diverse languages . |
Beyond Metadata: What Paper Authors Say About Corpora They Use (2021.findings-acl)
Copied to clipboard
| Challenge: | Currently, dataset retrieval relies almost exclusively on metadata provided by the publishers. |
| Approach: | They propose to use metadata to extract review statements from scientific publications . they argue that a crucial piece of information is missing to inform the examination of search results . |
| Outcome: | The proposed analysis is the first of its kind in the field of Natural Language Processing. |
High Performance Natural Language Processing (2020.emnlp-tutorials)
Copied to clipboard
| Challenge: | a tutorial on scaling natural language processing will recapitulate the state-of-the-art in the field . |
| Approach: | This cutting-edge tutorial recapitulates the state-of-the-art in natural language processing with scale in perspective. |
| Outcome: | This cutting-edge tutorial recapitulates the state-of-the-art in natural language processing with scale in perspective. |
Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP): System Demonstrations (D19-3)
Copied to clipboard
| Challenge: | Proceedings of the system demonstrations session were presented at the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) EMNMP-IjCNLP 2019 has a Best Demo Award for the first time . |
| Approach: | Proceedings of the system demonstrations session are available online . they were presented at the conference on empirical methods in natural language processing . |
| Outcome: | The system demonstrations session received 110 submissions, 22 of which were either invalid or withdrawn by the authors. |
Penn-Helsinki Parsed Corpus of Early Modern English: First Parsing Results and Analysis (2022.findings-naacl)
Copied to clipboard
| Challenge: | PPCEME has a large set of function tags and is difficult to parse . authors present results for PPceME using a modified version of the Berkeley Neural Parser . |
| Approach: | They propose to use a modified version of the Berkeley Neural Parser to parse PPCEME using function tags. |
| Outcome: | The proposed parser will be used to parse Early English Books Online, a 1.5 billion word corpus. |
A Gold Standard for Multilingual Automatic Term Extraction from Comparable Corpora: Term Structure and Translation Equivalents (L18-1)
Copied to clipboard
| Challenge: | Terms are notoriously difficult to identify, both automatically and manually. |
| Approach: | They propose a method to annotate terms manually from a comparable corpus . they show that the gold standard provides a tool for evaluation and a rich source of information . |
| Outcome: | The proposed method provides a tool for evaluation and rich source of information about terms. |
The Tembusu Treebank: An English Learner Treebank (2022.lrec-1)
Copied to clipboard
| Challenge: | a new treebank is created to help diagnose ungrammatical sentences using mal-rules . the Tembusu Learner Treebank is an open treebank created from the corpus of Learner English . |
| Approach: | They propose to use the Tembusu Learner Treebank to train a new parse-ranking model for the English Resource Grammar . the model incorporates mal-rules in the annotation of ungrammatical sentences . |
| Outcome: | The Tembusu Learner Treebank is an open treebank created from the NTU Corpus of Learner English . the treebank is unique for incorporating mal-rules in the annotation of ungrammatical sentences . |
Efficient Methods for Natural Language Processing: A Survey (2023.tacl-1)
Copied to clipboard
Marcos Treviso, Ji-Ung Lee, Tianchu Ji, Betty van Aken, Qingqing Cao, Manuel R. Ciosici, Michael Hassid, Kenneth Heafield, Sara Hooker, Colin Raffel, Pedro H. Martins, André F. T. Martins, Jessica Zosa Forde, Peter Milder, Edwin Simpson, Noam Slonim, Jesse Dodge, Emma Strubell, Niranjan Balasubramanian, Leon Derczynski, Iryna Gurevych, Roy Schwartz
| Challenge: | Recent work in natural language processing (NLP) has yielded appealing results from scaling model parameters and training data, but using only scale to improve performance means resource consumption also grows. |
| Approach: | They propose to use data, time, storage, or energy to improve model performance. |
| Outcome: | The proposed methods and findings provide guidance for conducting NLP under limited resources and point towards promising research directions for developing more efficient methods. |
Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations (2020.emnlp-demos)
Copied to clipboard
| Challenge: | 91 submissions were received, 10 of which were either invalid or withdrawn . |
| Approach: | 91 submissions were received for the system demonstrations session . 10 were either invalid or withdrawn by the authors . |
| Outcome: | The system demonstrations session was held at the 2020 conference on empirical methods in natural language processing . 91 submissions were accepted, 10 of which were either invalid or withdrawn . |