COSMOS: Experimental and Comparative Studies of Concept Representations in Schoolchildren (2022.lrec-1)
Copied to clipboard
| Challenge: | COSMOS is a multidisciplinary research project investigating schoolchildren’s beliefs and representations of specific concepts under control variables (age, gender, language spoken at home). |
| Approach: | They present a lexical study of seven concepts in a french school . they use a word-level lexicon to examine their representations under control variables . |
| Outcome: | The results of the study show that children's linguistic proficiency and lexical diversity increase with age, and that gender and age influence lexicality. |
Similar Papers
Is Child-Directed Speech Effective Training Data for Language Models? (2024.emnlp-main)
Copied to clipboard
| Challenge: | High-performing language models are typically trained on hundreds of billions of words, but human learners use language fluently after far less training data. |
| Approach: | They train GPT-2 and RoBERTa models on 29M words of English child-directed speech and a new matched, synthetic dataset. |
| Outcome: | The proposed models show that child language input is not valuable for training language models. |
SphereRE: Distinguishing Lexical Relations with Hyperspherical Relation Embeddings (P19-1)
Copied to clipboard
| Challenge: | Lexical relations are relations between terms in lexicons. |
| Approach: | They propose a neural representation learning model to distinguish lexical relations among term pairs based on hyperspherical relation embeddings. |
| Outcome: | The proposed model outperforms state-of-the-art models on several benchmarks. |
Finding Concept-specific Biases in Form–Meaning Associations (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing methods to detect cross-linguistic associations are not effective, but their effects are minor. |
| Approach: | They propose a method to measure cross-linguistic associations by controlling for the influence of language family and geographic proximity within a large concept-aligned, cross-lingual lexicon. |
| Outcome: | The proposed method shows that it is small, but it is unsurprisingly small (less than 0.5% on average). |
On the Automatic Generation and Simplification of Children’s Stories (2023.emnlp-main)
Copied to clipboard
| Challenge: | Recent advances in large language models (LLMs) have made it possible to generate children's educational texts with appropriate lexical and readability levels. |
| Approach: | They first examine the ability of several popular LLMs to generate stories with properly adjusted lexical and readability levels. |
| Outcome: | The proposed models can generalize to the domain of children's stories and create an efficient pipeline for their automatic generation. |
Word Acquisition in Neural Language Models (2022.tacl-1)
Copied to clipboard
| Challenge: | Language models acquire individual words during training, based on unigram token frequencies, before transitioning loosely to bigram probabilities, eventually converging on more nuanced predictions. |
| Approach: | They examine how neural language models acquire individual words during training, extracting learning curves and ages of acquisition for over 600 words on the MacArthur-Bates Communicative Development Inventory. |
| Outcome: | The models follow consistent patterns during training for both unidirectional and bidirectional models, and for both LSTM and Transformer architectures. |
Who is better at math, Jenny or Jingzhen? Uncovering Stereotypes in Large Language Models (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing research on stereotypes in large language models is limited and focuses on African Ameri- F. |
| Approach: | They propose to use global bias to probe a set of large language models via perplexity to determine how certain stereotypes are represented in the model's internal representations. |
| Outcome: | The proposed model amplifys harmful stereotypes and shows that the demographic groups associated with stereotypes remain consistent across model likelihoods and outputs. |
Cabbage Sweeter than Cake? Analysing the Potential of Large Language Models for Learning Conceptual Spaces (2023.emnlp-main)
Copied to clipboard
| Challenge: | Conceptual spaces are constructed from a set of quality dimensions, which are usually learned from human judgements, which means that applications of conceptual spaces are limited to narrow domains. |
| Approach: | They propose to use Large Language Models to learn perceptually grounded representations by comparing them to larger models of the BERT family. |
| Outcome: | The proposed models outperform the largest model, despite being 2 to 3 orders of magnitude smaller. |
ChildEval:WHEN LARGE LANGUAGE MODELS MEET CHILDREN’S PERSONALITIES (2026.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have achieved remarkable success in effectively understanding and generating human language, leading to a revolutionary era in LLMs. |
| Approach: | They propose a benchmark to evaluate LLMs' ability to infer and follow child-centered preferences in long-context conversations. |
| Outcome: | The proposed benchmark spans five top-level and fourteen sub-level categories covering children’s daily lives and development. |
KidLM: Advancing Language Models for Children – Early Insights and Future Directions (2024.emnlp-main)
Copied to clipboard
| Challenge: | Large language models have been shown to be effective in creating educational tools for children, yet there are significant challenges in maintaining key child-specific properties such as linguistic nuances, cognitive needs, and safety standards. |
| Approach: | They propose a user-centric data collection pipeline that involves gathering and validating a corpus specifically written for and sometimes by children. |
| Outcome: | The proposed model excels in understanding lower grade-level text, maintains safety by avoiding stereotypes, and captures children’s unique preferences. |
CALE : Concept-Aligned Embeddings for Both Within-Lemma and Inter-Lemma Sense Differentiation (2026.eacl-long)
Copied to clipboard
| Challenge: | Recent work on Word-in-Context fine-tunes models to investigate lexical meaning but only compares occurrences of the same lemma, limiting the range of captured information. |
| Approach: | They propose an extension to Word-in-Context to include inter-words scenarios by using a dataset and several models on a data set. |
| Outcome: | The proposed models provide efficient multi-purpose representations of lexical meaning that reach best performances in the experiments. |