From Linguistic Linked Data to Big Data (2024.lrec-main)

Copied to clipboard

Challenge: Language data on the LOD cloud has grown in number, size, and variety . Linked (Open) Data (LLOD) is a standardized way of representing and sharing linguistic datasets .
Approach: They propose to combine LLOD and Big Data to improve interoperability of linguistic datasets . they propose to use a machine-readable format to represent and share linguistic data .
Outcome: This paper examines the use cases of Linked (Open) Data and Big Data in language data.

Similar Papers

Recent Developments for the Linguistic Linked Open Data Infrastructure (2020.lrec-1)

Copied to clipboard

Challenge: Language data is rarely 'ready-to-use' and language technology specialists spend over 80% of their time cleaning, organizing and collecting language datasets.
Approach: They propose a methodology for building data value chains based around language resources and language technologies that can be integrated by means of semantic technologies.
Outcome: The proposed methodology is based on language resources and language technologies that can be integrated by means of semantic technologies.
Connecting Language Technologies with Rich, Diverse Data Sources Covering Thousands of Languages (2024.lrec-main)

Copied to clipboard

Challenge: Existing data sources for many thousands of languages are rich and diverse . Efforts are ongoing to extend technology to many more of the world's languages .
Approach: They provide an overview of some of the major online data sources available for thousands of languages.
Outcome: The proposed language technologies are based on the data available for thousands of languages.
How Do Large Language Models Capture the Ever-changing World Knowledge? A Review of Recent Advances (2023.emnlp-main)

Copied to clipboard

Challenge: Large language models (LLMs) are impressive in solving tasks, but they can quickly be outdated after deployment.
Approach: They provide a review of recent advances in aligning deployed large language models with the ever-changing world knowledge.
Outcome: The proposed models can be used to perform various tasks directly through in-context learning or for further fine-tuning for domain-specific uses.
Towards a Linked Open Data Edition of Sumerian Corpora (L18-1)

Copied to clipboard

Challenge: Linguistic Linked Open Data (LLOD) is a flourishing line of research in the language resource community . existing LLOD standards and vocabularies are not widely used in this community despite its popularity .
Approach: They propose to use Linguistic Linked Open Data to link a Sumerian corpus with lexical resources . they use a linguistically annotated archive to create a corpus of cuneiform texts .
Outcome: The proposed LLOD framework is used in assyriology, with philological resources underrepresented . the proposed framework is based on a linguistically annotated corpus of Sumerian texts .
On LLMs-Driven Synthetic Data Generation, Curation, and Evaluation: A Survey (2024.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) provide a data-centric solution to alleviate limitations of real-world data with synthetic data generation.
Approach: They propose a generic workflow for LLM-driven synthetic data generation.
Outcome: The proposed workflows highlight gaps in existing research and outline avenues for future studies.
Synthetic Data in the Era of Large Language Models (2025.acl-tutorials)

Copied to clipboard

Challenge: 'synthetic data' is a data generated with the assistance of large language models to make dataset construction faster and cheaper.
Approach: This tutorial seeks to build a shared understanding of recent progress in synthetic data generation from NLP and related fields by grouping and describing major methods, applications, and open problems.
Outcome: This tutorial will describe methods, applications, and open problems that have been developed and are being used to improve the quality and efficiency of synthetic data generation.
No Size Fits All: The Perils and Pitfalls of Leveraging LLMs Vary with Company Size (2025.coling-industry)

Copied to clipboard

Challenge: Large language models are playing a pivotal role in deploying strategic use cases across organizations . lack of studies examining potential challenges and risks associated with LLMs .
Approach: They propose a case study and a practical guide for industries to utilize LLMs more efficiently.
Outcome: The proposed study examines the literature on large language models with industry practitioners and examines industrial publications to address these questions.
Data and Model Centric Approaches for Expansion of Large Language Models to New languages (2025.emnlp-tutorials)

Copied to clipboard

Challenge: Existing LLMs mainly support English alongside a handful of high resource languages . this leaves a major gap for most low-resource languages despite increasing pace of research .
Approach: This tutorial examines approaches to expand the language coverage of LLMs . they look at tokenizer training, pre-training, instruction tuning, alignment, evaluation, etc.
Outcome: This tutorial examines approaches to expand the language coverage of LLMs . it provides an efficient and viable path to bring LLM technologies to low-resource languages .
Mastering the Craft of Data Synthesis for CodeLLMs (2025.naacl-long)

Copied to clipboard

Challenge: Large language models (LLMs) have shown impressive performance in code understanding and generation.
Approach: They propose a systematic review of large language models and their taxonomy and propose specialized LLMs for code-related tasks.
Outcome: The proposed models have shown to be highly effective in coding tasks.
The Data Frontier for Large Language Models: Selection, Synthesis, and Tools (2026.acl-tutorials)

Copied to clipboard

Challenge: acquiring and curating high-quality training data remains a significant bottleneck . acquiring such high-quality data is a key challenge for researchers and practitioners .
Approach: This tutorial provides a comprehensive and practical guide to the state-of-the-art in data research directions for LLMs.
Outcome: The tutorial covers methods for curating the most valuable information from vast, noisy datasets and the synthetic data revolution.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations