Annotating Modality Expressions and Event Factuality for a Japanese Chess Commentary Corpus (L18-1)
Copied to clipboard
| Challenge: | In recent years, there has been a surge of interest in the natural language processing related to the real world . shogi commentaries are an interesting testbed for these tasks, but can be grounded in the game tree . |
| Approach: | They propose to augment shogi commentaries with game states to generate a game commentary generator. |
| Outcome: | The proposed system can be used to ground symbols and events with factuality . it can be compared with other systems to find out if a commentator is a human . |
Similar Papers
ModaFact: Multi-paradigm Evaluation for Joint Event Modality and Factuality Detection (2025.coling-main)
Copied to clipboard
| Challenge: | NLP studies have mostly dealt with factuality and modality separately . linguistic modality conveys the relationship a situation is supposed to have with respect to wishes, norms, goals, authority, etc. |
| Approach: | They propose a resource with joint factuality and modality information for event-denoting expressions in Italian. |
| Outcome: | The proposed resource is consistent with existing ones and compares classification systems trained on italy's ModaFact dataset and best-performing model. |
Constructing a Japanese Verdict Prediction Dataset for Fact-Checking of LLM-Generated Texts (2026.acl-srw)
Copied to clipboard
Miwa Masano, Hirokazu Kiyomaru, Atsushi Keyaki, Kaito Horio, Rei Minamoto, Ribeka Keyaki, Kouta Nakayama, Hideyuki Tachibana, Daisuke Kawahara
| Challenge: | Text generated by Large Language Models (LLMs) may contain plausible but incorrect information known as hallucinations. |
| Approach: | They extend the label set for verdict prediction to capture claim-evidence relationships humans would commonly interpret as supported or refuted. |
| Outcome: | The proposed system improves F1 by 4 percentage points compared to baseline. |
Event-Centric Natural Language Processing (2021.acl-tutorials)
Copied to clipboard
| Challenge: | This tutorial will provide an introduction to various methods for automating the extraction, conceptualization and prediction of events and their relations. |
| Approach: | This tutorial will provide an introduction to various methods for automating events and their relations, and a wide range of NLU and commonsense understanding tasks. |
| Outcome: | This tutorial will provide an introduction to various methods for automating extraction, conceptualization and prediction of events and their relations, and a wide range of NLU and commonsense understanding tasks. |
Spanless Event Annotation for Corpus-Wide Complex Event Understanding (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods for annotating multilingual, multimedia data are limited by the availability of multilingual corpora for schema-based event representation. |
| Approach: | They propose a new approach to event annotation to promote whole-corpus understanding of complex events in multilingual, multimedia data. |
| Outcome: | The proposed method is part of the DARPA Knowledge-directed Artificial Intelligence Reasoning Over Schemas (KAIROS) Program. |
Japanese Realistic Textual Entailment Corpus (2020.lrec-1)
Copied to clipboard
| Challenge: | a corpus of 48,000 realistic examples is the largest among publicly available Japanese TE corpora . a textual entailment corpus is used to train natural language understanding . authors: to be truly helpful, machines must understand the meaning of texts. |
| Approach: | They perform textual entailment corpus construction with 48,000 realistic examples . they use two sentences that are spontaneous or almost equivalent . |
| Outcome: | The resulting corpus consists of 48,000 realistic Japanese examples . it is the largest among publicly available Japanese TE corpora . |
Natural Language Annotations for Reasoning about Program Semantics (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Xu et al., 2022) and Tafjord eet . al. 2021) have shown that programming assistants can explain their work by grounding natural language inference in code. |
| Approach: | They propose a dataset and protocol for annotating programs with natural language predicates at a finer granularity than code comments without relying on internal compiler representations. |
| Outcome: | The proposed method can be used to ground natural language inference in code without static analysis and without internal compiler representations. |
The DReaM Corpus: A Multilingual Annotated Corpus of Grammars for the World’s Languages (2020.lrec-1)
Copied to clipboard
| Challenge: | Until recently, language descriptions were available in paper form only, with indexes as the only search aid. |
| Approach: | They propose to digitize a multilingual corpus of language descriptions and annotate it with various meta, word, and text attributes to make searching and analysis easier and more useful. |
| Outcome: | The proposed corpus is searchable through a couple of well-established corpus infrastructures. |
Corpus-Level Evaluation for Event QA: The IndiaPoliceEvents Corpus Covering the 2002 Gujarat Violence (2021.findings-acl)
Copied to clipboard
| Challenge: | a new corpus-level evaluation approach for event extraction is needed in social science applications . human annotations are often required to extract the actions of political actors and actors . a novel corpus evaluation approach can guide creation of similar social science-oriented resources . |
| Approach: | They propose a corpus-based approach to event extraction that integrates corpus evaluation with real-world social science . they use human annotations to read and label every document for mentions of police activity events . |
| Outcome: | The proposed method can guide creation of similar social-science-oriented resources in the future. |
CAMERA³: An Evaluation Dataset for Controllable Ad Text Generation in Japanese (2024.lrec-main)
Copied to clipboard
| Challenge: | Despite numerous efforts in ad text generation, the aspect of diversifying a text has received limited attention, particularly in non-English languages like Japanese. |
| Approach: | They present a dataset for ad text generation in Japanese using annotators to examine the capabilities of recent NLG models. |
| Outcome: | The proposed dataset includes 3,980 ad texts written by experts taking into account various aspects of ade appeals. |
The Possible, the Plausible, and the Desirable: Event-Based Modality Detection for Language Processing (2021.acl-long)
Copied to clipboard
| Challenge: | Existing studies restrict modal expressions to a closed syntactic class . modal sense labels are vastly different across different studies, lacking an accepted standard . |
| Approach: | They propose a task where modal expressions can be words of any syntactic class and sense labels are drawn from a comprehensive taxonomy which harmonizes the modal concepts contributed by the different studies. |
| Outcome: | The proposed task is based on the Georgetown Gradable Modal Expressions corpus . it detects and classifies fine-grained modal concepts and associates them with modified events . |