Conflict and Overlap Classification in Construction Standards Using a Large Language Model (2025.naacl-industry)
Copied to clipboard
Seong-Jin Park, Youn-Gyu Jin, Hyun-Young Moon, Choi Bong-Hyuck, Lee Seung Hwan, Ohjoon Kwon, Kang-Min Kim
| Challenge: | Current manual approaches to analyzing overlapping or conflicting content are time-consuming, costly, and error-prone. |
| Approach: | They propose a large language model that uses a construction domain-adapted large language for the semantic comparison of sentences in construction standards. |
| Outcome: | The proposed framework achieves 97.9% accuracy and 0.907 macro F1-score in classifying sentences from Korean construction standards as overlapping, conflicting, or neutral. |
Similar Papers
Towards a Conversation-Analytic Taxonomy of Speech Overlap (L18-1)
Copied to clipboard
| Challenge: | a taxonomy for classifying speech overlap in natural language dialogue is presented . the scheme classifies overlap on the basis of several features, including onset point, local dialogue history, and management behavior. |
| Approach: | They propose a taxonomy for classifying speech overlap in natural language dialogue . they describe the various dimensions of the scheme and show how it was applied to a corpus of collaborative dialogue based on onset point, dialogue history, and management behavior . |
| Outcome: | The proposed taxonomy classifies overlap on the basis of onset point, dialogue history, management behavior. |
MATCHA: Matching Text via Contrastive Semantic Alignment (2026.findings-acl)
Copied to clipboard
| Challenge: | MATCHA is an automatic metric that rewards semantic agreement with a reference and penalizes contradictions. |
| Approach: | They introduce a metric that jointly rewards semantic agreement with a reference and penalizes contradictions. |
| Outcome: | The proposed metric outperforms popular metrics on eight public benchmarks compared with human annotations on question-answering, image caption generation, natural language inference, summarization, and semantic textual similarity tasks. |
Benchmarking Multi-National Value Alignment for Large Language Models (2025.findings-acl)
Copied to clipboard
Chengyi Ju, Weijie Shi, Chengzhong Liu, Jiaming Ji, Jipeng Zhang, Ruiyuan Zhang, Jiajie Xu, Yaodong Yang, Sirui Han, Yike Guo
| Challenge: | Existing studies on large language models focus on ethical reviews, failing to capture the diversity of national values. |
| Approach: | They propose a national value extraction pipeline to efficiently construct value assessment datasets and a model-based model with instruction tagging to process raw data sources. |
| Outcome: | The proposed benchmark evaluates the alignment of LLMs with the values of five major nations: China, the United States, the UK, France, and Germany. |
Analyzing the Surprising Variability in Word Embedding Stability Across Languages (2021.emnlp-main)
Copied to clipboard
| Challenge: | Word embeddings are powerful representations that form the foundation of many natural language processing architectures. |
| Approach: | They explore word embedding stability in a wide range of languages to gain insight into their stability. |
| Outcome: | The proposed results provide insights into word embedding stability in English and other languages. |
Examining Inter-Consistency of Large Language Models Collaboration: An In-depth Analysis via Debate (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies focus on inconsistency issues within a single LLM, while we explore the inter-consistencies among multiple LLMs for collaboration. |
| Approach: | They propose a formal debate framework to examine whether LLMs can collaborate effectively to achieve a consensus for a shared goal. |
| Outcome: | The proposed framework enables LLMs to achieve consensus in three real-world debate scenarios with real-time scenarios aligned to the LLM's goals. |
Semantic Overlap Summarization among Multiple Alternative Narratives: An Exploratory Study (2022.coling-1)
Copied to clipboard
| Challenge: | Existing tasks for summarizing multiple alternate narratives with different perspectives are under-explored. |
| Approach: | They propose a task which entails generating a single summary from multiple alternative narratives . they use a web-based dataset and human annotations to evaluate the task . |
| Outcome: | The proposed task is based on a novel dataset and human annotations. |
ECON: On the Detection and Resolution of Evidence Conflicts (2024.emnlp-main)
Copied to clipboard
Cheng Jiayang, Chunkit Chan, Qianqian Zhuang, Lin Qiu, Tianhang Zhang, Tengxiao Liu, Yangqiu Song, Yue Zhang, Pengfei Liu, Zheng Zhang
| Challenge: | Recent studies have shown that AI generated content is more likely to dominate search results, making it difficult to detect when compared to human-produced content. |
| Approach: | They propose a method for generating diverse, validated evidence conflicts to simulate real-world misinformation scenarios. |
| Outcome: | The proposed method enables the detection of conflicting information in real-world scenarios and shows that weaker models struggle with similar answer conflicts while stronger models show robust performance. |
Untangle the KNOT: Interweaving Conflicting Knowledge and Reasoning Skills in Large Language Models (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing studies have explained to what extent LLMs extract conflicting knowledge from the provided text, but they neglect the necessity to reason with conflicting information. |
| Approach: | They construct a dataset for knowledge conflict resolution examination in the form of question answering that divides reasoning with conflicting knowledge into three levels. |
| Outcome: | The proposed dataset enables analysis of reasoning with conflicting knowledge in the form of question answering. |
Conflicts in Texts: Data, Implications and Challenges (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Conflicts in data could reflect complexity of situations, changes that need to be explained and dealt with, difficulties in data annotation, and mistakes in generated outputs. |
| Approach: | This survey categorizes conflicting information into three key areas . they identify the areas where conflicting data can be ignored and undermine models' reliability and trustworthiness. |
| Outcome: | The findings highlight key challenges and future directions for developing conflict-aware NLP systems that can reason over and reconcile conflicting information more effectively. |
Quantifying Context Overlap for Training Word Embeddings (D18-1)
Copied to clipboard
| Challenge: | Experimental results show that word embeddings can be improved using word embeds . word embedings are a popular form of natural language processing . |
| Approach: | They propose to estimate second order co-occurrence relations based on context overlap . they use the augmented data to enhance word embeddings learning . |
| Outcome: | The proposed model improves word vectors for word similarity and downstream NLP tasks. |