Papers with GPT-5.2
Automatic Generation of a Compositional QA Benchmark for Geospatial Reasoning under Spatial and Entity Constraints (2026.eacl-srw)
Copied to clipboard
| Challenge: | Recent advances in large language models have enhanced their ability to perform reasoning tasks that integrate linguistic, visual, and factual information. |
| Approach: | They propose a method for constructing compositional geographic question answering datasets that jointly consider spatial and entity constraints. |
| Outcome: | The proposed method performs well on questions involving rich entity grounding, but its accuracy drops on quantitative spatial reasoning questions. |
Ryze: Evidence-Enriched Data Synthesis from Biomedical Papers (2026.acl-demo)
Copied to clipboard
| Challenge: | Existing post-training pipelines that generate QA pairs require costly expert annotation and synthetic data that drops evidence structure. |
| Approach: | They propose a system that converts raw biomedical papers into evidence-enriched training sets and a domain-specialized VLM. |
| Outcome: | Ryze synthesizes QA pairs with complete supporting evidence, reduces layout and OCR errors . the system outperforms the base model on LAB-Bench and surpasses GPT-5.2 by +3.8%. |
Accurate Legal Reasoning at Scale: Neuro-Symbolic Offloading and Structural Auditability for Robust Legal Adjudication (2026.acl-industry)
Copied to clipboard
| Challenge: | Legal texts contain computational legal clauses that exceed the semantic complexity of the realworld activities they govern. |
| Approach: | They propose a neuro-symbolic approach to legal adjudication using an LLM . they use a typed graph intermediate representation to translate a legal text into a deterministic contract language . |
| Outcome: | The proposed system reduces compute costs by over 90% in high-volume workflows while satisfying auditability requirements. |
OptiVerse: A Comprehensive Benchmark towards Optimization Problem Solving (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing benchmarks focus on Mathematical Programming and Combinatorial Optimization, hindering comprehensive evaluation. |
| Approach: | They propose a benchmarking tool that compares 1,000 curated optimization problems across three difficulty levels. |
| Outcome: | The proposed model improves performance on hard problems while maintaining 27% accuracy. |
Diagnosing and Mitigating Sycophancy and Skepticism in LLM Causal Judgment (2026.findings-acl)
Copied to clipboard
| Challenge: | Current evaluations obscure the answer to causal judgment in frontier models. |
| Approach: | They introduce a process-integrity evaluator that checks whether a model's answer is entailed by its own derivation, internally consistent, and not dominated by user hints under pressure. |
| Outcome: | The proposed model fails to distinguish between the two pathologies. |
From Charts to Code: A Hierarchical Benchmark for Multimodal Models (2026.acl-long)
Copied to clipboard
Jiahao Tang, Henry Hengyuan Zhao, Lijian Wu, Zijian Zhang, Yifei Tao, Dongxing Mao, Yang Wan, Jingru Tan, Min Zeng, Min Li, Alex Jinpeng Wang
| Challenge: | Chart2Code is a new benchmark for evaluating the natural language to chart code generation capabilities of large multimodal models. |
| Approach: | They introduce Chart2Code, a new benchmark for evaluating the natural language to chart code generation capabilities of large multimodal models. |
| Outcome: | The proposed benchmark is the first to scale task complexity while capturing diverse scenarios. |
FaithLens: Detecting and Explaining Faithfulness Hallucination (2026.findings-acl)
Copied to clipboard
Shuzheng Si, Qingyi Wang, Haozhe Zhao, Yuzhuo Bai, Guanqiao Chen, Kangyang Luo, Gang Chen, Fanchao Qi, Minjia Zhang, Baobao Chang, Maosong Sun
| Challenge: | Recent progress in large language models (LLMs) has revolutionized text generation. |
| Approach: | They propose a faithfulness hallucination detection model that can provide binary predictions and corresponding explanations to improve trustworthiness. |
| Outcome: | The proposed model outperforms advanced models on 12 diverse tasks. |
Right at My Level: A Unified Multilingual Framework for Proficiency-Aware Text Simplification (2026.acl-long)
Copied to clipboard
| Challenge: | Existing large language model-based readability control methods rely on pre-labeled sentence corpora and primarily target English. |
| Approach: | They propose a framework for adaptive multilingual text simplification without parallel corpora supervision that integrates three reward modules: vocabulary coverage, semantic preservation, and coherence. |
| Outcome: | The proposed framework achieves higher lexical coverage at target proficiency levels while maintaining original meaning and fluency compared to stronger LLMs. |
Into the Gray Zone: Domain Contexts Can Blur LLM Safety Boundaries (2026.acl-long)
Copied to clipboard
Ki Sen Hung, Xi Yang, Chang Liu, Haoran Li, Kejiang Chen, Changxuan Fan, Tsun On Kwok, Weiming Zhang, Xiaomeng Li, Yangqiu Song
| Challenge: | a goal of LLM alignment is to balance usefulness with harmlessness, but this conflictes when knowledge serves both legitimate and malicious purposes. |
| Approach: | They propose a framework that combines safety-research contexts with adversarial interactions to exploit a vulnerability in Jargon queries. |
| Outcome: | a framework outperforms existing methods in analyzing Jargon queries, a study shows . it achieves 93% of attacks across seven models, while remaining useful, the authors say . |
On the Cultural Anachronism and Temporal Reasoning in Vision Language Models (2026.findings-acl)
Copied to clipboard
| Challenge: | Vision-Language Models (VLMs) are increasingly applied to cultural heritage materials. |
| Approach: | They propose a temporal anachronism benchmark to evaluate temporal reasoning on 1,600 Indian cultural artifacts. |
| Outcome: | The proposed model achieves only 58.7% accuracy on the best model, which is a significant performance gap across architectures and scales. |
PluRule: A Benchmark for Moderating Pluralistic Communities on Social Media (2026.acl-long)
Copied to clipboard
| Challenge: | Social media are shifting towards community-governed platforms where groups define their own norms. |
| Approach: | They propose a multimodal, multilingual benchmark for detecting 13,371 rule violations across 1,989 Reddit communities . they show that bigger models and increased context provide marginal gains, and universal rules like civility and self-promotion are easier to detect. |
| Outcome: | The proposed model can detect 13,371 rule violations across 1,989 Reddit communities across 2,885 rules in 9 languages. |