Papers by Han Luo

Automated Peer Reviewing in Paper SEA: Standardization, Evaluation, and Analysis (2024.findings-emnlp)

Challenge:	Existing methods for calibration of large reasoning models (LRMs) focus on clean inputs, leaving noise unexplored.
Approach:	They propose a confidence calibration framework for character-level noisy inputs that extracts uncertainty signals from both the empirical answer distribution and the model’s predictive distribution and integrates them via a learned calibrator.
Outcome:	Experiments on multiple mathematical reasoning benchmarks show that DisCal outperforms existing calibration methods under noisy inputs, reducing expected calibration error (ECE) by up to 39.21% and improving Area Under the Receiver Operating Characteristic Curve (AUROC) by 31.44%.

Copied to clipboard

Jianxiang Yu, Zichen Ding, Jiaqi Tan, Kangyang Luo, Zhenmin Weng, Chenghua Gong, Long Zeng, RenJing Cui, Chengcheng Han, Qiushi Sun, Zhiyong Wu, Yunshi Lan, Xiang Li

MAGIC-VQA: Multimodal And Grounded Inference with Commonsense Knowledge for Visual Question Answering (2025.findings-acl)

Challenge:	Existing approaches to review scientific papers are limited by their content or quality . SEA is a framework for automated scientific review, but its contents are generic or partial.
Approach:	They propose a framework for automated scientific review using large language models . they propose to use a standardized review dataset to fine-tune an LLM to generate high-quality reviews.
Outcome:	The proposed framework can generate high-quality reviews from standardized datasets and improves on the existing feedback mechanisms.

Copied to clipboard

Shuo Yang, Caren Han, Siwen Luo, Eduard Hovy

Stepwise Perplexity-Guided Refinement for Efficient Chain-of-Thought Reasoning in Large Language Models (2025.findings-acl)

Challenge:	Existing Large Vision-Language Models (LVLMs) lack integrated commonsense knowledge . lack of integrated common knowledge limits their robustness and accuracy in VQA .
Approach:	They propose a framework to enhance multimodal inference by integrating commonsense reasoning.
Outcome:	MAGIC-VQA improves comprehensive benchmark datasets, surpassing existing models in tasks requiring advanced commonsense reasoning.

Copied to clipboard

Yingqian Cui, Pengfei He, Jingying Zeng, Hui Liu, Xianfeng Tang, Zhenwei Dai, Yan Han, Chen Luo, Jing Huang, Zhen Li, Suhang Wang, Yue Xing, Jiliang Tang, Qi He

Quantifying the Impact of Structured Output Format on Large Language Models through Causal Inference (2026.findings-eacl)

Challenge:	Chain-of-Thought (CoT) reasoning has improved the performance of large language models (LLMs) however, the detailed reasoning process in CoT often incurs long generation times and high computational costs due to the inclusion of unnecessary steps.
Approach:	They propose a method to identify critical reasoning steps using perplexity as a measure of their importance.
Outcome:	The proposed method achieves a better balance between reasoning accuracy and efficiency of CoT.

Copied to clipboard

Han Yuan, Yue Zhao, Li Zhang, Wuqiong Luo, Zheng Ma

Facilitating Long Context Understanding via Supervised Chain-of-Thought Reasoning (2025.emnlp-main)

Challenge:	Prior studies have examined the impact of structured output on LLMs’ generation quality, often presenting one-way findings.
Approach:	They propose to derive five potential causal structures characterizing the influence of structured output on LLMs’ generation using one assumed and two guaranteed constraints.
Outcome:	The proposed pipeline can be extended to other modules and is not limited to structured output but can be used in industrial applications.

Copied to clipboard

Jingyang Lin, Andy Wong, Tian Xia, Shenghua He, Hui Wei, Mei Han, Jiebo Luo

MiCRo: Mixture Modeling and Context-aware Routing for Personalized Preference Learning (2025.emnlp-main)

Challenge:	Recent advances in Large Language Models (LLMs) have enabled them to process increasingly longer sequences, ranging from 2K to 2M tokens and even beyond.
Approach:	They propose a synthetic dataset in the financial domain that integrates Chain-of-Thought reasoning into LLMs in a supervised manner to facilitate effective long-context understanding.
Outcome:	The proposed model outperforms standard GPT-4o-mini on the Loong benchmark and fine tunes LLaMA-3.1-8B-Instruct on the model, achieving a 28.0% gain on the financial subset.

Copied to clipboard

Jingyan Shen, Jiarui Yao, Rui Yang, Yifan Sun, Feng Luo, Rui Pan, Tong Zhang, Han Zhao

EscapeBench: Towards Advancing Creative Intelligence of Language Model Agents (2025.acl-long)

Challenge:	Existing reward models assume a global reward function, limiting personalization and pluralistic alignment.
Approach:	They propose a framework that leverages binary preference datasets to enhance personalized preference learning.
Outcome:	The proposed framework captures diverse human preferences without fine-grained annotations and significantly improves personalized preference learning on downstream tasks.

Copied to clipboard

Cheng Qian, Peixuan Han, Qinyu Luo, Bingxiang He, Xiusi Chen, Yuji Zhang, Hongyi Du, Jiarui Yao, Xiaocheng Yang, Denghui Zhang, Yunzhu Li, Heng Ji

MEIC-DT: Memory-Efficient Incremental Clustering for Long-Text Coreference Resolution with Dual-Threshold Constraints (2026.findings-acl)

Challenge:	Existing language model agents excel in planning and reasoning, but lack creativity in unfamiliar environments.
Approach:	They propose a benchmark suite of room escape game environments to challenge agents with creative reasoning, unconventional tool use and iterative problem-solving to uncover implicit goals.
Outcome:	The proposed framework can perform with 40% fewer steps and hints and performs robustly across difficulty levels.

Copied to clipboard

Kangyang Luo, Shuzheng Si, Yuzhuo Bai, Cheng Gao, Zhitong Wang, Cheng Huang, Yingli Shen, Yufeng Han, Wenhao Li, Cunliang Kong, Maosong Sun

Information Extraction & Text Mining

Challenge:	Existing supervised neural methods are underexplored for coreference resolution, especially in incremental clustering.
Approach:	They propose a dual-threshold incremental clustering approach based on a lightweight Transformer.
Outcome:	Experiments on common benchmarks show that MEIC-DT achieves highly competitive coreference performance under stringent memory constraints.

ActionIE: Action Extraction from Scientific Literature with Programming Languages (2024.acl-long)

Copied to clipboard

Xianrui Zhong, Yufeng Du, Siru Ouyang, Ming Zhong, Tingfeng Luo, Qirong Ho, Hao Peng, Heng Ji, Jiawei Han

Cross-Lingual Contrastive Learning for Fine-Grained Entity Typing for Low-Resource Languages (2022.acl-long)

Challenge:	a method that extracts experimental procedures from human language into actionable sequences in robotics language is challenging given the complexity of the instructions and context-dependent nature of the instruction.
Approach:	They propose a method that converts actions written in natural language into Python code that can be easily translated into robotics language.
Outcome:	The proposed method can extract experimental procedures from human language into actionable sequences in robotics language.

Copied to clipboard

Xu Han, Yuqi Luo, Weize Chen, Zhiyuan Liu, Maosong Sun, Zhou Botong, Hao Fei, Suncong Zheng

UBench: Benchmarking Uncertainty in Large Language Models with Multiple Choice Questions (2025.findings-acl)

Challenge:	Experimental results show that by applying our framework, we can easily learn effective FGET models for low-resource languages.
Approach:	They propose a cross-lingual contrastive learning framework to learn FGET models for low-resource languages.
Outcome:	The proposed framework can learn effective FGET models for low-resource languages even without human-labeled data.

Copied to clipboard

Xunzhi Wang, Zhuowei Zhang, Gaonan Chen, Qiongyu Li, Bitong Luo, Zhixin Han, Haotian Wang, Zhiyu Li, Hang Gao, Mengting Hu

GLTW: Joint Improved Graph Transformer and LLM via Three-Word Language for Knowledge Graph Completion (2025.findings-acl)

Challenge:	Existing methods for benchmarking the uncertainty of large language models face challenges . existing methods require internal model access, additional training, or high computational costs .
Approach:	They propose a new benchmark for evaluating the uncertainty of large language models based on confidence intervals . UBench encompasses 11,978 multiple choice questions spanning knowledge, language, understanding, and reasoning capabilities.
Outcome:	The proposed method outperforms existing methods for benchmarking the uncertainty of large language models.

Copied to clipboard

Kangyang Luo, Yuzhuo Bai, Cheng Gao, Shuzheng Si, Zhu Liu, Yingli Shen, Zhitong Wang, Cunliang Kong, Wenhao Li, Yufei Huang, Ye Tian, Xuantang Xiong, Lei Han, Maosong Sun

‘No’ Matters: Out-of-Distribution Detection in Multimodality Multi-Turn Interactive Dialogue Download PDF (2025.findings-acl)

Challenge:	Existing knowledge graphs lack the ability to integrate structural information into LLMs and output predictions deterministically.
Approach:	They propose a method which encodes structural information of KGs and merges it with LLMs to enhance KGC performance.
Outcome:	The proposed method improves the performance of KG Completion datasets on KGs by integrating structural information with LLMs.

Copied to clipboard

Rena Wei Gao, Xuetong Wu, Siwen Luo, Caren Han, Feng Liu

Natural Language Interfaces

Challenge:	Out-of-distribution (OOD) detection is essential for multimodal learning systems . a novel scoring framework is proposed to efficiently detect OOD in multi-round long dialogues .
Approach:	They propose a scoring framework that integrates visual language models with a score framework that detects OOD in two key scenarios.
Outcome:	The proposed framework detects OOD in two key scenarios: mismatches between dialogue and image input pair and previously unseen labels.

DeKeyNLU: Enhancing Natural Language to SQL Generation through Task Decomposition and Keyword Extraction (2025.findings-emnlp)

Copied to clipboard

Jian Chen, Zhenyan Chen, Xuming Hu, Peilin Zhou, Yining Hua, Han Fang, Cissy Hing Yee Choy, Xinmei Ke, Jingfeng Luo, Zixuan Yuan

Programming Languages in NLP

Challenge:	NL2SQL provides a model-centric paradigm that simplifies database access for non-technical users . challenges such as inaccurate task decomposition and keyword extraction remain major bottlenecks .
Approach:	They propose a RAG-based NL2SQL pipeline that employs three modules for query understanding, entity retrieval, and generation to improve SQL generation accuracy.
Outcome:	The proposed pipeline improves the accuracy of query generation on BIRD and Spider datasets.

Failure makes the agent stronger: Enhancing Accuracy through Structured Reflection for Reliable Tool Interactions (2026.findings-acl)

Copied to clipboard

Junhao Su, Yuanliang Wan, Junwei Yang, Hengyu Shi, Tianyang Han, Yurui Qiu, Junfeng Luo

Quantize What Counts: More for Keys, Less for Values (2026.findings-acl)

Challenge:	Existing approaches to self-reflection rely on heuristic prompting or unidirectional reasoning traces.
Approach:	They propose a structured reflection method that transforms the "from error to repair" process into a first-class, controllable, and trainable action.
Outcome:	The proposed method improves multi-turn tool-call success rates and error recovery while reducing redundant calls.

Copied to clipboard

Mohsen Hariri, Alan Luo, Weicong Chen, Tianyi Zhang, Qifan Wang, Xiaotian Han, Vipin Chaudhary

Challenge:	Empirical evaluations across various prominent LLMs and benchmarks show that key-favored allocations retain up to 98.3% accuracy compared to uniform allocations (e.g., 4-bit keys, 2-bit values).
Approach:	They propose two theorems that anchor mixed-precision KV quantization in the intrinsic geometry of Transformer models.
Outcome:	Empirical evaluations show that key-favored allocations retain up to 98.3% accuracy while conserving memory.

OlympiadBench: A Challenging Benchmark for Promoting AGI with Olympiad-Level Bilingual Multimodal Scientific Problems (2024.acl-long)

Copied to clipboard

Chaoqun He, Renjie Luo, Yuzhuo Bai, Shengding Hu, Zhen Thai, Junhao Shen, Jinyi Hu, Xu Han, Yujie Huang, Yuxiang Zhang, Jie Liu, Lei Qi, Zhiyuan Liu, Maosong Sun

Crowdsource, Crawl, or Generate? Creating SEA-VL, a Multicultural Vision-Language Dataset for Southeast Asia (2025.acl-long)

Challenge:	Large Language Models (LLMs) and Large Multimodal Models have exceeded general human capabilities in various tasks.
Approach:	They present an Olympiad-level bilingual multimodal scientific benchmark featuring 8,476 problems from Olympiad level mathematics and physics competitions.
Outcome:	The best performing model, GPT-4V, attains an average score of 17.97% on OlympiadBench, with a mere 10.74% in physics, highlighting the benchmark rigor and the intricacy of physical reasoning.

Copied to clipboard

Samuel Cahyawijaya, Holy Lovenia, Joel Ruben Antony Moniz, Tack Hwa Wong, Mohammad Rifqi Farhansyah, Thant Thiri Maung, Frederikus Hudi, David Anugraha, Muhammad Ravi Shulthan Habibi, Muhammad Reza Qorib, Amit Agarwal, Joseph Marvin Imperial, Hitesh Laxmichand Patel, Vicky Feliren, Bahrul Ilmi Nasution, Manuel Antonio Rufino, Genta Indra Winata, Rian Adam Rajagede, Carlos Rafael Catalan, Mohamed Fazli Mohamed Imam, Priyaranjan Pattnayak, Salsabila Zahirah Pranida, Kevin Pratama, Yeshil Bangera, Adisai Na-Thalang, Patricia Nicole Monderin, Yueqi Song, Christian Simon, Lynnette Hui Xian Ng, Richardy Lobo Sapan, Taki Hasan Rafi, Bin Wang, null Supryadi, Kanyakorn Veerakanjana, Piyalitt Ittichaiwong, Matthew Theodore Roque, Karissa Vincentio, Takdanai Kreangphet, Phakphum Artkaew, Kadek Hendrawan Palgunadi, Yanzhi Yu, Rochana Prih Hastuti, William Nixon, Mithil Bangera, Adrian Xuan Wei Lim, Aye Hninn Khine, Hanif Muhammad Zhafran, Teddy Ferdinan, Audra Aurora Izzani, Ayushman Singh, Evan Evan, Jauza Akbar Krito, Michael Anugraha, Fenal Ashokbhai Ilasariya, Haochen Li, John Amadeo Daniswara, Filbert Aurelian Tjiaranata, Eryawan Presma Yulianrifat, Can Udomcharoenchaikit, Fadil Risdian Ansori, Mahardika Krisna Ihsani, Giang Nguyen, Anab Maulana Barik, Dan John Velasco, Rifo Ahmad Genadi, Saptarshi Saha, Chengwei Wei, Isaiah Edri W. Flores, Kenneth Chen Ko Han, Anjela Gail D. Santos, Wan Shen Lim, Kaung Si Phyo, Tim Santos, Meisyarah Dwiastuti, Jiayun Luo, Jan Christian Blaise Cruz, Ming Shan Hee, Ikhlasul Akmal Hanif, M.Alif Al Hakim, Muhammad Rizky Sya’ban, Kun Kerdthaisong, Lester James Validad Miranda, Fajri Koto, Tirana Noor Fatyanosa, Alham Fikri Aji, Jostin Jerico Rosal, Jun Kevin, Robert Wijaya, Onno P. Kampman, Ruochen Zhang, Börje F. Karlsson, Peerat Limkonchotiwat

ImCoref-CeS: An Improved Lightweight Pipeline for Coreference Resolution with LLM-based Checker-Splitter Refinement (2026.acl-long)

Challenge:	Southeast Asia is underrepresented in vision-language research . SEA-VL is an open-source initiative dedicated to developing culturally relevant datasets for SEA languages.
Approach:	They propose to use crowdsourced, automated image crawling and synthetic image generation to develop culturally relevant datasets for SEA languages.
Outcome:	The proposed datasets capture SEA cultural nuances and contexts better than existing datasets.

Copied to clipboard

Kangyang Luo, Yuzhuo Bai, Shuzheng Si, Cheng Gao, Zhitong Wang, Yingli Shen, Wenhao Li, Zhu Liu, Yufeng Han, Jiayi Wu, Cunliang Kong, Maosong Sun

Information Extraction & Text Mining

Challenge:	Existing supervised neural methods for coreference resolution are underexplored . current methods rely on small language models, but their potential is underexploited .
Approach:	They propose a framework that integrates an enhanced supervised model with LLM-based reasoning.
Outcome:	The proposed method surpasses existing state-of-the-art methods in coreference resolution.

ReasonRec: A Reasoning-Augmented Multimodal Agent for Unified Recommendation (2026.findings-acl)

Copied to clipboard

Yihua Zhang, Mingfu Liang, Jiyan Yang, Rong Jin, Wen-Yen Chen, Yiping Han, Huayu Li, Buyun Zhang, Liang Luo, Luke Simon, Sijia Liu, Tianlong Chen, Xi Liu

Responsible & Trustworthy NLP

Challenge:	Recent advances in multimodal recommenders lack explicit reasoning and self-awareness of uncertainty.
Approach:	They propose a reasoning-augmented multimodal agent structured around a three-stage explicit reasoning pipeline.
Outcome:	The proposed agent improves ranking metrics and performance on four standard recommendation tasks across five real-world datasets.

Prompt-Based Editing for Text Style Transfer (2023.findings-emnlp)

Copied to clipboard

Guoqing Luo, Yu Han, Lili Mou, Mauajama Firdaus

Low-Resource NLP

Challenge:	Text style transfer is a type of textual prompt that generates style-transferred texts word by word . early prediction errors may affect future word predictions.
Approach:	They propose a prompt-based editing approach to text style transfer using a pretrained language model.
Outcome:	The proposed approach outperforms existing systems with 20 times more parameters on three style-transfer benchmark datasets.

UltraEval: A Lightweight Platform for Flexible and Comprehensive Evaluation for LLMs (2024.acl-demos)

Copied to clipboard

Chaoqun He, Renjie Luo, Shengding Hu, Ranchi Zhao, Jie Zhou, Hanghao Wu, Jiajie Zhang, Xu Han, Zhiyuan Liu, Maosong Sun

Protein Large Language Models: A Comprehensive Survey (2025.findings-emnlp)

Challenge:	Existing evaluation platforms are complex and poorly modularized, hindering seamless incorporation into researcher’s workflows.
Approach:	They propose a lightweight evaluation framework characterized by lightweight, comprehensiveness, modularity, and efficiency that integrates models, data, and metrics into a unified evaluation workflow.
Outcome:	The proposed evaluation framework is lightweight, comprehensive, modular, and efficient.

Copied to clipboard

Yijia Xiao, Wanjia Zhao, Junkai Zhang, Yiqiao Jin, Han Zhang, Zhicheng Ren, Renliang Sun, Haixin Wang, Guancheng Wan, Pan Lu, Xiao Luo, Yu Zhang, James Zou, Yizhou Sun, Wei Wang

Variator: Accelerating Pre-trained Models with Plug-and-Play Compression Modules (2023.findings-emnlp)

Challenge:	Existing studies focus on specific aspects or applications, but this study provides a comprehensive overview of Protein-specific large language models.
Approach:	This paper proposes a structured taxonomy of state-of-the-art ProteinLLMs . they analyze how they leverage large-scale protein sequence data for improved accuracy .
Outcome:	The proposed model covers their architectures, training datasets, evaluation metrics, and diverse applications.

Copied to clipboard

Chaojun Xiao, Yuqi Luo, Wenbin Zhang, Pengle Zhang, Xu Han, Yankai Lin, Zhengyan Zhang, Ruobing Xie, Zhiyuan Liu, Maosong Sun, Jie Zhou

Automate Strategy Finding with LLM in Quant Investment (2025.findings-emnlp)

Challenge:	Large language models (LLMs) have been successful on NLP tasks but require huge parameter sizes and computational resources.
Approach:	They propose a parameter-efficient acceleration method that enhances computational efficiency through plug-and-play compression plugins.
Outcome:	The proposed method saves 53% computational costs using only 0.9% additional parameters with a performance drop of less than 2%.

Copied to clipboard

Zhizhuo Kou, Holam Yu, Junyu Luo, Jingshu Peng, Xujia Li, Chengzhong Liu, Juntao Dai, Lei Chen, Sirui Han, Yike Guo

Doc-GCN: Heterogeneous Graph Convolutional Networks for Document Layout Analysis (2022.coling-1)

Challenge:	Experimental results demonstrate robust performance of the strategy in Chinese & US market regimes compared to established benchmarks.
Approach:	They propose a framework leveraging Large Language Models within a risk-aware multi-agent system for automate strategy finding in quantitative finance.
Outcome:	The proposed framework outperforms all benchmarks in Chinese & US market regimes with 53.17% cumulative return on SSE50.

Copied to clipboard

Siwen Luo, Yihao Ding, Siqu Long, Josiah Poon, Soyeon Caren Han

Structured Data in NLP

Challenge:	Document Layout Analysis tasks rely on visual cues to understand documents . traditional deep learning-based methods fail to recognize the layout and components of unstructured documents based on the document structure and the boundaries of each layout region.
Approach:	They propose a way to harmonize and integrate heterogeneous aspects for Document Layout Analysis by using graph convolutional networks to enhance each aspect of features.
Outcome:	The proposed task is based on three widely used datasets: PubLayNet, FUNSD, and DocBank.

VICTR: Visual Information Captured Text Representation for Text-to-Vision Multimodal Tasks (2020.coling-main)

Copied to clipboard

Caren Han, Siqu Long, Siwen Luo, Kunze Wang, Josiah Poon

KET-QA: A Dataset for Knowledge Enhanced Table Question Answering (2024.lrec-main)

Challenge:	Existing text-to-image generation models focus on generating high resolution images and neglect understanding text descriptions.
Approach:	They propose a visual contextual text representation which captures rich visual semantic information of objects from text input.
Outcome:	The proposed visual contextual text representation improves on the state-of-the-art models.

Copied to clipboard

Mengkang Hu, Haoyu Dong, Ping Luo, Shi Han, Dongmei Zhang

LLM-Friendly Knowledge Representation for Customer Support (2025.coling-industry)

Challenge:	Existing datasets that ignore the challenge of missing knowledge in TableQA are limited in their use.
Approach:	They propose to use a knowledge base as the external knowledge source for TableQA and construct a dataset with fine-grained gold evidence annotation.
Outcome:	The proposed model achieves remarkable performance improvements on three different settings, but still lags behind the human-level performance.

Copied to clipboard

Hanchen Su, Wei Luo, Yashar Mehdad, Wei Han, Elaine Liu, Wayne Zhang, Mia Zhao, Joy Zhang

SafeConf: A Confidence-Calibrated Safety Self-Evaluation Method for Large Language Models (2025.findings-emnlp)

Challenge:	a new approach to customer support is proposed to integrate large language models with a framework designed to navigate the complexities of Airbnb customer support operations.
Approach:	They propose a method for integrating Large Language Models with a framework designed to navigate the complexities of Airbnb customer support operations.
Outcome:	The proposed approach is cost-effective and improves customer support performance . it also allows human agents to focus on more complex issues, the authors show .

Copied to clipboard

Bo Zhang, Cong Gao, Linkang Yang, Bingxu Han, Minghao Hu, Zhunchen Luo, Guotong Geng, Xiaoying Bai, Jun Zhang, Wen Yao, Zhong Wang

ELBA-Bench: An Efficient Learning Backdoor Attacks Benchmark for Large Language Models (2025.acl-long)

Challenge:	Large language models (LLMs) have many advantages but they also pose significant safety risks.
Approach:	They propose a method to enhance the safety self-evaluation capability of LLMs . they perform semantic mutations on the original safety evaluation questions .
Outcome:	The proposed method improves safety self-evaluation accuracy by 5.86% and 7.79% over baseline methods on Chinese and English datasets.

Copied to clipboard

Xuxu Liu, Siyuan Liang, Mengya Han, Yong Luo, Aishan Liu, Xiantao Cai, Zheng He, Dacheng Tao

Responsible & Trustworthy NLP

Challenge:	Existing backdoor models are limited in coverage of attack, system integrity and backdoor alignment . ELBA-Bench provides over 1300 experiments encompassing 12 attack methods, 18 datasets, and 12 LLMs.
Approach:	They propose a framework that allows attackers to inject backdoor through parameter efficient fine-tuning or without fine-uning techniques.
Outcome:	ELBA-Bench provides over 1300 experiments encompassing 12 attack methods, 18 datasets, and 12 LLMs.

LLMBox: A Comprehensive Library for Large Language Models (2024.acl-demos)

Copied to clipboard

Tianyi Tang, Hu Yiwen, Bingqian Li, Wenyang Luo, ZiJing Qin, Haoxiang Sun, Jiapeng Wang, Shiyi Xu, Xiaoxue Cheng, Geyang Guo, Han Peng, Bowen Zheng, Yiru Tang, Yingqian Min, Yushuo Chen, Jie Chen, Ranchi Zhao, Luran Ding, Yuhao Wang, Zican Dong, Xia Chunxuan, Junyi Li, Kun Zhou, Xin Zhao, Ji-Rong Wen

Unleashing the Native Recommendation Potential: LLM-Based Generative Recommendation via Structured Term Identifiers (2026.findings-acl)

Challenge:	a library to facilitate the development, use, and evaluation of large language models (LLMs) is presented.
Approach:	They propose a unified library to facilitate the development, use and evaluation of large language models (LLMs).
Outcome:	The proposed library is based on extensive experiments in a variety of evaluation settings.

Copied to clipboard

Zhiyang Zhang, Junda She, Kuo Cai, Bo Chen, Shiyao Wang, Xinchen Luo, Qiang Luo, Ruiming Tang, Han Li, Kun Gai, Guorui Zhou

Robustness in NLP

Challenge:	Existing methods for constructing item identifiers face bottlenecks due to their large output space and expensive vocabulary expansion and alignment training.
Approach:	They propose to use Large Language Models to develop general-purpose, semantically-aware recommender systems that can be generalized and reusable.
Outcome:	Experiments on real-world datasets show that GRAM outperforms baselines and significantly outperformed baselines.

DialogGuard: Multi-Agent Psychosocial Safety Evaluation Interface of Sensitive LLM Responses (2026.acl-demo)

Copied to clipboard

Han Luo, Guy Laban

Dialogue Systems & Conversational Agents

Challenge:	Existing tools do not surface subtler psychosocial harms, nor provide explainable rationales that practitioners need.
Approach:	They propose an open-source system that lets practitioners inspect, stress-test, and create audit trails for prompted LLM agents across five psychosocial safety dimensions.
Outcome:	The open-source DialogGuard system lets practitioners inspect, stress-test, and create audit trails for prompted LLM agents across five psychosocial safety dimensions.

Reasoning with Graphs: Structuring Implicit Knowledge to Enhance LLMs Reasoning (2025.findings-acl)

Copied to clipboard

Haoyu Han, Yaochen Xie, Hui Liu, Xianfeng Tang, Sreyashi Nag, William Headden, Yang Li, Chen Luo, Shuiwang Ji, Qi He, Jiliang Tang

DongbaMIE: A Multimodal Information Extraction Dataset for Evaluating Semantic Understanding of Dongba Pictograms (2025.findings-emnlp)

Challenge:	Large language models (LLMs) have demonstrated remarkable success across a wide range of tasks, however, they still face challenges in reasoning tasks that require understanding and inferring relationships between distinct pieces of information within text sequences.
Approach:	They propose to construct explicit graphs from context and leverage them to enhance LLM reasoning performance on reasoning tasks.
Outcome:	Extensive experiments show that the proposed method improves both logical reasoning and multi-hop question answering tasks.

Copied to clipboard

Xiaojun Bi, Shuo Li, Junyao Xing, Ziyue Wang, Fuwen Luo, Weizheng Qiao, Lu Han, Ziwei Sun, Peng Li, Yang Liu

Self-attention-based Graph-of-Thought for Math Problem Solving (2025.findings-acl)

Challenge:	Dongba pictographic is the only pictograph script still in use in the world.
Approach:	DongbaMIE is the first dataset focusing on multimodal information extraction of Dongbe pictographs.
Outcome:	The dataset contains 23,530 sentence-level and 2,539 paragraph-level high-quality text-image pairs.

Copied to clipboard

Ruiqiao Bai, Xue Han, Shuo Lei, Junlan Feng, Yanyan Luo, Chao Deng

MedPlan: A Two-Stage RAG-Based System for Personalized Medical Plan Generation (2025.acl-industry)

Challenge:	Existing methods for generating reasoning paths in a chain structure are inefficient and non-human-like.
Approach:	They propose a decoding method for a chain-based LLM that constructs a thought graph simultaneously as an LLM inference and generates reasoning steps with a graph-structured self-attention mechanism.
Outcome:	The proposed method improves reasoning accuracy without huge computational over-expensive LLMs and avoids performance degradation issues when the LLM is too small to comprehend complex prompts.

Copied to clipboard

Hsin-Ling Hsu, Cong-Tinh Dao, Luning Wang, Zitao Shuai, Thao Nguyen Minh Phan, Jun-En Ding, Chun-Chieh Liao, Pengfei Hu, Xiaoxue Han, Chih-Ho Hsu, Dongsheng Luo, Wen-Chih Peng, Feng Liu, Fang-Ming Hung, Chenwei Wu

Mitigating Coordinate Prediction Bias from Positional Encoding Failures (2026.findings-acl)

Challenge:	Existing systems focus primarily on assessment rather than treatment planning.
Approach:	They propose a framework that structures LLM reasoning to align with real-life workflows.
Outcome:	The proposed framework outperforms baseline approaches in assessment accuracy and treatment plan quality.

Copied to clipboard

Xingjian Tao, Yiwei Wang, Yujun Cai, Yihong Luo, Kai Han, Jing Tang

Ideology Takes Multiple Looks: A High-Quality Dataset for Multifaceted Ideology Detection (2023.emnlp-main)

Challenge:	Multimodal Large Language Models (MLLMs) excel at general vision-language tasks, but precise coordinate prediction remains a challenge.
Approach:	They propose a training-free, inference-time correction method to correct VPEs . they isolate position-unconditioned tendencies by shuffling VPE and use it to steer digit decoding .
Outcome:	The proposed method is training-free, inference-time correction method . it effectively rectifies coordinate drift, yielding consistent improvements without retraining .

Copied to clipboard

Songtao Liu, Ziling Luo, Minghua Xu, Lixiao Wei, Ziyao Wei, Han Yu, Wei Xiang, Bang Wang

Challenge:	Existing datasets for the ID task only label a text as ideologically left- or right-leaning as a whole, regardless whether the text containing one or more different issues.
Approach:	They construct an ideological schema for a multifaceted ideology detection task using MITweet and an English Twitter dataset.
Outcome:	The proposed task uses a MITweet dataset with 12,594 English Twitter posts, each annotated with a Relevance and an Ideology label for all twelve facets.

ROSE: An Intent-Centered Evaluation Metric for NL2SQL (2026.acl-long)

Copied to clipboard

Wenqi Pei, Shizheng Hou, Boyan Li, Chen Han, Zhichao Shi, Yuyu Luo

Programming Languages in NLP

Challenge:	Existing evaluation metrics for evaluating the effectiveness of Natural Language to SQL (NL2SQL) solutions are becoming unreliable due to its sensitiveness to syntactic variation and inconsistent consistency with ground-truth SQL.
Approach:	They propose an intent-centered metric that focuses on whether the predicted SQL answers the question, rather than consistency with the ground-truth SQL.
Outcome:	The proposed metric outperforms the next-best metric by nearly 24% on the expert-aligned validation set ROSE-VEC.

FinMME: Benchmark Dataset for Financial Multi-Modal Reasoning Evaluation (2025.acl-long)

Copied to clipboard

Junyu Luo, Zhizhuo Kou, Liming Yang, Xiao Luo, Jinsheng Huang, Zhiping Xiao, Jingshu Peng, Chengzhong Liu, Jiaming Ji, Xuanzhe Liu, Sirui Han, Ming Zhang, Yike Guo

ChildEval:WHEN LARGE LANGUAGE MODELS MEET CHILDREN’S PERSONALITIES (2026.findings-acl)

Challenge:	Multimodal Large Language Models (MLLMs) have experienced rapid development in recent years, but there is a notable lack of effective and specialized multimodal evaluation datasets in the financial domain.
Approach:	They introduce FinMME, a multimodal large language model with 11,000 financial research samples and 20 annotators.
Outcome:	The proposed model performs better than state-of-the-art models, highlighting its challenging nature.

Copied to clipboard

Yanyan Luo, Xue Han, Chunxu Zhao, Ruiqiao Bai, Yaxing Zhang, Qian Hu, Lijun Mei, Junlan Feng