Papers by Pan Yang
FuxiTranyu: A Multilingual Large Language Model Trained with Balanced Data (2024.emnlp-industry)
Copied to clipboard
Haoran Sun, Renren Jin, Shaoyang Xu, Leiyu Pan, null Supryadi, Menglong Cui, Jiangcun Du, Yikun Lei, Lei Yang, Ling Shi, Juesi Xiao, Shaolin Zhu, Deyi Xiong
| Challenge: | Large language models exhibit significant performance discrepancies between high- and low-resource languages. |
| Approach: | They present an open-source multilingual LLM with 8 billion parameters and a multilingual instruction dataset. |
| Outcome: | The proposed model achieves consistent multilingual representations across languages. |
SG-FSM: A Self-Guiding Zero-Shot Prompting Paradigm for Multi-Hop Question Answering Based on Finite State Machine (2025.findings-naacl)
Copied to clipboard
Xiaochen Wang, Junqing He, Liang Chen, Gholamreza Haffari, Yiru Wang, Zhe Yang, Xiangdi Meng, Kunhao Pan, Zhifang Sui
| Challenge: | Multi-hop Question Answering (MHQA) is a challenging task that requires models to answer multiple questions with multiple passages. |
| Approach: | They propose a self-guided prompting finite state machine to improve multi-hop reasoning abilities by iterating over multiple questions and correcting itself to improve accuracy. |
| Outcome: | The proposed approach outperforms baselines on Musique and other datasets. |
Beyond Memorization: A Rigorous Evaluation Framework for Medical Knowledge Editing (2026.eacl-long)
Copied to clipboard
| Challenge: | Existing knowledge editing methods show promising results on general-domain benchmarks, but their effectiveness in the medical domain remains largely unexplored. |
| Approach: | They propose a framework to evaluate medical knowledge editing using model-generated rationales as editing targets. |
| Outcome: | The proposed method improves editing efficacy and generalization in medical models without full retraining. |
Memory-R1: Enhancing Large Language Model Agents to Manage and Utilize Memories via Reinforcement Learning (2026.acl-long)
Copied to clipboard
Sikuan Yan, Xiufeng Yang, Zuchao Huang, Ercong Nie, Zifeng Ding, Zonggen Li, Xiaowen Ma, Jinhe Bi, Kristian Kersting, Jeff Z. Pan, Hinrich Schuetze, Volker Tresp, Yunpu Ma
| Challenge: | Large Language Models (LLMs) are stateless and limited by a finite context window, preventing them from maintaining knowledge across long conversations or evolving tasks. |
| Approach: | They propose a reinforcement learning framework that empowers LLMs to actively manage external memory through two specialized agents. |
| Outcome: | The proposed framework outperforms baselines and benchmarks across diverse question types, three benchmarks, and multiple model scales. |
DANLI: Deliberative Agent for Following Natural Language Instructions (2022.emnlp-main)
Copied to clipboard
Yichi Zhang, Jianing Yang, Jiayi Pan, Shane Storks, Nikhil Devraj, Ziqiao Ma, Keunwoo Yu, Yuwei Bao, Joyce Chai
| Challenge: | Recent work on embodied AI agents that can perform tasks by following human language instructions is limited by reactive methods, which are insufficient for long-horizon complex tasks. |
| Approach: | They propose a neuro-symbolic deliberative agent that, while following language instructions, proactively applies reasoning and planning based on its neural and symbolic representations acquired from past experience. |
| Outcome: | The proposed agent achieves greater than 70% improvement over reactive baselines on the challenging TEACh benchmark. |
MathCoder-VL: Bridging Vision and Code for Enhanced Multimodal Mathematical Reasoning (2025.findings-acl)
Copied to clipboard
Ke Wang, Junting Pan, Linda Wei, Aojun Zhou, Weikang Shi, Zimu Lu, Han Xiao, Yunqiao Yang, Houxing Ren, Mingjie Zhan, Hongsheng Li
| Challenge: | Large Language Models (LMMs) struggle with simple tasks such as geometry, e.g., arithmetic, and reasoning. |
| Approach: | They propose to leverage code as supervision for cross-modal alignment . they propose to use FigCodifier and ImgCode-8.6M to synthesize novel mathematical figures . |
| Outcome: | The proposed model surpasses GPT-4o and Claude 3.5 Sonnet in the geometry problem-solving subset of MathVista, achieving improvements of 8.9% and 9.2%. |
GeAR: Graph-enhanced Agent for Retrieval-augmented Generation (2025.findings-acl)
Copied to clipboard
Zhili Shen, Chenxin Diao, Pavlos Vougiouklis, Pascual Merita, Shriram Piramanayagam, Enting Chen, Damien Graux, Andre Melo, Ruofei Lai, Zeren Jiang, Zhongyang Li, Ye Qi, Yang Ren, Dandan Tu, Jeff Z. Pan
| Challenge: | Retrieval-augmented Generation (RAG) relies on effective retrieval capabilities, yet traditional sparse and dense retrievers struggle with multi-hop retrieval scenarios. |
| Approach: | They propose a graph expansion mechanism that augments any conventional base retriever and an agent framework that incorporates the resulting graph-based retrieval into a multi-step retrieval framework. |
| Outcome: | The proposed system achieves state-of-the-art results on three multi-hop question answering datasets while consuming fewer tokens and requiring fewer iterations than existing multi-step retrieval systems. |
Learning to Plan for Retrieval-Augmented Large Language Models from Knowledge Graphs (2024.findings-emnlp)
Copied to clipboard
Junjie Wang, Mingyang Chen, Binbin Hu, Dan Yang, Ziqi Liu, Yue Shen, Peng Wei, Zhiqiang Zhang, Jinjie Gu, Jun Zhou, Jeff Pan, Wen Zhang, Huajun Chen
| Challenge: | Recent studies have attempted to enhance the performance of large language models (LLMs) in complex question-answering (QA) tasks by combining step-wise planning with external retrieval. |
| Approach: | They propose a framework for enhancing LLMs’ planning capabilities by using planning data derived from knowledge graphs (KGs). |
| Outcome: | The proposed framework improves LLMs’ planning capabilities by using knowledge graphs (KGs) the proposed framework is compared with existing frameworks on multiple datasets and shows that it is effective for large language models. |
A Web Scale Entity Extraction System (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing systems for large-scale entity extraction are limited by the scale and variety of data available on internet platforms. |
| Approach: | They propose to build an entity extraction system for multiple document types at large scale using multi-modal Transformers. |
| Outcome: | The proposed system extracts multiple types of entities from multiple document types at large scale using multi-modal Transformers. |
Fill In The Gaps: Model Calibration and Generalization with Synthetic Data (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing calibration methods negatively impact model accuracy due to the lack of diversity of validation data. |
| Approach: | They propose a calibration method that incorporates synthetic data without compromising accuracy. |
| Outcome: | The proposed method improves model accuracy on real data and reduces calibration error by 34% on four different tasks. |
UniArk: Improving Generalisation and Consistency for Factual Knowledge Extraction through Debiasing (2024.naacl-long)
Copied to clipboard
| Challenge: | Existing studies have investigated the potential of language models as knowledge bases and the existence of severe biases when extracting factual knowledge. |
| Approach: | They propose an adapter-based framework for generalised factual knowledge extraction using simple methods without introducing extra parameters. |
| Outcome: | The proposed framework improves the model’s out-of-domain generalisation and consistency under various prompts. |
HELENE: Hessian Layer-wise Clipping and Gradient Annealing for Accelerating Fine-tuning LLM with Zeroth-order Optimization (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) face memory challenges due to the high cost of backpropagation. |
| Approach: | They propose a zeroth-order (ZO) optimization that matches memory usage to inference . they propose scalable and memory-efficient zeroth order (ZE) optimizer that integrates annealed A-GNB gradients with diagonal Hessian estimation and layer-wise clipping as a second-order pre-conditioner. |
| Outcome: | The proposed algorithm outperforms state-of-the-art methods with an average speedup of 20 over MeZO on RoBERTa-large and OPT-1.3B. |
Path-enhanced Pre-trained Language Model for Knowledge Graph Completion (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Pre-trained language models have achieved remarkable knowledge graph completion (KGC) success. |
| Approach: | They propose a path-enhanced pre-trained language model-based knowledge graph completion method which uses multi-view generation to infer missing facts in triple-level and path-level simultaneously. |
| Outcome: | The proposed method significantly improves the performance of the knowledge graph completion task. |
CrowdSelect: SyntheticInstruction Data Selection with Multi-LLM Wisdom (2026.findings-eacl)
Copied to clipboard
| Challenge: | Existing methods for capturing instruction-following complexity rely on single-dimensional signals, but they fail to capture complexity across diverse fields. |
| Approach: | They propose three foundational metrics that leverage Multi-LLMs wisdom to capture instruction-response pair characteristics and propose CrowdSelect, an integrated metric incorporating a clustering-based approach to maintain response diversity. |
| Outcome: | The proposed metrics outperform existing models on MT-bench and Arena-hard and show improvements of 4.81% on full and LoRA fine-tuning. |
Making LLMs Better Many-to-Many Speech-to-Text Translators with Curriculum Learning (2025.acl-long)
Copied to clipboard
Yexing Du, Youcheng Pan, Ziyang Ma, Bo Yang, Yifan Yang, Keqi Deng, Xie Chen, Yang Xiang, Ming Liu, Bing Qin
| Challenge: | Existing studies on English-centric translation tasks have focused on multimodal large language models, but the exploration of many-to-many translation is limited by the scarcity of parallel data. |
| Approach: | They propose a three-stage curriculum learning strategy that leverages the machine translation capabilities of large language models and adapts them to S2TT tasks. |
| Outcome: | The proposed strategy achieves state-of-the-art average performance in 1514 language pairs, requiring fewer than 10 hours of speech data per language to achieve competitive results. |
Probability-Consistent Preference Optimization for Enhanced LLM Reasoning (2025.findings-acl)
Copied to clipboard
Yunqiao Yang, Houxing Ren, Zimu Lu, Ke Wang, Weikang Shi, Aojun Zhou, Junting Pan, Mingjie Zhan, Hongsheng Li
| Challenge: | Recent advances in preference optimization have demonstrated significant potential for improving mathematical reasoning capabilities in large language models. |
| Approach: | They propose a framework that establishes two quantitative metrics for preference selection: surface-level answer correctness and intrinsic token-level probability consistency. |
| Outcome: | The proposed framework outperforms existing outcome-only criterion approaches across a diverse range of LLMs and benchmarks. |
ProBench: Judging Multimodal Foundation Models on Open-ended Multi-domain Expert Tasks (2025.findings-acl)
Copied to clipboard
| Challenge: | Solving expert-level multimodal tasks requires strong user query understanding, domain-specific knowledge, and advanced reasoning abilities. |
| Approach: | They propose a benchmark of open-ended user queries encapsulating professional expertise and advanced reasoning. |
| Outcome: | The proposed benchmark is publicly accessible at TBC. |
KnowCoder: Coding Structured Knowledge into LLMs for Universal Information Extraction (2024.acl-long)
Copied to clipboard
Zixuan Li, Yutao Zeng, Yuxin Zuo, Weicheng Ren, Wenxuan Liu, Miao Su, Yucan Guo, Yantao Liu, Lixiang Lixiang, Zhilei Hu, Long Bai, Wei Li, Yidan Liu, Pan Yang, Xiaolong Jin, Jiafeng Guo, Xueqi Cheng
| Challenge: | None. None.. None! |
| Approach: | None. None.. None! |
| Outcome: | None. None. No. : |
MiCRo: Mixture Modeling and Context-aware Routing for Personalized Preference Learning (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing reward models assume a global reward function, limiting personalization and pluralistic alignment. |
| Approach: | They propose a framework that leverages binary preference datasets to enhance personalized preference learning. |
| Outcome: | The proposed framework captures diverse human preferences without fine-grained annotations and significantly improves personalized preference learning on downstream tasks. |
CVRH: Cross-modal Variational Role Hypergraph Network via Semantic Enhancement for Multi-modal Event Argument Extraction (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods focus on weakly aligning uni-modal representations and generatively data augmentation techniques, but they ignore the potential impact of event role information on MEAE. |
| Approach: | They propose a cross-modal variational role hypergraph network via semantic enhancement to model high-order role correlations among cross-mod arguments in multi-modal documents. |
| Outcome: | The proposed method achieves a 6.9% improvement in F1-score on the M2E2 benchmark compared to current state-of-the-art methods. |
Prototype Tuning: A Meta-Learning Approach for Few-Shot Document-Level Relation Extraction with Large Language Models (2025.findings-naacl)
Copied to clipboard
| Challenge: | Few-Shot Document-Level Relation Extraction (FSDLRE) aims to develop models capable of generalizing to new categories with minimal support examples. |
| Approach: | They propose a meta-training approach to train Large Language Models to improve their ICL capabilities . they construct simulated episodes using relation types that do not overlap with test corpus . |
| Outcome: | Experimental results show that the proposed approach outperforms baseline models on few-shot tasks. |
PsychEval: A Multi-Session and Multi-Therapy Benchmark for High-Realism AI Psychological Counselor (2026.findings-acl)
Copied to clipboard
Qianjun Pan, Junyi Wang, Jie Zhou, Yutao Yang, Junsong Li, Kaiyin Xu, Yougen Zhou, Yihan Li, JingYuan Zhao, Qin Chen, Ningning Zhou, Kai Chen, Liang He
| Challenge: | Existing models focus on a single therapy, but complex cases require flexible strategies among various therapies. |
| Approach: | They propose a multi-session, multi-therapy, and highly realistic benchmark . it is designed to address three key challenges: 1) can we train a highly realistic AI counselor? 2) How to systematically evaluate an AI counselor?" |
| Outcome: | The proposed benchmark is annotated with extensive professional skills and includes over 677 meta-skills and 4577 atomic skills. |
Document-Level Event Extraction via Information Interaction Based on Event Relation and Argument Correlation (2024.lrec-main)
Copied to clipboard
| Challenge: | Document-level Event Extraction (DEE) is a vital task in NLP . current approaches overlook intricate relationships among events and subtle correlations among arguments within a document . |
| Approach: | They propose a document-level event extraction tool that integrates event relationships and argument correlation graphs to model the relationship among events. |
| Outcome: | The proposed network outperforms existing models and large language models in terms of F1-score across two benchmark datasets. |
From Curated Data to Scalable Models: Continual Pre-training of Dense and MoE Large Language Models for Tibetan (2026.acl-long)
Copied to clipboard
Lei Yang, Leiyu Pan, Bojian Xiong, Renren Jin, Shaowei Zhang, Yue Chen, Ling Shi, Jiang Zhou, Junru Wu, Zhen Wang, Jianxiang Peng, Juesi Xiao, Tianyu Dong, Zhuowen Han, Zhuo Chen, Yuqi Ren, Deyi Xiong
| Challenge: | Large language models have achieved remarkable success across a wide range of tasks, yet their performance remains heavily biased toward high-resource languages. |
| Approach: | They propose a pipeline for advancing Tibetan language modeling through multilingual continual pre-training with Tibetan, Chinese, and English. |
| Outcome: | The proposed model outperforms open-source and Tibetan-focused models on diverse tasks. |
Adversarial Category Alignment Network for Cross-domain Sentiment Classification (N19-1)
Copied to clipboard
| Challenge: | Existing methods for cross-domain sentiment classification focus on aligning marginal distribution without taking category-specific decision boundaries into consideration. |
| Approach: | They propose an adversarial category alignment network to enhance category consistency . experimental results show the proposed method can achieve state-of-the-art performance . |
| Outcome: | The proposed method achieves state-of-the-art performance and produces more discriminative features on benchmark datasets. |
Table-R1: Region-based Reinforcement Learning for Table Understanding (2026.findings-acl)
Copied to clipboard
Zhenhe Wu, Jian Yang, Zhongjiang He, Changzai Pan, Jiaheng Liu, Xianjie Wu, Yu Zhao, Shuangyong Song, Yongxiang Li, Zhoujun Li, Xuelong Li
| Challenge: | Tables are a widely used data format that poses unique challenges for language models due to their structured row-column interactions. |
| Approach: | They propose a region-based reinforcement learning approach that integrates region evidence into reasoning steps. |
| Outcome: | The proposed method outperforms baseline models on three benchmark datasets and significantly reduces the reasoning token consumption by 67.5%. |
Linguistic Rule Induction Improves Adversarial and OOD Robustness in Large Language Models (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing large language models (LLMs) do not perform satisfactorily in OOD and adversarial robustness evaluations. |
| Approach: | They propose to use linguistic rule induction to fine-tune large language models with linguistic rules to achieve better adversarial and OOD robustness. |
| Outcome: | The proposed model achieves comparable or better results with GPT-3.5 and GPT-4 on various adversarial and OOD robustness evaluations. |
Evaluating and Improving Graph to Text Generation with Large Language Models (2025.naacl-long)
Copied to clipboard
| Challenge: | Recent advances in large language models have revolutionized natural language processing due to their zero-and-short-shot capabilities. |
| Approach: | They propose a tuning-free prompting approach for graph-to-text generation tasks. |
| Outcome: | The proposed approach improves LLMs on graph-to-text generation tasks incrementally. |
Comprehensive Benchmarking of Long-Form Speech Generation in Diverse Scenarios (2026.findings-acl)
Copied to clipboard
Changhao Pan, Rui Yang, Han Wang, Zhuan Zhou, Xuming He, Wenxiang Guo, Ziyue Jiang, Ruiqi Li, Yu Zhang, Chenyuhao Wen, Ke Lei, Xiang Yin, Jingyu Lu, Zhiyuan Zhu, Zhou Zhao
| Challenge: | Existing evaluation benchmarks for long-form speech are limited to limited domains, creating a significant gap with the diverse downstream applications. |
| Approach: | They propose a benchmark that decomposes "long-form speech quality" into specific, disentangled dimensions. |
| Outcome: | The proposed benchmark decomposes “long-form speech quality” into specific, disentangled dimensions. |
Enhanced Language Representation with Label Knowledge for Span Extraction (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to extract text spans from plain text do not fully exploit label knowledge. |
| Approach: | They propose a model to integrate label knowledge into text representations by encoding texts and annotations independently and then integrating label knowledge with an elaborate-designed semantics fusion module. |
| Outcome: | The proposed model achieves state-of-the-art performance on four benchmarks and reduces training time and inference time by 76% and 77% on average compared with the existing paradigm. |
SlowBERT: Slow-down Attacks on Input-adaptive Multi-exit BERT (2023.findings-acl)
Copied to clipboard
| Challenge: | Pre-trained language models such as Google’s BERT have been gaining significant improvements to various down-stream applications, but the enormous training and inference cost severely hinders its practice on real-time applications and hardwareconstrained edge devices. |
| Approach: | They propose a slow-down attack on input-adaptive multi-exit BERT where the adversary imperceptibly modifies the input texts to drastically increase the inference cost. |
| Outcome: | The proposed attack on input-adaptive multi-exit BERT dramatically increases the average inference cost by 4.57, which would hurt the service quality of multi-extit BRT in practice, e.g., increasing the real-time cloud services’ response times for online users. |
MCGA: A Multi-task Classical Chinese Literary Genre Audio Corpus (2026.findings-acl)
Copied to clipboard
Yexing Du, Kaiyuan Liu, Bihe Zhang, Youcheng Pan, Bo Yang, Liangyu Huo, Xiyuan Zhang, Jian Xie, Daojing He, Yang Xiang, Ming Liu, Bing Qin
| Challenge: | Multimodal Large Language Models (MLLMs) have advanced Chinese Classical Studies (CCS) but the audio dimension of CCS remains underexplored due to a lack of high-quality, domain-specific audio corpora. |
| Approach: | They propose a 119-hour audio corpus comprising 22,000 audio samples to bridge this gap . it encompasses a diverse range of literary genres across six tasks . |
| Outcome: | The proposed corpus encompasses a diverse range of literary genres across six tasks: Automatic Speech Recognition (ASR), Speech-to-Text Translation (S2TT), Speech Emotion Captioning (SEC), Spoken Question Answering ( SQA), Speech Understanding (SU), and Speech Reasoning (SR). |
ProjectEval: A Benchmark for Programming Agents Automated Evaluation on Project-Level Code Generation (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing benchmarks lack the ability to automatically evaluate from users’ perspective and lack the explainability of the results of LLM agents’ code generation capabilities. |
| Approach: | They propose a new benchmark for LLM agents' automated evaluation by simulating user interaction. |
| Outcome: | The proposed benchmark can evaluate the generated projects by user interaction simulation and by code similarity through existing objective indicators. |
Enhancing LLM-Based Persuasion Simulations with Cultural and Speaker-Specific Information (2025.findings-emnlp)
Copied to clipboard
Weicheng Ma, Hefan Zhang, Shiyu Ji, Farnoosh Hashemi, Qichao Wang, Ivory Yang, Joice Chen, Juanwen Pan, Michael Macy, Saeed Hassanpour, Soroush Vosoughi
| Challenge: | Existing approaches to persuasive dialogue generation suffer from stance oscillation and low informativeness. |
| Approach: | They propose reinforced instructional prompting, a method that ensures speaker characteristics consistently guide all stages of dialogue generation. |
| Outcome: | The proposed method ensures speaker characteristics guide all stages of dialogue generation and aligns language use with speakers’ native languages to better capture cultural nuances. |
Discourse Marker Augmented Network with Reinforcement Learning for Natural Language Inference (P18-1)
Copied to clipboard
| Challenge: | Existing approaches to natural language inference focus on interaction architectures of sentences . but, we propose to transfer knowledge from discourse markers to augment the model . |
| Approach: | They propose to transfer knowledge from discourse markers to augment the quality of the NLI model. |
| Outcome: | The proposed method achieves state-of-the-art performance on large-scale datasets. |
MultiAgent Collaboration Attack: Investigating Adversarial Attacks in Large Language Model Collaborations via Debate (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have shown exceptional results when working individually, and have reduced parameter size and inference times. |
| Approach: | They evaluate the behavior of a network of models collaborating through debate under the influence of an adversary and examine inference-time methods to generate more compelling arguments. |
| Outcome: | The proposed model-based model-driven analysis shows that the model-led model-mediated debates generate more compelling arguments and provide a defensive strategy. |
Exploring Label Hierarchy in a Generative Way for Hierarchical Text Classification (2022.coling-1)
Copied to clipboard
| Challenge: | Existing methods for hierarchical text classification are lacking in the field of natural language processing. |
| Approach: | They propose a hierarchy-aware T5 model with path-adaptive attention mechanism to exploit hierarchical dependency across different levels. |
| Outcome: | The proposed model outperforms state-of-the-art models especially in Macro-F1 and low Macro. |
OASum: Large-Scale Open Domain Aspect-based Summarization (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing generic summarization methods generate only one summary for all different requests which is not optimal for diverse demands. |
| Approach: | They use crowd-sourced knowledge on Wikipedia to create a large-scale open-domain aspect-based summarization dataset with 1 million different aspects on 2 million Wikipedia pages. |
| Outcome: | The proposed model can generate diverse aspect-based summarizations on Wikipedia with zero/few-shot and fine-tuning on seven downstream datasets. |
Finding and Editing Multi-Modal Neurons in Pre-Trained Transformers (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to identify key neurons for interpretability of multi-modal large language models are unclear. |
| Approach: | They propose a method to identify key neurons for interpretability by multi-modal large language models. |
| Outcome: | The proposed method improves conventional works upon efficiency and applied range by removing needs of costly gradient computation. |
DivScene: Towards Open-Vocabulary Object Navigation with Large Vision Language Models in Diverse Scenes (2025.findings-emnlp)
Copied to clipboard
Zhaowei Wang, Hongming Zhang, Tianqing Fang, Ye Tian, Yue Yang, Kaixin Ma, Xiaoman Pan, Yangqiu Song, Dong Yu
| Challenge: | Large Vision-Language Models (LVLMs) have achieved significant progress in tasks like visual question answering and document understanding. |
| Approach: | They introduce DivScene, a large-scale dataset with 4,614 houses across 81 scene types and 5,707 kinds of target objects. |
| Outcome: | The proposed dataset provides a much greater diversity of target objects and scene types than existing datasets, enabling a comprehensive task evaluation. |
DaMo: Data Mixing Optimizer in Fine-tuning Multimodal LLMs for Mobile Phone Agents (2026.findings-acl)
Copied to clipboard
Kai Shi, Jun Yang, Ni Yang, Binqiang Pan, Qingsong Xie, null Zhangchao, Zhenyu Yang, Tianhuang Su, Haonan Lu
| Challenge: | Mobile Phone Agents (MPAs) have attracted huge attention due to their practicability in a multitude of scenarios. |
| Approach: | They propose a data mixture optimization solution that extrapolates optimal data mixtures from a trainable network. |
| Outcome: | The proposed model outperforms existing methods on open-source benchmarks and on open source benchmarks. |
Error Analysis of Uyghur Name Tagging: Language-specific Techniques and Remaining Challenges (L18-1)
Copied to clipboard
| Challenge: | despite efforts at name tagging, there is limited understanding on the performance ceiling . despite the high-resource language, there are very few natural language processing tools available . |
| Approach: | They propose to use a machine learning model to identify Uyghur name tagger errors . they conclude that such a model is unlikely to be effective for Uygur, or low-resource languages . |
| Outcome: | The proposed model is unlikely to be effective for Uyghur, or low-resource languages in general, the authors argue . they show that the proposed model can be used for high-res languages with superficial features . |
DMSD: Dual-Modal Semantic Disentanglement for Compositional Zero-Shot Learning (2026.findings-acl)
Copied to clipboard
| Challenge: | Compositional Zero-Shot Learning (CZSL) is a new research paradigm that learns sub-concepts from seen compositions and recognizes unseen novel combinations. |
| Approach: | They propose a Dual-Modal Semantic Disentanglement framework that integrates visual and textual information to achieve effective sub-concept disentangling. |
| Outcome: | The proposed framework achieves state-of-the-art performance on three benchmark datasets . it integrates a class-centroid bridge module to guide class centroids toward the textual space . |
Reading Like HER: Human Reading Inspired Extractive Summarization (D19-1)
Copied to clipboard
| Challenge: | Existing methods for extracting text summarization are abstractive and extractive. |
| Approach: | They propose a novel approach for extractive summarization by simulating two stages . they adopt a convolutional neural network to encode gist of paragraphs for rough reading . |
| Outcome: | The proposed method significantly outperforms the state-of-the-art extractive methods on CNN and DailyMail datasets. |
Good Reasoning Makes Good Demonstrations: Implicit Reasoning Quality Supervision via In-Context Reinforcement Learning (2026.findings-acl)
Copied to clipboard
| Challenge: | Reinforcement Learning with Verifiable Rewards (RLVR) improves reasoning in large language models but treats all correct solutions equally, potentially reinforcing flawed traces that arrive at correct answers by chance. |
| Approach: | They propose a method that reweights rewards by a factor approximately proportional to Evidence Gain and assigns higher weights to high-quality traces without requiring costly computation. |
| Outcome: | Experiments on mathematical reasoning benchmarks show that Reinforcement Learning with Verifiable Rewards (RLVR) improves reasoning in large language models but treats all correct solutions equally. |
Streaming Hallucination Detection in Long Chain-of-Thought Reasoning (2026.findings-acl)
Copied to clipboard
Haolang Lu, Minghui Pan, Ripeng LI, Guoshun Nan, Jialin Zhuang, Zijie Zhao, Zhongxiang Sun, Kun Wang, Yang Liu
| Challenge: | Long chain-of-thought reasoning improves performance of large language models, yet hallucinations in such settings often emerge subtly and propagate across reasoning steps. |
| Approach: | They propose to treat step-level hallucination judgments as local observations and introduce a cumulative prefix-level signal that tracks the global evolution of the reasoning state over the entire trajectory. |
| Outcome: | The proposed method enables streaming hallucination detection in long CoT reasoning, providing real-time, interpretable evidence. |
OpenResearcher: Unleashing AI for Accelerated Scientific Research (2024.emnlp-demo)
Copied to clipboard
Yuxiang Zheng, Shichao Sun, Lin Qiu, Dongyu Ru, Cheng Jiayang, Xuefeng Li, Jifan Lin, Binjie Wang, Yun Luo, Renjie Pan, Yang Xu, Qingkai Min, Zizhao Zhang, Yiwen Wang, Wenjie Li, Pengfei Liu
| Challenge: | Global scientific publications are growing annually by about 4%-5% (Pinedo et al., 2024). |
| Approach: | They introduce an AI-assisted platform that answers diverse questions from researchers using Retrieval-Augmented Generation (RAG) they develop various tools to understand queries, search from the scientific literature, filter retrieved information, provide accurate and comprehensive answers, and self-refine answers. |
| Outcome: | OpenResearcher is built on Retrieval-Augmented Generation (RAG) to integrate Large Language Models (LLMs) with up-to-date, domain-specific knowledge. |
Alignment with Fill-In-the-Middle for Enhancing Code Generation (2025.emnlp-main)
Copied to clipboard
Houxing Ren, Zimu Lu, Weikang Shi, Haotian Hou, Yunqiao Yang, Ke Wang, Aojun Zhou, Junting Pan, Mingjie Zhan, Hongsheng Li
| Challenge: | Existing methods for generating test cases with limited training data are not reliable and may be counterproductive. |
| Approach: | They propose a method that splits code snippets into smaller, granular blocks, creating more diverse DPO pairs from the same test cases. |
| Outcome: | The proposed approach shows significant improvements in code generation tasks on benchmark datasets such as HumanEval (+), MBPP (+), and APPS. |
Retrieval-Augmented Generation with Hierarchical Knowledge (2025.findings-emnlp)
Copied to clipboard
Haoyu Huang, Yongfeng Huang, Yang Junjie, Zhenyu Pan, Yongqiang Chen, Kaili Ma, Hongzhi Chen, James Cheng
| Challenge: | Existing RAG methods do not utilize hierarchical knowledge in human cognition, which limits the capabilities of RAG systems. |
| Approach: | They propose a graph-based approach that utilizes hierarchical knowledge to enhance the semantic understanding and structure capturing capabilities of RAG systems. |
| Outcome: | The proposed approach achieves significant performance improvements over the state-of-the-art methods. |
From Long to Lean: Performance-aware and Adaptive Chain-of-Thought Compression via Multi-round Refinement (2025.emnlp-main)
Copied to clipboard
| Challenge: | Chain-of-Thought reasoning introduces significant inference latency due to its verbosity. |
| Approach: | They propose a framework that leverages token elasticity phenomenon to progressively compress CoTs via multiround refinement. |
| Outcome: | The proposed method achieves an average accuracy improvement of 5.6% over state-of-the-art baselines while reducing CoT length by an average of 47 tokens and significantly lowering latency. |
Towards Efficient CoT Distillation: Self-Guided Rationale Selector for Better Performance with Fewer Rationales (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing work on rationale quality underestimates the importance of CoT distillation, focusing primarily on data quantity, which may result in transferring noisy or incorrect information to the student model. |
| Approach: | They propose a method which can discern and select high quality rationales for distillation and a Rationale Difficulty metric to measure the ability of the student model to generate the correct answer under a given rationale. |
| Outcome: | The proposed method achieves 4.6% accuracy improvement over baseline data on seven datasets over three tasks, controlling accuracy, diversity, and difficulty. |
CoMave: Contrastive Pre-training with Multi-scale Masking for Attribute Value Extraction (2023.findings-acl)
Copied to clipboard
Xinnan Guo, Wentao Deng, Yongrui Chen, Yang Li, Mengdi Zhou, Guilin Qi, Tianxing Wu, Dong Yang, Liubin Wang, Yong Pan
| Challenge: | Existing methods to extract product features from unstructured text still suffer from problems . e-commerce platforms are focusing on multi-scale values, which can be confusing . |
| Approach: | They propose a pre-training technique to automatically obtain attribute value pairs from product descriptions to aid e-commerce. |
| Outcome: | The proposed method improves on the existing token-level masking strategy and achieves state-of-the-art on four benchmarks. |
COIG-P: A High-Quality and Large-Scale Chinese Preference Dataset for Alignment with Human Values (2026.findings-eacl)
Copied to clipboard
Siwei Wu, JinCheng Ren, Xeron Du, Shuyue Guo, Xingwei Qu, Yiming Liang, Jie Liu, Yunwen Li, Tyler Loakman, Tianyu Zheng, Boyu Feng, Huaqing Yuan, Zili Wang, Jiaheng Liu, Wenhao Huang, Chenglin Cai, Haoran Que, Jian Yang, Yuelin Bai, Zekun Moore Wang, Zhouliang Yu, Qunshu Lin, Ding Pan, Yuchen Eleanor Jiang, Tiannan Wang, Wangchunshu Zhou, Shenzhi Wang, Xingyuan Bu, Minghao Liu, Guoyin Wang, Ge Zhang, Chenghua Lin
| Challenge: | Existing Chinese preference datasets suffer from limited scale, restricted domain coverage, and insufficiently rigorous data validation. |
| Approach: | They propose an LLM-based data annotation pipeline with no human intervention to annotate Chinese preference datasets. |
| Outcome: | The proposed pipeline outperforms existing Chinese preference datasets on AlignBench and Chinese Reward Benchmark. |
A Survey on Detection of LLMs-Generated Content (2024.findings-emnlp)
Copied to clipboard
Xianjun Yang, Liangming Pan, Xuandong Zhao, Haifeng Chen, Linda Petzold, William Yang Wang, Wei Cheng
| Challenge: | Recent advances in large language models have led to an increase in synthetic content generation . the ability to detect LLMs-generated content has become of paramount importance . |
| Approach: | They propose to provide a detailed overview of existing detection strategies and benchmarks, scrutinizing their differences and advocating for more adaptable and robust models to enhance detection accuracy. |
| Outcome: | The proposed model will be able to detect human-written content in real time. |
PersonaAgent: Bridging Memory and Action for Personalized LLM Agents (2026.findings-acl)
Copied to clipboard
Weizhi Zhang, Xinyang Zhang, Chenwei Zhang, Liangwei Yang, Jingbo Shang, Zhepei Wei, Henry Peng Zou, Zijie Huang, Zhengyang Wang, Yifan Gao, Xiaoman Pan, Lian Xiong, Jingguo Liu, Philip S. Yu, Xian Li
| Challenge: | Existing Large Language Model (LLM) enabled agents lack flexibility to respond to users’ varying needs and preferences. |
| Approach: | They propose a test-time user-preference alignment strategy that optimizes the persona prompt, ensuring real-time preference alignment through textual loss feedback between simulated and ground-truth responses. |
| Outcome: | The proposed framework outperforms baseline methods in real-time and in real applications. |
Deputy: Accelerating Large Language Model Inference with Dynamic Low-Rank Substitution (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing dynamic schemes such as early-exit and layer-drop reduce FLOPs but break batch processing or introduce KV-cache inconsistency. |
| Approach: | They propose a dynamic low-rank substitution framework that employs a lightweight decision module at each layer to dynamically determine the execution branch for different tokens. |
| Outcome: | The proposed model reduces computation by approximately 40% compared to the original dense model while outperforming existing baseline methods. |
Rethinking the Video Sampling and Reasoning Strategies for Temporal Sentence Grounding (2022.findings-emnlp)
Copied to clipboard
Jiahao Zhu, Daizong Liu, Pan Zhou, Xing Di, Yu Cheng, Song Yang, Wenzheng Xu, Zichuan Xu, Yao Wan, Lichao Sun, Zeyu Xiong
| Challenge: | Existing methods for temporal sentence grounding ignore two crucial issues . 1) Boundary-bias: the video downsampling process may lose these two frames . 2) Reasoning-biases: such incorrect new boundary frames lead to the reasoning bias . |
| Approach: | They propose a siamese sampling mechanism to generate additional contextual frames . they use a reasoning strategy to learn the inter-relationship among these frames a . |
| Outcome: | Extensive experiments demonstrate the effectiveness of a new siamese sampling network on three challenging datasets. |
VillagerAgent: A Graph-Based Multi-Agent Framework for Coordinating Complex Task Dependencies in Minecraft (2024.findings-acl)
Copied to clipboard
| Challenge: | Multi-agent collaboration using LLMs is a challenging research topic that aims to enable multiple autonomous agents to coordinate their actions and achieve a common goal. |
| Approach: | They propose a benchmark for multi-agent collaboration in the Minecraft environment and introduce a Directed Acyclic Graph Multi-Agent Framework to resolve complex inter-ag dependencies. |
| Outcome: | The proposed framework outperforms existing ModelVerse, reducing hallucinations and improving task decomposition efficacy. |
S2ST-Omni: Hierarchical Language-Aware SpeechLLM Adaptation for Multilingual Speech-to-Speech Translation (2026.findings-acl)
Copied to clipboard
| Challenge: | S2ST-Omni integrates a speech-to-text frontend with a modular, plug-and-play text-tospeech backend. |
| Approach: | They propose a compositional S2ST framework that integrates a speech-to-text frontend with a modular, plug-and-play text-tospeech backend. |
| Outcome: | The proposed framework outperforms existing frameworks in translation and synthesis . it integrates a speech-to-text translation frontend with a plug-and-play text-tospeech backend . |
GRV-KBQA: A Three-Stage Framework for Knowledge Base Question Answering with Decoupled Logical Structure, Semantic Grounding and Structure-Aware Validation (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for Knowledge Base Question Answering generate non-executable queries and inefficiencies in query execution. |
| Approach: | a framework that decouples logical structure generation from semantic grounding is proposed . the framework explicitly enforces KB constraints to improve alignment between generated logical forms and KB structures. |
| Outcome: | GRV-KBQA decouples logical structure generation from semantic grounding and incorporates structure-aware validation to enhance accuracy. |
How Is LLM Reasoning Distracted by Irrelevant Context? An Analysis Using a Controlled Benchmark (2025.emnlp-main)
Copied to clipboard
| Challenge: | Prior work has not explored the mechanisms underlying this sensitivity. |
| Approach: | They propose a synthetic benchmark to evaluate Large Language Models’ reasoning robustness against systematically controlled irrelevant context (IC). |
| Outcome: | The proposed model improves in-distribution and out-of-disttribution scenarios while training with strong distractors. |
Noise Robust Named Entity Understanding for Voice Assistants (2021.naacl-industry)
Copied to clipboard
Deepak Muralidharan, Joel Ruben Antony Moniz, Sida Gao, Xiao Yang, Justine Kao, Stephen Pulman, Atish Kothari, Ray Shen, Yinying Pan, Vivek Kaul, Mubarak Seyed Ibrahim, Gang Xiang, Nan Dun, Yidan Zhou, Andy O, Yuan Zhang, Pooja Chitkara, Xuan Wang, Alkesh Patel, Kushal Tayal, Roger Zheng, Peter Grasch, Jason D Williams, Lin Li
| Challenge: | Named Entity Recognition and Entity Linking are challenging for voice assistants . utterances are relatively short, so there is not much context to help disambiguate . |
| Approach: | They propose a Named Entity Understanding system that combines NER and EL in a joint reranking module. |
| Outcome: | The proposed framework improves NER accuracy by up to 3.13% and EL accuracy by 3.6% in F1 score . it also leads to better accuracies in other natural language understanding tasks . |
T2R-BENCH: A Benchmark for Real World Table-to-Report Task (2025.emnlp-main)
Copied to clipboard
Jie Zhang, Changzai Pan, Sishi Xiong, Kaiwen Wei, Yu Zhao, Xiangyu Li, Jiaxin Peng, Xiaoyan Gu, Jian Yang, Wenhan Chang, Zhenhe Wu, Jiang Zhong, Shuangyong Song, Xuelong Li
| Challenge: | Existing table benchmarks lack the capacity to adequately assess the practical application of table reasoning in industrial applications. |
| Approach: | They propose a bilingual table-to-report task and a table-based benchmark to assess the quality of table reasoning. |
| Outcome: | The proposed task is based on a bilingual benchmark with 457 industrial tables and evaluation criteria to measure the quality of report generation. |
SciAgent: Tool-augmented Language Models for Scientific Reasoning (2024.emnlp-main)
Copied to clipboard
Yubo Ma, Zhibin Gou, Junheng Hao, Ruochen Xu, Shuohang Wang, Liangming Pan, Yujiu Yang, Yixin Cao, Aixin Sun
| Challenge: | SciAgent surpasses other LLMs with the comparable size by more than 8.0% in absolute accuracy. |
| Approach: | They propose a tool-augmented scientific reasoning setting that supplements LLMs with scalable toolsets and builds a benchmark to evaluate LLM’s abilities with tool assistance. |
| Outcome: | The proposed setting augments LLMs with scalable toolsets and shifts the focus from pursuing an omniscient problem solver to a proficient tool-user. |
Aligning Agents via Planning: A Benchmark for Trajectory-Level Reward Modeling (2026.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) evolve into agentic systems capable of autonomous tool invocation and complex reasoning. |
| Approach: | They propose a trajectory-level preference benchmark to evaluate judges' ability to distinguish preferred versus distractor agent trajectories in tool-integrated environments. |
| Outcome: | The proposed benchmark evaluates how well judges distinguish preferred versus distractor agent trajectories in complex tool-using scenarios. |
SpiderFlow: Efficient Topology-Aware Scheduling for LLM Training Across Decentralized GPU Clusters (2026.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to training large language models lack topologyaware task scheduling mechanisms and model parallelization strategies. |
| Approach: | They propose a topology-aware scheduling system specifically designed for decentralized GPU clusters . they propose heuristic methods at the inter-cluster level with ILP-based optimization within clusters. |
| Outcome: | The proposed system reduces job completion time by 1.2-1.3 and improves throughput by 1.12-1.25 . it also reduces scheduling overhead by 20-90 on average compared to state-of-the-art scheduling systems. |
LLMLingua-2: Data Distillation for Efficient and Faithful Task-Agnostic Prompt Compression (2024.findings-acl)
Copied to clipboard
Zhuoshi Pan, Qianhui Wu, Huiqiang Jiang, Menglin Xia, Xufang Luo, Jue Zhang, Qingwei Lin, Victor Rühle, Yuqing Yang, Chin-Yew Lin, H. Vicky Zhao, Lili Qiu, Dongmei Zhang
| Challenge: | Existing approaches to compress prompts only leverage unidirectional context, causing suboptimal results. |
| Approach: | They propose a task-agnostic prompt compression method that takes tokens from context . they use a Transformer encoder to capture all essential information needed for prompt compression . |
| Outcome: | The proposed method is 3x-6x faster than existing prompt compression methods and faster than baselines. |
Takin-VC: Expressive Zero-Shot Voice Conversion via Adaptive Hybrid Content Encoding and Enhanced Timbre Modeling (2025.acl-long)
Copied to clipboard
Yang Yuguang, Yu Pan, Jixun Yao, Xiang Zhang, Jianhao Ye, Hongbin Zhou, Lei Xie, Lei Ma, Jianjun Zhao
| Challenge: | Expressive zero-shot voice conversion (VC) aims to modify source timbre to match unseen speaker . existing zero- shot VC systems struggle to reproduce paralinguistic information in highly expressive speech . |
| Approach: | They propose a framework for expressive zero-shot voice conversion that uses hybrid content encoding and memory-augmented context-aware timbre modeling. |
| Outcome: | The proposed framework surpasses state-of-the-art VC systems in speech naturalness, speaker similarity, and speaker similarness. |
PEK: A Parameter-Efficient Framework for Knowledge-Grounded Dialogue Generation (2024.findings-acl)
Copied to clipboard
| Challenge: | Pre-trained language models have shown great dialogue generation capability in different scenarios, but the huge VRAM consumption when fine-tuning them is one of their drawbacks. |
| Approach: | They propose a parameter-efficient framework for knowledge-enhanced dialogue generation that leverages external knowledge documents and knowledge graphs to enhance its generation capabilities. |
| Outcome: | The proposed framework outperforms baseline methods on multiple evaluation metrics on Wizard of Wikipedia and CMU_DoG datasets. |
COSMIC: Generalized Refusal Direction Identification in LLM Activations (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods depend on predefined refusal templates detectable in output tokens or manual review. |
| Approach: | They propose a framework that optimally identifies steering directions and target layers using cosine similarity, entirely independent of output text. |
| Outcome: | The proposed framework achieves comparable steering effectiveness without any prior knowledge or assumptions of a model’s refusal behavior such as the use of certain refusal tokens. |
FlattenQuant: Breaking through the Inference Compute-bound for Large Language Models with Per-tensor Quantization (2024.lrec-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) have demonstrated state-of-the-art accuracies across tasks, but their latency and GPU memory consumption limit their performance. |
| Approach: | They propose a method which flattens the tensor to achieve low bit per-tensori quantization with minimal accuracy loss. |
| Outcome: | The proposed method achieves low bit per-tensor quantization with minimal accuracy loss. |
Multi-Task Neural Model for Agglutinative Language Translation (2020.acl-srw)
Copied to clipboard
| Challenge: | Neural machine translation (NMT) has been gaining popularity in high-resource translation tasks, but struggles in low-ressource and morphologically-rich scenarios. |
| Approach: | They propose a multi-task neural model that jointly learns to perform bi-directional translation and agglutinative language stemming. |
| Outcome: | The proposed model can significantly improve translation performance on agglutinative languages by using a small amount of monolingual data. |
SAFE-QAQ: End-to-End Slow-Thinking Audio-Text Fraud Detection via Reinforcement Learning (2026.acl-long)
Copied to clipboard
Peidong Wang, Zhiming Ma, Xin Dai, YongKang Liu, Shi Feng, Xiaocui Yang, Wenxing Hu, Zhihao Wang, Mingjun Pan, Li Yuan, Daling Wang
| Challenge: | Existing methods for fraud detection rely on transcribed text, lacking acoustic cues . a proposed framework for audio-based slow-thinking fraud detection eliminates transcription errors . |
| Approach: | They propose a framework for audio-based slow-thinking fraud detection that eliminates transcription errors and rewards slow-thought reasoning by capturing fine-grained audio details. |
| Outcome: | The proposed method improves accuracy, inference efficiency, and real-time processing capabilities. |
Meta Distant Transfer Learning for Pre-trained Language Models (2021.emnlp-main)
Copied to clipboard
| Challenge: | Notable PLMs are available for text classification tasks, but performance of PLM on downstream tasks may be limited by the availability of training set. |
| Approach: | They propose a meta-learning framework to learn the transferable knowledge across tasks using PLMs. |
| Outcome: | The proposed framework outperforms baselines on seven datasets and is task-agnostic and unbiased. |
AiraXiv: An AI-Driven Open-Access Platform for Human and AI Scientists (2026.acl-demo)
Copied to clipboard
| Challenge: | Recent advances in artificial intelligence (AI) have accelerated the growth of both human-authored and AI-generated research outputs. |
| Approach: | They propose an AI-driven open-access platform built on open preprints, AI-augmented analysis and review, and reader feedback. |
| Outcome: | The proposed platform supports human scientists through an interactive UI and AI scientists through Model Context Protocol (MCP)-based interactions. |
OPINE: A Prior-calibrated Scoring Framework for LLM-based Multi-label Scientific Opinion Classification (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for scientific opinion classification rely on direct label generation and are limited by the multi-label nature of scientific expressions. |
| Approach: | They propose a framework that reformulates scientific opinion classification as a controllable pipeline. |
| Outcome: | The proposed framework outperforms baseline models on 18 discourse functions in micro, macro, and example settings. |
Enhancing Open-Domain Task-Solving Capability of LLMs via Autonomous Tool Integration from GitHub (2025.acl-long)
Copied to clipboard
Bohan Lyu, Xin Cong, Heyang Yu, Pan Yang, Cheng Qian, Zihe Wang, Yujia Qin, Yining Ye, Yaxi Lu, Chen Qian, Zhong Zhang, Yukun Yan, Yankai Lin, Zhiyuan Liu, Maosong Sun
| Challenge: | Existing approaches lack flexibility to address diverse and ever-evolving user queries in open domains. |
| Approach: | They propose to evaluate LLMs on open-domain knowledge that requires tools to solve diverse and ever-evolving user queries. |
| Outcome: | The proposed system outperforms baselines in the open domain task-solving benchmark. |
GenTool: Enhancing Tool Generalization in Language Models through Zero-to-One and Weak-to-Strong Simulation (2025.findings-acl)
Copied to clipboard
Jie He, Jennifer Neville, Mengting Wan, Longqi Yang, Hui Liu, Xiaofeng Xu, Xia Song, Jeff Z. Pan, Pei Zhou
| Challenge: | Large Language Models (LLMs) can expand their capabilities by integrating external tools. |
| Approach: | They propose a training framework that prepares LLMs for diverse generalization challenges in tool utilization. |
| Outcome: | The proposed framework improves the tool-usage capabilities of LLMs by up to 8B parameters, surpassing GPT-4o. |
Reward Generalization in RLHF: A Topological Perspective (2025.findings-acl)
Copied to clipboard
Tianyi Alex Qiu, Fanzhi Zeng, Jiaming Ji, Dong Yan, Kaile Wang, Jiayi Zhou, Yang Han, Josef Dai, Xuehai Pan, Yaodong Yang
| Challenge: | Existing alignment methods share a common topology of information flow, but their alternatives have not been thoroughly explored. |
| Approach: | They propose a theory of reward generalization in reinforcement learning from human feedback . they propose induced Bayesian networks to model the impact of dataset topologies on reward generalisation . |
| Outcome: | The proposed method achieves an average win rate of 65% on three NLP tasks. |
CompKBQA: Component-wise Task Decomposition for Knowledge Base Question Answering (2025.emnlp-main)
Copied to clipboard
Yuhang Tian, Dandan Song, Zhijing Wu, Pan Yang, Changzhi Zhou, Jun Yang, Hao Wang, Huipeng Ma, Chenhao Li, Luan Zhang
| Challenge: | Existing knowledge base question answering methods struggle with complex queries. |
| Approach: | They propose a framework that optimizes the process of fine-tuning a LLM for generating logical forms by enabling it to learn relevant sub-tasks like skeleton generation, topic entity generation, and relevant relations generation. |
| Outcome: | The proposed framework achieves state-of-the-art on two benchmark KBQA datasets, WebQSP and CWQ. |