Papers by Xin Yang
Progra: Progress-Aware Reinforcement Learning for Multi-Turn Function Calling (2026.findings-acl)
Copied to clipboard
Huacan Chai, Zijie Cao, Maolin Ran, Yingxuan Yang, Jianghao Lin, Xin Peng, Hairui Wang, Renjie Ding, Ziyu Wan, Muning Wen, Weiwen Liu, Weinan Zhang, Fei Huang, Ying Wen
| Challenge: | Existing methods for multi-turn function calling are limited by redundancy and lack explicit integration of progress awareness into training. |
| Approach: | They propose a framework that explicitly integrates progress awareness into LLM training for multi-turn function calling. |
| Outcome: | Empirical results show that Progra outperforms existing methods on two public benchmarks. |
HSDreport: Heart Sound Diagnosis with Echocardiography Reports (2024.findings-emnlp)
Copied to clipboard
Zihan Zhao, Pingjie Wang, Liudan Zhao, Yuchen Yang, Ya Zhang, Kun Sun, Xin Sun, Xin Zhou, Yu Wang, Yanfeng Wang
| Challenge: | Existing methods for heart sound diagnosis are limited to a few fixed categories and do not utilize echocardiography reports, the gold standard in the diagnosis of related diseases. |
| Approach: | They propose a benchmark that mandates the direct utilization of heart sounds obtained from auscultation to predict echocardiography reports. |
| Outcome: | The proposed method outperforms existing methods and existing multimodal LLMs in detecting key abnormalities in heart sounds. |
SILO-BENCH: A Scalable Environment for Evaluating Distributed Coordination in Multi-Agent LLM Systems (2026.acl-long)
Copied to clipboard
Yuzhe Zhang, Feiran Liu, Yi Shan, Xinyi Huang, Xin Yang, Yueqi Zhu, Xuxin Cheng, Cao Liu, Ke Zeng, Terry Jingchen Zhang, Wenyuan Jiang
| Challenge: | Existing benchmarks conflate coordination ability with role-based priors. |
| Approach: | They propose a role-free benchmark for evaluating free-form collaboration under information silos. |
| Outcome: | The proposed benchmark systematically probes coordination capabilities under information silos using 54 configurations and 3 frontier LLMs. |
Assessing Multilingual Fairness in Pre-trained Multimodal Representations (2022.findings-acl)
Copied to clipboard
| Challenge: | Recent pre-trained multimodal models have shown exceptional capabilities towards connecting images and natural language. |
| Approach: | They propose two new fairness notions for pre-trained multimodal models that consider language as the fairness recipient. |
| Outcome: | The proposed models can be generalized to multilingualism by cross-lingual alignment . the results show that the models are individually fair across languages . |
Are U a Joke Master? Pun Generation via Multi-Stage Curriculum Learning towards a Humor LLM (2024.findings-acl)
Copied to clipboard
Yang Chen, Chong Yang, Tu Hu, Xinhao Chen, Man Lan, Li Cai, Xinlin Zhuang, Xuan Lin, Xin Lu, Aimin Zhou
| Challenge: | Existing research has demonstrated that the ability of large language models (LLMs) to generate humorous sentences is limited to producing 25 unique jokes. |
| Approach: | They propose a multi-stage curriculum preference learning framework to optimize both pun structure preferences and humor preferences by a Chinese Pun dataset. |
| Outcome: | The proposed method significantly outperforms baseline models on Chinese and English benchmark datasets. |
DSP: Discriminative Soft Prompts for Zero-Shot Entity and Relation Extraction (2023.findings-acl)
Copied to clipboard
| Challenge: | Prompt-based methods have shown their efficacy in transferring general knowledge within pre-trained language models (PLMs) however, when applied to zero-shot entity and relation extraction, they struggle with the limited coverage of verbalizers to labels and the slow inference speed. |
| Approach: | They propose a method which reformulates zero-shot tasks into token discrimination tasks without having to construct verbalizers. |
| Outcome: | The proposed method outperforms baselines on two zero-shot entity recognition datasets with higher inference speed and achieves 7.5% improvement over previous state-of-the-art models on Wiki-ZSL and FewRel. |
Scaling Laws for Code: Every Programming Language Matters (2026.findings-acl)
Copied to clipboard
Jian Yang, Shuyue Guo, Linzheng Chai, Wei Zhang, Aishan Liu, Chuan Hao, Zhoujun Li, Xin Zhao, Xianglong Liu, Weifeng Lv, Bryan Dai
| Challenge: | Existing studies focus on language-agnostic settings, neglecting the inherently multilingual nature of modern software development. |
| Approach: | They propose a proportion-dependent scaling law that prioritizes high-utility languages . they propose PLs to have varying effects during pre-training that affect model performance . |
| Outcome: | The proposed scaling law is based on 1000+ experiments across multiple languages and models. |
Gradient-based Intra-attention Pruning on Pre-trained Language Models (2023.acl-long)
Copied to clipboard
| Challenge: | Pre-trained language models are computationally expensive and slow in inference due to their large sizes. |
| Approach: | They propose a structured pruning method which combines pruning with knowledge distillation to yield highly effective models. |
| Outcome: | The proposed method outperforms other pruning methods in sparsity regimes while maintaining 93% 99% performance. |
Compressing Large-Scale Transformer-Based Models: A Case Study on BERT (2021.tacl-1)
Copied to clipboard
Prakhar Ganesh, Yao Chen, Xin Lou, Mohammad Ali Khan, Yin Yang, Hassan Sajjad, Preslav Nakov, Deming Chen, Marianne Winslett
| Challenge: | Popular pre-trained Transformers have improved performance for various NLP tasks by sizable margins, but are too resource-hungry and computation-intensive to suit low-capacity devices or applications with strict latency requirements. |
| Approach: | They present a literature review of the compression of Transformers, focusing on the popular BERT model, which has attracted considerable research attention. |
| Outcome: | The proposed models improve Sentiment analysis, paraphrase detection, machine reading comprehension, question answering, text summarization, and other tasks by sizable margins. |
Reinforced Efficient Reasoning via Semantically Diverse Exploration (2026.acl-long)
Copied to clipboard
Ziqi Zhao, Zhaochun Ren, Jiahong Zou, Liu Yang, Zhiwei Xu, Xuri Ge, Zhumin Chen, Xinyu Ma, Daiting Shi, Shuaiqiang Wang, Dawei Yin, Xin Xin
| Challenge: | Existing methods for reinforcement learning with verifiable rewards suffer from limited exploration diversity and inefficient reasoning. |
| Approach: | They propose a method that rewards concise and correct reasoning while penalizing unnecessarily long reasoning chains. |
| Outcome: | Extensive experiments on Qwen and Llama models validate the effectiveness and efficiency of ROSE. |
Bridging Subword Gaps in Pretrain-Finetune Paradigm for Natural Language Generation (2021.acl-long)
Copied to clipboard
| Challenge: | Existing methods to pretrain language models are limited by one-size-fits-all vocabulary . embeddings of mismatch tokens can be efficiently initialized in downstream tasks . |
| Approach: | They propose to extend pretrain-finetune pipeline with an embedding transfer step . plug-and-play embeddable generator is introduced to generate any input token . |
| Outcome: | The proposed approach allows for more efficient and better performed NLG models. |
AgentGym2: Benchmarking Large Language Model Agents in De-Idealized Real-World Environments (2026.acl-long)
Copied to clipboard
Zhiheng Xi, Dingwen Yang, Jiaqi Liu, Jixuan Huang, Honglin Guo, Baodai Huang, Tinggang Chen, Qi Zhang, Zhonghang Lu, Chenyu Liu, Jiajun Sun, Jiazheng Zhang, Dingwei Zhu, Xin Guo, Junzhe Wang, Zhihao Zhang, Yuming Yang, Junjie Ye, Minghe Gao, Dongrui Liu, Jiaming Ji, Guohao Li, Tao Gui, Qi Zhang, Xuanjing Huang
| Challenge: | Existing benchmarks evaluate agents in simplified, idealized settings, relying on pre-packaged tool interfaces, overlooking critical steps, and assume inputs are clean and fully specified. |
| Approach: | They propose a framework that evaluates language agents in simplified, idealized settings . they show that even SOTA systems like Gemini and GPT-5 struggle on AgentGym2 . |
| Outcome: | Experiments on 15 proprietary and open-source models show that even SOTA systems like Gemini and GPT-5 struggle on AgentGym2 . |
How to Train a Real-World Silicon Concierge? Internalizing Complex Business Workflow to Only OneModel (2026.acl-industry)
Copied to clipboard
| Challenge: | Traditional industrial agents rely on modular workflows that fracture into a labyrinth of ad-hoc patches, leading to cascading errors and high latency. |
| Approach: | They propose a paradigm shift from external workflows to internalized knowledge representation that consolidates complex business logic and SOPs directly into the model’s parameters. |
| Outcome: | The proposed model breaks the impossible triangle of latency, accuracy, and complexity. |
OCR-Memory: Optical Context Retrieval for Long-Horizon Agent Memory (2026.acl-long)
Copied to clipboard
| Challenge: | Existing LLMs are limited by text-context budgets, resulting in token-expensive storage of raw trajectories . Optical Context Retrieval Memory (OCR-Memory) renders historical tra-jectorios into images annotated with unique visual identifiers. |
| Approach: | They propose a framework that leverages the visual modality as a high-density representation of agent experience. |
| Outcome: | Optical Context Retrieval Memory (OCRM) renders historical trajectories into images annotated with unique visual identifiers. |
GMH: A General Multi-hop Reasoning Model for KG Completion (2021.emnlp-main)
Copied to clipboard
| Challenge: | Knowledge graphs are incomplete with many facts missing, causing performance bottlenecks in many applications. |
| Approach: | They propose a general multi-hop reasoning task that can be formulated as a search process and can be extended to long-distance reasoning scenarios. |
| Outcome: | The proposed model improves on baselines in short and long distance reasoning scenarios. |
Task-oriented Domain-specific Meta-Embedding for Text Classification (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods neglect domain-specific knowledge and use the same word embedding for each word in all domain-specified datasets. |
| Approach: | They propose a method to incorporate domain-specific and task-oriented information into meta-embeddings by combining pre-trained word embeddings. |
| Outcome: | The proposed method performs well on four text classification datasets and shows that it is compatible with existing methods. |
Are Emotion and Rhetoric Neurons in LLM? Neuron Recognition and Adaptive Masking for Emotion-Rhetoric Prediction Steering (2026.acl-long)
Copied to clipboard
| Challenge: | Existing studies on neurons focus on emotion and rhetoric, neglecting their intrinsic connections. |
| Approach: | They propose a framework for fine-grained steering of emotion and rhetoric in large language models . they propose 'neuro-based' masking method that integrates multi-dimensional screening . |
| Outcome: | The proposed method achieves directed induction of non-target sentences and enhancement of emotion tasks via rhetoric neurons. |
DrAgent: Empowering Large Language Models as Medical Agents for Multi-hop Medical Reasoning (2025.findings-emnlp)
Copied to clipboard
Fenglin Liu, Zheng Li, Hongjian Zhou, Qingyu Yin, Jingfeng Yang, Xin Liu, Zhengyang Wang, Xianfeng Tang, Shiyang Li, Xiang He, Ruijie Wang, Bing Yin, Xiao Gu, Lei Clifton, David A. Clifton
| Challenge: | commercial LLMs can be difficult to use in real-world clinical decision-making . a lightweight LLM can be used to collaborate with diverse clinical tools . |
| Approach: | They propose a lightweight LLM that can be used to build medical LLMs as agents . they use recursive curriculum learning to optimize the LLM in an easy-to-hard progression . |
| Outcome: | The proposed approach outperforms human experts in medical examinations on diverse datasets. |
mGTE: Generalized Long-Context Text Representation and Reranking Models for Multilingual Text Retrieval (2024.emnlp-industry)
Copied to clipboard
Xin Zhang, Yanzhao Zhang, Dingkun Long, Wen Xie, Ziqi Dai, Jialong Tang, Huan Lin, Baosong Yang, Pengjun Xie, Fei Huang, Meishan Zhang, Wenjie Li, Min Zhang
| Challenge: | Existing models for text retrieval are based on a multi-stage process that involves retrieving documents from a large corpus. |
| Approach: | They propose to build a multilingual text representation model and a cross-encoder reranker from scratch for text retrieval. |
| Outcome: | The proposed models outperform the state-of-the-art models on long-context retrieval benchmarks. |
MAIN: Mutual Alignment Is Necessary for instruction tuning (2025.emnlp-main)
Copied to clipboard
Fanyi Yang, Jianfeng Liu, Xin Zhang, Haoyu Liu, Xixin Cao, Yuefeng Zhan, Hao Sun, Weiwei Deng, Feng Sun, Qi Zhang
| Challenge: | Instruction tuning has enabled large language models to achieve remarkable performance, yet its success heavily depends on the availability of high-quality instruction-response pairs. |
| Approach: | They propose a mutual alignment framework which enforces coherence between instructions and responses through mutual constraints. |
| Outcome: | The proposed framework generalizes well across model architectures and sizes, achieving state-of-the-art performance on LLaMA, Mistral, and Qwen models across diverse benchmarks. |
ZSEE: A Dataset based on Zeolite Synthesis Event Extraction for Automated Synthesis Platform (2024.findings-naacl)
Copied to clipboard
| Challenge: | Automated synthesis of zeolite holds great significance for attaining economic and environmental benefits. |
| Approach: | They propose an event extraction task to mine structural synthesis actions from experimental narratives for modular automated synthesis. |
| Outcome: | The proposed method can significantly expedite automated synthesis of zeolites owing to its machine readability. |
RAG-Star: Enhancing Deliberative Reasoning with Retrieval Augmented Verification and Refinement (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing large language models (LLMs) show exceptional problem-solving capabilities but struggle with complex reasoning tasks. |
| Approach: | They propose a novel RAG approach that integrates retrieved information to guide tree-based reasoning process based on LLMs. |
| Outcome: | The proposed approach outperforms existing methods in large language models . iteratively plans intermediate sub-queries and answers based on the LLM itself . |
Hephaestus: Improving Fundamental Agent Capabilities of Large Language Models through Continual Pre-Training (2025.naacl-long)
Copied to clipboard
Yuchen Zhuang, Jingfeng Yang, Haoming Jiang, Xin Liu, Kewei Cheng, Sanket Lokegaonkar, Yifan Gao, Qing Ping, Tianyi Liu, Binxuan Huang, Zheng Li, Zhengyang Wang, Pei Chen, Ruijie Wang, Rongzhi Zhang, Nasser Zalmout, Priyanka Nigam, Bing Yin, Chao Zhang
| Challenge: | Existing LLMs often rely on complex prompting or extensive fine-tuning to introduce new capabilities while preserving strong generalizability. |
| Approach: | They propose a large-scale pre-training corpus to enhance LLM agents' capabilities . they use 103B agent-specific data encompassing 76,537 APIs . |
| Outcome: | The proposed training corpus outperforms open-source LLMs and commercial LLM agents on three agent benchmarks. |
Modeling Temporal-Modal Entity Graph for Procedural Multimodal Machine Comprehension (2022.acl-long)
Copied to clipboard
| Challenge: | Procedural Multimodal Documents organize textual instructions and corresponding images step by step. |
| Approach: | They propose a novel temporal-modal entity Graph for comprehending PMDs . they propose encoding and reasoning modules to capture textual and visual entities . |
| Outcome: | The proposed model can capture textual and visual entities and trace their temporal-modal evolution. |
When Inverse Data Outperforms: Exploring the Pitfalls of Mixed Data in Multi-Stage Fine-Tuning (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for o1-level performance focus on unidirectional supervised fine-tuning (SFT), overlooking the intricate interplay between diverse reasoning patterns. |
| Approach: | They construct a reverse reasoning dataset and examine how it is supervised . they find that naively mixing forward and reverse data during SFT weakens the directional distinction . |
| Outcome: | The proposed model improves accuracy by 1.6%–6.8% over a standard model. |
AgenticEval: Toward Agentic and Self-Evolving Safety Evaluation of Large Language Models (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing static safety evaluation methods are ill-equipped to address dynamic nature of AI risks and evolving regulations, creating a critical safety gap. |
| Approach: | They propose a new paradigm of agentic safety evaluation reframing evaluation as a continuous and self-evolving process rather than a one-time audit. |
| Outcome: | The proposed framework shows a consistent decline in model safety as the evaluation hardens. |
CPL: Counterfactual Prompt Learning for Vision and Language Models (2022.emnlp-main)
Copied to clipboard
Xuehai He, Diji Yang, Weixi Feng, Tsu-Jui Fu, Arjun Akula, Varun Jampani, Pradyumna Narayana, Sugato Basu, William Yang Wang, Xin Wang
| Challenge: | Existing prompt tuning methods tend to learn spurious or entangled representations, leading to poor generalization to unseen concepts. |
| Approach: | They propose a prompt tuning technique that tunes the learnable prompt for pre-trained vision and language models. |
| Outcome: | The proposed method improves few-shot performance on vision and language tasks over existing prompt tuning methods. |
MTRec: Multi-Task Learning over BERT for News Recommendation (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing news recommendation methods learn news representations solely based on news titles. Existing methods only utilize title information and neglect other valuable news information such as categories and entities. |
| Approach: | They propose a multi-task method to incorporate multi-field information into BERT, which improves its news encoding capability. |
| Outcome: | Extensive experiments on the MIND news recommendation benchmark show the proposed method is effective. |
Muffin or Chihuahua? Challenging Multimodal Large Language Models with Multipanel VQA (2024.acl-long)
Copied to clipboard
Yue Fan, Jing Gu, Kaiwen Zhou, Qianqi Yan, Shan Jiang, Ching-Chen Kuo, Yang Zhao, Xinze Guan, Xin Wang
| Challenge: | Multipanel images are a common form of visual representations, and humans can achieve approximately 99% accuracy on these questions. |
| Approach: | They propose a benchmark that tests multipanel visual reasoning models with 6,600 triplets of questions, answers, and multipanel images. |
| Outcome: | The proposed benchmark features 6,600 triplets of questions, answers, and multipanel images that challenge state-of-the-art Multimodal Large Language Models (MLLMs) human users can attain approximately 99% accuracy on these questions, compared with previous benchmarks. |
Improving Knowledge Graph Embedding Using Affine Transformations of Entities Corresponding to Each Relation (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing knowledge graph embedding methods use k-dimensional vectors to represent each entity in a knowledge graph. |
| Approach: | They propose to use affine transformations to embed knowledge graphs using previous methods . they propose to add k additional variables to the existing methods to perform embedding . |
| Outcome: | The proposed method outperforms RotatE, Distmult and ComplEx on various data sets. |
E-ConvRec: A Large-Scale Conversational Recommendation Dataset for E-Commerce Customer Service (2022.lrec-1)
Copied to clipboard
Meihuizi Jia, Ruixue Liu, Peiying Wang, Yang Song, Zexi Xi, Haobin Li, Xin Shen, Meng Chen, Jinhui Pang, Xiaodong He
| Challenge: | Recent research has focused on developing conversational recommendation system (CRS), which provides valuable recommendations to users through conversations. |
| Approach: | They construct an authentic Chinese dialogue dataset consisting of over 25k dialogues and 770k utterances, which contains user profile, product knowledge base, and multiple sequential real conversations between users and recommenders. |
| Outcome: | The proposed dataset contains user profile, product knowledge base, and multiple sequential real conversations between users and recommenders. |
KACC: A Multi-task Benchmark for Knowledge Abstraction, Concretization and Completion (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing studies focus on partial aspects of knowledge abstraction, concretization, and completion (KACC). |
| Approach: | They propose a unified knowledge graph benchmark to improve existing benchmarks . they collect new datasets that contain larger concept graphs and cross-view links . |
| Outcome: | The proposed benchmark improves existing benchmarks in terms of dataset scale, task coverage, and difficulty. |
PaCoRe: Learning to Scale Test-Time Compute with Parallel Coordinated Reasoning (2026.acl-long)
Copied to clipboard
Jingcheng Hu, Yinmin Zhang, Shijie Shang, Xiaobo Yang, Yue Peng, Zhewei Huang, Hebin Zhou, Xin Wu, Jie Cheng, Fanqi Wan, Xiangwen Kong, Chengyuan Yao, Kaiwen Yan, Ailin Huang, Hongyu Zhou, Qi Han, Zheng Ge, Xiangyu Zhang, Heung-Yeung Shum
| Challenge: | Parallel Coordinated Reasoning (PaCoRe) overcomes a central limitation of contemporary language models: their inability to scale test-time compute (TTC) far beyond sequential reasoning under a fixed context window. |
| Approach: | They propose a training-and-inference framework to overcome a central limitation of language models: their inability to scale test-time compute (TTC) under a fixed context window. |
| Outcome: | The proposed model scales to multi-million-token effective TTC without exceeding context limits. |
HyperCL: A Contrastive Learning Framework for Hyper-Relational Knowledge Graph Embedding with Hierarchical Ontology (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing studies neglect the ontology of knowledge Graph (KG) embeddings and suffer from the dominance issue of facts over ontologies. |
| Approach: | They propose a framework for hyper-relational KG embeddings that captures the hierarchical ontology and a concept-aware contrastive loss to alleviate the dominance issue. |
| Outcome: | The proposed framework improves on three real-world datasets and shows that it can integrate with other embedding methods and improve link prediction performance. |
From Paraphrasing to Semantic Parsing: Unsupervised Semantic Parsing via Synchronous Semantic Decoding (2021.acl-long)
Copied to clipboard
Shan Wu, Bo Chen, Chunlei Xin, Xianpei Han, Le Sun, Weipeng Zhang, Jiansong Chen, Fan Yang, Xunliang Cai
| Challenge: | Experimental results show that Synchronous Semantic Decoding (SSD) can achieve state-of-the-art unsupervised semantic parsing performance on multiple datasets. |
| Approach: | They propose an unsupervised method which solves the semantic gap and the structure gap by leveraging paraphrasing and grammar-constrained decoding. |
| Outcome: | The proposed method can solve the semantic gap and structure gap on multiple datasets. |
An Iterative Emotion Interaction Network for Emotion Recognition in Conversations (2020.coling-main)
Copied to clipboard
| Challenge: | Emotion recognition in conversations (ERC) is a task that aims to recognize the emotion of each utterance in conversations. |
| Approach: | They propose an iterative emotion interaction network which uses iterativly predicted emotion labels instead of gold emotion labels to explicitly model the emotion interaction. |
| Outcome: | The proposed method retains state-of-the-art performance on two datasets and achieves high accuracy. |
Aspect-based Sentiment Analysis in Question Answering Forums (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies on aspects-based sentiment analysis focus on a single opinionated sentence. |
| Approach: | They propose a model to combine aspects and their sentiments for QA forums . they use cross-sentence aspect-opinion interaction modeling to align the aspect mentioned in the question and associated opinion clues in the answer. |
| Outcome: | The proposed model outperforms baseline models on three real-world datasets. |
Once Upon a Time in Graph: Relative-Time Pretraining for Complex Temporal Reasoning (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing work focuses on strengthening the knowledge-time association between text and time-stamps, but this is insufficient for downstream tasks. |
| Approach: | They propose a model that explicitly connects all temporally-scoped facts by modeling the time relations between any two sentences. |
| Outcome: | The proposed model outperforms baseline T5 on multiple temporal question answering datasets . it is especially good at modeling long-range complex temporal dependencies, the authors say . |
AgentCPM-GUI: Building Mobile-Use Agents with Reinforcement Fine-Tuning (2025.emnlp-demos)
Copied to clipboard
Zhong Zhang, Yaxi Lu, Yikun Fu, Yupeng Huo, Shenzhi Yang, Yesai Wu, Han Si, Xin Cong, Haotian Chen, Yankai Lin, Xie Xie, Wei Zhou, Wang Xu, Zhou Su, Zhongwu Zhai, Xiaoming Liu, null Meiyudong, Jianming Xu, Hongyan Tian, Chongyi Wang, Chi Chen, Yuan Yao, Zhiyuan Liu, Maosong Sun
| Challenge: | Large language model agents have enabled GUI-based automation, but their deployment is limited by noisy data, poor generalization, and lack of support for non-English GUIs. |
| Approach: | They propose an 8B-parameter GUI agent built for robust and efficient on-device GUI interaction. |
| Outcome: | The proposed GUI agent achieves promising performance on five public benchmarks and proposed Chinese benchmark CAGUI. |
KG-Agent: An Efficient Autonomous Agent Framework for Complex Reasoning over Knowledge Graph (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods to design the interaction strategy between large language models and knowledge graphs (KGs) are not effective for large language model (LLM)s to solve complex tasks due to the large volume and structured format of KG data. |
| Approach: | They propose an LLM-based agent framework that enables small LLMs to actively make decisions over knowledge graphs. |
| Outcome: | The proposed framework outperforms existing methods on in-domain and out-domain datasets using 10K samples. |
Controllable Contrastive Generation for Multilingual Biomedical Entity Linking (2023.emnlp-main)
Copied to clipboard
| Challenge: | Multilingual biomedical entity linking (MBEL) aims to map language-specific mentions in biomedically text to standardized concepts in a multilingual knowledge base (KB). |
| Approach: | They propose a prompt-based controllable contrastive generation framework for MBEL which summarizes multidimensional information of the UMLS concept mentioned in biomedical text into a natural sentence following a predefined template. |
| Outcome: | The proposed framework matches against UMLS concepts in as many languages and types as possible, thus facilitating cross-information disambiguation. |
AgentGym: Evaluating and Training Large Language Model-based Agents across Diverse Environments (2025.acl-long)
Copied to clipboard
Zhiheng Xi, Yiwen Ding, Wenxiang Chen, Boyang Hong, Honglin Guo, Junzhe Wang, Xin Guo, Dingwen Yang, Chenyang Liao, Wei He, Songyang Gao, Lu Chen, Rui Zheng, Yicheng Zou, Tao Gui, Qi Zhang, Xipeng Qiu, Xuanjing Huang, Zuxuan Wu, Yu-Gang Jiang
| Challenge: | Large language models (LLMs) are promising foundations to build generally-capable agents . however, the community lacks a unified interactive framework that covers diverse environments for comprehensive evaluation of agents. |
| Approach: | They propose a framework that features 7 real-world scenarios, 14 environments, and 89 tasks for unified, real-time, and concurrent agent interaction. |
| Outcome: | The proposed framework features 7 real-world scenarios, 14 environments, and 89 tasks for unified, real-time, and concurrent agent interaction. |
RepoGenesis: Benchmarking End-to-End Microservice Generation from Readme to Repository (2026.acl-long)
Copied to clipboard
Zhiyuan Peng, Xin Yin, Pu Zhao, Fangkai Yang, Lu Wang, Ran Jia, Xu Chen, Qingwei Lin, Saravan Rajmohan, Dongmei Zhang
| Challenge: | Existing benchmarks focus on isolated function/class-level generation, neglecting complete microservice repository generation. |
| Approach: | They propose a multilingual benchmark for repository-level end-to-end web microservice generation that reflects real-world development workflows. |
| Outcome: | The benchmark compared 106 repositories across 18 domains and 11 frameworks and 1,258 API endpoints and 2,335 test cases. |
ORBIT: Cost-Effective Dataset Curation for Large Language Model Domain Adaptation with an Astronomy Case Study (2025.findings-acl)
Copied to clipboard
| Challenge: | General-purpose models lack depth for expert-level tasks because of limited domain-specific information. |
| Approach: | They propose a method for curating domain-specific datasets from noisy web sources to improve model performance. |
| Outcome: | The proposed model outperforms the baseline model on the astronomy benchmark and on the AstroBench. |
Reasoning-Enhanced Domain-Adaptive Pretraining of Multimodal Large Language Models for Short Video Content Governance (2025.emnlp-industry)
Copied to clipboard
Zixuan Wang, Yu Sun, Hongwei Wang, Baoyu Jing, Xiang Shen, Xin Dong, Zhuolin Hao, Hongyu Xiong, Yang Song
| Challenge: | Existing approaches to identifying inappropriate content require extensive human-labeled data and lack cross-issue generalization. |
| Approach: | They propose a reasoning-enhanced multimodal large language model (MLLM) pretraining paradigm for unified inappropriate content detection. |
| Outcome: | The proposed model improves the MLLM's performance in both zero-shot and supervised fine-tuning settings and shows strong generalization capabilities to emergent, previously unseen issues. |
DocAgent: A Multi-Agent System for Automated Code Documentation Generation (2025.acl-demo)
Copied to clipboard
| Challenge: | Existing methods for generating documentation using Large Language Models (LLMs) produce incomplete, unhelpful, or factually incorrect outputs. |
| Approach: | They propose a novel collaborative system that uses topological code processing for incremental context building to generate documentation by agents. |
| Outcome: | The proposed system outperforms baselines in completeness, helpfulness, and truthfulness evaluations. |
AutoConv: Automatically Generating Information-seeking Conversations with Large Language Models (2023.acl-short)
Copied to clipboard
Siheng Li, Cheng Yang, Yichun Yin, Xinyu Zhu, Zesen Cheng, Lifeng Shang, Xin Jiang, Qun Liu, Yujiu Yang
| Challenge: | Existing research on information-seeking conversations is stymied by the lack of training data. |
| Approach: | They propose to use autoconv for synthetic conversation generation to capture the characteristics of the information-seeking process and fine tune an LLM with a few human conversations to generate synthetic conversations with high quality. |
| Outcome: | The proposed model improves on two commonly-used datasets and alleviates the dependence on human annotation. |
Can Language Models Follow Multiple Turns of Entangled Instructions? (2025.findings-emnlp)
Copied to clipboard
Chi Han, Xin Liu, Haodong Wang, Shiyang Li, Jingfeng Yang, Haoming Jiang, Zhengyang Wang, Qingyu Yin, Liang Qiu, Changlong Yu, Yifan Gao, Zheng Li, Bing Yin, Jingbo Shang, Heng Ji
| Challenge: | Despite of significant achievements in improving instruction-following capabilities of large language models, the ability to process multiple potentially entangled or conflicting instructions remains a considerable challenge. |
| Approach: | They construct multi-turn instruction with 1.1K high-quality multi-turned conversations using the human-in-the-loop approach and examine their capabilities. |
| Outcome: | The proposed model shows that it is difficult to integrate multiple turns and balance competing objectives when instructions intersect or conflict. |
Beyond the Last Frame: Process-aware Evaluation for Generative Video Reasoning (2026.acl-long)
Copied to clipboard
| Challenge: | Existing evaluation frameworks often rely on single-frame assessments, which can lead to outcome-hacking. |
| Approach: | They propose a process-aware evaluation paradigm that uses a hierarchical rubric to evaluate the validity of the intermediate steps and the final result. |
| Outcome: | The proposed model achieves POC@1.0 only about 20% and exhibits significant outcome-hacking. |
Less is More: Improving LLM Reasoning with Minimal Test-Time Intervention (2026.acl-long)
Copied to clipboard
| Challenge: | Recent advances in large language models (LLMs) have focused on test-time scaling to improve reasoning quality but at the cost of efficiency. |
| Approach: | They propose a training-free framework that enhances reasoning accuracy and stability with minimal overhead. |
| Outcome: | The proposed framework yields consistent gains across general, coding, and STEM tasks while remaining highly efficient. |
Knowledge Graph Embedding by Adaptive Limit Scoring Loss Using Dynamic Weighting Strategy (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing knowledge graph embedding models use a loss framework to distinguish between correct and incorrect triplets. |
| Approach: | They propose a loss framework that reweights each triplet to highlight the less-optimized triplets. |
| Outcome: | The proposed method performs on several knowledge graph embedding models, including TransE, TransH and ComplEx. |
Video2Roleplay: A Multimodal Dataset and Framework for Video-Guided Role-playing Agents (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to RPAs focus on static role profiles, overlooking dynamic perceptual abilities inherent to humans. |
| Approach: | They propose a framework that combines adaptive temporal sampling with dynamic and static role profiles. |
| Outcome: | The proposed framework combines adaptive temporal sampling with dynamic and static role profiles. |
MASTER: Multi-Agent Security Through Exploration of Roles and Topological Structures - A Comprehensive Framework (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Large Language Models (LLMs)-based Multi-Agent Systems (MAS) exhibit remarkable problem-solving and task planning capabilities across diverse domains . |
| Approach: | They propose a security research framework for LLM-based multi-agent systems . they propose corresponding defense strategies to address MAS security risks . |
| Outcome: | The proposed framework amplifies the severity of security risks under MAS attacks . it offers an automated construction process for different MAS setups and an interaction paradigm . |
Accurate Word Alignment Induction from Neural Machine Translation (2020.emnlp-main)
Copied to clipboard
| Challenge: | Prior work suggests that Transformer captures poor word alignments through its attention mechanism. |
| Approach: | They propose two new word alignment induction methods that use attention weights to capture accurate word alignments. |
| Outcome: | The proposed methods outperform baselines on three publicly available datasets and are significantly better than GIZA++. |
Enhancing Neural Topic Model with Multi-Level Supervisions from Seed Words (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing topic seed words are difficult to incorporate into topic models due to the semantic diversity of natural language. |
| Approach: | They propose a neural topic model enhanced with supervisions from seed words on word and document levels. |
| Outcome: | The proposed model outperforms the state-of-the-art seeded topic models in terms of topic quality and classification accuracy. |
SeCuRepair: Semantics-Aligned, Curriculum-Driven, and Reasoning-Enhanced Vulnerability Repair Framework (2026.acl-long)
Copied to clipboard
Chengran Yang, Ting Zhang, Jinfeng Jiang, Xin Zhou, Haoye Tian, Mingzhe Du, Jieke Shi, Junkai Chen, Yikun Li, Eng Lieh Ouh, Lwin Khin Shar, David Lo
| Challenge: | Existing methods for automating vulnerability repair suffer from syntactic overfitting . nvd published 49,230 Common Vulnerabilities and Exposures (CVE) records in 2025 alone . |
| Approach: | They propose a semantic-aware reward framework that optimizes for code semantic equivalence rather than lexical mimicry. |
| Outcome: | The proposed framework outperforms state-of-the-art frameworks on repository-level splits . it incorporates expert-aligned reasoning mechanism that grounds patch generation in structured diagnosis. |
XY-Tokenizer: Mitigating the Semantic-Acoustic Conflict in Low-Bitrate Speech Codecs (2026.acl-long)
Copied to clipboard
Yitian Gong, Luozhijie Jin, Kuangwei Chen, Dong Zhang, Ruifan Deng, Xiaogui Yang, Xin Zhang, Zhaoye Fei, Qinyuan Cheng, Shimin Li, Xipeng Qiu
| Challenge: | Existing speech codecs struggle to balance these objectives at low bitrates . XY-Tokenizer achieves stronger semantic alignment than representative semantic-distillation codec . |
| Approach: | They propose a low-bitrate speech codec that aligns discrete speech representations with text while preserving fine-grained acoustic details for reconstruction. |
| Outcome: | The proposed codec outperforms existing low-bitrate speech codecs in speech understanding and generation tasks. |
Probing the Safety Robustness of LLMs in Latent Space (2026.acl-long)
Copied to clipboard
Tianle Gu, Kexin Huang, Zongqi Wang, Yixu Wang, Jie Li, Xin Wang, Yang Yao, Yujiu Yang, Yan Teng, Yingchun Wang
| Challenge: | Despite substantial progress in safety alignment techniques, aligned large language models can still produce unsafe responses under minor internal perturbations. |
| Approach: | They introduce Activation Steering Attack (ASA) and leverage the Negative Log-Likelihood (NLL) as a diagnostic signal to probe the local sensitivity of safety behaviors in latent space. |
| Outcome: | The proposed method is model-agnostic and supervision-free, enabling a general and reproducible diagnostic metric for analyzing safety robustness. |
MatPlotAgent: Method and Evaluation for LLM-Based Agentic Scientific Data Visualization (2024.findings-acl)
Copied to clipboard
Zhiyu Yang, Zihan Zhou, Shuo Wang, Xin Cong, Xu Han, Yukun Yan, Zhenghao Liu, Zhixing Tan, Pengyuan Liu, Dong Yu, Zhiyuan Liu, Xiaodong Shi, Maosong Sun
| Challenge: | Scientific data visualization is an essential process in research, but its use of large language models remains unexplored. |
| Approach: | They propose a model-agnostic LLM agent framework to automate scientific data visualization tasks. |
| Outcome: | The proposed framework improves performance of commercial and open-source models. |
T2IAT: Measuring Valence and Stereotypical Biases in Text-to-Image Generation (2023.findings-acl)
Copied to clipboard
| Challenge: | Recent advances in text-to-image generative models have produced high quality images with a breakthrough of inference speed. |
| Approach: | They propose a text-to-image association test framework that quantifies implicit stereotypes between concepts and valence and those in images. |
| Outcome: | The proposed framework quantifies implicit stereotypes between concepts and valence and those in images. |
MetaMem: Evolving Meta-Memory for Knowledge Utilization through Self-Reflective Symbolic Optimization (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing memory systems can support long-horizon human-LLM interactions by persisting historical interactions beyond limited context windows. |
| Approach: | They propose a framework that augments memory systems with a self-evolving meta-memory . meta-meso is iteratively distilling transferable knowledge utilization experiences . results show MetaMem outperforms strong baselines by over 3.6% . |
| Outcome: | The proposed framework outperforms baselines by over 3.6% in the long-horizon human-LLM interaction. |
Enhanced Language Representation with Label Knowledge for Span Extraction (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to extract text spans from plain text do not fully exploit label knowledge. |
| Approach: | They propose a model to integrate label knowledge into text representations by encoding texts and annotations independently and then integrating label knowledge with an elaborate-designed semantics fusion module. |
| Outcome: | The proposed model achieves state-of-the-art performance on four benchmarks and reduces training time and inference time by 76% and 77% on average compared with the existing paradigm. |
Diffusion Based Counterfactual Augmentation for Dual Sentiment Classification (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods to augment sentiment models have failed to mitigate spurious association problem inherent in the original data. |
| Approach: | They propose a framework for enhancing sentiment models using an antonymous paradigm and contrastive learning to generate high-quality samples. |
| Outcome: | The proposed framework achieves state-of-the-art performance on four benchmark datasets. |
Interpretable Research Replication Prediction via Variational Contextual Consistency Sentence Masking (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for predicting research replication are insufficient especially for long research papers. |
| Approach: | They propose to build an interpretable neural model which can provide sentence-level explanations and apply weakly supervised approach to leverage large corpus of unlabeled datasets. |
| Outcome: | The proposed model can provide sentence-level explanations and leverage large unlabeled datasets to boost interpretability and improve prediction performance. |
YuLan-Mini: Pushing the Limits of Open Data-efficient Language Model (2025.acl-long)
Copied to clipboard
Hu Yiwen, Huatong Song, Jie Chen, Jia Deng, Jiapeng Wang, Kun Zhou, Yutao Zhu, Jinhao Jiang, Zican Dong, Yang Lu, Xu Miao, Xin Zhao, Ji-Rong Wen
| Challenge: | prevailing pre-training approaches for large language models involve several complexities. |
| Approach: | They propose a low-cost training recipe and a robust optimization approach to mitigate training instability . they also propose synthesis, curriculum, and data selection pipelines to integrate data . |
| Outcome: | The proposed model achieves top-tier performance among models with similar parameter scale . it is comparable to industry-leading models that require significantly more data . |
Synonym-unaware Fast Adversarial Training against Textual Adversarial Attacks (2025.findings-naacl)
Copied to clipboard
| Challenge: | Existing adversarial defense methods rely on predetermined linguistic knowledge and assume that attackers’ synonym candidates are known, which is often unrealistic. |
| Approach: | They propose a Fast Adversarial Training method that leverages single-step perturbation generation and effective perturbation initialization to improve model robustness without requiring synonym awareness. |
| Outcome: | Experiments show that the proposed method outperforms existing models under character-level and word-level attacks while still maintaining the correct syntax. |
AgentOCR: Reimagining Agent History via Optical Self-Compression (2026.acl-long)
Copied to clipboard
| Challenge: | Recent advances in large language models (LLMs) have enabled agentic systems trained with reinforcement learning over multi-turn interaction, but practical deployment is bottlenecked by rapidly growing textual histories that inflate token and memory costs. |
| Approach: | They propose a framework that represents the accumulated observation-action history as a compact rendered image. |
| Outcome: | The proposed framework preserves over 95% of text-based agent performance while significantly reducing token consumption (>50%), yielding consistent token and memory efficiency. |
Demystifying Data Organization for Enhanced LLM Training (2026.acl-long)
Copied to clipboard
Yalun Dai, Yangyu Huang, Tongshen Yang, Yonghan Wang, Xin Zhang, Wenshan Wu, Qihao Zhao, Hao Li, Yuanyuan Gao, Kim-Hui Yap, Scarlett Li
| Challenge: | Large Language Models (LLMs) have revolutionized various fields, yet their training efficiency is heavily reliant on effective data curation. |
| Approach: | They propose to reuse pre-computed sample-level scores originally generated for data efficiency and introduce two new data ordering methods to improve LLM training. |
| Outcome: | The proposed methods improve the stability and performance of LLM training. |
AutoSchemaKG: Autonomous Knowledge Graph Construction through Dynamic Schema Induction from Web-Scale Corpora (2026.acl-long)
Copied to clipboard
Jiaxin Bai, Wei Fan, Qi Hu, Qing Zong, Chunyang Li, Hong Ting Tsang, Hongyu Luo, Yauwai Yim, Haoyu Huang, Xiao Zhou, Feng Qin, Tianshi Zheng, Xi Peng, Xin Yao, Huiwen Yang, Leijie Wu, JI Yi, Gong Zhang, Renhai Chen, Yangqiu Song
| Challenge: | Existing knowledge graph construction frameworks require predefined schemas, limiting their scalability and domain coverage. |
| Approach: | They propose a framework for fully autonomous knowledge graph construction that eliminates the need for predefined schemas. |
| Outcome: | The proposed framework outperforms state-of-the-art models on multi-hop QA tasks and enhances LLM factuality. |
SCAN: Structured Capability Assessment and Navigation for LLMs (2026.acl-long)
Copied to clipboard
| Challenge: | Existing research has focused on approximating model rankings, but such benchmarks fail to provide users and developers with a comprehensive and fine-grained understanding of a specific model’s capabilities. |
| Approach: | They propose a framework that enables detailed characterization of LLM capabilities through comprehensive and fine-grained evaluation. |
| Outcome: | The proposed framework enables detailed characterization of large language models through comprehensive and fine-grained evaluation. |
HyperPELT: Unified Parameter-Efficient Language Model Tuning for Both Language and Vision-and-Language Tasks (2023.findings-acl)
Copied to clipboard
| Challenge: | Pretraining and fine-tuning are the dominant paradigms in natural language processing. |
| Approach: | They propose a parameter-efficient multitask learning framework that takes trainable hyper-embeddings and visual modality as input and outputs weights for different modules in a pretrained language model. |
| Outcome: | The proposed framework adds fewer trainable parameters in multi-task learning while achieving superior performances and transfer ability compared to state-of-the-art methods. |
SeqAR: Jailbreak LLMs with Sequential Auto-Generated Characters (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing studies have focused on the potential misuse of large language models (LLMs) however, the ability to align LLMs with human values is still vulnerable to malicious attacks. |
| Approach: | They propose a red-teaming strategy to enhance LLM safety by using a framework to design jailbreak prompts automatically. |
| Outcome: | The proposed framework achieves attack success rates of 88% and 60% in cold-start scenarios. |
MASFactory: A Graph-centric Framework for Orchestrating LLM-Based Multi-Agent Systems with Vibe Graphing (2026.acl-demo)
Copied to clipboard
| Challenge: | Large language model-based multi-agent systems (MAS) are increasingly used to extend agentic problem solving via role specialization and collaboration. |
| Approach: | They propose a graph-centric framework for orchestrating large language model-based multi-agent systems . they compile a user's natural-language intent into an editable workflow specification and then into an executable graph . |
| Outcome: | The proposed framework compiles natural-language intent into an executable graph and then compile and executes it at runtime. |
IPS: In-Prompt Process Supervision for Short Video Content Moderation (2026.acl-industry)
Copied to clipboard
| Challenge: | Multimodal large language models (MLLMs) capture semantics of short video content but fail to account for policy-specific details. |
| Approach: | They propose a framework that integrates In-prompt Process Supervision into MLLMs . they propose sequential reasoning over ancillary questions during fine-tuning . |
| Outcome: | IPS outperforms baseline MLLMs on public and proprietary benchmarks . replacing human-annotated ancillary labels with MLML-generated ones results in performance degradation. |
LinkAlign: Scalable Schema Linking for Real-World Large-Scale Multi-Database Text-to-SQL (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing Text-to-SQL models fail to address schema linking problems in large-scale multi-database environments. |
| Approach: | They propose a framework that aims to enable non-expert users to retrieve data effortlessly . they highlight four core errors leading to schema linking failures . |
| Outcome: | The proposed framework outperforms baselines on all schema linking metrics. |
Not All Citations Are Equal:Entropy-Guided Citation Selection for Noise-Resistant Medical LLM (2026.findings-acl)
Copied to clipboard
| Challenge: | Large language models have demonstrated extensive potential in medical applications . however, their practical deployment in healthcare faces significant challenges . |
| Approach: | They propose a training-free multi-turn reasoning framework and a post-training methodology that provides external knowledge support for large language models. |
| Outcome: | The proposed framework elicits internal thought, external thought, and fusion thought, with an entropy-based reward that encourages selective citation of beneficial external knowledge while penalizing noisy citations. |
From Scaffolding to Assimilation: Progressive Structural Internalization for Format-Constrained Creative Text Generation (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing paradigms rely on unreliable prompting or rigid constrained decoding strategies to achieve aesthetic unity. |
| Approach: | They propose a framework to embed external constraints into the model’s intrinsic intuition and use it to generate open-ended creative texts. |
| Outcome: | The proposed framework surpasses baselines in both strict constraint adherence and literary aesthetics. |
EARA: Improving Biomedical Semantic Textual Similarity with Entity-Aligned Attention and Retrieval Augmentation (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods to measure semantic similarity between biomedical texts are inefficient due to too many biomedically-related entities. |
| Approach: | They propose an entity-aligned, attention-based and retrieval-augmented PLM that aligns the same type of fine-grained entity information in each sentence pair with an entity alignment matrix with an auxiliary loss. |
| Outcome: | The proposed model can achieve state-of-the-art on both in-domain and out-of domain datasets. |
Reasoning While Asking: Transforming Reasoning Large Language Models from Passive Solvers to Proactive Inquirers (2026.acl-long)
Copied to clipboard
| Challenge: | Existing reasoning-oriented LLMs lack a blind self-thinking paradigm . current models fail to recognize when their reasoning is underinformed or based on ambiguous user instructions . |
| Approach: | They propose a new reasoning paradigm that transforms LLMs into proactive inquirers that interleave reasoning with clarification. |
| Outcome: | The proposed model outperforms baseline models on mathematical reasoning, code generation, and document editing. |
Latent Part-of-Speech Sequences for Neural Machine Translation (D19-1)
Copied to clipboard
| Challenge: | Existing methods for learning target side syntactic structure are greedy and only allow them to explore a limited portion of the latent space. |
| Approach: | They propose a new latent variable model, LaSyn, that captures the co-dependence between syntax and semantics while allowing for effective inference over the latent space. |
| Outcome: | The proposed model captures the co-dependence between syntax and semantics while allowing for efficient inference over the latent space. |
From Generalist to Specialist: A Survey of Large Language Models for Chemistry (2025.coling-main)
Copied to clipboard
| Challenge: | Existing studies on pretraining of LLMs on extensive web-based texts are insufficient for advanced scientific discovery, especially in chemistry. |
| Approach: | They outline methodologies for incorporating domain-specific chemistry knowledge and multi-modal information into LLMs and conceptualize chemistry LLM agents using chemistry tools. |
| Outcome: | The proposed models are based on domain-specific chemistry knowledge and multi-modal information and are capable of accelerating scientific research. |
BFS-Prover: Scalable Best-First Tree Search for LLM-based Automatic Theorem Proving (2025.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to theorem proving in large language models rely on value functions and/or Monte Carlo Tree Search (MCTS), but the potential of simpler methods like Best-First Tree Search remains underexplored. |
| Approach: | They propose a scalable expert iteration framework that implements strategic data filtering at each expert iteration round, excluding problems solvable via beam search node expansion to focus on harder cases. |
| Outcome: | The proposed framework achieves a state-of-the-art score of 72.95 on the MiniF2F test set and challenges the perceived necessity of complex tree search methods. |
Read Anywhere Pointed: Layout-aware GUI Screen Reading with Tree-of-Lens Grounding (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing models for GUI understanding ignore a key GUI-referring task: screen reading based on user-indicated points. |
| Approach: | They propose a Tree-of-Lens agent that constructs a Hierarchical Layout Tree based on user input points and a GUI screenshot. |
| Outcome: | The proposed agent can interpret the Screen Point-and-Read task on mobile, web, and operating systems. |
MANBench: Is Your Multimodal Model Smarter than Human? (2025.findings-acl)
Copied to clipboard
| Challenge: | Multimodal Large Language Models (MLLMs) have been gaining popularity in multimodal tasks . a bilingual benchmark is available for MLLM users to evaluate their multimodal capabilities . |
| Approach: | They propose a bilingual multimodal ability norms benchmark that measures multimodality across nine tasks. |
| Outcome: | The proposed benchmark compared human performance against state-of-the-art MLLMs. |
Retrieved Sequence Augmentation for Protein Representation Learning (2024.emnlp-main)
Copied to clipboard
Chang Ma, Haiteng Zhao, Lin Zheng, Jiayi Xin, Qintong Li, Lijun Wu, Zhihong Deng, Yang Lu, Qi Liu, Sheng Wang, Lingpeng Kong
| Challenge: | Using multiple sequence alignments (MSA) to extract evolutionary knowledge is limited. |
| Approach: | They propose to use multiple sequence alignments to augment protein representations . they propose to employ Retrieved Sequence Augmentation to enhance protein representation learning . |
| Outcome: | The proposed method surpasses MSA Transformer by 5% in structural and property prediction tasks while being 373 times faster. |
Vision-Language Introspection: Mitigating Overconfident Hallucinations in MLLMs via Interpretable Bi-Causal Steering (2026.acl-long)
Copied to clipboard
Shuliang Liu, Songbo Yang, Dong Fang, Sihang Jia, Yuqi Tang, Lingfeng Su, Ruoshui Peng, Yibo Yan, Xin Zou, Xuming Hu
| Challenge: | Existing approaches to overcome object hallucination are limited . Existing mitigations include costly retraining and a training-free inference framework . |
| Approach: | They propose a training-free inference framework that simulates a metacognitive self-correction process. |
| Outcome: | The proposed framework reduces object hallucination rates by 12.67% on MMHal-Bench and improves accuracy by 5.8% on POPE. |
Teaching Your Models to Understand Code via Focal Preference Alignment (2025.emnlp-main)
Copied to clipboard
Jie Wu, Haoling Li, Xin Zhang, Xiao Liu, Yangyu Huang, Jianwen Luo, Yizhen Zhang, Zuchao Li, Ruihang Chu, Yujiu Yang, Scarlett Li
| Challenge: | Existing methods for supervised fine-tuning focus on unit test feedback to construct preference pairs. |
| Approach: | They propose a preference alignment framework that mimics human iterative debugging to refine Code LLMs. |
| Outcome: | Experiments show that Preference Learning improves on BigCodeBench and BigCodeBind tasks. |
Learning Hierarchy-Aware Quaternion Knowledge Graph Embeddings with Representing Relations as 3D Rotations (2022.coling-1)
Copied to clipboard
| Challenge: | Existing knowledge graph embedding models fail to model semantic hierarchies . Existing methods fail to understand the semantic hierarchies of knowledge graphs . |
| Approach: | They propose a model which embeds entities as pure quaternions and constrains the modulus of entities to make them have hierarchical distributions. |
| Outcome: | The proposed model can encode symmetry/antisymmetry, inversion, composition, multiple relation patterns and learn semantic hierarchies simultaneously. |
Are Gender-Neutral Queries Really Gender-Neutral? Mitigating Gender Bias in Image Search (2021.emnlp-main)
Copied to clipboard
| Challenge: | Extensive experiments on MS-COCO and Flickr30K benchmarks show that our methods significantly reduce the gender bias in image search models. |
| Approach: | They propose a fair sampling method and a feature clipping method to debias image search models. |
| Outcome: | The proposed methods significantly reduce gender bias in image search models on MS-COCO and Flickr30K benchmarks. |
MMLU-ProX: A Multilingual Benchmark for Advanced Large Language Model Evaluation (2025.emnlp-main)
Copied to clipboard
Weihao Xuan, Rui Yang, Heli Qi, Qingcheng Zeng, Yunze Xiao, Aosong Feng, Dairui Liu, Yun Xing, Junjue Wang, Fan Gao, Jinghui Lu, Yuang Jiang, Huitao Li, Xin Li, Kunyu Yu, Ruihai Dong, Shangding Gu, Yuekang Li, Xiaofei Xie, Felix Juefei-Xu, Foutse Khomh, Osamu Yoshie, Qingyu Chen, Douglas Teodoro, Nan Liu, Randy Goebel, Lei Ma, Edison Marrese-Taylor, Shijian Lu, Yusuke Iwasawa, Yutaka Matsuo, Irene Li
| Challenge: | Existing large language model evaluation benchmarks focus on English, while current multilingual tasks lack parallel questions that specifically assess cross-lingual reasoning abilities. |
| Approach: | They propose a comprehensive benchmark covering 29 languages, built on an English benchmark. |
| Outcome: | The MMLU-ProX is a comprehensive benchmark covering 29 languages, built on an English benchmark. |
Experiential Co-Learning of Software-Developing Agents (2024.acl-long)
Copied to clipboard
Chen Qian, Yufan Dang, Jiahao Li, Wei Liu, Zihao Xie, YiFei Wang, Weize Chen, Cheng Yang, Xin Cong, Xiaoyin Che, Zhiyuan Liu, Maosong Sun
| Challenge: | Recent advances in large language models (LLMs) have brought significant changes to various domains, especially through autonomous agents. |
| Approach: | They propose a framework that lets agents learn shortcuts from their past tasks and use them for future task execution. |
| Outcome: | The proposed framework enables agents to tackle unseen software-developing tasks more effectively. |
CTR-Guided Generative Query Suggestion in Conversational Search (2025.emnlp-industry)
Copied to clipboard
Erxue Min, Hsiu-Yuan Huang, Xihong Yang, Min Yang, Xin Jia, Yunfang Wu, Hengyi Cai, Junfeng Wang, Shuaiqiang Wang, Dawei Yin
| Challenge: | Generating effective query suggestions requires aligning model outputs with user click preferences. |
| Approach: | They propose a generative framework that leverages click modeling to denoise implicit feedback and enables reliable preference optimization for improving real-world user engagement. |
| Outcome: | The proposed framework outperforms strong baselines in CTR, relevance, diversity and diversity. |
Global Context or Local Detail? Adaptive Visual Grounding for Hallucination Mitigation (2026.findings-acl)
Copied to clipboard
Yubo Jiang, Xin Yang, Abudukelimu Wuerkaixi, Zheming Yuan, Xuxin Cheng, Cao Liu, Ke Zeng, Fengying Xie, Zhiguo Jiang, Haopeng Zhang
| Challenge: | Large vision–language models suffer from object-existence hallucinations when multi-step deliberation decouples from visual evidence. |
| Approach: | They propose a framework that allocates visual computation by uncertainty . they propose highlighting retains global context, while selective zoom-in performs local verification. |
| Outcome: | The proposed framework reduces the complexity of multimodal reasoning by minimizing the operator trade-off. |
EcomScriptBench: A Multi-task Benchmark for E-commerce Script Planning via Step-wise Intention-Driven Product Association (2025.acl-long)
Copied to clipboard
Weiqi Wang, Limeng Cui, Xin Liu, Sreyashi Nag, Wenju Xu, Chen Luo, Sheikh Muhammad Sarwar, Yang Li, Hansu Gu, Hui Liu, Changlong Yu, Jiaxin Bai, Yifan Gao, Haiyang Zhang, Qi He, Shuiwang Ji, Yangqiu Song
| Challenge: | Goal-oriented script planning is used by humans to plan for typical activities . however, this capability remains underexplored due to several challenges . |
| Approach: | They propose a framework that enables product-enriched scripts by associating products with each step based on the semantic similarity between the actions and their purchase intentions. |
| Outcome: | The proposed framework can generate product-enriched scripts from 2.4 million scripts . human annotations are conducted to provide gold labels for a sampled subset . |
When 20 Agents Fail to Sort: The Distributed Sorting Benchmark for Scalable Multi-Agent Systems (2026.findings-acl)
Copied to clipboard
| Challenge: | MAS-BENCH isolates coordination under explicit communication constraints . CAMOC significantly improves coordination success and efficiency across backends . |
| Approach: | They propose a distributed-sorting benchmark that isolates coordination under explicit communication constraints. |
| Outcome: | MAS-BENCH improves coordination success and efficiency across backends . CAMOC significantly improves efficiency under shared-state interaction . |
HyperFM: Fact-Centric Multimodal Fusion for Link Prediction over Hyper-Relational Knowledge Graphs (2025.acl-long)
Copied to clipboard
| Challenge: | Existing link prediction techniques focus on learning the complex relationships between entities and relations while ignoring the multimodal information. |
| Approach: | They propose a fact-centric fusion technique that captures complex interactions between different data modalities while accommodating the hyper-relational structure of the KG in a facts-centric manner. |
| Outcome: | The proposed technique improves on two real-world KG datasets by 6.0-6.8% over baselines. |
Code to Think, Think to Code: A Survey on Code-Enhanced Reasoning and Reasoning-Driven Code Intelligence in LLMs (2025.emnlp-main)
Copied to clipboard
Dayu Yang, Tianyang Liu, Daoan Zhang, Antoine Simoulin, Xiaoyi Liu, Yuwei Cao, Zhaopu Teng, Xin Qian, Grey Yang, Jiebo Luo, Julian McAuley
| Challenge: | Recent breakthrough models like OpenAI-o1 and DeepSeek-R1 show powerful task-solving capabilities, particularly advances in reasoning. |
| Approach: | They propose future research directions that may deepen the synergy, ultimately advancing LLM performance in both complex reasoning and code intelligence. |
| Outcome: | The proposed research may deepen the synergy, ultimately advancing LLM performance in both complex reasoning and code intelligence. |
SeaLLMs - Large Language Models for Southeast Asia (2024.acl-demos)
Copied to clipboard
Xuan-Phi Nguyen, Wenxuan Zhang, Xin Li, Mahani Aljunied, Zhiqiang Hu, Chenhui Shen, Yew Ken Chia, Xingxuan Li, Jianyu Wang, Qingyu Tan, Liying Cheng, Guanzheng Chen, Yue Deng, Sen Yang, Chaoqun Liu, Hang Zhang, Lidong Bing
| Challenge: | Existing large language models favor high-resource languages, such as English, at the expense of low-resourced and regional languages. |
| Approach: | They propose a series of language models that specifically focuses on Southeast Asian languages. |
| Outcome: | SeaLLM models outperform ChatGPT-3.5 in non-Latin languages by large margins . linguistic disparity impedes access to state-of-the-art AI technologies for non-English-speaking populations . |
Towards Generative Aspect-Based Sentiment Analysis (2021.acl-short)
Copied to clipboard
| Challenge: | Existing work on Aspect-based sentiment analysis ignores the rich label semantics of ABSA. |
| Approach: | They propose to tackle various ABSA tasks in a unified generative framework . they propose to use annotation-style and extraction-style modeling to enable training . |
| Outcome: | The proposed framework achieves state-of-the-art on four ABSA tasks across multiple benchmark datasets. |
Transferable End-to-End Aspect-based Sentiment Analysis with Selective Adversarial Learning (D19-1)
Copied to clipboard
| Challenge: | Existing methods to extract aspects and sentiments are limited due to lack of annotated sequence data. |
| Approach: | They propose a Selective Adversarial Learning method to align latent correlation vectors . they propose tagging a set of aspect boundary tags and sentiment tags to create a joint label space . |
| Outcome: | The proposed method can learn weights for words to achieve fine-grained adaptation. |
Combating Label Sparsity in Short Text Topic Modeling via Nearest Neighbor Augmentation (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing topic models suffer from poor performance when applied to short text contents due to the limited length of a single topic. |
| Approach: | They propose a neural short text topic model that augments reconstruction labels with k-nearest documents to complement relevant but unobserved words. |
| Outcome: | The proposed model outperforms the state-of-the-art models on multiple public short-text datasets and can derive high-quality topics and document representations. |
DecoupledESC: Enhancing Emotional Support Generation via Strategy-Response Decoupled Preference Optimization (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing ESC data entangles psychological strategies and response content, making it difficult to construct high-quality preference pairs. |
| Approach: | They propose a Decoupled ESC framework that decomposes the ESC task into two sequential subtasks: strategy planning and empathic response generation. |
| Outcome: | The proposed framework outperforms baselines, reducing preference bias and improving response quality. |
Personalized Question Answering with User Profile Generation and Compression (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models are prone to providing “midguy” answers regardless of users’ knowledge background, thereby failing to meet each user’s personalized needs. |
| Approach: | They propose to generate personalized answers with LLMs based on users’ past question-answering records. |
| Outcome: | The proposed method generates personalized answers based on user's past question-answering records. |
Jailbreaking Attacks vs. Content Safety Filters: How Far Are We in the LLM Safety Arms Race? (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing studies have focused on the models, neglecting the full deployment pipeline . previous studies have underestimated the practical success of these attacks . |
| Approach: | They evaluate the effectiveness of jailbreak attacks targeting LLM safety alignment . they highlight critical gaps and call for further refinement of detection accuracy and usability . |
| Outcome: | The proposed attacks can detect at least one safety filter across the entire deployment pipeline. |
Optimizing NLU Reranking Using Entity Resolution Signals in Multi-domain Dialog Systems (2021.naacl-industry)
Copied to clipboard
Tong Wang, Jiangning Chen, Mohsen Malmir, Shuyan Dong, Xin He, Han Wang, Chengwei Su, Yue Liu, Yang Liu
| Challenge: | In dialog systems, the Natural Language Understanding component makes the interpretation decision before the mentioned entities are resolved. |
| Approach: | They propose to leverage Entity Resolution (ER) features in NLU reranking to learn model weights . they propose a score distribution matching method to ensure the models are calibrated . |
| Outcome: | The proposed approach outperforms the baseline model on multiple domain evaluations. |
Socratic Style Chain-of-Thoughts Help LLMs to be a Better Reasoner (2025.findings-acl)
Copied to clipboard
| Challenge: | Synthetic data generation is a promising approach to enhance reasoning capabilities of large language models. |
| Approach: | They propose a multi-agent debate framework based on the Socratic questioning strategy . they use socratic questions to deepen the thinking process and broaden it to motivate self-reflection . |
| Outcome: | The proposed framework outperforms existing methods on math and code generation tasks while maintaining affordable costs. |
PeerDA: Data Augmentation via Modeling Peer Relation for Span Identification Tasks (2023.acl-long)
Copied to clipboard
| Challenge: | Experimental results on ten datasets across seven domains demonstrate the effectiveness of PeerDA. |
| Approach: | They propose a new approach which uses span pairs with the PR relation as the augmentation data for training. |
| Outcome: | The proposed approach achieves state-of-the-art results on ten datasets across seven domains. |
Aligning Agents via Planning: A Benchmark for Trajectory-Level Reward Modeling (2026.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) evolve into agentic systems capable of autonomous tool invocation and complex reasoning. |
| Approach: | They propose a trajectory-level preference benchmark to evaluate judges' ability to distinguish preferred versus distractor agent trajectories in tool-integrated environments. |
| Outcome: | The proposed benchmark evaluates how well judges distinguish preferred versus distractor agent trajectories in complex tool-using scenarios. |
CAME: Confidence-guided Adaptive Memory Efficient Optimization (2023.acl-long)
Copied to clipboard
| Challenge: | Existing memory-efficient methods require second-moment estimates of the per-parameter gradients to maintain their performance. |
| Approach: | They propose to use memory-efficient optimizers to reduce memory usage by preserving second-moment estimates of gradients. |
| Outcome: | The proposed method achieves fast convergence and lower memory usage across training tasks. |
Mapping Natural Language Instructions to Mobile UI Action Sequences (2020.acl-main)
Copied to clipboard
| Challenge: | a new problem of grounding natural language instructions to mobile UI actions is emerging . we use a Transformer to extract action phrase tuples from long-range natural language instruction . |
| Approach: | They propose a dataset that pairs English instructions with actions performed by people on a mobile UI emulator. |
| Outcome: | The proposed model achieves 70.59% accuracy on predicting complete ground-truth action sequences in PixelHelp. |
LogicPoison: Logical Attacks on Graph Retrieval-Augmented Generation (2026.acl-long)
Copied to clipboard
Yilin Xiao, Jin Chen, Qinggang Zhang, Yujing Zhang, Chuang Zhou, Longhao Yang, Lingfei Ren, Xin Yang, Xiao Huang
| Challenge: | Graph-based Retrieval-Augmented Generation (GraphRAG) enhances the reasoning capabilities of Large Language Models (LLMs) however, traditional RAG attacks are difficult to pose an effective threat to GraphRAg systems. |
| Approach: | They propose a novel attack framework that targets logical reasoning rather than injecting false contents into GraphRAG systems by grounding their responses in structured knowledge graphs. |
| Outcome: | The proposed framework outperforms state-of-the-art attacks on GraphRAG systems in both effectiveness and stealth. |
Neuro-Symbolic Integration Brings Causal and Reliable Reasoning Proofs (2025.findings-naacl)
Copied to clipboard
| Challenge: | a new framework for complex reasoning with LLMs is developed to improve reasoning proof accuracy and interpretability. |
| Approach: | They propose to use LLMs to generate search logs that can be interpreted into human-readable reasoning proofs. |
| Outcome: | The proposed framework improves reasoning accuracy but lacks interpretability due to black-box nature of the solvers. |
OAgents: An Empirical Study of Building Effective Agents (2025.findings-emnlp)
Copied to clipboard
He Zhu, Tianrui Qin, King Zhu, Heyuan Huang, Yeyi Guan, Jinxiang Xia, Hanhao Li, Yi Yao, Ningning Wang, Pai Liu, Tianhao Peng, Xin Gui, Li Xiaowan, Yuhui Liu, Xiangru Tang, Jian Yang, Ge Zhang, Xitong Gao, Yuchen Eleanor Jiang, Changwang Zhang, Jun Wang, Jiaheng Liu, Wangchunshu Zhou
| Challenge: | a recent study shows that agent research practices are far from standard, rigorous . lack of a standard evaluation protocol makes previous works not reproducible, authors say . |
| Approach: | They conduct an empirical study on the GAIA benchmark to investigate agent design choices . they find that lack of a standard evaluation protocol makes previous works not reproducible . |
| Outcome: | The proposed framework achieves state-of-the-art performance among open-source projects. |
SAFE-QAQ: End-to-End Slow-Thinking Audio-Text Fraud Detection via Reinforcement Learning (2026.acl-long)
Copied to clipboard
Peidong Wang, Zhiming Ma, Xin Dai, YongKang Liu, Shi Feng, Xiaocui Yang, Wenxing Hu, Zhihao Wang, Mingjun Pan, Li Yuan, Daling Wang
| Challenge: | Existing methods for fraud detection rely on transcribed text, lacking acoustic cues . a proposed framework for audio-based slow-thinking fraud detection eliminates transcription errors . |
| Approach: | They propose a framework for audio-based slow-thinking fraud detection that eliminates transcription errors and rewards slow-thought reasoning by capturing fine-grained audio details. |
| Outcome: | The proposed method improves accuracy, inference efficiency, and real-time processing capabilities. |
FinEval: A Chinese Financial Domain Knowledge Evaluation Benchmark for Large Language Models (2025.naacl-long)
Copied to clipboard
Xin Guo, Haotian Xia, Zhaowei Liu, Hanyang Cao, Zhi Yang, Zhiqiang Liu, Sizhe Wang, Jinyi Niu, Chuqi Wang, Yanhui Wang, Xiaolong Liang, Xiaoming Huang, Bing Zhu, Zhongyu Wei, Yun Chen, Weining Shen, Liwen Zhang
| Challenge: | Large language models have demonstrated outstanding performance in various natural language processing tasks, but their security capabilities in the financial domain have not been explored. |
| Approach: | They propose to use a benchmark to evaluate large language models' financial domain knowledge and practical abilities. |
| Outcome: | The proposed benchmark evaluates large language models' financial domain knowledge and practical abilities. |
NewsDialogues: Towards Proactive News Grounded Conversation (2023.findings-acl)
Copied to clipboard
Siheng Li, Yichun Yin, Cheng Yang, Wangjie Jiang, Yiwei Li, Zesen Cheng, Lifeng Shang, Xin Jiang, Qun Liu, Yujiu Yang
| Challenge: | Hot news is one of the most popular topics in daily conversations. |
| Approach: | They propose a task where a dialogue system can lead the conversation based on key topics of the news. |
| Outcome: | The proposed method can lead conversations based on key topics of the news . it can also be used in information-seeking and chit-chat scenarios . |
Watermarking with Low-Entropy POS-Guided Token Partitioning and Z-Score-Driven Dynamic Bias for Large Language Models (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing watermarking methods reduce the fidelity of semantics in LLMs . |
| Approach: | They propose a low-entropy token partitioning mechanism and z-score-driven dynamic bias mechanism to enhance semantics. |
| Outcome: | The proposed framework improves semantic fidelity and robustness against bias sparsity attacks. |
Leveraging Capsule Routing to Associate Knowledge with Medical Literature Hierarchically (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to integrate knowledge into text can confuse the representation and import unexpected noises. |
| Approach: | They propose to leverage capsule routing to associate knowledge with medical literature hierarchically . they extract two fragments from medical literature and encode them into fragment representations . |
| Outcome: | The proposed method can more accurately associate knowledge with medical literature than mainstream methods. |
SessionIntentBench: A Multi-task Inter-session Intention-shift Modeling Benchmark for E-commerce Customer Behavior Understanding (2026.findings-acl)
Copied to clipboard
Yuqi Yang, Weiqi Wang, Baixuan Xu, Wei Fan, Qing Zong, Chunkit Chan, Zheye Deng, Xin Liu, Yifan Gao, Changlong Yu, Chen Luo, Yang Li, Zheng Li, Qingyu Yin, Bing Yin, Yangqiu Song
| Challenge: | Existing models fail to capture and model customer intention effectively because of insufficient information exploitation and only apparent information like descriptions and titles are used. |
| Approach: | They propose to exploit existing session data to capture and model intention in E-commerce product purchase sessions using a multimodal benchmark. |
| Outcome: | The proposed framework can bridge the gap between intention understanding in simplified research cases like co-buy intention and more complex yet practical scenarios like session history. |
Whether LLMs Know If They Know: Identifying Knowledge Boundaries via Debiased Historical In-Context Learning (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for active retrieval (AR) rely on training classification models or using the confidence of the model’s answer to determine knowledge boundaries. |
| Approach: | They propose a method to identify knowledge boundaries in active retrieval by retrieving historical queries as high-confidence in-context examples. |
| Outcome: | Experiments on four QA benchmarks show that DH-ICL achieves performance comparable to full retrieval on LLaMA with only half the number of retrievals, without any additional training. |
BaseCal: Unsupervised Confidence Calibration via Base Model Signals (2026.acl-long)
Copied to clipboard
Hexiang Tan, Wanli Yang, Junwei Zhang, Xin Chen, Rui Tang, Du Su, Jingang Wang, Yuanzhuo Wang, Fei Sun, Xueqi Cheng
| Challenge: | Post-trained LLMs typically compromise reliability with severe overconfidence, resulting in inaccurate responses. |
| Approach: | They propose a solution that feeds PoLLMs into the base LLM to get confidence. |
| Outcome: | The proposed solution reduces expected calibration error (ECE) by 42.90% compared to the best unsupervised baselines. |
SeaEval for Multilingual Foundation Models: From Cross-Lingual Alignment to Cultural Reasoning (2024.naacl-long)
Copied to clipboard
| Challenge: | a new benchmark for multilingual foundation models is being developed . brittleness of foundation models in the dimensions of semantics and multilinguality is a key limitation . |
| Approach: | They propose a benchmark for multilingual foundation models, SeaEval . they examine how well these models comprehend cultural practices, nuances, and values . |
| Outcome: | The proposed model can be used to evaluate multilingual and multicultural scenarios. |
Aspect Sentiment Quad Prediction as Paraphrase Generation (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies focus on predicting the four elements in one shot, instead of predicting them all. |
| Approach: | They propose a task to jointly detect all sentiment elements in quads for a given opinionated sentence. |
| Outcome: | The proposed method can generate the semantics of the sentiment elements in the natural language form. |
MGCL: Multi-Granularity Clue Learning for Emotion-Cause Pair Extraction via Cross-Grained Knowledge Distillation (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Traditional methods often rely on coarse-grained clause-level annotations, which overlook valuable fine-grain clues. |
| Approach: | They propose a method that captures fine-grained clues from a weakly-supervised perspective efficiently by using a teacher model to give sub-clause clues without needing fine-grain annotations. |
| Outcome: | The proposed method achieves state-of-the-art performance while offering improved interpretability. |
CDAˆ2: Counterfactual Diffusion Augmentation for Cross-Domain Adaptation in Low-Resource Sentiment Analysis (2025.coling-main)
Copied to clipboard
| Challenge: | Domain adaptation is widely employed in cross-domain sentiment analysis, but concerns have been raised regarding their robustness and sensitivity to data distribution shift. |
| Approach: | They propose a framework CDA2 for cross-domain adaptation in low-resource sentiment analysis which employs counterfactual diffusion augmentation. |
| Outcome: | The proposed framework generates high-quality counterfactual target samples and achieves state-of-the-art performance on benchmark datasets. |
The BQ Corpus: A Large-scale Domain-specific Chinese Corpus For Sentence Semantic Equivalence Identification (D18-1)
Copied to clipboard
| Challenge: | Bank Question corpus is a corpus for sentence semantic equivalence identification (SSEI) because of rich expressions in natural languages, SSEI is really a challenging task. |
| Approach: | They propose to cluster 120,000 question pairs from 1-year online bank custom service logs into stacks by the Word Mover’s Distance (WMD) based Affinity Propagation algorithm to achieve questions with the same intent. |
| Outcome: | The proposed method achieves questions with the same intent by clustering deduplicated questions into stacks by the Word Mover’s Distance (WMD) based Affinity Propagation (AP) algorithm. |
Voice Query Auto Completion (2021.emnlp-main)
Copied to clipboard
Raphael Tang, Karun Kumar, Kendra Chalkley, Ji Xin, Liming Zhang, Wenyan Li, Gefei Yang, Yajie Mao, Junho Shin, Geoffrey Craig Murray, Jimmy Lin
| Challenge: | Existing methods fail to complete voice queries from incomplete prefixes because they use orthographic prefix and substrings instead of the true phonetic prefix. |
| Approach: | They propose to condition QAC approaches on intermediate transcriptions to complete voice queries. |
| Outcome: | The proposed method obtains an 18% relative improvement over previous methods on a speech-enabled smart television with real-life voice search traffic. |
BatonVoice: An Operationalist Framework for Enhancing Controllable Speech Synthesis with Linguistic Intelligence from LLMs (2026.acl-long)
Copied to clipboard
Yue Wang, Ruotian Ma, Xingyu Chen, Zhengliang Shi, Morunliu Yang, Wanshun Chen, Huang Liu, Jiadi Yao, Xin He, Qu Yang, Qingxuan Jiang, Fanghua Ye, Juntao Li, Zhaopeng Tu, Xiaolong Li, Liefeng Bo, Min Zhang
| Challenge: | Existing approaches often fail to leverage the linguistic intelligence of Large Language Models (LLMs) Existing models lack the ability to follow text instructions for controllable Text-to-Speech (TTS). |
| Approach: | They propose a framework where an LLM acts as a conductor, understanding user instructions and generating a textual plan - explicit vocal features. |
| Outcome: | The proposed model outperforms open- and closed-source models in speech synthesis and achieves zero-shot cross-lingual generalization. |
Ambiguous Learning from Retrieval: Towards Zero-shot Semantic Parsing (2023.acl-long)
Copied to clipboard
Shan Wu, Chunlei Xin, Hongyu Lin, Xianpei Han, Cao Liu, Jiansong Chen, Fan Yang, Guanglu Wan, Le Sun
| Challenge: | Existing neural semantic parsers require a large amount of training data which is expensive and difficult to obtain. |
| Approach: | They propose a framework for a supervised retrieval system based on pretrained language models . they propose ambiguous supervision to improve the precision and coverage of the task . |
| Outcome: | The proposed approach outperforms state-of-the-art zero-shot parsing methods in ambiguous supervision. |
Unleashing Low-Bit Inference on Ascend NPUs: A Comprehensive Evaluation of HiFloat Formats (2026.acl-industry)
Copied to clipboard
Pengxiang Zhao, Hui-Ling Zhen, Xing Li, Han Bao, Weizhe Lin, Zhiyuan Yang, Yu Zi Wei, Xin Wang, Mingxuan Yuan, Xianzhi Yu, Zhenhua Dong
| Challenge: | Low-bit floating-point formats like MXFP and NVFP4 offer new opportunities for precision and efficiency. |
| Approach: | They evaluate HiFloat (HiF8 and HiF4), a family of floating-point formats tailored for Ascend NPUs. |
| Outcome: | The proposed formats excel with high-variance data and are compatible with state-of-the-art quantization frameworks. |
Enhancing Open-Domain Task-Solving Capability of LLMs via Autonomous Tool Integration from GitHub (2025.acl-long)
Copied to clipboard
Bohan Lyu, Xin Cong, Heyang Yu, Pan Yang, Cheng Qian, Zihe Wang, Yujia Qin, Yining Ye, Yaxi Lu, Chen Qian, Zhong Zhang, Yukun Yan, Yankai Lin, Zhiyuan Liu, Maosong Sun
| Challenge: | Existing approaches lack flexibility to address diverse and ever-evolving user queries in open domains. |
| Approach: | They propose to evaluate LLMs on open-domain knowledge that requires tools to solve diverse and ever-evolving user queries. |
| Outcome: | The proposed system outperforms baselines in the open domain task-solving benchmark. |
ElitePLM: An Empirical Study on General Language Ability Evaluation of Pretrained Language Models (2022.naacl-main)
Copied to clipboard
Junyi Li, Tianyi Tang, Zheng Gong, Lixin Yang, Zhuohao Yu, Zhipeng Chen, Jingyuan Wang, Xin Zhao, Ji-Rong Wen
| Challenge: | Recent years have featured a trend towards Transformer based pretrained language models (PLMs) in natural language processing systems. |
| Approach: | They propose to use four evaluation dimensions to evaluate ten widely-used PLMs . they find that pretrained language models are good at different ability tests . |
| Outcome: | The results show that pretrained language models are good at different ability tests and have excellent transferability between tasks. |
SecureVibeBench: Benchmarking Secure Vibe Coding of AI Agents via Reconstructing Vulnerability-Introducing Scenarios (2026.acl-long)
Copied to clipboard
Junkai Chen, Huihui Huang, Yunbo Lyu, Junwen An, Jieke Shi, Chengran Yang, Ting Zhang, Haoye Tian, Yikun Li, Zhenhao Li, Xin Zhou, Xing Hu, David Lo
| Challenge: | Existing benchmarks fail to capture scenarios in which vulnerabilities are introduced by humans . we evaluate 5 popular code agents supported by 5 LLMs on SecureVibeBench . |
| Approach: | They propose a benchmarking tool that compares 105 C/C++ secure coding tasks . they use real-world open-source vulnerabilities and a comprehensive evaluation tool . |
| Outcome: | The proposed benchmarks show that code agents struggle to produce correct and secure code . the best performing agent produces merely 23.8% correct and secured solutions . |
LANG: Reinforcement Learning for Multilingual Reasoning with Language-Adaptive Hint Guidance (2026.acl-long)
Copied to clipboard
Yuchun Fan, Bei Li, Peiguang Li, Yilin Wang, Yongyu Mu, Jian Yang, Xin Chen, Rongxiang Weng, Jingang Wang, Xunliang Cai, JingBo Zhu, Tong Xiao
| Challenge: | Existing methods for enhancing multi-step reasoning have not fully translated to multilingual contexts. |
| Approach: | They propose a framework that leverages language-conditioned hints to guide exploration in non-English reasoning tasks. |
| Outcome: | Empirical results show that the proposed framework improves reasoning performance without compromising language consistency. |
An Adaptive Logical Rule Embedding Model for Inductive Reasoning over Temporal Knowledge Graphs (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for temporal knowledge graphs (TKGs) are incomplete and therefore lack interpretability. |
| Approach: | They propose an interpretable temporal knowledge graph reasoning model that captures deep causal logic by learning rule embeddings. |
| Outcome: | The proposed model outperforms state-of-the-art models on the ICEWS14, ICEW0515 and ICEw18 datasets. |