Papers by Kun Li

111 papers
Pierce the Mists, Greet the Sky: Decipher Knowledge Overshadowing via Knowledge Circuit Analysis (2025.emnlp-main)

Copied to clipboard

Challenge: Large Language Models (LLMs) are hampered by hallucinations, a particularly challenging variant, knowledge overshadowing, which can lead to erroneous outputs even with high-quality training data.
Approach: They propose a framework to analyze and detect knowledge overshadowing by using knowledge circuit analysis to dissect the function of key components in the circuit and how attention pattern dynamics contribute to the phenomenon.
Outcome: Extensive experiments show that the framework can detect and analyze knowledge overshadowing and improves on existing models.
HATA: Trainable and Hardware-Efficient Hash-Aware Top-k Attention for Scalable Large Model Inference (2025.findings-acl)

Copied to clipboard

Challenge: Existing top-k attention methods struggle to strike a balance between efficiency and accuracy.
Approach: They propose a top-k attention approach that integrates low-overhead techniques into the Top-k Attention process to achieve 7.2 speedup compared to vanilla full attention.
Outcome: The proposed approach achieves 7.2 speedup compared to current top-k attention methods while maintaining model accuracy.
Text Embedding as Treatment: A Meta Causal Approach for Robust Sentiment Classification (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods for sentiment classification use binary treatment of words . Existing approaches limit generalizability to novel words and low-frequency words if there is a word in a sentence that is not treated .
Approach: They propose a meta-causal approach that uses a single training task to identify causal words for arbitrary words.
Outcome: The proposed method reduces the spurious correlation between word treatment and sentiment classification by removing words with low treatment effects from a pre-trained language model.
Semantics of the Unwritten: The Effect of End of Paragraph and Sequence Tokens on Text Generation with GPT2 (2021.acl-srw)

Copied to clipboard

Challenge: Experimental results show that pre-trained language model GPT2 can generate better continuations by learning to generate the in the fine-tuning stage.
Approach: They conduct experiments on an English essay dataset using Chinese-GPT2 . they find that the model can generate better continuations by learning to generate the in the fine-tuning stage.
Outcome: The pre-trained language model GPT2 can generate better continuations by learning to generate the in the fine-tuning stage.
MAKAR: a Multi-Agent framework based Knowledge-Augmented Reasoning for Grounded Multimodal Named Entity Recognition (2025.emnlp-main)

Copied to clipboard

Challenge: Existing methods for GMNER fail to address semantic ambiguity caused by polysemy and long-tail distribution of datasets.
Approach: They propose a framework for Grounded Multimodal Named Entity Recognition that leverages a Multimodal Large Language Model to address semantic ambiguity.
Outcome: Extensive experiments show that the proposed framework outperforms existing methods on two benchmark datasets.
Dependency Parsing as MRC-based Span-Span Prediction (2022.acl-long)

Copied to clipboard

Challenge: Existing methods for dependency parsing address the issue that edges should be constructed at the text span/subtree level rather than word level.
Approach: They propose a method that constructs dependency trees by directly modeling span-span relations by modeling subtree-subtree relationships.
Outcome: The proposed method constructs dependency trees by modeling span-span relations . it can retrieve missing spans in the span proposal stage, which leads to higher recall .
TexSmart: A System for Enhanced Natural Language Understanding (2021.acl-demo)

Copied to clipboard

Challenge: TexSmart supports fine-grained named entity recognition (NER) Large-scale fine-granular entity types are expected to provide richer semantic information for downstream NLP applications.
Approach: They introduce TexSmart, a text understanding system that supports fine-grained named entity recognition (NER) and enhanced semantic analysis functionalities.
Outcome: The proposed system supports fine-grained named entity recognition (NER) and enhanced semantic analysis functions.
Diffusion-NAT: Self-Prompting Discrete Diffusion for Non-Autoregressive Text Generation (2024.eacl-long)

Copied to clipboard

Challenge: Existing non-autoregressive (NAR) text-to-text generation methods are unable to generate coherent and fluent texts due to discrete nature of text.
Approach: They propose to integrate discrete diffusion models (DDM) into NAR text-to-text generation and integrate BART to improve the performance.
Outcome: The proposed method outperforms competing methods and surpasses autoregressive methods on 7 datasets.
A Prism Module for Semantic Disentanglement in Name Entity Recognition (P19-1)

Copied to clipboard

Challenge: Xu et al., 2015) proposed a noise reduction mechanism to disentangle semantics of words . hard and soft attention mechanisms are used to reduce noise in NLP tasks .
Approach: They propose a prism module to disentangle semantic aspects of words and reduce noise . they propose combining prism modules with downstream models to improve model performance .
Outcome: The proposed method significantly improves the performance of baselines on named entity recognition (NER) tasks.
Evaluating Object Hallucination in Large Vision-Language Models (2023.emnlp-main)

Copied to clipboard

Challenge: Large vision-language models (LVLMs) suffer from object hallucinations, i.e., they tend to generate objects inconsistent with the target images in the descriptions.
Approach: They propose to integrate powerful large vision-language models (LVLMs) they propose a polling-based query method to evaluate object hallucination .
Outcome: The proposed model can evaluate object hallucination in a more stable and flexible way.
CommonLID: Re-evaluating State-of-the-Art Language Identification Performance on Web Data (2026.acl-long)

Copied to clipboard

Pedro Ortiz Suarez, Laurie Burchell, Catherine Arnett, Rafael Mosquera, Sara Hincapié Monsalve, Thom Vaughan, Damian Stewart, Malte Ostendorff, Idris Abdulmumin, Vukosi Marivate, Shamsuddeen Hassan Muhammad, Atnafu Lambebo Tonja, Hend Al-Khalifa, Nadia Ghezaiel Hammouda, Verrah Akinyi Otiende, Tack Hwa Wong, Jakhongir Saydaliev, Melika Nobakhtian, Muhammad Ravi Shulthan Habibi, Chalamalasetti Kranti, Carol Muchemi, Khang Nguyen, Faisal Muhammad Adam, Luis Frentzen Salim, Reem Alqifari, Cynthia Jayne Amol, Joseph Marvin Imperial, Ilker Kesen, Ahmad Mustafid, Pavel Stepachev, Leshem Choshen, David Anugraha, Hamada Nayel, Seid Muhie Yimam, Vallerie Alexandra Putra, My Chiffon Nguyen, Azmine Toushik Wasi, Gouthami Vadithya, Rob Van Der Goot, Lanwenn ar C’horr, Karan Dua, Andrew Yates, Mithil Bangera, Yeshil Bangera, Hitesh Laxmichand Patel, Shu Okabe, Fenal Ashokbhai Ilasariya, Dmitry Gaynullin, Genta Indra Winata, Yiyuan Li, Juan Pablo Martínez, Amit Agarwal, Ikhlasul Akmal Hanif, Raia Abu Ahmad, Esther Adenuga, Filbert Aurelian Tjiaranata, Weerayut Buaphet, Michael Anugraha, Sowmya Vajjala, Benjamin L Rice, Azril Hafizi Amirudin, Jesujoba Oluwadara Alabi, Srikant Panda, Yassine Toughrai, Bruhan Kyomuhendo, Daniel Ruffinelli, null Akshata, Manuel Goulão, Ej Zhou, Ingrid Gabriela Franco Ramirez, Cristina Aggazzotti, Konstantin Dobler, Jun Kevin, Quentin Pagès, Nicholas Andrews, Nuhu Ibrahim, Mattes Ruckdeschel, Amr Keleg, Mike Zhang, Casper Rufaro Muziri, Saron Samuel, Sotaro Takeshita, Kun Kerdthaisong, Luca Foppiano, Rasul Dent, Tommaso Green, Ahmad Mustapha Wali, Kamohelo Makaaka, Vicky Feliren, Inshirah Idris, Hande Celikkanat, Abdulhamid Abubakar, Jean Maillard, Benoît Sagot, Thibault Clérice, Kenton Murray, Sarah K. K. Luger
Challenge: Language identification (LID) is a fundamental step in curating multilingual corpora.
Approach: They introduce CommonLID, a community-driven, human-annotated LID benchmark for the web domain, covering 109 languages.
Outcome: The proposed benchmark covers 109 languages and shows that existing evaluations overestimate accuracy for many languages in the web domain.
FLEEK: Factual Error Detection and Correction with Evidence Retrieved from External Knowledge (2023.emnlp-demo)

Copied to clipboard

Challenge: Existing large language models (LLMs) have a tendency to hallucinate and provide creative and fluent responses that are not factually accurate.
Approach: They propose a tool that automatically extracts factual claims from text, gathers evidence from external knowledge sources, evaluates the factuality of each claim, and suggests revisions for identified errors.
Outcome: The proposed tool detects errors in text and evaluates their factuality and suggests revisions based on the collected evidence.
Tailoring Diagnostic Modeling to Individual Learners: Personalized Distractor Generation via MCTS-Guided Reasoning Reconstruction (2026.acl-long)

Copied to clipboard

Challenge: Current distractor generation methods produce shared distractors for all students, ignoring individual variations in reasoning, which limits their diagnostic effectiveness.
Approach: They propose a method which tailors distractors to each student’s specific cognitive flaws, inferred from their past question-answering (QA) history.
Outcome: The proposed framework outperforms existing methods in generating plausible distractors and adapts to group-level settings.
Adaptive Query Rewriting: Aligning Rewriters through Marginal Probability of Conversational Answers (2024.emnlp-main)

Copied to clipboard

Challenge: Existing methods to incorporate retriever’s preference during the training of query rewriting models rely on extensive annotations such as in-domain rewrites and/or relevant passage labels, limiting their generalization and adaptation capabilities.
Approach: They propose a framework for training query rewriting models with limited rewrite annotations from seed datasets and completely no passage label.
Outcome: The proposed approach decontexualizes conversational queries into self-contained questions suitable for off-the-shelf retrievers.
R2F: A General Retrieval, Reading and Fusion Framework for Document-level Natural Language Inference (2022.emnlp-main)

Copied to clipboard

Challenge: Document-level natural language inference (DOCNLI) is a new task in natural language processing.
Approach: They propose a document-level natural language inference framework that fuses sentence-level tasks into a set of sentence-based tasks.
Outcome: The proposed framework improves interpretability and performance with evidence.
Don’t Change Me! User-Controllable Selective Paraphrase Generation (2021.eacl-main)

Copied to clipboard

Challenge: a new technique allows paraphrase generation to be user-controlled . a user looking for cheap hotels in New York would not find the other answer helpful .
Approach: They propose a method that provides a user with explicit tags that can be placed around any arbitrary segment of text to mean "don't change me!" they propose allowing user-controllable paraphrase generation by fine-tuning model that exhibits this behavior .
Outcome: The proposed technique is language agnostic and tested in English and Chinese.
DeepSynth-Eval: Objectively Evaluating Information Consolidation in Deep Survey Writing (2026.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) are evolving towards autonomous agents . retrieval capabilities are well-benchmarked, but post-retrieval synthesis is under-evaluated due to open-ended writing.
Approach: They propose a benchmark to evaluate information consolidation capabilities using survey papers as gold standards.
Outcome: The proposed benchmark analyzes the post-retrieval synthesis stage of large language models . it leverages high-quality survey papers as gold standards and reverse-engineers research requests . the proposed benchmark outperforms single-turn generation and reduces hallucinations .
Enhancing Court View Generation with Knowledge Injection and Guidance (2024.lrec-main)

Copied to clipboard

Challenge: Existing methods of natural language generation (NLG) rely on the extensive parameters of pretrained language models (PLMs) but their effectiveness may be compromised by insufficient domain-specific knowledge.
Approach: They propose a knowledge-injected prompt encoder to incorporate domain knowledge during the training stage, thereby reducing computational overhead.
Outcome: The proposed approach outperforms established baselines on real-world data in responsivity of claims and in the ability to transfer domain knowledge.
Federated LoRA Fine-Tuning with Pipelined Error-Mitigated Aggregation and Matrix-Wise Freezing (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods for fine-tuning large language models often suffer from biased model aggregation and are hindered by significant communication and computation burden.
Approach: They propose a Federated low-rank adaptation system for large language models that leverages pipelined error-mitigated model aggregation and adaptive matrix-wise parameter freezing to mitigate aggregations.
Outcome: The proposed system improves time-to-target by 2.17-8.48 on real-world datasets.
From Graph to Word Bag: Introducing Domain Knowledge to Confusing Charge Prediction (2024.lrec-main)

Copied to clipboard

Challenge: Existing charge prediction methods have shown impressive performance, but they face significant challenges when dealing with confusing charges, such as Snatch and Robbery.
Approach: They propose a novel approach which introduces domain knowledge regarding constituent elements to guide the model in making judgments on confusing charges, much like a judge’s reasoning process.
Outcome: The proposed approach maintains exceptional performance in imbalanced label distributions.
Mem2ActBench: A Benchmark for Evaluating Long-Term Memory Utilization in Task-Oriented Autonomous Agents (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks focus on direct queries for a factual answer, but fail to evaluate the more crucial capability of actively applying memory to execute tasks.
Approach: They propose a benchmark to evaluate whether agents can proactively leverage long-term memory to execute tool-based actions by selecting appropriate tools and grounding their parameters.
Outcome: The proposed benchmarks show that 91.3% of tasks are memory-dependent . the benchmarks simulate persistent assistant usage, where users mention the same topic across long, interrupted interactions and expect previously established preferences and task states to be implicitly applied.
ErrorRadar: Benchmarking Complex Mathematical Reasoning of Multimodal Large Language Models Via Error Detection (2026.findings-acl)

Copied to clipboard

Challenge: Current mathematical benchmarks focus on evaluating MLLMs’ problem-solving ability, yet there is a crucial gap in addressing more complex scenarios such as error detection.
Approach: They propose to evaluate multimodal error detection by evaluating two sub-tasks error step identification and error categorization.
Outcome: The proposed task evaluates MLLMs' ability to handle multimodal questions compared to text-only models.
LaTeX2Solver: a Hierarchical Semantic Parsing of LaTeX Document into Code for an Assistive Optimization Modeling Application (2023.acl-demo)

Copied to clipboard

Challenge: Existing systems that translate optimization formulas manually are cumbersome and time-consuming.
Approach: They propose a system that converts optimization formulas from TeX document to solver language.
Outcome: The proposed system helps operations research practitioners convert optimization formulations into solver modeling languages.
MeaeQ: Mount Model Extraction Attacks with Efficient Queries (2023.emnlp-main)

Copied to clipboard

Challenge: Recent studies focus on limited-query budget settings and adopt random sampling or active learning-based sampling strategies on publicly available, unannotated data sources.
Approach: They propose a model extraction attack with efficient Queries that uses a zero-shot sequence inference classifier to filter task-relevant data from a public text corpus instead of a problem domain-specific dataset.
Outcome: The proposed method achieves higher similarity to the victim model than baselines while requiring fewer queries.
FinanceReasoning: Benchmarking Financial Numerical Reasoning More Credible, Comprehensive and Challenging (2025.acl-long)

Copied to clipboard

Challenge: Compared to existing benchmarks, FinanceReasoning provides three key advancements: (1) credibility; (2) comprehensiveness; (3) numerical precision; (4) complexity; (5) complexity; and (6) complexity.
Approach: They propose a benchmark to evaluate the reasoning capabilities of large reasoning models (LRMs) in financial numerical reasoning problems.
Outcome: The proposed benchmark exceeds existing benchmarks in 67.8% of financial concepts and formulas and is credible, comprehensive, and challenging.
MolTC: Towards Molecular Relational Modeling In Language Models (2024.findings-acl)

Copied to clipboard

Challenge: Molecular Relational Learning (MRL) is a promising way to understand interactions between molecular pairs.
Approach: They propose a novel LLM-based multi-modal framework for molecular interaction modeling following Chain-of-Thought (CoT) theory which integrates graphical information of two molecules in pair.
Outcome: The proposed framework integrates graphical information of two molecules in pair.
PunchBench: Benchmarking MLLMs in Multimodal Punchline Comprehension (2025.acl-long)

Copied to clipboard

Challenge: Existing benchmarks on punchline comprehension suffer from language shortcuts that allow models to rely on text, lack of question diversity, and narrow focus on a specific domain of multimodal content.
Approach: They propose a multimodal punchline comprehension benchmark to assess models' ability to comprehend punchlines.
Outcome: The proposed model surpasses in-context learning and chain-of-thought in punchline comprehension.
Unlocking Multilingual Reasoning Capability of LLMs and LVLMs through Representation Engineering (2026.acl-long)

Copied to clipboard

Challenge: Existing approaches to enhance multilingual reasoning capabilities rely on costly multilingual training or employ prompting with external translation tools.
Approach: They propose a training-free inference-time method to enhance multilingual reasoning capabilities via Representation Engineering without additional training data or tools.
Outcome: The proposed method outperforms existing methods on four reasoning benchmarks in English and Thai and Swahili.
Learning Structured Representations of Entity Names using Active Learning and Weak Supervision (2020.emnlp-main)

Copied to clipboard

Challenge: Structured representations of entity names are useful for many entity-related tasks such as entity normalization and variant generation.
Approach: They propose a framework that combines active learning and weak supervision to solve this problem.
Outcome: The proposed framework enables learning of high-quality models from a dozen labeled examples.
DATA-CUBE: Data Curriculum for Instruction-based Sentence Representation Learning (2024.findings-acl)

Copied to clipboard

Challenge: Existing methods to improve sentence representation learning (SRL) ignore the potential interference problems across tasks and instances.
Approach: They propose a multi-task instruction tuning method that arranges the order of multi- task data for training to minimize interference risks.
Outcome: The proposed method can boost the performance of state-of-the-art methods.
Improve Student’s Reasoning Generalizability through Cascading Decomposed CoTs Distillation (2024.emnlp-main)

Copied to clipboard

Challenge: Existing studies have tried to distill these capabilities into smaller language models (SLMs) however, these capabilities are often associated with more parameters, which is not practical to emergent in smaller models.
Approach: They propose to decompose the traditional single-step learning process into two cascaded learning steps by restructuring the training objectives and concatenating the question with the rationale as input.
Outcome: Extensive experiments show that the proposed method improves reasoning generalizability and diversity of the model.
FactVerse: A Benchmark for Factual Consistency in Interleaved Image–Text Generation (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks lack effective mechanisms to evaluate factual consistency in interleaved image-text generation.
Approach: They propose a benchmark dedicated to evaluating factual consistency in interleaved image-text generation.
Outcome: The proposed framework outperforms existing evaluation methods in evaluating factual consistency in interleaved image-text generation.
Mind Reader: Latent User Demand-Guided Content Optimization for Generative Search Engine (2026.acl-long)

Copied to clipboard

Challenge: Generative Search Engines (GSEs) have reshaped information retrieval and Generating Engine Optimization (GEO) emerges to improve the content visibility in GSEs’ responses.
Approach: They propose a method to optimize content to cover latent semantic information of GSEs by decomposing query into diverse perspectives and capturing underlying semantic information.
Outcome: The proposed method outperforms baselines and effectively improves content visibility (with up to 2.44x objective metrics and 1.23x subjective metrics on average).
Beyond the Last Frame: Process-aware Evaluation for Generative Video Reasoning (2026.acl-long)

Copied to clipboard

Challenge: Existing evaluation frameworks often rely on single-frame assessments, which can lead to outcome-hacking.
Approach: They propose a process-aware evaluation paradigm that uses a hierarchical rubric to evaluate the validity of the intermediate steps and the final result.
Outcome: The proposed model achieves POC@1.0 only about 20% and exhibits significant outcome-hacking.
SrDetection: A Self-Referential Framework for Data Leakage Detection in Code Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods for evaluating code large language models assume access to proprietary training corpora or use external reference sets with manually tuned, non-generalizable thresholds.
Approach: They propose a framework for self-referential leakage detection for gray-box and black-box settings.
Outcome: The proposed framework improves average F1 by 21.52 points in the gray-box setting and 14.46 points in black-box settings over strong baselines.
RSA-Bench: Benchmarking Audio Large Models in Real-World Acoustic Scenarios (2026.findings-acl)

Copied to clipboard

Challenge: Existing evaluations rely on synthetic Gaussian noise or simplistic single-source interference, failing to capture the intricate, multi-layered acoustic dynamics that characterize authentic physical environments.
Approach: They propose a robustness benchmark to stress-test Audio Large Models (ALLMs) using high-fidelity auditory scene simulations.
Outcome: The proposed model performs well on a wide range of tasks, including automatic speech recognition, speech translation, and audio-based reasoning.
AgentThink: A Unified Framework for Tool-Augmented Chain-of-Thought Reasoning in Vision-Language Models for Autonomous Driving (2025.findings-emnlp)

Copied to clipboard

Challenge: Vision-Language Models struggle with hallucinations, inefficient reasoning, and limited real-world validation hinders accurate perception and robust step-by-step reasoning.
Approach: AgentThink integrates Chain-of-Thought reasoning with dynamic, agent-style tool invocation for autonomous driving tasks.
Outcome: Experiments on the DriveLMM-o1 benchmark show AgentThink significantly boosts overall reasoning scores by 53.91% and enhances answer accuracy by 33.54% .
STORM-BORN: A Challenging Mathematical Derivations Dataset Curated via a Human-in-the-Loop Multi-Agent Framework (2025.findings-acl)

Copied to clipboard

Challenge: Existing datasets suffer from outdated and insufficient challenging content, neglecting human-like reasoning, and limited reliability due to single-LLM generation.
Approach: They propose a human-in-the-loop, multi-agent data generation framework that integrates reasoning-dense filters, multiagent collaboration, and human mathematicians’ evaluations to ensure the reliability and quality of the dataset.
Outcome: The proposed framework improves accuracy and quality of the 2,000-synthesized datasets by integrating reasoning-dense filters, multi-agent collaboration, and human mathematicians’ evaluations.
DyLex: Incorporating Dynamic Lexicons into BERT for Sequence Labeling (2021.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to integrate lexical knowledge into deep learning models are limited by large-scale dynamic lexicons.
Approach: They propose a plug-in lexicon incorporation approach for BERT based sequence labeling tasks . they adopt word-agnostic tag embeddings to avoid re-training the representation .
Outcome: The proposed framework achieves new SOTA even with large scale lexicons, the authors show . they adopt word-agnostic tag embeddings to avoid re-training the representation .
Constituency Lattice Encoding for Aspect Term Extraction (2020.coling-main)

Copied to clipboard

Challenge: a challenge for aspect term extraction is to extract phrase-level aspect terms . a constituency lattice structure is constructed using the span annotations of constituents of a sentence .
Approach: They propose to incorporate the span annotations of constituents of a sentence to leverage syntactic information in neural network models.
Outcome: The proposed model outperforms existing models on two benchmark datasets.
ThinkAnswer Loss: Balancing Semantic Similarity and Exact Matching for LLM Reasoning Enhancement (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for knowledge distillation use Chain-of-Thought (CoT) and answer pairs, but they lack appropriate supervision signals.
Approach: They propose a framework that decouples CoT and answer supervision . the framework applies semantic similarity constraints while maintaining strict literal matching for the answer .
Outcome: The proposed framework decouples CoT and answer supervision while maintaining strict literal matching for the answer.
Enhancing Partially Relevant Video Retrieval with Robust Alignment Learning (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing methods focus on enhancing multi-scale clip representations but lack robust data alignment . inherent data uncertainty renders PRVR vulnerable to distractor videos with spurious similarities .
Approach: proposed framework for partially relevant video retrieval aims to retrieve untrimmed videos partially relevant to a given query.
Outcome: The proposed framework can be seamlessly integrated into existing architectures.
CRSLab: An Open-Source Toolkit for Building Conversational Recommender System (2021.acl-demo)

Copied to clipboard

Challenge: Existing studies on conversational recommender systems lack a unified and standardized implementation or comparison.
Approach: They propose to use a unified framework and highly-decoupled modules to develop CRSs.
Outcome: The proposed framework collects 6 commonly used human-annotated CRS datasets and implements 19 models that include advanced techniques such as graph neural networks and pre-training models.
Capture the Key in Reasoning to Enhance CoT Distillation Generalization (2025.acl-long)

Copied to clipboard

Challenge: Existing distillation methods for Large Language Models (LLMs) focus on fine-tuning student SLMs on correct data, resulting in students struggling to learn the key instead of analyzing mistakes according to correct solutions.
Approach: They propose a method that exposes key reasoning steps rather than simple fine-tuning students' CoTs data by using a set of prompts with similar reasoning paths but divergent conclusions.
Outcome: The proposed method improves student SLMs' ability to learn key reasoning steps rather than fine-tuning them on teacher data.
ReEvalMed: Rethinking Medical Report Evaluation by Aligning Metrics with Real-World Clinical Judgment (2025.emnlp-main)

Copied to clipboard

Challenge: Automatically generated radiology reports often receive high scores from existing evaluation metrics but fail to earn clinicians’ trust.
Approach: They propose a meta-evaluation framework that uses criteria spanning discrimination, robustness, and monotonicity to evaluate existing metrics.
Outcome: The proposed framework offers guidance for building more clinically reliable evaluation methods.
UniLR: Unleashing the Power of LLMs on Multiple Legal Tasks with a Unified Legal Retriever (2025.acl-long)

Copied to clipboard

Challenge: Existing retrieval methods are designed for general domains, struggling with legal knowledge, or tailored for specific legal tasks, unable to handle diverse legal knowledge types.
Approach: They propose a novel retrieval method that integrates specialized knowledge into LLMs.
Outcome: The proposed method can perform multiple legal retrieval tasks for LLMs.
Reinforcement Learning on Pre-Training Data (2026.acl-long)

Copied to clipboard

Challenge: Recent progress in large language models is driven by scaling of training compute through pre-training with nexttoken prediction (NTP) or post-training (RL) Pre-training using NTP enables models to acquire extensive knowledge and skills from general data, but it suffers from data inefficiency and catastrophic forgetting in continual learning settings.
Approach: They propose to scale training compute through pre-training with next-token prediction (NTP) or post-training by scaling reinforcement learning (RL) to improve learning from general data.
Outcome: Experiments on multiple benchmarks and models show that the proposed approach improves continual pre-training and provides a strong foundation for post-training on Qwen3-8B-Base.
Unleashing the Power of LLMs in Court View Generation by Stimulating Internal Knowledge and Incorporating External Knowledge (2024.findings-naacl)

Copied to clipboard

Challenge: Large Language Models (LLMs) have made remarkable strides in language generation, but they encounter difficulties in the knowledge-intensive legal domain.
Approach: They propose to decompose court views into different parts, stimulate internal knowledge, and incorporate external information to unleash the power of LLMs in the task.
Outcome: The proposed method generates more accurate and reliable court views on two real-world datasets LAIC2021 and CJO2022.
ViFT: Towards Visual Instruction-Free Fine-tuning for Large Vision-Language Models (2025.findings-emnlp)

Copied to clipboard

Challenge: Visual instruction tuning is the predominant technology in eliciting multimodal task-solving capabilities of large vision-language models.
Approach: They propose a visual instruction-free fine-tuning framework for large vision-language models . they require only text-only instructions and image caption data during training .
Outcome: The proposed framework is based on visual instruction tuning, but requires images as input . it can achieve state-of-the-art performance on several downstream benchmarks with less training data.
Conditional Augmentation for Aspect Term Extraction via Masked Sequence-to-Sequence Generation (2020.acl-main)

Copied to clipboard

Challenge: Aspect term extraction is a task to extract aspect terms from review texts as opinion targets for sentiment analysis.
Approach: They propose a conditional generation task for augmentation of aspect term extraction . they use a sequence-to-sequence method that generates a new sentence . results confirm that their method alleviates the data scarcity problem significantly .
Outcome: The proposed method reduces the data scarcity problem significantly and boosts current models.
Generate, Discriminate, Evolve: Enhancing Context Faithfulness via Fine-Grained Sentence-Level Self-Evolution (2025.findings-acl)

Copied to clipboard

Challenge: Existing methods to improve context faithfulness in large language models are either inadequate or overlook the potential for self-improvement.
Approach: They propose a framework that enhances context faithfulness through fine-grained sentence-level optimization.
Outcome: Experiments on ASQA and ConFiQA datasets show that GenDiE surpasses baselines in faithfulness and correctness and exhibits robust performance for domain adaptation.
Time Sensitive Knowledge Editing through Efficient Finetuning (2024.acl-short)

Copied to clipboard

Challenge: Existing locate-and-edit knowledge editing methods suffer from two limitations: they are infeasible for large scale KE in practice and require long run-time.
Approach: They propose to use parametric fine-tuning techniques to update obsolete knowledge and induce new knowledge into LLMs.
Outcome: The proposed methods improve the performance of KE and knowledge update in a temporal dataset with knowledge update and knowledge injection examples.
MMEKG: Multi-modal Event Knowledge Graph towards Universal Representation across Modalities (2022.acl-demo)

Copied to clipboard

Challenge: Recent Knowledge Graphs (KGs) store billions of world facts in a directed graph, but expression ability of such entity-centric KGs is limited.
Approach: They propose a large-scale multi-modal event knowledge graph named MMEKG that unifies different modalities of knowledge via events.
Outcome: The proposed system unifies different modalities of knowledge via events, which complement and disambiguate each other.
RAG-Zeval: Enhancing RAG Responses Evaluator through End-to-End Reasoning and Ranking-Based Reinforcement Learning (2025.emnlp-main)

Copied to clipboard

Challenge: Existing evaluation frameworks rely on direct prompting of resource-intensive models with complex multi-stage prompts, introducing significant computational cost and underutilizing models’ reasoning capabilities.
Approach: They propose a framework that trains evaluators with reinforcement learning to generate comprehensive and sound assessments with detailed explanation in one-pass.
Outcome: The proposed framework outperforms baseline evaluation frameworks that rely on LLMs with 10-100 more parameters and achieves the strongest correlation with human judgments.
DEMO: Reframing Dialogue Interaction with Fine-grained Element Modeling (2025.findings-acl)

Copied to clipboard

Challenge: Large language models (LLMs) enabled dialogue systems are one of the central modes in human-machine interaction.
Approach: They propose a benchmark task for dialogue element MOdeling and Element Awareness and a new benchmark for dialogue agent interaction that allows the agent to model dialogue elements via imitation learning.
Outcome: The proposed agent performs well in both dialogue element modeling and out-of-domain tasks.
InspireDebate: Multi-Dimensional Subjective-Objective Evaluation-Guided Reasoning and Optimization for Debating (2025.acl-long)

Copied to clipboard

Challenge: Existing LLMs focus on responding to specific arguments while neglecting objective assessments such as authenticity and logical validity.
Approach: They propose a multi-dimensional evaluation system and an optimized debating framework . they propose to use coT reasoning enhancement, web-based Retrieval Augmented Generation to optimize across various dimensions.
Outcome: The proposed framework outperforms baseline models in argument quality assessment and debate process simulation by 57%.
CoEvo: Coevolution of LLM and Retrieval Model for Domain-Specific Information Retrieval (2025.emnlp-main)

Copied to clipboard

Challenge: Recent methods to enhance queries by generating intermediary elements can degrade retrieval performance . combining LLMs and retrievers can be difficult, resulting in unreliable or irrelevant intermediaries .
Approach: They propose a framework that facilitates the coevolution of large language models and retrieval models.
Outcome: The proposed framework facilitates the coevolution of LLMs and retrieval models.
ERGO: Event Relational Graph Transformer for Document-level Event Causality Identification (2022.coling-1)

Copied to clipboard

Challenge: Existing methods to identify event-event causal relations in a document are noisy and require heuristic rules or external tools.
Approach: They propose a document-level event-event causality identification framework that uses heuristic rules to design edges between events.
Outcome: The proposed framework outperforms existing state-of-the-art methods on two benchmark datasets.
Meta-CQG: A Meta-Learning Framework for Complex Question Generation over Knowledge Bases (2022.coling-1)

Copied to clipboard

Challenge: Existing methods train one encoder-decoder-based model to fit all questions . however, such a one-size-fits-all strategy may not perform well for complex questions involving multiple KB relations or functional constraints.
Approach: They propose a meta-learning framework for complex question generation over knowledge bases . they propose he meta-trained generator can acquire universal meta-knowledge .
Outcome: The proposed framework can acquire universal and transferable meta-knowledge and quickly adapt to long-tailed samples under different dimensions.
Just Ask One More Time! Self-Agreement Improves Reasoning of Language Models in (Almost) All Scenarios (2024.findings-acl)

Copied to clipboard

Challenge: chain-of-thought (CoT) prompting has been shown to be effective on complex reasoning tasks, but the naive greedy decoding used in CoT prompting causes the repetitiveness and local optimality.
Approach: They propose a generalizable ensemble-optimization method that uses a set of reasoning paths to prompt a language model one more time to determine the optimal answer.
Outcome: The proposed method can be generalized to almost all scenarios where the type of input questions and answer format of reasoning paths may be unknown.
Generative Frame Sampler for Long Video Understanding (2025.findings-acl)

Copied to clipboard

Challenge: Existing video large language models (LMMs) employ an impedance of thousands of frames to understand long videos.
Approach: They propose a plug-and-play module integrated with VideoLLMs to facilitate efficient lengthy video perception.
Outcome: The proposed module boosts the performance of open-source VideoLLMs and proprietary assistants on long-form video benchmarks.
CT-GAT: Cross-Task Generative Adversarial Attack based on Transferability (2023.emnlp-main)

Copied to clipboard

Challenge: Neural network models are vulnerable to adversarial examples, and current methods based on adversarially transferable models rely on substitute models, which can be impractical and costly in real-world scenarios due to the unavailability of training data and the victim model’s structural details.
Approach: They propose a novel approach that directly constructs adversarial examples by extracting transferable features across various tasks.
Outcome: The proposed approach achieves superior attack performance with small cost on ten datasets and demonstrates that it is a novel approach.
DORA: Dynamic Optimization Prompt for Continuous Reflection of LLM-based Agent (2025.coling-main)

Copied to clipboard

Challenge: Existing studies have shown that reflection can enhance performance, but our investigation reveals an undesirable pattern in reflection framework: effective self-reflection occurs primarily at the beginning of iterations, with subsequent attempts failing to produce further improvements.
Approach: They propose a framework that generates task-adaptive reflection advice using an external open-source small language model.
Outcome: The proposed framework generates task-adaptive and diverse reflection advice in MiniWoB++ and Alfworld environments.
Decoding on Graphs: Faithful and Sound Reasoning on Knowledge Graphs through Generation of Well-Formed Chains (2025.acl-long)

Copied to clipboard

Challenge: Existing research on the utilization of Knowledge Graphs (KGs) for large language models (LLMs) relies on subgraph retriever or iterative prompting, overlooking the potential synergy of LLMs’ step-wise reasoning capabilities and KGs’ structural nature.
Approach: They propose a graph-aware constrained decoding framework that facilitates a deep synergy between LLMs and KGs by constraint derived from the topology of the KG.
Outcome: The proposed framework can provide faithful and sound reasoning for KGQA.
RED: Unleashing Token-Level Rewards from Holistic Feedback via Reward Redistribution (2025.emnlp-main)

Copied to clipboard

Challenge: Experimental results demonstrate the superiority of our approach to aligning large language models with human preferences.
Approach: They propose a method that evaluates and assigns specific credit to each token using an off-the-shelf reward model.
Outcome: The proposed method evaluates and assigns specific credit to each token using an off-the-shelf reward model.
Bottom-Up Synthesis of Knowledge-Grounded Task-Oriented Dialogues with Iteratively Self-Refined Prompts (2025.naacl-short)

Copied to clipboard

Challenge: Training conversational question-answering systems requires in-domain data, which is often scarce in practice.
Approach: They propose a bottom-up approach where QA pairs are generated first and combined into a coherent dialogue.
Outcome: The proposed approach produces more realistic and higher-quality dialogues compared to top-down methods.
Discovery and Reinforcement of Tool-Integrated Reasoning Chains via Rollout Trees (2026.acl-long)

Copied to clipboard

Challenge: Existing approaches to augment Large Language Models (LLMs) with computational capabilities have focused on short Chain-of-thought (CoT) integrating tool-use into long CoT remains underexplored due to the scarcity of training data and the challenge of integrating it without compromising the model’s intrinsic long-chain reasoning.
Approach: They propose a framework that enables spontaneous tool-use during long CoT reasoning without additional human annotation.
Outcome: Experiments on AIME and GPQA-Diamond show that DART significantly outperforms existing methods, successfully harmonizing tool execution with long CoT reasoning.
Crowdsource, Crawl, or Generate? Creating SEA-VL, a Multicultural Vision-Language Dataset for Southeast Asia (2025.acl-long)

Copied to clipboard

Samuel Cahyawijaya, Holy Lovenia, Joel Ruben Antony Moniz, Tack Hwa Wong, Mohammad Rifqi Farhansyah, Thant Thiri Maung, Frederikus Hudi, David Anugraha, Muhammad Ravi Shulthan Habibi, Muhammad Reza Qorib, Amit Agarwal, Joseph Marvin Imperial, Hitesh Laxmichand Patel, Vicky Feliren, Bahrul Ilmi Nasution, Manuel Antonio Rufino, Genta Indra Winata, Rian Adam Rajagede, Carlos Rafael Catalan, Mohamed Fazli Mohamed Imam, Priyaranjan Pattnayak, Salsabila Zahirah Pranida, Kevin Pratama, Yeshil Bangera, Adisai Na-Thalang, Patricia Nicole Monderin, Yueqi Song, Christian Simon, Lynnette Hui Xian Ng, Richardy Lobo Sapan, Taki Hasan Rafi, Bin Wang, null Supryadi, Kanyakorn Veerakanjana, Piyalitt Ittichaiwong, Matthew Theodore Roque, Karissa Vincentio, Takdanai Kreangphet, Phakphum Artkaew, Kadek Hendrawan Palgunadi, Yanzhi Yu, Rochana Prih Hastuti, William Nixon, Mithil Bangera, Adrian Xuan Wei Lim, Aye Hninn Khine, Hanif Muhammad Zhafran, Teddy Ferdinan, Audra Aurora Izzani, Ayushman Singh, Evan Evan, Jauza Akbar Krito, Michael Anugraha, Fenal Ashokbhai Ilasariya, Haochen Li, John Amadeo Daniswara, Filbert Aurelian Tjiaranata, Eryawan Presma Yulianrifat, Can Udomcharoenchaikit, Fadil Risdian Ansori, Mahardika Krisna Ihsani, Giang Nguyen, Anab Maulana Barik, Dan John Velasco, Rifo Ahmad Genadi, Saptarshi Saha, Chengwei Wei, Isaiah Edri W. Flores, Kenneth Chen Ko Han, Anjela Gail D. Santos, Wan Shen Lim, Kaung Si Phyo, Tim Santos, Meisyarah Dwiastuti, Jiayun Luo, Jan Christian Blaise Cruz, Ming Shan Hee, Ikhlasul Akmal Hanif, M.Alif Al Hakim, Muhammad Rizky Sya’ban, Kun Kerdthaisong, Lester James Validad Miranda, Fajri Koto, Tirana Noor Fatyanosa, Alham Fikri Aji, Jostin Jerico Rosal, Jun Kevin, Robert Wijaya, Onno P. Kampman, Ruochen Zhang, Börje F. Karlsson, Peerat Limkonchotiwat
Challenge: Southeast Asia is underrepresented in vision-language research . SEA-VL is an open-source initiative dedicated to developing culturally relevant datasets for SEA languages.
Approach: They propose to use crowdsourced, automated image crawling and synthetic image generation to develop culturally relevant datasets for SEA languages.
Outcome: The proposed datasets capture SEA cultural nuances and contexts better than existing datasets.
MoRE: A Mixture of Low-Rank Experts for Adaptive Multi-Task Learning (2025.findings-acl)

Copied to clipboard

Challenge: Recent advances in Large Language Models (LLMs) have revolutionized various domains, offering unprecedented performance across numerous tasks.
Approach: They propose a new Mixture of Low-Rank Experts (MoRE) for multi-task PEFT to improve performance of LLMs with fewer parameters.
Outcome: The proposed method improves performance over multiple tasks and no additional inference cost.
Multi-Task Dense Retrieval via Model Uncertainty Fusion for Open-Domain Question Answering (2021.findings-emnlp)

Copied to clipboard

Challenge: Existing approaches to multitask dense retrieval are not effective due to corpus inconsistency.
Approach: They propose to train individual dense passage retrievers for different open-domain question-answering tasks and aggregate their predictions during test time.
Outcome: The proposed method achieves state-of-the-art performance on 5 benchmark QA datasets, with up to 10% improvement in top-100 accuracy compared to a joint-training multi-task DPR on SQuAD.
CE-GPPO: Coordinating Entropy via Gradient-Preserving Clipping Policy Optimization in Reinforcement Learning (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for proximal policy optimization discard valuable gradient signals from low-probability tokens due to the clipping mechanism.
Approach: They propose an algorithm that reintroduces gradients from clipped tokens in native PPO in a gentle and bounded manner.
Outcome: The proposed algorithm outperforms strong baselines on reasoning benchmarks on different model scales.
Enhancing Zero-Shot Chain-of-Thought Reasoning in Large Language Models through Logic (2024.lrec-main)

Copied to clipboard

Challenge: Experimental evaluations of large language models demonstrate the efficacy of enhanced reasoning by logic.
Approach: They propose a framework that uses symbolic logic to verify and rectify reasoning steps by steps.
Outcome: The proposed framework improves the zero-shot chain-of-thought reasoning ability of large language models by verifying and rectifying the reasoning steps step by step.
Optimizing Language Models with Fair and Stable Reward Composition in Reinforcement Learning (2024.emnlp-main)

Copied to clipboard

Challenge: Recent research has developed algorithms for reinforcement learning from human feedback and AI-generated feedback.
Approach: They propose a method for reinforcement learning from human feedback and AI-generated feedback that incorporates weighting, ranking, and constraining to handle disparate rewards.
Outcome: The proposed method reduces disparity and enhances stability among rewards . empirical results show that the proposed method is efficient and straightforward .
DynamicNER: A Dynamic, Multilingual, and Fine-Grained Dataset for LLM-based Named Entity Recognition (2025.emnlp-main)

Copied to clipboard

Challenge: Existing datasets designed for Named Entity Recognition methods are inadequate for LLMs.
Approach: They propose a dataset that is multilingual and multi-granular and enables LLMs to be applied to Named Entity Recognition methods.
Outcome: The proposed dataset is multilingual and multi-granular, covering 8 languages and 155 entity types, with corpora spanning a diverse range of domains.
HearSay Benchmark: Do Audio LLMs Leak What They Hear? (2026.findings-acl)

Copied to clipboard

Challenge: Recent advances in audio large language models have led to their potential privacy implications unexplored.
Approach: They propose a benchmark to examine whether ALLMs leak user privacy through acoustic voiceprints.
Outcome: The proposed benchmark is constructed from over 22,000 real-world audio clips.
Can LLMs Really Judge? A Progressive Argumentation-Mining Framework for Distinguishing Understanding from Aggregation (2026.findings-acl)

Copied to clipboard

Challenge: Existing evaluations of large language models rely on dataset-based generation accuracy . however, generative correctness does not guarantee discriminative capability to verify solutions .
Approach: They propose a diagnostic framework that explicitly controls context and isolates discriminative behaviors.
Outcome: The proposed framework explicitly controls context and isolates discriminative behaviors.
BertGCN: Transductive Text Classification by Combining GNN and BERT (2021.findings-acl)

Copied to clipboard

Challenge: Text classification is a core task in natural language processing (NLP) Graph neural networks (GNNs) serve as an effective approach for transductive learning.
Approach: They propose a model that combines large scale pretraining and transductive learning for text classification.
Outcome: The proposed model achieves SOTA performance on a wide range of datasets.
On the Generation of Medical Dialogs for COVID-19 (2021.acl-short)

Copied to clipboard

Challenge: under the pandemic of COVID-19, people experiencing COVI D19-related symptoms have a pressing need to consult doctors.
Approach: They develop a medical dialog system that can provide COVID19-related consultations . they use two dialog datasets containing conversations between doctors and patients .
Outcome: The proposed system can provide COVID19-related consultations, but is too small compared with general-domain dialog datasets.
A General Knowledge Injection Framework for ICD Coding (2025.findings-acl)

Copied to clipboard

Challenge: Existing methods to improve ICD coding focus on a single type of knowledge and design specialized modules that are complex and incompatible with each other.
Approach: They propose a general knowledge injection framework that integrates three key types of knowledge without specialized design of additional modules.
Outcome: The proposed framework outperforms baseline models and is comparable to models relying on extra human annotations.
Rotation Control Unlearning: Quantifying and Controlling Continuous Unlearning for LLM with The Cognitive Rotation Space (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods to remove undesirable data from Large Language Models suffer from cumulative catastrophic utility loss under continuous unlearning requests.
Approach: They propose a method that leverages the rotational salience weight of RCU to quantify and control the unlearning degree in the continuous unlearning process.
Outcome: The proposed method achieves SOTA performance without a retained dataset.
Prompt for Extraction? PAIE: Prompting Argument Interaction for Event Argument Extraction (2022.acl-long)

Copied to clipboard

Challenge: Using a prompt-based model, we find that event argument extraction is efficient and generalized well to few-shot settings.
Approach: They propose a model PAIE for event argument extraction using prompt tuning for extractive objectives.
Outcome: The proposed model can extract arguments with the same role instead of heuristic threshold tuning.
Exploiting Contrastive Learning and Numerical Evidence for Confusing Legal Judgment Prediction (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing studies fail to distinguish different classification errors with a standard cross-entropy classification loss and ignore the numbers in the fact description for predicting the term of penalty.
Approach: They propose to extract crime amounts from fact description and use them to learn distinguishable representations to exploit the numbers in the fact description for predicting the term of penalty.
Outcome: The proposed method achieves state-of-the-art results on real-world datasets and ablation studies demonstrate the effectiveness of each component.
End-to-End Open-Domain Question Answering with BERTserini (N19-4)

Copied to clipboard

Challenge: a new open-domain question answering system integrates best practices from IR with a BERT-based reader to identify answers from a large corpus of Wikipedia articles.
Approach: They propose an end-to-end question answering system that integrates BERT with an IR reader.
Outcome: The proposed system improves on a standard benchmark test collection.
SGP-TOD: Building Task Bots Effortlessly via Schema-Guided LLM Prompting (2023.findings-emnlp)

Copied to clipboard

Challenge: Experimental results show that SGP-TOD provides state-of-the-art zero-shot performance . prevailing approach for creating task bots is to fine-tune pre-trained language models .
Approach: They propose a Schema-Guided Prompting for building Task-Oriented Dialog systems . they use predefined task schema and dialog policy to instruct fixed LLMs to generate appropriate responses .
Outcome: The proposed system outperforms few-shot approaches on multiwoz, RADDLE, and STAR datasets.
Crafting Customisable Characters with LLMs: A Persona-Driven Role-Playing Agent Framework (2025.findings-emnlp)

Copied to clipboard

Challenge: Large Language Models (LLMs) are capable of generating human-like text, but the potential for freely customisable characters remains underexplored.
Approach: They propose a framework which employs Large Language Models to create freely customisable characters through personalised characteristic feature injection.
Outcome: The proposed framework provides valuable insights for developing more accurate and customisable human simulacra.
AesBiasBench: Evaluating Bias and Alignment in Multimodal Language Models for Personalized Image Aesthetic Assessment (2025.emnlp-main)

Copied to clipboard

Challenge: Multimodal Large Language Models are increasingly used in Personalized Image Aesthetic Assessment (PIAA) however, their predictions may reflect subtle biases influenced by demographic factors such as gender, age, and education.
Approach: They propose to evaluate MLLMs along two complementary dimensions: (1) stereotype bias and (2) alignment between model outputs and genuine human aesthetic preferences.
Outcome: The proposed benchmark covers three subtasks: aesthetic perception, assessment, empathy and alignment between outputs and genuine human aesthetic preferences.
Legal Judgment Prediction based on Knowledge-enhanced Multi-Task and Multi-Label Text Classification (2025.naacl-long)

Copied to clipboard

Challenge: Legal judgment prediction (LJP) is an essential task for legal AI, aiming at predicting judgments based on the facts of a case.
Approach: They propose a knowledge-enhanced approach that incorporates 'label-level knowledge' to enhance the representation of case facts for each task and 'task-level' knowledge to improve synergy.
Outcome: The proposed method is effective in comparison to state-of-the-art (SOTA) baselines.
DuSQL: A Large-Scale and Pragmatic Chinese Text-to-SQL Dataset (2020.emnlp-main)

Copied to clipboard

Challenge: Existing text-to-SQL parsing methods mainly focus on English, but there is no labeled data available for the language . a larges-scale and pragmatic Chinese dataset is used for cross-domain text- to-Sql task .
Approach: They propose a larges-scale Chinese dataset for a cross-domain text-to-SQL task . they analyze questions from several representative applications and use an effective data construction framework .
Outcome: The proposed dataset contains 200 databases, 813 tables, and 23,797 question/SQL pairs.
Dynamic Simulation Framework for Disinformation Dissemination and Correction With Social Bots (2025.findings-emnlp)

Copied to clipboard

Challenge: Current studies rely on simplistic user and network modeling and neglect dynamic behavior of bots.
Approach: They propose a multi-agent-based framework for disinformation dissemination . it incorporates both malicious and legitimate bots and allows quantitative evaluation of correction strategies.
Outcome: The proposed framework incorporates both malicious and legitimate bots and their controlled dynamic participation allows for quantitative analysis of correction strategies.
Data Augmentation with Hierarchical SQL-to-Question Generation for Cross-domain Text-to-SQL Parsing (2021.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to parse text-to-SQL data are lacking labeled data for unseen evaluation databases.
Approach: They propose a framework for enhancing SQL queries by automatically producing large numbers of SQL queries based on an abstract syntax tree grammar.
Outcome: The proposed framework can produce high-quality natural language questions over strong baselines.
GaLa: Hypergraph-Guided Visual Language Models for Procedural Planning (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods for procedural planning over-rely on visual inputs and lack structured semantic information.
Approach: They propose a vision–language framework for multimodal procedural planning that exploits implicit spatial relations and deep semantics encoded in object attributes.
Outcome: The proposed framework outperforms existing methods in terms of execution success rate, LCS, and planning correctness.
Variational Graph Autoencoding as Cheap Supervision for AMR Coreference Resolution (2022.acl-long)

Copied to clipboard

Challenge: Abstract Meaning Representation (AMR) is a way to preserve the semantic meaning of a sentence in a graph.
Approach: They propose a general pretraining method that leverages any general AMR corpus and even automatically parses AMR data to achieve performance gains of up to 6% absolute F1 points.
Outcome: The proposed model significantly improves on the previous state-of-the-art model by up to 11% F1.
Low-resource Deep Entity Resolution with Transfer and Active Learning (P19-1)

Copied to clipboard

Challenge: Entity resolution (ER) is the task of identifying different representations of the same real-world entities across databases.
Approach: They propose a deep learning-based method that targets low-resource settings for ER by combining transfer learning and active learning.
Outcome: The proposed method achieves comparable, if not better, performance compared to state-of-the-art learning-based methods while using an order of magnitude fewer labels.
Embracing Imperfection: Simulating Students with Diverse Cognitive Levels Using LLM-based Agents (2025.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) are becoming increasingly popular in education, enabling researchers to simulate students' learning patterns and learning patterns.
Approach: They propose a training-free framework for student simulation that takes into account student cognitive diversity and realism.
Outcome: The proposed model outperforms baseline models and achieves 100% improvement in simulation accuracy and realism.
Exploiting Structure in Representation of Named Entities using Active Learning (C18-1)

Copied to clipboard

Challenge: Named entities are atomic objects of reference and reasoning in many knowledge-centric applications.
Approach: They propose an active-learning based framework that drastically reduces the labeled data required to learn entities' structures.
Outcome: The proposed framework outperforms handwritten programs and supervised learning models in relation extraction and entity resolution tasks.
LLMBox: A Comprehensive Library for Large Language Models (2024.acl-demos)

Copied to clipboard

Challenge: a library to facilitate the development, use, and evaluation of large language models (LLMs) is presented.
Approach: They propose a unified library to facilitate the development, use and evaluation of large language models (LLMs).
Outcome: The proposed library is based on extensive experiments in a variety of evaluation settings.
Few-shot Temporal Pruning Accelerates Diffusion Models for Text Generation (2024.lrec-main)

Copied to clipboard

Challenge: Existing acceleration methods for text generation ignore the importance of the distribution of sampling steps, resulting in slow sampling rates.
Approach: They propose a technique to accelerate diffusion models for text generation without additional training by using a Bayesian optimization approach.
Outcome: The proposed technique achieves 400x acceleration even with minimal sampling steps after down to less than 1 minute of optimization yielding a competitive performance even with minimum sampling steps.
Entropy Ratio Clipping as a Soft Global Constraint for Stable Reinforcement Learning (2026.findings-acl)

Copied to clipboard

Challenge: Large language model post-training often adopts an off-policy training paradigm . however, the off-poliicy training model introduces distribution shifts that push the policy beyond the trust region.
Approach: They propose to use the entropy ratio as a global metric to measure the relative change in policy exploration throughout updates.
Outcome: Experiments show that the proposed metric improves performance across multiple benchmarks.
Unleashing the Native Recommendation Potential: LLM-Based Generative Recommendation via Structured Term Identifiers (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods for constructing item identifiers face bottlenecks due to their large output space and expensive vocabulary expansion and alignment training.
Approach: They propose to use Large Language Models to develop general-purpose, semantically-aware recommender systems that can be generalized and reusable.
Outcome: Experiments on real-world datasets show that GRAM outperforms baselines and significantly outperformed baselines.
"I Don’t Know What to Say": A Fact-Filling Questionnaire Method to Help Non-Experts Talk to LegalAI Assistant (2026.findings-acl)

Copied to clipboard

Challenge: Recent advances in large language models (LLMs) have greatly expanded the scope of legal AI.
Approach: They propose a method that generates questionnaires to help users refine queries . they leverage an iterative training process that collects valuable questionnaires .
Outcome: The proposed method improves the completeness of queries and ensures the performance of domain-specific models in downstream legal tasks.
Stick to the Facts: Learning towards a Fidelity-oriented E-Commerce Product Description Generation (D19-1)

Copied to clipboard

Challenge: Existing models for product description generation do not take the product attribute information into account.
Approach: They propose a model that takes the embedding and the entity label of each word into account . they establish a keyword memory that stores the entity labels as keys and keywords as values .
Outcome: The proposed model increases the fidelity of the generated descriptions by 25%.
OS Agents: A Survey on MLLM-based Agents for Computer, Phone and Browser Use (2025.acl-long)

Copied to clipboard

Challenge: a new generation of (M)LLMs is enabling the creation of superintelligent AI assistants . OS Agents can complete tasks autonomously and have the potential to significantly enhance the lives of billions of users worldwide.
Approach: They propose to build OS Agents that operate within operating systems' GUIs and GUIs . they examine evaluation metrics and benchmarks to identify promising directions .
Outcome: The proposed agents are based on operating systems (OS) and operating systems frameworks.
ReasoningLM: Enabling Structural Subgraph Reasoning in Pre-trained Language Models for Question Answering over Knowledge Graph (2023.emnlp-main)

Copied to clipboard

Challenge: Question Answering over Knowledge Graph (KGQA) aims to find answer entities for natural language questions based on knowledge graphs.
Approach: They propose a subgraph-aware self-attention mechanism to imitate the graph neural network (GNN) based module to perform multi-hop reasoning on KG.
Outcome: The proposed method surpasses state-of-the-art models by a large margin even with fewer updated parameters and less training data.
BackdoorAgent: A Unified Framework for Backdoor Attacks on LLM-based Agents (2026.findings-acl)

Copied to clipboard

Challenge: Large language model (LLM) agents execute tasks through multi-step workflows that combine planning, memory, and tool use.
Approach: They propose a modular framework that provides a unified view of backdoor threats in LLM agents.
Outcome: The proposed framework provides a unified, agent-centric view of backdoor threats in LLM agents.
Do Not Guess, Verify: Logic-Guided Adaptive Reasoning for Multimodal Misinformation Detection (2026.findings-acl)

Copied to clipboard

Challenge: Existing multimodal misinformation detection paradigms rely on passive aggregation of multimodal features and social signals.
Approach: They propose a verification-oriented framework that integrates large vision–language models into multimodal misinformation detection through explicit rationale-guided reasoning.
Outcome: The proposed framework outperforms state-of-the-art methods on multimodal misinformation detection benchmarks while significantly reducing computational cost.
Detecting Customer Complaint Escalation with Recurrent Neural Networks and Manually-Engineered Features (N19-2)

Copied to clipboard

Challenge: e-commerce companies often have the option of escalating complaints by filing grievances with a government authority . this is detrimental to an ecommerce company, but this problem is challenging to solve by integrating recurrent neural networks with manually-engineered features.
Approach: They propose a model that integrates recurrent neural networks with manually-engineered features to identify cases where the customer expresses such an intent.
Outcome: The proposed model outperforms baseline models and provides better recall and triage for specialized agents.
OneRec-Think: In-Text Reasoning for Generative Recommendation (2026.acl-long)

Copied to clipboard

Challenge: Existing generative models lack the capacity for explicit and controllable reasoning, a key advantage of LLMs.
Approach: They propose a framework that integrates dialogue, reasoning, and personalized recommendation.
Outcome: Experiments across public benchmarks show state-of-the-art performance.
Small Agent Can Also Rock! Empowering Small Language Models as Hallucination Detector (2024.emnlp-main)

Copied to clipboard

Challenge: Existing studies on hallucination detection rely heavily on closed-source LLMs such as GPT-4.
Approach: They propose an LLM-based agent framework called HaluAgent that integrates LLMs, multi-functional toolbox and a memory mechanism for hallucination detection.
Outcome: The proposed framework integrates the LLM, multi-functional toolbox, and can detect hallucinations on Chinese and English datasets.
Scaling Law for Multimodal Large Language Model Supervised Fine-Tuning (2026.acl-long)

Copied to clipboard

Challenge: supervised fine-tuning (SFT) is crucial for multimodal large language models, yet a comprehensive scaling law is lacking . et al.: scaling laws focus on model size, pre-training tokens, and MLLM SFT data volumes .
Approach: They propose two scaling laws to guide optimal model-data configuration . they propose one applicable when training data volumes are well defined by researchers .
Outcome: The proposed scaling laws provide valuable recommendations for optimal resource allocation . they show that the proposed laws are more accurate than existing models .
CORBA: Contagious Recursive Blocking Attacks on Multi-Agent Systems Based on Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Existing security models rely on open-ended communication, but the collaborative process itself can be exploited and disrupted.
Approach: They propose a new threat class, called Denial-of-Collaboration, which corrupts collaborative structure and transforms communication topology into self-sabotage.
Outcome: The proposed attacks bypass conventional safety alignments that are not designed to detect behavioral or systemic attacks.
MPR-GUI: Benchmarking and Enhancing Multilingual Perception and Reasoning in GUI Agents (2026.acl-long)

Copied to clipboard

Challenge: Existing GUI benchmarks lack fine-grained diagnostics to identify which capabilities lead to task failures.
Approach: They propose a multilingual P R GUI Benchmark to assess LVLMs' language capabilities . they propose XLI to align non-English hidden states with English ones during inference .
Outcome: The proposed benchmark reveals consistent gaps between English and non-English settings . it reduces the cross-lingual gaps with an average gain of 6.5% in non- English settings compared to static benchmarks .

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations