Papers by Hao Lin

81 papers
AdaMix: Adaptive Mixing for Short and Long Reasoning Adapters (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for large reasoning models have improved efficiency but still face limitations such as conflicting objectives and limited adaptability.
Approach: They propose an adaptive reasoning framework that applies a uniform, computation-intensive deep reasoning strategy to all problems.
Outcome: The proposed framework reduces the average response length of DeepSeek-R1-Distill-Qwen-7B by 54.9% while improving accuracy by up to 4.8% on five mathematical datasets.
PDTrim: Targeted Pruning for Prefill-Decode Disaggregation in Inference (2026.acl-long)

Copied to clipboard

Challenge: Existing pruning methods ignore prefill-decode (PD) disaggregation in practice.
Approach: They propose a pruning method that is highly integrated with prefill-decode (PD) disaggregation, enabling more precise pruning of blocks.
Outcome: The proposed method achieves strong performance in both PD disaggregation and PD unified settings, and can be extended to other non-block pruning methods.
Task-Oriented Dialogue as Dataflow Synthesis (2020.tacl-1)

Copied to clipboard

Challenge: Existing approaches to task-oriented dialogue represent dialogue state as a dataflow graph . microsoft's SMCalFlow dataset features complex dialogues about events, weather, places, and people .
Approach: They propose a dataflow graph-based dialogue agent that maps each user utterance to a program that extends this graph.
Outcome: The proposed framework improves representability and predictability in natural dialogues . it uses dataflow graphs and metacomputation to map user intents to a program .
Hierarchical Topic Modeling via Contrastive Learning and Hyperbolic Embedding (2024.lrec-main)

Copied to clipboard

Challenge: Existing hierarchical topic models are based on Euclidean space, which cannot retain the hierarchically semantic information in the corpus, leading to irrational structure of the generated topics.
Approach: They propose a novel hierarchical topic model that uses contrastive learning to capture information from documents.
Outcome: The proposed model performs on topic coherence and topic diversity, and on the rationality of the topic hierarchy.
TableDreamer: Progressive and Weakness-guided Data Synthesis from Scratch for Table Instruction Tuning (2025.findings-acl)

Copied to clipboard

Challenge: Existing methods for table instruction tuning are limited due to limited data diversity and lack of data quality.
Approach: They propose a weakness-guided data synthesis framework for table instruction tuning that explores the vast input space of table understanding tasks and then iterates through the input space.
Outcome: The proposed framework boosts the average accuracy of Llama3.1-8B-instruct by 11.62% with 27K GPT-4o synthetic data and outperforms state-of-the-art data synthesis baselines which use more training data.
MAVEN-ARG: Completing the Puzzle of All-in-One Event Understanding Dataset with Event Argument Annotation (2024.acl-long)

Copied to clipboard

Challenge: Existing datasets for event understanding have limited coverage due to complexity of tasks.
Approach: They propose a dataset that augments MAVEN datasets with event argument annotations . they propose 98,591 events and 290,613 arguments obtained with laborious human annotation .
Outcome: The proposed dataset is the first all-in-one dataset supporting event detection, event argument extraction, and event relation extraction.
Correctable-DST: Mitigating Historical Context Mismatch between Training and Inference for Improved Dialogue State Tracking (2022.emnlp-main)

Copied to clipboard

Challenge: Existing dialogue state tracking approaches predict the dialogue state of a target turn sequentially based on the ground-truth previous dialogue state.
Approach: They propose a method that predicts dialogue state sequentially based on previous dialogue state . they propose generating a previously “predicted” dialogue state using ground-truth previous dialogue states .
Outcome: The proposed method achieves 67.51%, 68.24%, 70.30%, 71.38%, and 81.27% joint goal accuracy on MultiWOZ 2.0-2.4 datasets.
DeepPresenter: Environment-Grounded Reflection for Agentic Presentation Generation (2026.findings-acl)

Copied to clipboard

Challenge: Existing presentation agents rely on predefined workflows and fixed templates to generate presentations.
Approach: They propose an agentic framework that adapts to diverse user intents and iterative refinement based on observation.
Outcome: The proposed framework can be used to generate presentations with environmental observations.
ChartM3: A Multi-Stage Code-Driven Pipeline for Constructing Multi-Dimensional and Multi-Step Visual Reasoning Data in Chart Comprehension (2025.findings-emnlp)

Copied to clipboard

Challenge: Currently, research on complex chart understanding tasks is limited . a pipeline for visual reasoning datasets addresses these limitations .
Approach: They propose a code-driven pipeline for generating visual reasoning datasets . pipeline integrates retrieval-augmented generation to retrieve professional chart templates .
Outcome: The proposed pipeline enhances chart diversity and data quality through model-based evaluation.
ReCreate: Reasoning and Creating Domain Agents Driven by Experience (2026.acl-long)

Copied to clipboard

Challenge: Large Language Model (LLM) agents are reshaping the industrial landscape, but tasks differ widely, making them labor-intensive to build.
Approach: They propose an experience-driven framework for the automatic creation of domain agents . they leverage agent interaction histories to provide rich concrete signals on success or failure .
Outcome: The proposed framework outperforms human-designed agents and existing methods in experiments across diverse domains.
Modeling Multi-Dimensional Cognitive States in Large Language Models under Cognitive Crowding (2026.findings-acl)

Copied to clipboard

Challenge: Existing Large Language Models (LLMs) mainly address isolated tasks such as emotion analysis or stance detection.
Approach: They propose a large-scale model that combines large-level annotations with hyperbolic space to model human cognitive states.
Outcome: The proposed model outperforms baseline models on cognitive dimensions on single dimension tasks while retaining strong hierarchical structure.
TeamLoRA: Boosting Low-Rank Adaptation with Expert Collaboration and Competition (2025.acl-long)

Copied to clipboard

Challenge: Existing methods for fine-tuning are resource-efficient, but performance often falls short . a new approach, TeamLoRA, integrates collaborative and competitive modules to improve performance.
Approach: They propose to introduce task-specific LoRA as domain experts to improve learning efficiency . teamLoRA integrates collaborative and competition modules to improve model learning .
Outcome: Experiments show that TeamLoRA improves performance in multi-task learning . teamLorea integrates collaborative and competitive modules to improve performance .
More Data, More Relations, More Context and More Openness: A Review and Outlook for Relation Extraction (2020.aacl-main)

Copied to clipboard

Challenge: Existing methods for extracting relational facts from text have been successful . but with explosion of Web text, human knowledge is increasing drastically .
Approach: They propose to improve relation extraction methods to extract relational facts from text . they analyze existing methods and show promising directions towards more powerful RE .
Outcome: The proposed methods can extract relational facts from text, but they are still lacking in the current field.
MTVQA: Benchmarking Multilingual Text-Centric Visual Question Answering (2025.findings-acl)

Copied to clipboard

Challenge: Text-Centric Visual Question Answering (TEC-VQA) is a text-centric visual task understanding tool.
Approach: They introduce a benchmark that features human expert annotations across 9 languages . they prioritize the text in question-answer pairs while disregarding visual text in images .
Outcome: The proposed benchmarks prioritize the text in question-answer pairs while disregarding visual text in images.
DeepMed: Building a Medical DeepResearch Agent via Multi-hop Med-Search Data and Turn-Controlled Agentic Training & Inference (2026.findings-acl)

Copied to clipboard

Challenge: Medical reasoning models are constrained by parametric knowledge and can induce hallucinations and spurious attributions.
Approach: They propose a model that uses a multi-hop med-search QA synthesis method to apply the DR paradigm in medical contexts.
Outcome: The proposed model outperforms larger medical reasoning models on medical benchmarks.
Active Sentence Learning by Adversarial Uncertainty Sampling in Discrete Space (2020.findings-emnlp)

Copied to clipboard

Challenge: Existing uncertainty sampling methods are time-consuming and can't be executed frequently.
Approach: They propose adversarial uncertainty sampling in discrete space to find informative unlabeled text samples for annotation using adversarials.
Outcome: The proposed approach outperforms baselines on effectiveness on five datasets.
CTRLEval: An Unsupervised Reference-Free Metric for Evaluating Controlled Text Generation (2022.acl-long)

Copied to clipboard

Challenge: Existing reference-free metrics have obvious limitations for evaluating controlled text generation models.
Approach: They propose an unsupervised reference-free metric which evaluates controlled text generation from different aspects by formulating each aspect into multiple text infilling tasks.
Outcome: The proposed metric has higher correlations with human judgments while obtaining better generalization of evaluating generated texts from different models and with different qualities.
M3-VQA: A Benchmark for Multimodal, Multi-Entity, Multi-Hop Visual Question Answering (2026.acl-long)

Copied to clipboard

Challenge: Existing knowledge-based VQA benchmarks focus on coarse-grained categories and simple reasoning over single entities.
Approach: They propose a knowledge-based Visual Question Answering benchmark to enhance multimodality evaluation.
Outcome: The proposed benchmark improves evaluation of multimodal large language models in fine-grained multimodal entity understanding and complex multihop reasoning.
RMTBench: Benchmarking LLMs Through Multi-Turn User-Centric Role-Playing (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing benchmarks focus on character-centric approach and fail to reflect real-world applications.
Approach: RMTBench is a user-centric bilingual role-playing benchmark featuring 80 diverse characters and over 8,000 dialogue rounds.
Outcome: RMTBench features 80 diverse characters and over 8,000 dialogue rounds.
SciVQR: A Multidisciplinary Multimodal Benchmark for Advanced Scientific Reasoning Evaluation (2026.findings-acl)

Copied to clipboard

Challenge: Existing benchmarks for multimodal large language models fail to capture complexity and traceability of reasoning processes . SciVQR includes domain-specific visuals and challenges models to combine visual comprehension with reasoning.
Approach: They propose a multimodal benchmark for scientific reasoning covering 54 subfields . SciVQR includes domain-specific visuals and challenges models to combine visual comprehension with reasoning .
Outcome: SciVQR evaluates 54 subfields in mathematics, physics, chemistry, geography, astronomy, and biology . the results highlight the need for improved multi-step reasoning and integration of interdisciplinary knowledge .
GAPO: Robust Advantage Estimation for Real-World Code LLMs (2026.findings-acl)

Copied to clipboard

Challenge: Reinforcement learning (RL) is widely used for post-training large language models (LLMs) in code editing, but in real-world code editing scenarios, reward distributions are often skewed with unpredictable noise, leading to distorted advantage computation and increased rollout outliers.
Approach: They propose a group-relative method that finds an interval with the highest SNR and uses the median of that interval as an adaptive Q to replace the group mean in advantage calculation.
Outcome: The proposed method improves on nine instruction-tuned LLMs while remaining plug-and-play and efficient.
RealMedDial: A Real Telemedical Dialogue Dataset Collected from Online Chinese Short-Video Clips (2022.coling-1)

Copied to clipboard

Challenge: Existing medical dialogue systems are limited by the lack of corpora and data from real scenarios.
Approach: They construct a Chinese medical dialogue dataset based on real medical consultations.
Outcome: The proposed dataset is applicable to a wide range of NLP tasks with respect to medical dialogue.
X-LeBench: A Benchmark for Extremely Long Egocentric Video Understanding (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing benchmark datasets focus on short to moderately long videos, leaving a substantial gap in evaluating extensive, ultra-long egocentric video recordings.
Approach: X-LeBench is a benchmark dataset designed to evaluate long egocentric video recordings . it uses a life-logging pipeline to produce realistic, coherent daily plans .
Outcome: X-LeBench is a new benchmark dataset designed to evaluate long-form egocentric video understanding . the approach produces realistic, coherent daily plans aligned with real-world video data .
CIF-Bench: A Chinese Instruction-Following Benchmark for Evaluating the Generalizability of Large Language Models (2024.findings-acl)

Copied to clipboard

Challenge: a recent study shows that large language models have limited generalization in low-resource languages like Chinese.
Approach: They propose to evaluate the zero-shot generalizability of large language models to the Chinese language . they release only half of the dataset publicly, with the remainder kept private .
Outcome: The Chinese Instruction-Following Benchmark evaluates the generalizability of LLMs to the Chinese language.
Multi-task Adversarial Attacks against Black-box Model with Few-shot Queries (2025.acl-long)

Copied to clipboard

Challenge: Existing adversarial text attacks rely on abundant access to shared internal features and numerous queries, limited to a single task type.
Approach: They propose a black-box attack that exploits the transferability of adversarial texts . they use a deep-level substitute model trained in a plug-and-play manner for text classification .
Outcome: The proposed attack can target multiple tasks with minimal perturbations . it can target commercial APIs, large language models, and image-generation models .
Incorporating Chinese Characters of Words for Lexical Sememe Prediction (P18-1)

Copied to clipboard

Challenge: Existing methods of lexical sememe prediction rely on external context information of words to represent meaning.
Approach: They propose a character-enhanced sememe prediction framework for Chinese language that takes advantage of internal character information and external context information.
Outcome: The proposed framework outperforms state-of-the-art methods on a Chinese sememe knowledge base and maintains robust performance even for low-frequency words.
Cross-lingual Lexical Sememe Prediction (D18-1)

Copied to clipboard

Challenge: Sememes are defined as the minimum semantic units of human languages . but most languages do not have sememe-based linguistic knowledge bases . a new framework is proposed to predict sememes for words in other languages based on semems .
Approach: They propose a framework to model correlations between sememes and multi-lingual words in low-dimensional semantic space for sememe prediction.
Outcome: The proposed model improves on baseline methods on real-world datasets.
Expressing Visual Relationships via Language (P19-1)

Copied to clipboard

Challenge: Current studies on image captioning focus on single image, but there are no effective models for generating relational captions for two images.
Approach: They propose a language-guided image editing dataset that contains real image pairs with corresponding editing instructions.
Outcome: The proposed model outperforms baseline and existing methods on two datasets.
MAVEN-ERE: A Unified Large-scale Dataset for Event Coreference, Temporal, Causal, and Subevent Relation Extraction (2022.emnlp-main)

Copied to clipboard

Challenge: Existing datasets only cover limited relation types at once, which prevents models from taking full advantage of relation interactions.
Approach: They construct a large-scale human-annotated ERE dataset with improved annotation schemes to address these drawbacks.
Outcome: The proposed dataset is larger than existing datasets of all the ERE tasks by at least an order of magnitude.
MorphoBench: A Benchmark with Difficulty Adaptive to Model Reasoning (2026.findings-acl)

Copied to clipboard

Challenge: Existing benchmarks designed to evaluate the reasoning capabilities of large models are limited in scope and lack flexibility to adapt difficulty according to evolving reasoning capacities of models.
Approach: They propose a benchmark that incorporates multidisciplinary questions to evaluate the reasoning capabilities of large models and can adjust and update question difficulty based on the reasoning abilities of advanced models.
Outcome: The proposed benchmark incorporates multidisciplinary questions to evaluate the reasoning capabilities of large models and can adjust and update question difficulty based on the reasoning abilities of advanced models.
Pre-training Multilingual Neural Machine Translation by Leveraging Alignment Information (2020.emnlp-main)

Copied to clipboard

Challenge: Existing pre-training methods are not effective for machine translation tasks.
Approach: They propose a method to pre-train a universal multilingual neural machine translation model . they use random aligned substitution technique to bring words and phrases with similar meanings closer in the representation space.
Outcome: The proposed approach improves translation quality on low, medium, rich resource languages.
Stable Language Guidance for Vision–Language–Action Models (2026.acl-long)

Copied to clipboard

Challenge: Existing vision-Language-Action models are notoriously brittle to linguistic perturbations.
Approach: They propose a probabilistic framework that disentangles physical affordance from semantic execution.
Outcome: The proposed framework disentangles physical affordance from semantic execution.
Better Literary Translation: A Multi-Aspect Data Generation and LLM Training Approach (2026.acl-industry)

Copied to clipboard

Challenge: Literary translation requires balancing expression fluency with literary effect due to the scarcity of high-quality training data and the difficulty of capturing nuanced quality trade-offs.
Approach: They propose a multi-aspect iterative refinement framework that generates high-quality translation references and preference data through specialized LLM translators.
Outcome: The proposed models outperform the ground truth for SFT by 8.65 CEA100 points while leveraging an explicit reward model for GRPO yields an additional 1.51 point improvement.
CausalMACE: Causality Empowered Multi-Agents in Minecraft Cooperative Tasks (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing work on multi-agent collaborative tasks in Minecraft is limited due to inefficiency and limited fault tolerance.
Approach: They propose a framework that incorporates causality to manage dependencies among subtasks.
Outcome: The proposed framework achieves state-of-the-art performance in multi-agent cooperative tasks of Minecraft.
UCL-Bench: A Chinese User-Centric Legal Benchmark for Large Language Models (2025.findings-naacl)

Copied to clipboard

Challenge: Existing legal benchmarks focusing on knowledge and logic evaluate LLMs on various tasks in legal domain, but few have explored the practical application of LLM by actual users.
Approach: They propose a Chinese user-centric legal benchmark that aims to assess the practical application of LLMs by real users.
Outcome: The proposed model outperforms existing models on various tasks in legal domain but does not outperfect ChatGPT.
DUET: Joint Exploration of User–Item Profiles in Recommendation System (2026.findings-acl)

Copied to clipboard

Challenge: Existing LLMs are opaque and difficult to interpret, resulting in limited interpretability.
Approach: They propose an interaction-aware profile generator that jointly produces user and item profiles conditioned on both user history and item evidence.
Outcome: The proposed model outperforms baselines on three real-world datasets.
Not All Directions Matter: Towards Structured and Task-Aware Low-Rank Model Adaptation (2026.acl-long)

Copied to clipboard

Challenge: Low-Rank Adaptation (LoRA) is a key parameter-efficient fine-tuning method . however, its effectiveness is hampered by semantic drift and structural incoherence .
Approach: They propose a low-rank Adaptation framework that tackles semantic drift and structural incoherence by pruning task-irrelevant directions.
Outcome: Experiments on large language models, vision models, and vision models show that the proposed framework outperforms LoRA and advanced dynamic rank allocation and sparsity-based methods.
Meta-Cognitive Analysis: Evaluating Declarative and Procedural Knowledge in Datasets and Large Language Models (2024.lrec-main)

Copied to clipboard

Challenge: Recent advances in large language models have push NLP into a new era, moving away from traditional task-specific pre-train finetuning paradigm.
Approach: They provide a comprehensive analysis of declarative and procedural knowledge for large language models and evaluate their effectiveness.
Outcome: The proposed model can perform better with both kinds of knowledge, but at different speeds.
Does Acceleration Cause Hidden Instability in Vision Language Models? Uncovering Instance-Level Divergence Through a Large-Scale Empirical Study (2025.emnlp-main)

Copied to clipboard

Challenge: Current acceleration evaluations focus on minimal overall performance degradation . however, accelerated models can exhibit significant changes in instance-level predictions .
Approach: They investigate whether accelerated vision-Language Models can still give the same answers as before . they found that accelerated models changed original answers up to 20% of the time .
Outcome: The results show that accelerated models changed their original answers up to 20% of the time.
Learning Logic Rules for Document-Level Relation Extraction (2021.emnlp-main)

Copied to clipboard

Challenge: Existing models for document-level relation extraction relied on implicitly powerful representations, which makes the model less transparent.
Approach: They propose a probabilistic model for document-level relation extraction by learning logic rules.
Outcome: The proposed model outperforms baseline models in relation performance and logical consistency.
Beyond the Surface: Measuring Self-Preference in LLM Judgments (2025.emnlp-main)

Copied to clipboard

Challenge: Existing methods measure self-preference bias by comparing the scores a judge model assigns to its own responses with those assigned to other models.
Approach: They propose to use gold judgments as proxies for the actual quality of responses . they propose to measure self-preference bias as the difference between the judge model's own and other models' scores .
Outcome: The proposed method can assess self-preference bias across large language models . it uses gold judgments as proxies for the ground truth scores of the judge model .
Match, Compare, or Select? An Investigation of Large Language Models for Entity Matching (2025.coling-main)

Copied to clipboard

Challenge: Entity matching (EM) is a critical step in entity resolution (ER).
Approach: They propose a method that incorporates record interactions from different perspectives.
Outcome: The proposed framework improves on 8 ER datasets and 10 LLMs and achieves higher efficiency and effectiveness.
LongInsightBench: A Comprehensive Benchmark for Evaluating Omni-Modal Models on Human-Centric Long-Video Understanding. (2026.findings-acl)

Copied to clipboard

Challenge: LongInsightBench is the first benchmark designed to assess models’ ability to understand long videos, with a focus on human language, viewpoints, actions, and other contextual elements.
Approach: They propose a benchmark to assess models’ ability to understand long videos with a focus on human language, viewpoints, actions, and other contextual elements.
Outcome: The proposed model excels in three key areas: a) long-duration, human-centric videos; b) diversifying and challenging task scenarios; c) quality assurance pipeline; and d) reliability.
Self-Steering Optimization: Autonomous Preference Optimization for Large Language Models (2025.findings-acl)

Copied to clipboard

Challenge: Prior research focused on developing data generation methods, while insufficient attention has been paid to quality control mechanisms and often produces inaccurate and unhelpful data.
Approach: They propose an algorithm that automatically generates high-quality preference data, eliminating manual annotation requirements.
Outcome: The proposed algorithm outperforms baselines in human preference alignment and reward optimization.
Graph Neural Networks with Generated Parameters for Relation Extraction (P19-1)

Copied to clipboard

Challenge: Existing graph neural networks can only process multi-hop relational reasoning on pre-defined graphs and cannot be directly applied in natural language relational reasoning.
Approach: They propose a graph neural network with generated parameters using natural language sentences as inputs.
Outcome: The proposed model can process relational reasoning on graphs and in natural language processing tasks.
Chain-of-Thought Reasoning in Tabular Language Models (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing approaches to extend chain-of-thought reasoning into large language models are not viable in the scenario of privatization deployment or limited resources.
Approach: They propose a framework that extends chain-of-thought reasoning into tabular language models . framework coordinates two TaLMs responsible for CoT generation and answer inference .
Outcome: The proposed framework outperforms the state-of-the-art ChatGPT on the TABMWP dataset by 9.55% (82.60%92.15% in accuracy) with less parameters (0.8B).
LVPruning: An Effective yet Simple Language-Guided Vision Token Pruning Approach for Multi-modal Large Language Models (2025.findings-naacl)

Copied to clipboard

Challenge: Multi-modal Large Language Models (MLLMs) incur significant computational overhead due to the large number of vision tokens processed, limiting their practicality in resource-constrained environments.
Approach: They propose a language-guided vision token pruning method that can be integrated into existing MLLMs with minimal architectural changes.
Outcome: The proposed method reduces vision tokens by 90% and preserves model performance.
Dynamically Fused Graph Network for Multi-hop Reasoning (P19-1)

Copied to clipboard

Challenge: Text-based question answering (TBQA) has been studied extensively in recent years.
Approach: They propose a Dynamically Fused Graph Network to answer questions requiring multiple scattered evidence and reasoning over them.
Outcome: The proposed method achieves competitive results on a public TBQA dataset and produces interpretable reasoning chains.
AutoAlign: Get Your LLM Aligned with Minimal Annotations (2025.acl-demo)

Copied to clipboard

Challenge: Automated Alignment (ALM) is a set of algorithms designed to align Large Language Models (LLMs) with human intentions and values while minimizing manual intervention.
Approach: They propose an open-source toolkit that integrates mainstream automated algorithms through a consistent interface and an accessible workflow supporting one-click execution for prompt synthesis and automatic alignment signal construction.
Outcome: The proposed framework enables easy reproduction of existing results through extensive benchmarks and facilitates the development of novel approaches via modular components.
CFBench: A Comprehensive Constraints-Following Benchmark for LLMs (2025.acl-long)

Copied to clipboard

Challenge: Existing evaluations of Large Language Models (LLMs) focus on fragmented constraints or narrow scenarios, but they overlook the comprehensiveness and authenticity of constraints from the user’s perspective.
Approach: They propose a Chinese Comprehensive Constraints Following Benchmark for LLMs that compiles constraints from real-world instructions and constructs a systematic framework for constraint types.
Outcome: The proposed framework integrates multi-dimensional assessment criteria with requirement prioritization, covering various perspectives of constraints, instructions, and requirement fulfillment.
Neural Finite-State Transducers: Beyond Rational Relations (N19-1)

Copied to clipboard

Challenge: a finite state transducer defines joint and conditional probability distributions over strings . a weighted finite-state transducers can only model certain functions, known as the rational relations .
Approach: They propose a family of string transduction models defining joint and conditional probability distributions over pairs of strings.
Outcome: The proposed models are more powerful than previous finite-state models with neural features.
IM-TQA: A Chinese Table Question Answering Dataset with Implicit and Multi-type Table Structures (2023.acl-long)

Copied to clipboard

Challenge: Existing benchmarks only evaluate model performance on tables with explicit table structures, which means headers are explicitly annotated and treated as model input during inference.
Approach: They propose a new Table Question Answering (TQA) dataset with implicit and multi-type table structures that requires the model to understand tables without directly available header annotations.
Outcome: The proposed framework outperforms baselines on a dataset with implicit and multi-type table structures and can handle multi-table tables including previously neglected complex tables.
Prompt Tuning for Unified Multimodal Pretrained Models (2023.findings-acl)

Copied to clipboard

Challenge: Prompt tuning has demonstrated success in natural language pretraining and even vision pretraining.
Approach: They propose to apply prompt tuning to a unified sequence-to-sequence pretrained model by adding a sequence of learnable embeddings to each layer and finetuning the pretrained models on downstream tasks.
Outcome: The proposed method outperforms other parameter-efficient tuning methods on multimodal models and is robust against adversarial attacks.
Token-level Proximal Policy Optimization for Query Generation (2025.emnlp-main)

Copied to clipboard

Challenge: Large Language Models (LLMs) have improved search engines and recommendation systems through their text understanding capabilities.
Approach: They propose a token-level proximal policy optimization approach to empower LLMs to perform better in query generation through fine-tuning.
Outcome: The proposed approach outperforms existing LLMs on an open-source and industrial dataset.
Plug-and-Play Data Module for Code RL: Adaptive Ambiguity Replay (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches to reinforcement learning (RL) rely on static, in-epoch metrics that overlook training dynamics, often introducing low-utility or outdated data.
Approach: They propose a plug-and-play module that prioritizes cross-epoch ambiguous samples to neutralize the noise from stale experiences.
Outcome: Extensive experiments on nine LLMs show that Adaptive Ambiguity Replay outperforms state-of-the-art baselines on real-world code editing tasks.
QaRL: Rollout-Aligned Quantization-Aware RL for Fast and Stable Training under Training–Inference Mismatch (2026.findings-acl)

Copied to clipboard

Challenge: Recent work has shown that reinforcement learning with simple rule-based reward functions (RLVR) can induce emergent reasoning behaviors and yield gains in challenging domains such as math problem solving.
Approach: They propose a rollout-alignment-quantization-aware RL which aligns training-side forward with the quantized rollout to minimize mismatch.
Outcome: The proposed approach outperforms quantized-rollout training by +5.5 on Qwen3-30B-A3B MoE for math problems while maintaining low-bit throughput.
Glancing Transformer for Non-Autoregressive Neural Machine Translation (2021.acl-long)

Copied to clipboard

Challenge: Existing non-autoregressive neural machine translation methods are either inferior to Transformer or require multiple decoding passes, leading to reduced speedup.
Approach: They propose a Glancing Language Model (GLM) for single-pass parallel generation models and Glancing Transformer (GLAT) with only single- pass decoding, GLAT is able to generate high-quality translation with 8-15 speedup.
Outcome: The proposed model outperforms all previous non-autoregressive methods on multiple language directions and is nearly comparable to Transformer.
Rethinking Entropy Interventions in RLVR: An Entropy Change Perspective (2026.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) have remarkable reasoning capabilities in complex tasks such as mathematics and coding.
Approach: They propose an entropy-modulation method that adaptively reweighs tokens based on theoretically-estimated entropic variations.
Outcome: The proposed method outperforms state-of-the-art methods in six mathematical reasoning and three coding benchmarks.
PPTAgent: Generating and Evaluating Presentations Beyond Text-to-Slides (2025.emnlp-main)

Copied to clipboard

Challenge: Existing methods for generating presentations from documents focus on improving and evaluating content quality in isolation, overlooking visual appeal and structural coherence.
Approach: They propose an edit-based presentation generation system that analyzes and iterates on slides to create new slides.
Outcome: The proposed presentation generation tool outperforms existing methods in three dimensions . it analyzes slides, iterates and generates edit actions based on selected slides .
Exploring Backdoor Vulnerabilities of Chat Models (2025.coling-main)

Copied to clipboard

Challenge: Recent studies show that Large Language Models (LLMs) are susceptible to a security threat known as Backdoor Attack.
Approach: They propose a backdoor attack method that distributes trigger scenarios across user inputs in different rounds and makes the backdoor be triggered only when all trigger scenarios have appeared in the historical conversations.
Outcome: The proposed method achieves high attack success rates on chat models while maintaining normal capabilities on providing helpful responses to benign user requests.
LEPO: Latent Reasoning Policy Optimization for Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Existing latent reasoning methods that use chain of thought (CoT) are limited to selecting one discrete token at each reasoning step, which potentially induces information loss.
Approach: They propose a framework that injects controllable stochasticity into latent reasoning via Gumbel-Softmax, restoring LLMs' exploratory capacity and enhancing their compatibility with Reinforcement Learning (RL).
Outcome: The proposed framework preserves richer information for more comprehensive reasoning and is compatible with Reinforcement Learning (RL).
ROSE: Robust Selective Fine-tuning for Pre-trained Language Models (2022.emnlp-main)

Copied to clipboard

Challenge: Recent studies have highlighted the lack of adversarial robustness in pre-trained models.
Approach: They propose a fine-tuning approach that conducts selective updates when adapting pre-trained models to downstream tasks.
Outcome: The proposed approach improves adversarial robustness on downstream tasks . it eliminates spurious updates, leading to flatter and wider optima than the conventional method .
TrimTokenator: Towards Adaptive Visual Token Pruning for Large Multimodal Models (2026.findings-acl)

Copied to clipboard

Challenge: Existing token pruning methods rely on costly calibration or suboptimal importance metrics, leading to redundant retained tokens.
Approach: They propose a token pruning strategy that preserves cross-modal alignment and informational diversity.
Outcome: The proposed method maintains strong performance while reducing tokens by 88.9% on two models.
Cognitive Policy-Driven LLM for Diagnosis and Intervention of Cognitive Distortions in Emotional Support Conversation (2026.acl-long)

Copied to clipboard

Challenge: Existing models for ESC ignore cognitive distortions in help-seekers' expressions . current models provide basic emotional comfort, rather than helping help- seekers address psychological distress at a deeper cognitive level.
Approach: They propose a Large Language Model framework to enhance LLMs' ability to diagnose and intervene cognitive distortions in help-seekers.
Outcome: The proposed framework outperforms 15 state-of-the-art baselines in terms of distortion diagnosis accuracy, intervention strategy effectiveness, and safety risk control.
WebDP: Understanding Discourse Structures in Semi-Structured Web Documents (2023.findings-acl)

Copied to clipboard

Challenge: Web documents are one of the most primary and biggest data resources in current era, and understanding their discourse structure will benefit various downstream document processing applications.
Approach: They propose a web document discourse structure representation schema by extending classical discourse theories and adding special features to well represent discourse characteristics of web documents.
Outcome: The proposed task is feasible but challenging for current models.
Language Modeling with Sparse Product of Sememe Experts (D18-1)

Copied to clipboard

Challenge: Existing language modeling methods rely on large-scale text data to learn the sequential patterns of words.
Approach: They propose to use sememes to represent the implicit semantics behind words for language modeling . they propose to employ sememe-driven language models to fine-grained semem-level semantics .
Outcome: Experiments on language modeling and the downstream application of headline generation show the effectiveness of SDLM.
CoreCodeBench: Decoupling Code Intelligence via Fine-Grained Repository-Level Tasks (2026.acl-long)

Copied to clipboard

Challenge: Existing large language models for software engineering rely on coarse-grained pass rates obscuring specific cognitive bottlenecks.
Approach: They propose a repository-level benchmark that dissects coding capabilities through atomized tasks.
Outcome: The proposed framework achieves a 78.55% validity yield, surpassing the 31.7% retention rate of SWE-bench-Verified.
MAPLE: Enhancing Review Generation with Multi-Aspect Prompt LEarning in Explainable Recommendation (2025.acl-long)

Copied to clipboard

Challenge: Existing models that generate generic aspects do not provide personalized informative recommendations.
Approach: They propose a model that integrates aspect category as another input dimension to facilitate memorizing fine-grained aspect terms.
Outcome: The proposed model outperforms baseline model on restaurant review datasets in the restaurant domain.
SolEval: Benchmarking Large Language Models for Repository-level Solidity Smart Contract Generation (2025.emnlp-main)

Copied to clipboard

Challenge: Existing methods focus on Python and Java, neglecting Solidity, the programming language for Ethereum smart contracts.
Approach: They construct a repository-level benchmark for Solidity to evaluate the performance of LLMs on Ethereum.
Outcome: The proposed benchmarks show that the best performing LLM achieves only 26.29% Pass@10, highlighting room for improvement in Solidity code generation.
HCRE: LLM-based Hierarchical Classification for Cross-Document Relation Extraction with a Prediction-then-Verification Strategy (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches to cross-document relation extraction (RE) focus on identifying relations between head and tail entities from single sentence or document.
Approach: They propose a hierarchical relation tree-based LLM-based hierarchic classification model for cross-document relation extraction (HCRE) based on predefined relations, the model can perform hierarchically classification level by level.
Outcome: The proposed model outperforms existing baselines and validates its effectiveness.
A Multi-answer Multi-task Framework for Real-world Machine Reading Comprehension (D18-1)

Copied to clipboard

Challenge: Existing models of machine reading comprehension (MRC) are based on cloze style questions or crowdworkers given a short passage from well-edited sources.
Approach: They propose a multi-answer multi-task framework that uses multiple reference answers for multiple questions.
Outcome: The proposed model increases the ROUGE-L score on the DuReader dataset from 44.18, the previous state-of-the-art, to 51.09 .
Improving Text Generation with Student-Forcing Optimal Transport (2020.emnlp-main)

Copied to clipboard

Challenge: Maximum likelihood estimation (MLE) is used to train models, but during testing, the model is conditioned on previously generated tokens, resulting in exposure bias.
Approach: They propose to use optimal transport to match the sequences generated in MLE and test modes to reduce exposure bias.
Outcome: The proposed method is validated on machine translation, text summarization, and text generation tasks.
PsyQA: A Chinese Dataset for Generating Long Counseling Text for Mental Health Support (2021.findings-acl)

Copied to clipboard

Challenge: Existing research on text-based mental health counseling is limited due to the lack of relevant corpora in Chinese language.
Approach: They propose a Chinese dataset of psychological health support in the form of question and answer pair that is crawled from a mental health service platform and contains 22K questions and 56K long and wellstructured answers.
Outcome: The proposed dataset contains 22K questions and 56K long and wellstructured answers.
Investigating Inference-time Scaling for Chain of Multi-modal Thought: A Preliminary Study (2025.findings-acl)

Copied to clipboard

Challenge: Inference-time scaling of chain-of-thought (CoT) has been demonstrated as a promising approach for addressing multi-modal reasoning tasks.
Approach: They propose to integrate visual and textual modalities within the reasoning process . they adopt a consistency-enhanced verifier to ensure effective guidance for both methods across different thought paradigms.
Outcome: The proposed method outperforms text-only reasoning on 10 tasks spanning diverse domains and requires higher token consumption for processing richer visual inputs.
InTriage: Intelligent Telephone Triage in Pre-Hospital Emergency Care (2025.emnlp-demos)

Copied to clipboard

Challenge: Existing TT processes face challenges such as incomplete data collection, communication barriers, and manual errors, leading to high over-triage and under-triages rates.
Approach: They propose to use an AI-driven multilingual TT system to provide decision support for triage.
Outcome: The proposed system achieves word error rate of 14.57% for speech recognition and an F1 score of 73.34% for key information extraction.
EWEK-QA : Enhanced Web and Efficient Knowledge Graph Retrieval for Citation-based Question Answering Systems (2024.acl-long)

Copied to clipboard

Challenge: citation-based QA systems are suffering from two shortcomings . they usually rely only on web as a source of extracted knowledge and external knowledge sources can hamper the efficiency of the system.
Approach: They propose to use a web-based knowledge graph retrieval solution to enrich extracted knowledge fed to a citation-based QA system.
Outcome: The proposed model outperforms open-source state-of-the-art models in 7 quantitative and human evaluation tasks.
Learning from Context or Names? An Empirical Study on Neural Relation Extraction (2020.emnlp-main)

Copied to clipboard

Challenge: Existing datasets may leak shallow heuristics via entity mentions, thus contributing to the high performance on RE benchmarks.
Approach: They propose an entity-masked contrastive framework for relation extraction to gain a deeper understanding on textual context and type information while avoiding rote memorization of entities.
Outcome: The proposed framework improves the effectiveness and robustness of neural models in different RE scenarios.
A Survey on Foundation Language Models for Single-cell Biology (2025.acl-long)

Copied to clipboard

Challenge: Existing single-cell foundation language models are based on pre-trained and large language models.
Approach: They review the development of single-cell foundation language models . they discuss data tokenization strategies and pre-training paradigms .
Outcome: The proposed models have shown remarkable performance in a variety of single-cell data analysis tasks.
Dolphin: Document Image Parsing via Heterogeneous Anchor Prompting (2025.findings-acl)

Copied to clipboard

Challenge: Current document image parsing solutions rely on specialized models or generate content autoregressively.
Approach: They propose a multimodal document image parsing model that integrates specialized models with autogeneous content generation.
Outcome: The proposed model achieves state-of-the-art performance across diverse page-level and element-level settings while ensuring superior efficiency.
Imitation Learning for Non-Autoregressive Neural Machine Translation (P19-1)

Copied to clipboard

Challenge: Existing non-autoregressive translation models lack parallel decoding, which is a bottleneck for NMT decoding.
Approach: They propose a framework for non-autoregressive machine translation that emulates the autoregressive model by sampling sentence length in parallel.
Outcome: The proposed model achieves 31.85 BLEU on WMT16 RoEn and 30.68 BLUE on IWSLT16 EnDe on the IWSLD16, WMT14 and WMT15 datasets.
IntelliCockpitBench: A Comprehensive Benchmark to Evaluate VLMs for Intelligent Cockpit (2025.findings-acl)

Copied to clipboard

Challenge: Visual Question Answering (VQA) is a key task in vehicular systems.
Approach: They propose a benchmark that encompasses diverse automotive scenarios . they use images from front, side, and rear cameras, various road types, weather conditions, and interior views .
Outcome: The proposed benchmark includes images from front, side, and rear cameras, various road types, weather conditions, and interior views.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations