Papers by Hang Liu

65 papers
Through the MUD: A Multi-Defendant Charge Prediction Benchmark with Linked Crime Elements (2024.acl-long)

Copied to clipboard

Challenge: Existing charge prediction datasets focus on single-defendant cases, but real-world cases involve multiple defendants.
Approach: They propose a benchmark that encompasses legal cases involving multiple defendants . they develop an interpretable model called EJudge that incorporates crime elements and legal rules to infer charges.
Outcome: The proposed model outperforms state-of-the-art models in predicting crime charges while providing corresponding rationales.
Step-level Verifier-guided Hybrid Test-Time Scaling for Large Language Models (2025.emnlp-main)

Copied to clipboard

Challenge: Recent training-based TTS methods, such as continued reinforcement learning, have surged in popularity, while training-free TTS approaches are gradually fading from prominence.
Approach: They propose a fine-grained sequential scaling method guided by process verification that integrates training-free TTS methods with other classical parallel scaling methods at the step level.
Outcome: Experiments on five instruction-tuned large language models (LLMs) show that training-free TTS methods can extend reasoning performance boundaries.
MDSEval: A Meta-Evaluation Benchmark for Multimodal Dialogue Summarization (2025.findings-emnlp)

Copied to clipboard

Challenge: Multimodal Dialogue Summarization (MDS) is a critical task with wide-ranging applications.
Approach: They propose a meta-evaluation benchmark for multimodal dialogue summarization based on image-sharing dialogues, corresponding summaries and human judgments .
Outcome: The proposed framework is the first to identify and formalize key evaluation dimensions specific to MDS.
From Selection to Refinement: Iterative Optimization for Instruction Data (2026.acl-long)

Copied to clipboard

Challenge: Existing methods to optimize instruction tuning datasets face two main challenges: unreasonable pruning of potentially valuable low-quality data and the persistence of noise or semantic drift during revision.
Approach: They propose an automated iterative framework for instruction data optimization that prunes low-quality data and refines low quality data using feedback-driven iteration.
Outcome: The proposed framework outperforms state-of-the-art methods on seven public benchmark datasets with high data efficiency.
Identifying Semantic Induction Heads to Understand In-Context Learning (2024.findings-acl)

Copied to clipboard

Challenge: Large language models (LLMs) have demonstrated remarkable performance, but lack of transparency in their inference logic raises concerns about their trustworthiness.
Approach: They conduct a detailed analysis of the operations of attention heads to understand their in-context learning of LLMs.
Outcome: The proposed analysis of attention heads reveals that they increase the output logits of object tokens and recall objects . the proposed model is a novel approach to understand the in-context learning of large language models.
PTCSpell: Pre-trained Corrector Based on Character Shape and Pinyin for Chinese Spelling Correction (2023.findings-acl)

Copied to clipboard

Challenge: Chinese spelling correction (CSC) is a task which detects incorrect characters in Chinese text and corrects them.
Approach: They propose to pre-train a Chinese spelling correction corrector under the detector-corrector architecture and propose to capture pronunciation and shape information in Chinese characters.
Outcome: The proposed corrector achieves an average of 5.8% F1 improvements over state-of-the-art methods, verifying its effectiveness.
Does syntax matter? A strong baseline for Aspect-based Sentiment Analysis with RoBERTa (2021.naacl-main)

Copied to clipboard

Challenge: Aspect-based sentiment analysis (ABSA) is a fine-grained task in sentiment analysis.
Approach: They compare a model with a dependency parser and a tree from a fine-tuned RoBERTa model to find the polarities for aspects in a sentence.
Outcome: The proposed model outperforms the parser-provided tree on six datasets across four languages.
Guided Knowledge Generation with Language Models for Commonsense Reasoning (2024.findings-emnlp)

Copied to clipboard

Challenge: Large Language Models (LLMs) have achieved notable success in commonsense reasoning tasks, benefiting from extensive world knowledge acquired through extensive pretraining.
Approach: They propose a method to generate knowledge explanations and to automatically assign labels based on the probability of correct answers.
Outcome: The proposed method outperforms baselines on four widely-used commonsense reasoning benchmarks and shows that it can generate high quality knowledge leading to correct answers.
Noisy Pair Corrector for Dense Retrieval (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing dense retrieval models assume that query-document pairs are exactly matched, resulting in mismatched-pair noise.
Approach: They propose a novel approach to train an effective model with mismatched-pair noise.
Outcome: The proposed model performs well on natural question and triviaQA, code-search benchmarks and SO-DS.
CoCo: Coherence-Enhanced Machine-Generated Text Detection Under Low Resource With Contrastive Learning (2023.emnlp-main)

Copied to clipboard

Challenge: Recent proposed methods fail to consider the linguistic structure of texts and lack the ability to handle the low-resource problem.
Approach: They propose a coherence-based contrastive learning model named CoCo to detect MGTs under low-resource scenario.
Outcome: The proposed model outperforms state-of-the-art methods on two datasets and two self-constructed datasets.
Ask-Before-Detection: Identifying and Mitigating Conformity Bias in LLM-Powered Error Detector for Math Word Problem Solutions (2025.acl-long)

Copied to clipboard

Challenge: Recent studies have demonstrated the potential of large language models (LLMs) for automatic error detection in math word problems (MWPs).
Approach: They propose a framework that generates adaptive reference solutions using LLMs to enhance error detection by reducing conformity bias in MWPs.
Outcome: The proposed framework mitigates the performance gap between conventional and alternative solutions in MWPs, especially when combined with reasoning-enhancing techniques like chain-of-thought prompting.
CoBa: Convergence Balancer for Multitask Finetuning of Large Language Models (2024.emnlp-main)

Copied to clipboard

Challenge: Existing multi-task learning approaches for large language models fall short due to computational intensive or lack of simultaneous task convergence.
Approach: They propose a new multi-task learning approach that dynamically adjusts task weights during the training process, ensuring that the validation loss of all tasks progresses towards convergence at an even pace.
Outcome: The proposed approach improves the performance of large language models by up to 13% compared to the second-best approaches.
SynthRL: Scaling Visual Reasoning with Verifiable Data Synthesis (2026.findings-acl)

Copied to clipboard

Challenge: SynthRL synthesizes over 3.3K additional verifiable, challenging questions from approximately 8K seed samples.
Approach: They propose a scalable and guaranteed pipeline for automatic data scaling in reasoning-oriented RL training.
Outcome: The proposed pipeline synthesizes over 3.3K additional verifiable, challenging questions from approximately 8K seed samples.
CLEAR: A Framework Enabling Large Language Models to Discern Confusing Legal Paragraphs (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing work focuses on enabling LLMs to leverage legal rules to tackle complex legal reasoning tasks, but ignores their ability to understand legal rules.
Approach: They propose a legal paragraph prediction task that aims to predict the legal paragraph given criminal facts and a framework CLEAR to enhance their legal reasoning ability.
Outcome: The proposed model improves the ability of LLMs to analyze legal cases with the guidance of legal rule insights.
A Neural-Symbolic Approach to Natural Language Understanding (2022.findings-emnlp)

Copied to clipboard

Challenge: Pre-trained language models have enabled deep neural networks to perform natural language understanding tasks, but their performance can drastically deteriorate when logical reasoning is needed.
Approach: They propose a framework for NLU based on analogical reasoning based upon neural processing and logical reasoning using both neural and symbolic processing.
Outcome: The proposed framework outperforms state-of-the-art methods on two NLU tasks, question answering (QA) and natural language inference (NLI).
AnyGPT: Unified Multimodal LLM with Discrete Sequence Modeling (2024.acl-long)

Copied to clipboard

Challenge: Existing language models that use discrete representations for unified processing of various modalities are limited to text generation and do not include multimodal output.
Approach: They propose a multimodal language model that utilizes discrete representations for unified processing of various modalities.
Outcome: The proposed model can be trained stably without any alterations to existing models or training paradigms.
Balancing Knowledge Breadth and Task Depth for Effective Domain Adaptation Fine-Tuning (2026.findings-acl)

Copied to clipboard

Challenge: a lack of knowledge breadth and task depth can hinder curriculum learning in domains such as medicine and finance.
Approach: They propose a two-dimensional curriculum learning framework that coordinates model training along two orthogonal axes: the knowledge dimension and the task dimension.
Outcome: The proposed framework improves accuracy on medical evaluations by 2.49% and on financial evaluations 1.2% compared with the second-best method.
Towards Robust Few-Shot Relation Classification: Incorporating Relation Description with Agreement (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing approaches to recognize relational relationships with a few support samples are limited for unlimited queries.
Approach: They propose a simple but effective framework that uses relation descriptions as external knowledge to enhance the model’s comprehension of the relation semantics.
Outcome: The proposed framework outperforms strong baselines while being robust against various NOTA rates.
Efficient Transformer-based Large Scale Language Representations using Hardware-friendly Block Structured Pruning (2020.findings-emnlp)

Copied to clipboard

Challenge: Pretrained large-scale language models have been criticized for their limited weight storage and computational speed on hardware platforms.
Approach: They propose an efficient transformer-based large-scale language representation using hardware-friendly block structure pruning.
Outcome: The proposed model achieves 5.0x accuracy on GLUE benchmarks and 1.79x compression rate on DistilBERT.
Document-Level Relation Extraction via Pair-Aware and Entity-Enhanced Representation Learning (2022.coling-1)

Copied to clipboard

Challenge: Existing document-level relation extraction methods are sparse in relational entity pairs and the representation of entity pairs is insufficient.
Approach: They propose a Pair-Aware and Entity-Enhanced(PAEE) model to solve two challenges . they propose predicting potential relational entity pairs and assembling directional entity pairs .
Outcome: The proposed model can obtain state-of-the-art performance on four benchmark datasets . it can predict potential relational entity pairs and assemble directional entity pairs .
Collective Event Detection via a Hierarchical and Bias Tagging Networks with Gated Multi-level Attention Mechanisms (D18-1)

Copied to clipboard

Challenge: Existing approaches to ACE event detection treat multiple events in one sentence as independent ones and recognize them separately.
Approach: They propose a hierarchical and bias tagging network framework to detect multiple events in one sentence collectively and a gated multi-level attention mechanism to automatically extract and fuse the sentence-level and document-level information.
Outcome: The proposed framework outperforms state-of-the-art methods on a 2005 ACE dataset.
Classical Sequence Match Is a Competitive Few-Shot One-Class Learner (2022.coling-1)

Copied to clipboard

Challenge: Existing models that use transformers are unable to learn new knowledge in the few-shot scenarios.
Approach: They propose a few-shot one-class problem which takes a known sample as a reference to detect whether an unknown instance belongs to the same class.
Outcome: The proposed method significantly outperforms transformer models under meta-learning and fine-tuning.
Simple but Effective Compound Geometric Operations for Temporal Knowledge Graph Completion (2024.acl-long)

Copied to clipboard

Challenge: Current methods embed factual knowledge into continuous vector space and apply geometric operations to learn potential patterns in temporal knowledge graphs.
Approach: They propose a temporal knowledge graph completion method that uses two geometric operations to learn missing facts in temporal graphs.
Outcome: The proposed method significantly outperforms existing temporal knowledge graph embedding models.
TAG: Gradient Attack on Transformer-based Language Models (2021.findings-emnlp)

Copied to clipboard

Challenge: Recent studies show that publicly shared gradients in the training process can reveal the private training data to a third-party.
Approach: They propose a gradient attack algorithm to reconstruct the local training data using GLUE benchmarks.
Outcome: The proposed algorithm achieves 1.5x recover rate and 2.5x ROUGE-2 over previous methods without the need of ground truth label.
Hybrid Alignment Training for Large Language Models (2024.findings-acl)

Copied to clipboard

Challenge: Existing approaches to align large language models with instructions and preferences are conflicting . et al., 2023b) show that hybrid alignment training can outperform baselines .
Approach: They propose a hybrid alignment training approach based on alternating alignment and modified elastic weight consolidation methods to achieve better collaboration between different alignment tasks.
Outcome: The proposed approach outperforms baseline alignment training methods on summarization and dialogue tasks.
LongWanjuan: Towards Systematic Measurement for Long Text Quality (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing efforts to improve data quality have focused on deduplication and the evaluation of data diversity and difficulty.
Approach: They propose a set of metrics to evaluate the quality of long texts by evaluating three fundamental linguistic dimensions: coherence, cohesion, and complexity.
Outcome: The proposed model improves on long-text tasks with over 160B tokens and categorizes long texts into holistic, aggregated, and chaotic types.
TRUST: Towards Robust Social Bot Detection via Uncertainty-Guided Pseudo-Labeling and Graph Structure Purification (2026.findings-acl)

Copied to clipboard

Challenge: Existing graph-based detection models are vulnerable to deceptive message propagation, where bots deliberately interact with legitimate users.
Approach: They propose a framework to mitigate deceptive message propagation by node-level uncertainty estimation and graph structure purification.
Outcome: The proposed framework improves on three benchmark datasets and six GNN backbones on real-world social bots.
DCFEE: A Document-level Chinese Financial Event Extraction System based on Automatically Labeled Training Data (P18-4)

Copied to clipboard

Challenge: Existing methods to extract events from documents are limited due to the high cost of labeling . Experimental results demonstrate the effectiveness of a document-level Chinese financial event extraction system.
Approach: They propose a document-level Chinese financial event extraction framework which detects event mentions and extracts events from financial news.
Outcome: The proposed system detects event mentions and extracts events from financial news . it can generate large scale labeled data and extract events from entire document .
TP-RAG: Benchmarking Retrieval-Augmented Large Language Model Agents for Spatiotemporal-Aware Travel Planning (2025.emnlp-main)

Copied to clipboard

Challenge: Existing studies on large language models (LLMs) focus on basic plan validity, but neglect critical aspects such as route efficiency, POI appeal, and real-time adaptability.
Approach: They propose a benchmark for retrieval-augmented, spatiotemporal-aware travel planning that integrates retrieved trajectories with LLMs’ intrinsic reasoning.
Outcome: The proposed framework improves spatial efficiency and POI rationality while challenging universality and robustness due to conflicting references and noisy data.
Towards Provably Secure Generative AI: Reliable Consensus Sampling (2026.findings-acl)

Copied to clipboard

Challenge: Existing research on generative AI security is driven by mutually reinforcing attack and defense methodologies grounded in empirical experience.
Approach: They propose a new algorithm that uses a random sampling algorithm to control risk.
Outcome: The proposed algorithm improves robustness and utility while maintaining latency comparable to existing algorithms.
MUR: Momentum Uncertainty guided Reasoning for Large Language Models (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for optimizing reasoning quality are limited by overthinking.
Approach: They propose a method that allocates thinking budgets to critical reasoning steps by tracking and aggregating step-wise uncertainty over time.
Outcome: The proposed method reduces computation by over 45% on average while improving accuracy by 0.33–3.46%.
A Survey of Uncertainty Estimation Methods on Large Language Models (2025.findings-acl)

Copied to clipboard

Challenge: Large language models (LLMs) have demonstrated remarkable capabilities but could produce biased, hallucinated, or non-factual responses.
Approach: They propose to conduct extensive experimental evaluations of LLM uncertainty estimation methods . large language models have demonstrated remarkable capabilities across tasks .
Outcome: The proposed method could produce biased, hallucinated, or non-factual responses . a lack of comprehensive surveys on LLM uncertainty estimation is a problem .
Are Large Language Models (LLMs) Good Social Predictors? (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing studies suggest that Large Language Models can generate human-like responses, but it is unclear how well they work and where the plausible predictions derive from.
Approach: They propose to use LLMs to generate human-like responses by mutability and accessibility of social inputs to perform a social prediction task.
Outcome: The proposed model performs well in three realistic settings and a novel social prediction task.
XFormParser: A Simple and Effective Multimodal Multilingual Semi-structured Form Parser (2025.coling-main)

Copied to clipboard

Challenge: Document AI parsing semi-structured image form is a key information extraction task.
Approach: They propose a multimodal and multilingual semi-structured FORM PARSER which integrates SER and relation extraction into a unified framework.
Outcome: The proposed framework achieves up to 1.79% improvement on RE tasks in multilingual and zero-shot settings.
Genius: A Generalizable and Purely Unsupervised Self-Training Framework For Advanced Reasoning (2025.acl-long)

Copied to clipboard

Challenge: Existing methods for enhancing LLM reasoning rely on supervisory signals . current methods rely heavily on outcome supervision and auxiliary reward models .
Approach: They propose a gen-eralizable and purely unsupervised self-training framework to enhance LLM reasoning without supervision.
Outcome: The proposed framework improves LLM reasoning without supervision without external supervision.
DRAGON: Domain-specific Robust Automatic Data Generation for RAG Optimization (2026.findings-eacl)

Copied to clipboard

Challenge: Existing retrieval-augmented generation paradigms rely heavily on public knowledge . Existing RAGs reliant on public information and often falter when faced with domain-specific queries.
Approach: They propose a framework that combines a data-construction modeling approach with a scalable synthetic data-generation pipeline to optimize domain-specific retrieval performance.
Outcome: The proposed framework optimizes domain-specific retrieval performance and bolsters retriever robustness.
Disco-RAG: Discourse-Aware Retrieval-Augmented Generation (2026.acl-long)

Copied to clipboard

Challenge: Existing RAG strategies treat retrieved passages in a flat and unstructured way, which prevents the model from capturing structural cues and constrains its ability to synthesize knowledge from dispersed evidence across documents.
Approach: They propose a framework that explicitly injects discourse signals into the generation process.
Outcome: Experiments on question answering and long-document summarization benchmarks show the efficacy of the proposed framework.
GLGE: A New General Language Generation Evaluation Benchmark (2021.findings-acl)

Copied to clipboard

Challenge: Multi-task benchmarks focus on a range of Natural Language Understanding (NLU) tasks without considering the Natural Language Generation (NLG) models.
Approach: They propose a multi-task benchmark for evaluating the generalization capabilities of NLG models across eight language generation tasks.
Outcome: The proposed benchmarks are based on GLUE and Su-perGLUE for English and several other languages.
Toward Optimal LLM Alignments Using Two-Player Games (2025.findings-emnlp)

Copied to clipboard

Challenge: Alignment of large language models (LLM) is a process that ensures the model’s responses to user prompts align with human intentions and social values.
Approach: They propose an alignment method based on a two-agent game consisting of an adversarial agent and a defensive agent.
Outcome: The proposed method improves on a two-agent game with an adversarial agent and a defensive agent.
REALM: Recursive Relevance Modeling for LLM-based Document Re-Ranking (2025.emnlp-main)

Copied to clipboard

Challenge: Existing LLMs face ranking uncertainty, unstable top-k recovery, and high token cost due to token-intensive prompting.
Approach: They propose a re-ranking framework that captures uncertainty and refines LLM-derived relevance through recursive Bayesian updates.
Outcome: The proposed framework outperforms state-of-the-art re-rankers while reducing token usage and latency.
Reconstructing Event Regions for Event Extraction via Graph Attention Networks (2020.aacl-main)

Copied to clipboard

Challenge: Existing approaches for event extraction focus on sentence-level event extraction, but they lack a broader view of the document context.
Approach: They build graphs with candidate event filler extractions enriched by sentential embeddings as nodes and use graph attention networks to identify event regions in a document and aggregate event information.
Outcome: The proposed method performs well on two languages and shows that it is faster than previous methods.
Mathematical Word Problem Generation from Commonsense Knowledge Graph and Equations (2021.emnlp-main)

Copied to clipboard

Challenge: Existing models for generating mathematical word problems are lacking in educational assessment.
Approach: They propose an end-to-end neural model to generate diverse mathematical word problems from commonsense knowledge graph and equations.
Outcome: The proposed model outperforms the SOTA models in terms of evaluation metrics and topic relevance.
Divide and Conquer: Legal Concept-guided Criminal Court View Generation (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for creating rationales for criminal cases do not pay enough attention to the important legal concepts.
Approach: They propose a legal concept-guided court view generation framework that generates rationales based on predicted legal concepts . they first divide the court view into sub-views, then employ a solver and verifier to generate and select rationale.
Outcome: The proposed model generates coherent and coherent court views on a real-world criminal case dataset.
MedCPI: A Construct–Personalize–Integrate Framework for KG-enhanced Clinical Prediction (2026.findings-acl)

Copied to clipboard

Challenge: Existing KG-enhanced approaches to clinical prediction are limited . existing approaches to personalize and integrate knowledge are weakly controlled .
Approach: They propose a framework to integrate medical knowledge graphs into EHRs to support KG-enhanced clinical prediction.
Outcome: The proposed framework improves on MIMIC-III and MIMIC IV tasks.
Knowledge Enhanced Pre-training for Cross-lingual Dense Retrieval (2024.lrec-main)

Copied to clipboard

Challenge: Existing mPLMs neglect the importance of knowledge in cross-lingual dense retrieval.
Approach: They propose a novel mPLM that leverages knowledge to learn language-agnostic semantic representations from a multilingual knowledge base and an annotation of Wiki.
Outcome: The proposed model achieves strong multilingual and cross-lingual retrieval performance with significant improvements over existing mPLMs.
MM-Doc-R1: Training Agents for Long Document Visual Question Answering through Multi-turn Reinforcement Learning (2026.findings-acl)

Copied to clipboard

Challenge: Existing work on long document visual question answering is based on Retrieval-Augmented Generation (RAG) where textual or visual content is encoded into embeddings and relevance is determined by similarity scores with respect to the original query.
Approach: They propose a framework that employs an agentic, vision-aware workflow to address long document visual question answering through iterative information discovery and synthesis.
Outcome: The proposed framework outperforms existing RL systems by 10.4% on the MMLongbench-Doc benchmark and demonstrates superior training performance over GRPO.
Boosting Textural NER with Synthetic Image and Instructive Alignment (2024.findings-acl)

Copied to clipboard

Challenge: Named entity recognition (NER) is a key task reliant on textual data.
Approach: They propose a method to transform NER into a multimodal task by using images from the internet as auxiliaries.
Outcome: The proposed method surpasses all text-only baselines and improves F1 score by 1.4% to 2.3% on prominent MNER datasets.
RAPID: Efficient Retrieval-Augmented Long Text Generation with Writing Planning and Information Discovery (2025.findings-acl)

Copied to clipboard

Challenge: Existing methods for knowledge-intensive long texts struggle with issues like hallucinations, topic incoherence, and significant latency.
Approach: They propose a retrieval-augmented long text generation framework with writing P**lanning and I**nformation to address these challenges.
Outcome: The proposed framework outperforms state-of-the-art methods on a freshWiki-2024 dataset.
Document-level Event Extraction via Parallel Prediction Networks (2021.acl-long)

Copied to clipboard

Challenge: Document-level event extraction (DEE) is indispensable when events are described throughout a document.
Approach: They propose a document-level event extraction model that can extract structured events from a text in parallel.
Outcome: The proposed model outperforms current state-of-the-art methods on a document-level event extraction task.
COSIGN: Contextual Facts Guided Generation for Knowledge Graph Completion (2024.naacl-long)

Copied to clipboard

Challenge: Existing methods for knowledge graph completion (KGC) are limited in generality and scalability due to poor contextual facts.
Approach: They propose a contextual facts collector and contextual facts organizer to enhance the inference ability of GM-based methods for various KGC tasks.
Outcome: The proposed model outperforms state-of-the-art methods in terms of performance.
SeaLLMs - Large Language Models for Southeast Asia (2024.acl-demos)

Copied to clipboard

Challenge: Existing large language models favor high-resource languages, such as English, at the expense of low-resourced and regional languages.
Approach: They propose a series of language models that specifically focuses on Southeast Asian languages.
Outcome: SeaLLM models outperform ChatGPT-3.5 in non-Latin languages by large margins . linguistic disparity impedes access to state-of-the-art AI technologies for non-English-speaking populations .
Adaptive Schema-aware Event Extraction with Retrieval-Augmented Generation (2025.findings-emnlp)

Copied to clipboard

Challenge: Event extraction is a task in natural language processing that involves identifying and extracting event information from unstructured text.
Approach: They propose a paradigm that combines schema paraphrasing with schema retrieval-augmented generation.
Outcome: The proposed paradigm retrieves paraphrased schemas and accurately generates targeted structures.
DiMo-GUI: Advancing Test-time Scaling in GUI Grounding via Modality-Aware Visual Reasoning (2025.emnlp-main)

Copied to clipboard

Challenge: DiMo-GUI is a training-free framework for GUI grounding that splits input into textual elements and iconic elements, allowing the model to reason over each modality independently using general-purpose vision-language models.
Approach: They propose a training-free framework for GUI grounding that leverages two core strategies: dynamic visual grounding and modality-aware optimization.
Outcome: The proposed framework splits the input into textual elements and iconic elements, allowing the model to reason over each modality independently using general-purpose vision-language models.
CoPA: Benchmarking Personalized Question Answering with Data-Informed Cognitive Factors (2026.findings-acl)

Copied to clipboard

Challenge: Existing LLMs rely on surface-level similarity or manual heuristics to evaluate personalization . Existing evaluation protocols for personalization are lacking sufficient data-driven validation.
Approach: They propose a benchmark to assess personalization by mining CIPDs to quantify individual preferences.
Outcome: The proposed benchmark provides a more comprehensive and discriminative standard than generic metrics.
Personalized Question Answering with User Profile Generation and Compression (2025.findings-emnlp)

Copied to clipboard

Challenge: Large language models are prone to providing “midguy” answers regardless of users’ knowledge background, thereby failing to meet each user’s personalized needs.
Approach: They propose to generate personalized answers with LLMs based on users’ past question-answering records.
Outcome: The proposed method generates personalized answers based on user's past question-answering records.
CoLLiE: Collaborative Training of Large Language Models in an Efficient Way (2023.emnlp-demo)

Copied to clipboard

Challenge: Large language models (LLMs) are increasingly pivotal in a wide range of tasks . however, the resources required for training these models necessitate efficient solutions .
Approach: They propose a library that facilitates collaborative training of large language models . they use 3D parallelism, parameter-efficient fine-tuning methods and optimizers .
Outcome: The proposed library has proven superior training efficiency in comparison with prevalent solutions in pre-training and fine-tuning scenarios.
Sparse Progressive Distillation: Resolving Overfitting under Pretrain-and-Finetune Paradigm (2022.acl-long)

Copied to clipboard

Challenge: Conventional wisdom in pruning Transformer-based language models is that it reduces model expressiveness, but new research shows pruning increases risk of overfitting when performed at the fine-tuning phase.
Approach: They propose to reduce pruning risk under pretrain-and-finetune paradigm . they propose to use knowledge distillation to improve pruning performance .
Outcome: The proposed method outperforms the leading competitors on the GLUE benchmark.
EviReport: From Reasoned Outlines to Evidence Tracked Long-Form Reports (2026.findings-acl)

Copied to clipboard

Challenge: Evidence-intensive reports often produce fluent but under-supported drafts . eviReport is an evidence-grounded workflow for automated long-form report generation .
Approach: They propose an evidence-tracked workflow that organizes corpus evidence into compact, traceable units and retrieves query-relevant subgraphs into retrieval-ready packages.
Outcome: The proposed workflow outperforms baselines in factual coverage, factual accuracy and visual evidence integration.
LCO: LLM-based Constraint Optimization for Safer Agentic LLMs in Real-world Tasks (2026.findings-acl)

Copied to clipboard

Challenge: Existing defense methods are insufficient to address in-context reward hacking (ICRH), where LLMs iteratively optimize their behavior to maximize proxy objectives, resulting in harmful side effects.
Approach: They propose a framework that reduces in-context reward hacking (ICRH) through repeated interactions with the environment.
Outcome: The proposed framework reduces ICRH without model fine-tuning while maintaining task performance.
Spelling Error Correction with Soft-Masked BERT (2020.acl-main)

Copied to clipboard

Challenge: Experimental results show that the proposed method is significantly better than the baselines including the one solely based on BERT.
Approach: They propose a neural architecture which uses a network for error detection and a system for error correction based on BERT, with the latter connected to the other using what they call soft-masking technique.
Outcome: The proposed method performs better than baselines including the one solely based on BERT, and is general and may be employed in other language detection-correction problems.
𝜙-Decoding: Adaptive Foresight Sampling for Balanced Inference-Time Exploration and Exploitation (2025.acl-long)

Copied to clipboard

Challenge: Existing inference-time optimization strategies address the shortsightedness of auto-regressive generation, but the vast search space leads to excessive exploration and insufficient exploitation.
Approach: They propose a decoding strategy that approximates two distributions via foresight and clustering to provide an efficient estimation of step value.
Outcome: The proposed decoding strategy outperforms strong baselines in performance and efficiency.
Embodied-Reasoner: Synergizing Visual Search, Reasoning, and Action for Embodied Interactive Tasks (2026.acl-long)

Copied to clipboard

Challenge: Recent advances in reasoning models have demonstrated remarkable capabilities on mathematical and coding tasks, but their effectiveness in embodied domains remains largely unexplored.
Approach: They propose a reasoning model for interactive embodied tasks that synthesizes 9.3k coherent Observation-Thought-Action trajectories containing 64k ego-centric images and 90k diverse reasoning processes.
Outcome: The proposed model outperforms existing visual reasoning models by +9%, 24%, and +13% on long-horizon tasks.
BvSP: Broad-view Soft Prompting for Few-Shot Aspect Sentiment Quad Prediction (2024.acl-long)

Copied to clipboard

Challenge: Aspect sentiment quad prediction aims to predict aspects due to distinct data distribution.
Approach: They propose a method that aggregates multiple templates with a broader view . they first construct a few-shot ASQP dataset that contains richer categories .
Outcome: The proposed method outperforms the state-of-the-art methods under four few-shot settings and other public datasets.
ECoK: Emotional Commonsense Knowledge Graph for Mining Emotional Gold (2024.findings-acl)

Copied to clipboard

Challenge: Existing knowledge graphs focus on the representation and reasoning of general factual knowledge, while there are significant deficiencies in the understanding and reasoning for emotional knowledge.
Approach: They propose a commonsense knowledge graph that can be used to represent emotional knowledge by combining theories from psychology, cognitive science, and linguistics.
Outcome: The proposed model surpasses GPT-4-Turbo in the emotion-related tasks.
CTAL: Pre-training Cross-modal Transformer for Audio-and-Language Representations (2021.emnlp-main)

Copied to clipboard

Challenge: Existing audio-language task-specific predictive approaches focus on building complicated late-fusion mechanisms.
Approach: They propose a cross-modal transformer for audio-and-language that learns inter-modal connections between audio and language through two proxy tasks on a large amount of audio- and-language pairs.
Outcome: The proposed model improves on multiple audio-and-language tasks and can be used in fine-tuning phase.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations