Papers by Yixin Cao

60 papers
Information Screening whilst Exploiting! Multimodal Relation Extraction with Feature Denoising and Multimodal Topic Modeling (2023.acl-long)

Copied to clipboard

Challenge: Existing research on multimodal relation extraction (MRE) faces internal-information over-utilization and external-information under-exploitation.
Approach: They propose a framework that implements internal-information screening and external-information exploiting to address these challenges.
Outcome: The proposed framework outperforms the current best model on the benchmark dataset.
Towards Storage-Efficient Visual Document Retrieval: An Empirical Study on Reducing Patch-Level Embeddings (2025.findings-acl)

Copied to clipboard

Challenge: Visualized Document Retrieval (VDR) uses large vision-language models to encode document pages into embeddings.
Approach: They evaluate methods to reduce patch embeddings per page while minimizing performance degradation.
Outcome: The proposed method maintains 98.2% of retrieval performance with only 11.8% of original memory usage and preserves 94.6% effectiveness at 2% memory footprint.
MolCA: Molecular Graph-Language Modeling with Cross-Modal Projector and Uni-Modal Adapter (2023.emnlp-main)

Copied to clipboard

Challenge: Language Models (LMs) have demonstrated impressive molecule understanding ability on 1D text-related tasks, but lack 2D graph perception, a critical ability of human professionals in comprehending molecules’ topological structures.
Approach: They propose to combine a cross-modal projector and a uni-modal adapter to enable an LM to understand both text- and graph-based molecular contents via a Q-Former.
Outcome: The proposed model outperforms the baselines on tasks such as molecule captioning, IUPAC name prediction, and molecule-text retrieval.
LLMs Assist NLP Researchers: Critique Paper (Meta-)Reviewing (2024.emnlp-main)

Copied to clipboard

Challenge: a comparative analysis of paper (meta-)reviews by large language models (LLMs) aims to identify and distinguish LLMs from human activities .
Approach: They present a comparative analysis to identify and distinguish LLM activities from human activities.
Outcome: The proposed analysis aims to improve recognition of instances when someone implicitly uses LLMs for reviewing activities.
Joint Representation Learning of Cross-lingual Words and Entities via Attentive Distant Supervision (D18-1)

Copied to clipboard

Challenge: Existing methods for learning word and entity representations in monolingual settings are limited.
Approach: They propose a method for joint representation learning of cross-lingual words and entities that captures mutually complementary knowledge and enables cross-linguistic inferences.
Outcome: The proposed method captures mutually complementary knowledge and enables cross-lingual inferences among knowledge bases and texts.
Improving Event Detection via Open-domain Trigger Knowledge (2020.acl-main)

Copied to clipboard

Challenge: Existing methods for event detecting are prone to overfitting densely labeled trigger words due to the small scale of training data.
Approach: They propose a novel Enrichment Knowledge Distillation model to leverage external open-domain trigger knowledge to reduce in-built biases to frequent trigger words in annotations.
Outcome: The proposed model outperforms nine strong baselines and is especially effective for unseen/sparsely labeled trigger words.
PRISM: Probabilistic Reward Model with Inherent Structural Modeling (2026.acl-long)

Copied to clipboard

Challenge: Existing evaluators compress diverse human judgments into a single scalar, leading to brittle alignment and reward hacking.
Approach: They propose a Gaussian-based reinterpretation of reward evaluation as a conditional distribution and a mixture of Gaussians to capture conflicting preference dimensions.
Outcome: The proposed model outperforms scalar baselines in accuracy and generalization.
R2F: A General Retrieval, Reading and Fusion Framework for Document-level Natural Language Inference (2022.emnlp-main)

Copied to clipboard

Challenge: Document-level natural language inference (DOCNLI) is a new task in natural language processing.
Approach: They propose a document-level natural language inference framework that fuses sentence-level tasks into a set of sentence-based tasks.
Outcome: The proposed framework improves interpretability and performance with evidence.
Quantifying and Mitigating Unimodal Biases in Multimodal Large Language Models: A Causal Perspective (2024.findings-emnlp)

Copied to clipboard

Challenge: Recent advances in Large Language Models have facilitated the development of Multimodal LLMs.
Approach: They propose a causal framework to interpret unimodal biases in visual question answering problems and a framework to integrate information from different modalities and mitigate biase.
Outcome: The proposed framework analyzes visual question answering (VQA) problems to assess their impact on predictions.
Take a Break in the Middle: Investigating Subgoals towards Hierarchical Script Generation (2023.findings-acl)

Copied to clipboard

Challenge: Existing work assumes that events are sequentially arranged in a script, while this assumption leads to linear generation that is far from sufficient for comprehensively acquiring the representation about how events are organized towards a task goal.
Approach: They propose to extend goal-oriented Script Generation task from the perspective of cognitive theory by incorporating subgoals into hierarchical script generation.
Outcome: The proposed task is based on a new dataset and human evaluation metrics.
Examining Inter-Consistency of Large Language Models Collaboration: An In-depth Analysis via Debate (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing studies focus on inconsistency issues within a single LLM, while we explore the inter-consistencies among multiple LLMs for collaboration.
Approach: They propose a formal debate framework to examine whether LLMs can collaborate effectively to achieve a consensus for a shared goal.
Outcome: The proposed framework enables LLMs to achieve consensus in three real-world debate scenarios with real-time scenarios aligned to the LLM's goals.
Rethinking the Role of Entropy in Optimizing Tool-Use Behaviors for Large Language Model Agents (2026.acl-long)

Copied to clipboard

Challenge: Large language models excel in mathematical reasoning and multi-hop question answering tasks, but in long trajectories, agents often invoke tools excessively or inappropriately, increasing computation cost and derailing the reasoning process.
Approach: They propose to use entropy reduction as a supervisory signal to reduce tool calls . they propose to design two reward strategies to address the needs of optimizing tool-use behavior.
Outcome: The proposed reward strategies reduce tool calls by 72.07% and improve performance by 22.27%.
Large Language Model Is Not a Good Few-shot Information Extractor, but a Good Reranker for Hard Samples! (2023.findings-emnlp)

Copied to clipboard

Challenge: Large Language Models have made remarkable strides in various tasks, but whether they are competitive few-shot solvers remains an open question.
Approach: They propose an adaptive filter-then-rerank paradigm to combine the strengths of LLMs and SLMs.
Outcome: The proposed system achieves promising improvements on various IE tasks with acceptable time and cost investment.
Multi-Programming Language Sandbox for LLMs (2025.acl-demo)

Copied to clipboard

Challenge: MPLSandbox is an out-of-the-box multi-programming language sandbox designed to provide unified and comprehensive feedback from compiler and analysis tools for Large Language Models (LLMs).
Approach: They propose a multi-programming language sandbox that provides unified feedback from compilers and analysis tools for Large Language Models.
Outcome: The proposed multi-language sandbox can provide comprehensive feedback from compilers and analysis tools for large language models (LLMs).
SCALER: Synthetic Scalable Adaptive Learning Environment for Reasoning (2026.findings-acl)

Copied to clipboard

Challenge: Reinforcement learning (RL) is a principled way to enhance the reasoning capabilities of large language models, yet its effectiveness hinges on training signals that remain informative as models evolve.
Approach: They propose a framework that sustains effective learning signals through adaptive environment design that transforms real-world programming problems into verifiable reasoning environments with controllable difficulty and unbounded instance generation.
Outcome: The proposed framework outperforms baselines across diverse reasoning benchmarks and exhibits more stable, long-horizon training dynamics.
Are Missing Links Predictable? An Inferential Benchmark for Knowledge Graph Completion (2021.acl-long)

Copied to clipboard

Challenge: Existing benchmarks for Knowledge Graph Completion (KGC) are unsatisfactory .
Approach: They propose to use rule-guided train/test generation instead of conventional random split to ensure that each testing sample is predictable with supportive data in the training set.
Outcome: The proposed model improves on existing benchmarks in inferential ability, assumptions, and patterns.
LogicPro: Improving Complex Logical Reasoning via Program-Guided Learning (2025.acl-long)

Copied to clipboard

Challenge: LogicPro is a data synthesis method that uses LeetCode-style algorithm problems and their corresponding Program solutions to generate complex logic data.
Approach: They propose a new method which leverages LeetCode-style algorithm Problems and their corresponding Program solutions to synthesize complex logic data in text format.
Outcome: The proposed method outperforms existing models for BBH27, LogicBench, DROP, AR-LSAT, and GSM8K, and a wide range of reasoning datasets.
Planning Like Human: A Dual-process Framework for Dialogue Planning (2024.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) operate in a reactive mode, often resulting in efficiency issues or suboptimal performance.
Approach: They propose a dual-process dialogue planning framework that leverages the dual-process theory of human cognition and a deliberative Monte Carlo Tree Search mechanism to emulate human-like conversational dynamics.
Outcome: The proposed framework outperforms existing methods in achieving high-quality dialogues and operational efficiency.
Intuitive or Dependent? Investigating LLMs’ Behavior Style to Conflicting Prompts (2024.acl-long)

Copied to clipboard

Challenge: Extensive experiments with seven Large Language Models reveal their varying behaviors.
Approach: They investigate the behaviors of Large Language Models when faced with conflicting prompts versus their internal memory.
Outcome: Extensive experiments with seven LLMs reveal their varying behaviors.
Low-Resource Name Tagging Learned with Weakly Labeled Data (D19-1)

Copied to clipboard

Challenge: Existing methods for name tagging in low-resource languages or domains require extensive human efforts for training annotations.
Approach: They propose a neural model for name tagging based on weakly labeled (WL) data.
Outcome: The proposed model outperforms existing models in five low-resource languages and fine-grained food domains and shows that it is more efficient and efficient than existing models.
Expertise Style Transfer: A New Task Towards Better Communication between Experts and Laymen (2020.acl-main)

Copied to clipboard

Challenge: a curse of knowledge can impede communication between experts and laymen.
Approach: They propose a task of expertise style transfer to automate the communication between experts and laymen using an annotated dataset.
Outcome: The proposed task simplifies professional language and improves accuracy and expertise level of laymen descriptions using simple words.
MMEKG: Multi-modal Event Knowledge Graph towards Universal Representation across Modalities (2022.acl-demo)

Copied to clipboard

Challenge: Recent Knowledge Graphs (KGs) store billions of world facts in a directed graph, but expression ability of such entity-centric KGs is limited.
Approach: They propose a large-scale multi-modal event knowledge graph named MMEKG that unifies different modalities of knowledge via events.
Outcome: The proposed system unifies different modalities of knowledge via events, which complement and disambiguate each other.
Disentangling Language and Culture for Evaluating Multilingual Large Language Models (2025.acl-long)

Copied to clipboard

Challenge: Extensive evaluations of large language models (LLMs) are conducted on a wide range of models, revealing a notable cultural-linguistic synergy phenomenon, where models exhibit better performance when questions are culturally aligned with the language.
Approach: They propose a Dual Evaluation Framework to comprehensively assess the multilingual capabilities of large language models by decomposing evaluation along dimensions of linguistic medium and cultural context.
Outcome: The proposed framework allows for a nuanced analysis of LLMs’ ability to process questions within both native and cross-cultural contexts cross-lingually.
LLMs-as-Instructors: Learning from Errors Toward Automating Model Improvement (2024.findings-emnlp)

Copied to clipboard

Challenge: Using advanced Large Language Models, instructors can improve training of smaller models by analyzing their own model's errors.
Approach: They propose a framework that leverages advanced Large Language Models to enhance training of smaller target models.
Outcome: The proposed framework outperforms ChatGPT on multiple benchmarks and shows that it improves on both in-domain and out-of-domain benchmarks.
CriticLean: Critic-Guided Reinforcement Learning for Mathematical Formalization (2026.acl-long)

Copied to clipboard

Challenge: Existing approaches to formalizing mathematical statements face limitations in accuracy, especially in the context of complex, highlevel problems that involve sophisticated mathematical reasoning.
Approach: They propose a CriticLean framework that elevates the role of the critic from a passive validator to an active learning component and introduce a benchmark to measure models’ ability to distinguish semantically correct from incorrect formalizations.
Outcome: The proposed framework outperforms open- and closed-source benchmarks and shows that it significantly outperformed existing models.
ERGO: Event Relational Graph Transformer for Document-level Event Causality Identification (2022.coling-1)

Copied to clipboard

Challenge: Existing methods to identify event-event causal relations in a document are noisy and require heuristic rules or external tools.
Approach: They propose a document-level event-event causality identification framework that uses heuristic rules to design edges between events.
Outcome: The proposed framework outperforms existing state-of-the-art methods on two benchmark datasets.
Semi-supervised Entity Alignment via Joint Knowledge Embedding Model and Cross-graph Model (D19-1)

Copied to clipboard

Challenge: Entity alignment aims at integrating complementary knowledge graphs (KGs) from different sources or languages.
Approach: They propose a semi-supervised entity alignment method by joint Knowledge Embedding model and Cross-Graph model to make better use of seed alignments to propagate over the entire graphs with KG-based constraints.
Outcome: The proposed method can make better use of seed alignments to propagate over entire graphs with KG-based constraints.
Multi-Channel Graph Neural Network for Entity Alignment (P19-1)

Copied to clipboard

Challenge: Existing methods to learn alignment-oriented knowledge graph embeddings suffer from structural heterogeneity and limited seed alignments.
Approach: They propose a multi-channel Graph Neural Network model to learn alignment-oriented knowledge graph embeddings by encoding two KGs via multiple channels.
Outcome: The proposed model is expected to reconcile the structural differences of two KGs, and thus make better use of seed alignments.
Finding and Editing Multi-Modal Neurons in Pre-Trained Transformers (2024.findings-acl)

Copied to clipboard

Challenge: Existing methods to identify key neurons for interpretability of multi-modal large language models are unclear.
Approach: They propose a method to identify key neurons for interpretability by multi-modal large language models.
Outcome: The proposed method improves conventional works upon efficiency and applied range by removing needs of costly gradient computation.
Exploring and Evaluating Attributes, Values, and Structures for Entity Alignment (2020.emnlp-main)

Copied to clipboard

Challenge: Entity alignment (EA) aims at building a Knowledge Graph (KG) of rich content by linking the equivalent entities from various KGs.
Approach: They propose to use an attributed value encoder to partition a Knowledge Graph into subgraphs to model the various types of attribute triples efficiently.
Outcome: The proposed method achieves significant improvements over 12 baselines in cross-lingual and monolingual datasets.
How Knowledge Graph and Attention Help? A Qualitative Analysis into Bag-level Relation Extraction (2021.acl-long)

Copied to clipboard

Challenge: Knowledge Graph (KG) and attention mechanism have been demonstrated effective in introducing and selecting useful information for weakly supervised methods.
Approach: They propose a paradigm to quantitatively evaluate the effect of attention and KG on bag-level relation extraction (RE) they propose to incorporate entity prior to KG-enhanced attention to improve RE performance .
Outcome: The proposed model achieves significant improvements on two real-world datasets compared with three state-of-the-art baselines.
Breaking the Reasoning Barrier A Survey on LLM Complex Reasoning through the Lens of Self-Evolution (2025.findings-acl)

Copied to clipboard

Challenge: OpenAI's O1 and subsequent projects like DeepSeek R1 have significantly advanced research on complex reasoning in LLMs.
Approach: They analyze existing reasoning studies from the perspective of self-evolution and summarize O1-like works from open-source projects like DeepSeek R1 and Kimi-k1.5.
Outcome: The proposed models are based on open-source models and pioneer advanced methodologies like Scaling Reinforcement Learning (RL).
Recognizing Everything from All Modalities at Once: Grounded Multimodal Universal Information Extraction (2024.findings-acl)

Copied to clipboard

Challenge: Existing studies on IE tasks have focused on recognizing and analyzing cross-modal information . a multimodal large language model (MLLM) is developed to analyze IE across modalities .
Approach: They propose a multimodal large language model (MLLM) capable of grounding information from all modalities.
Outcome: The proposed framework provides a framework to analyze IE tasks over various modalities and their fine-grained groundings.
DocEE: A Large-Scale and Fine-grained Benchmark for Document-level Event Extraction (2022.naacl-main)

Copied to clipboard

Challenge: Existing datasets focus on sentence-level event extraction, but document-level EE is limited due to the lack of large-scale and practical training and evaluation datasets.
Approach: They propose a document-level event extraction dataset with 27,000+ events and 180,000+ arguments.
Outcome: The proposed dataset includes 27,000+ events, 180,000+ arguments and large-scale manual annotations, fine-grained argument types and application-oriented settings.
Neural Collective Entity Linking (C18-1)

Copied to clipboard

Challenge: Entity linking aims to link entity mentions in texts to knowledge bases, but existing methods rely on local contexts to resolve entities independently.
Approach: They propose a neural model for collective entity linking that integrates local contextual features and global coherence information to improve the computation efficiency.
Outcome: The proposed model improves its performance on five publicly available datasets and can be used to train on Wikipedia hyperlinks to avoid overfitting and domain bias.
X-Eval: Generalizable Multi-aspect Text Evaluation via Augmented Instruction Tuning with Auxiliary Evaluation Aspects (2024.naacl-long)

Copied to clipboard

Challenge: X-Eval is a two-stage instruction tuning framework to evaluate text in both seen and unseen aspects customized by end users.
Approach: They introduce a two-stage instruction tuning framework to evaluate text in both seen and unseen aspects customized by end users.
Outcome: The proposed framework improves the model’s ability to follow evaluation instructions and enhances the learning stage to better assess text quality.
Is Multi-Hop Reasoning Really Explainable? Towards Benchmarking Reasoning Interpretability (2021.emnlp-main)

Copied to clipboard

Challenge: Existing models for multi-hop reasoning are not able to evaluate their interpretability . a recent study found that many paths are unreasonable .
Approach: They propose a framework to evaluate the interpretability of multi-hop reasoning models . they annotate all possible rules and establish a benchmark .
Outcome: The proposed framework outperforms existing models in terms of performance and interpretability.
CHEER: Centrality-aware High-order Event Reasoning Network for Document-level Event Causality Identification (2023.acl-long)

Copied to clipboard

Challenge: Recent studies focus on building a document-level graph for cross-sentence reasoning, but ignore important causal structures.
Approach: They propose a document-level event causality identification model which annotates central events and incorporates event centrality information into the reasoning network.
Outcome: The proposed model performs high-order reasoning while considering event centrality.
Do Pre-trained Models Benefit Knowledge Graph Completion? A Reliable Evaluation and a Reasonable Approach (2022.findings-acl)

Copied to clipboard

Challenge: Pre-trained language models capture factual knowledge from massive texts . but they are still quite behind the SOTA KGC models in terms of performance .
Approach: They propose to use open-world assumption to evaluate PLM-based knowledge graph completion models . they propose to convert each triple and its support information into natural prompt sentences .
Outcome: The proposed model is more accurate under the open-world assumption (OWA) this setting manual checks the correctness of knowledge that is not in KGs.
Discriminative Reasoning with Sparse Event Representation for Document-level Event-Event Relation Extraction (2023.acl-long)

Copied to clipboard

Challenge: Document-level Event Causality Identification (DECI) is a sentence-level task that requires long-text understanding.
Approach: They propose a document-level event causality identification model (SENDIR) that uses sparse attention to capture long-distance dependence.
Outcome: The proposed model can be used to discriminate between event pairs in the same sentence or span multiple sentences.
Towards Verifiable Generation: A Benchmark for Knowledge-aware Language Model Attribution (2024.findings-acl)

Copied to clipboard

Challenge: Existing evaluation metrics and benchmarks to attribute large language models to structured knowledge are lacking.
Approach: They propose a task of Knowledge-aware Language Model Attribution that improves upon three core concerns with conventional attributed LMs.
Outcome: The proposed model improves upon core concerns with conventional attributed LMs.
Navigating the Nuances: A Fine-grained Evaluation of Vision-Language Navigation (2024.findings-emnlp)

Copied to clipboard

Challenge: a new evaluation framework for vision-language navigation is proposed . current evaluation standards hinge on endpoint success rates and path alignment metrics .
Approach: They propose a semi-automatic method for CFG construction with Large-Language Models . they induct data spanning five principal instruction categories and analyze them .
Outcome: The proposed framework diagnoses current models for the Vision-Language Navigation task at a finer-grained level.
Prompt for Extraction? PAIE: Prompting Argument Interaction for Event Argument Extraction (2022.acl-long)

Copied to clipboard

Challenge: Using a prompt-based model, we find that event argument extraction is efficient and generalized well to few-shot settings.
Approach: They propose a model PAIE for event argument extraction using prompt tuning for extractive objectives.
Outcome: The proposed model can extract arguments with the same role instead of heuristic threshold tuning.
A + B: A General Generator-Reader Framework for Optimizing LLMs to Unleash Synergy Potential (2024.findings-acl)

Copied to clipboard

Challenge: Retrieval-Augmented Generation (RAG) is an effective solution to supplement necessary knowledge to large language models.
Approach: They propose a "generate-then-read" pipeline to replace retrieval stage with generation from the LLM itself.
Outcome: The proposed framework outperforms single models in the base and chat versions and addresses safety and helpfulness post-adaptation challenges.
CoVariance-based Causal Debiasing for Entity and Relation Extraction (2023.findings-emnlp)

Copied to clipboard

Challenge: Named Entity Recognition and Relation Extraction are key tasks of Information Extraction.
Approach: They propose a causal framework called c ovariance and variance optimization framework (OVO) to optimize feature representations and conduct general debiasing.
Outcome: The proposed framework minimizes characterizing features’ covariance for alleviating selection and distribution bias and enhances feature representation in the feature space.
Thinking Traps in Long Chain-of-Thought: A Measurable Study and Trap-Aware Adaptive Restart (2026.findings-acl)

Copied to clipboard

Challenge: Experiments show that extended generation does not guarantee correctness . a recurring pattern in Long-CoT failures is a problem for large reasoning models .
Approach: They propose a test-time control framework that truncates the trajectory before the trap segment and adaptively restarts decoding.
Outcome: Experiments show that TAAR improves reasoning performance without fine-tuning model parameters.
Grounded-VideoLLM: Sharpening Fine-grained Temporal Grounding in Video Large Language Models (2025.findings-emnlp)

Copied to clipboard

Challenge: Video Large Language Models (VLMs) have been praised for their performance in coarse-grained video understanding but still face ineffective temporal grounding and inadequate timestamp representations.
Approach: They propose a novel Video-LLM that senses and reasoned over specific video moments with fine-grained temporal precision.
Outcome: The proposed model surpasses existing models in fine-grained video understanding tasks and exhibits strong potential as a general video understanding assistant.
Robust Prompt Optimization for Large Language Models Against Distribution Shifts (2023.emnlp-main)

Copied to clipboard

Challenge: Existing research has explored automatic prompt optimization methods to eliminate manual effort in identifying effective prompts for a given task.
Approach: They propose a framework for prompt optimization that can be generalized to an unlabeled target group.
Outcome: The proposed framework improves on target group and source group while generalizing to unlabeled target group.
Com2 : A Causal-Guided Benchmark for Exploring Complex Commonsense Reasoning in Large Language Models (2025.acl-long)

Copied to clipboard

Challenge: Existing works focus on complex tasks like math and code, while complex commonsense reasoning remains underexplored due to its uncertainty and lack of structure.
Approach: They propose to build a benchmark for large language models based on complex commonsense reasoning based upon causal event graphs and causal theory.
Outcome: The proposed benchmark combines a complex commonsense reasoning benchmark with a detective story to achieve a more challenging subset.
Analyzing Temporal Complex Events with Large Language Models? A Benchmark towards Temporal, Long Context Understanding (2024.acl-long)

Copied to clipboard

Challenge: Existing research in complex event analysis has made significant strides but is constrained by inadequate natural language processing techniques.
Approach: They propose a novel approach using Large Language Models to extract and analyze the event chain within TCE, characterized by their key points and timestamps.
Outcome: The proposed model performs comparable to models with long context window and retrieval-augmented generation method in three distinct tasks .
Learning from Miscellaneous Other-Class Words for Few-shot Named Entity Recognition (2021.acl-long)

Copied to clipboard

Challenge: Existing methods to classify named entity mentions with fewshots fail to differentiate rich semantics in other-class words, which will aggravate overfitting under few shot scenario.
Approach: They propose a model that can automatically induce different unde- fined classes from the other class to improve few-shot Named Entity Recognition (NER) .
Outcome: The proposed model outperforms five state-of-the-art models in 1- shot and 5-shots settings on four NER bench marks.
SciAgent: Tool-augmented Language Models for Scientific Reasoning (2024.emnlp-main)

Copied to clipboard

Challenge: SciAgent surpasses other LLMs with the comparable size by more than 8.0% in absolute accuracy.
Approach: They propose a tool-augmented scientific reasoning setting that supplements LLMs with scalable toolsets and builds a benchmark to evaluate LLM’s abilities with tool assistance.
Outcome: The proposed setting augments LLMs with scalable toolsets and shifts the focus from pursuing an omniscient problem solver to a proficient tool-user.
Complex Logical Query Answering by Calibrating Knowledge Graph Completion Models (2024.findings-acl)

Copied to clipboard

Challenge: Existing methods to solve complex logical queries are not well-calibrated . CKGC is lightweight and effective, allowing the model to quickly converge .
Approach: They propose a method for calibrating KGC models to adapt to complex logical queries . they map the values of predictions of KGC to the range [0, 1] .
Outcome: The proposed method can significantly boost model performance in complex logical query answering task.
Improving Large Language Models in Event Relation Logical Prediction (2024.acl-long)

Copied to clipboard

Challenge: Event relation extraction tasks require rigorous logical reasoning and semantic comprehension, a challenge for narrative understanding and reasoning.
Approach: They propose three approaches to endow LLMs with event relation logic to generate more coherent answers across different scenarios.
Outcome: The proposed approach improves on a set of ERE tasks and provides insights for future work.
A Comprehensive Evaluation of Large Language Models on Legal Judgment Prediction (2023.findings-emnlp)

Copied to clipboard

Challenge: Large language models (LLMs) have demonstrated great potential for domain-specific applications, such as the law domain.
Approach: They propose a framework to investigate LLMs' competence in the law domain by using similar cases and multi-choice options.
Outcome: The proposed solutions can be extended to other domains to facilitate evaluations in other domain.
QRMeM: Unleash the Length Limitation through Question then Reflection Memory Mechanism (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for processing large textual content face insufficient adaptation to task-specific needs and missing multi-segmentation relationships.
Approach: They propose a question then reflection memory mechanism which integrates a dual-structured memory pool and a structured graph guidance to facilitate a reflective trial-and-error approach for navigating and identifying relevant segments.
Outcome: The proposed model achieves superior performance on multiple-choice questions and multi-doc QA.
Are LLMs Rational Investors? A Study on the Financial Bias in LLMs (2025.findings-acl)

Copied to clipboard

Challenge: Existing studies on biases within specific domains, such as finance, remain limited.
Approach: They propose a framework to detect, detect, analyze and mitigate financial biases in large language models.
Outcome: The proposed framework reduces bias by 68% for the most biased model, according to key metrics.
EvoWiki: Evaluating LLMs on Evolving Knowledge (2025.acl-long)

Copied to clipboard

Challenge: Existing knowledge evolution benchmarks are static and fail to capture the evolving nature of LLMs and knowledge.
Approach: They propose an evolving dataset that categorizes information into stable, evolved, and uncharted states.
Outcome: The proposed dataset is auto-updatable and enables evaluation of continuously changing knowledge and newly released LLMs.
XFinBench: Benchmarking LLMs in Complex Financial Problem Solving and Reasoning (2025.findings-acl)

Copied to clipboard

Challenge: Existing large language models (LLMs) lack advanced capabilities such as temporal reasoning, future forecasting, and numerical modeling.
Approach: They propose a benchmarking tool to evaluate LLMs' ability to solve complex financial problems across diverse graduate-level finance topics with multi-modal context.
Outcome: The proposed model improves on the o1 model but still lags behind human experts in temporal reasoning and scenario planning capabilities.
Few-shot Event Detection: An Empirical Study and a Unified View (2023.acl-long)

Copied to clipboard

Challenge: Extensive studies have been carried out on fewshot event detection (ED) however, there are noticeable discrepancies among existing methods from three aspects.
Approach: They propose a unified view of ED models and a better unified baseline for fair evaluation.
Outcome: The proposed framework outperforms existing methods by a large margin on three datasets.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations