Papers by Wei Ji

47 papers
Omni-RewardBench: Toward a Comprehensive Evaluation of Generative Reward Models Across Modalities (2026.acl-long)

Copied to clipboard

Challenge: Existing evaluation benchmarks for ORMs are largely text-centric or limited to bimodal tasks . a new study examines the effectiveness of Omni-RewardBench for ORms across modalities .
Approach: They propose a hybrid automatic-annotation and human-verification pipeline to construct high-quality evaluation data.
Outcome: The proposed model is the first benchmark for comprehensive evaluation of ORMs across modalities.
Emergent Relational Order in LLM Agent Societies: From Collective Affect to Authority Stratification (2026.findings-acl)

Copied to clipboard

Challenge: Fei Xiaotong’s Differential Order Pattern characterizes rural society as egocentric and relationally graded, with cooperation attenuating over social distance.
Approach: They propose a multi-agent framework grounded in Affect Control Theory, Social Identity Theory, and Durkheimian collective affect.
Outcome: Extensive simulations support interpreting Differential Order as a structure-sensitive emergent outcome of general social mechanisms.
Retrieval and Reasoning on KGs: Integrate Knowledge Graphs into Large Language Models for Complex Question Answering (2024.findings-emnlp)

Copied to clipboard

Challenge: Large Language Models (LLMs) have performed impressively in various NLP tasks, but their inherent hallucination phenomena severely challenge their credibility in complex reasoning.
Approach: They propose to integrate explainable Knowledge Graphs (KGs) with LLMs to alleviate hallucinations . they construct subgraphs to enhance the retrieval capabilities of KGs via CoT reasoning.
Outcome: Extensive experiments on two KGQA datasets show that the proposed model achieves convincing performance compared to strong baselines.
A Comprehensive Survey of Scientific Large Language Models and Their Applications in Scientific Discovery (2024.emnlp-main)

Copied to clipboard

Challenge: Existing surveys on scientific LLMs focus on one or two fields or a single modality.
Approach: They survey 260 scientific LLMs and examine their architectures and pre-training techniques . they also discuss commonalities and differences between LLM architectures .
Outcome: The proposed model architectures and evaluation techniques are used to improve scientific discovery.
Unsupervised Morphological Tree Tokenizer (2025.findings-acl)

Copied to clipboard

Challenge: Conventional statistical tokenizers often disrupt constituent boundaries within words, thereby corrupting semantic information.
Approach: They propose a method that uses morphological structure guidance to induce character-level structures of words by training a deep model.
Outcome: Empirical results show that the proposed method retains complete morphemes and outperforms existing methods on morphological segmentation and language modeling tasks.
Two Heads Are Better Than One: Improving Fake News Video Detection by Correlating with Neighbors (2023.findings-acl)

Copied to clipboard

Challenge: Existing frameworks for detecting fake news videos are limited . a new approach is proposed to integrate neighborhood information of new videos .
Approach: They propose a framework for automatically detecting fake news videos . it integrates neighborhood relationship of new videos belonging to same event .
Outcome: The proposed framework improves performance of existing detectors and graph aggregation and debunking rectification modules.
Enhancing Large Language Models for Scientific Multimodal Summarization with Multimodal Output (2025.coling-industry)

Copied to clipboard

Challenge: Scientific publications are becoming more multimedia, containing both text and visual content.
Approach: They propose a framework for Scientific Multimodal Summarization with Multimodal Output . it leverages the power of large language models and extends its capability to cross-modal understanding .
Outcome: The proposed framework outperforms uni- and multi-modality methods on two new datasets . it leverages the power of large language models and extends its capability to cross-modal understanding .
A Deep Relevance Model for Zero-Shot Document Filtering (P18-1)

Copied to clipboard

Challenge: Existing methods for document classification do not consider document filtering . existing methods do not include document filter.
Approach: They propose a deep relevance model for zero-shot document filtering called DAZER . they use word embeddings to extract the relevance signals from word embeds .
Outcome: The proposed model outperforms existing models on two document collections . it estimates the relevance between a document and a category by using seed words .
Mitigating the Alignment Tax of RLHF (2024.emnlp-main)

Copied to clipboard

Challenge: Large Language Models (LLMs) acquire a wide range of abilities during pre-training, but aligning LLMs under Reinforcement Learning with Human Feedback (RLHF) can lead to forgetting pretrained abilities, which is also known as the alignment tax.
Approach: They propose to use a model averaging technique to find the most powerful alignment-forging Pareto front among RLHF algorithms.
Outcome: The proposed method achieves the strongest alignment-forging Pareto front among competing methods.
PEVL: Position-enhanced Pre-training and Prompt Tuning for Vision-language Models (2022.emnlp-main)

Copied to clipboard

Challenge: Recent advances on self-supervised learning have led to powerful vision-language pre-training models that achieve state-of-the-art performance on a wide range of cross-modal tasks.
Approach: They propose a vision-language pre-training framework that reformulates discretized object positions and language in a unified language modeling framework.
Outcome: The proposed model improves performance on position-sensitive vision-language (VL) tasks and also improves on position insensitive tasks.
Transfer Learning for Context-Aware Question Matching in Information-seeking Conversations in E-commerce (P18-2)

Copied to clipboard

Challenge: Recent researches focus on deep learning and reinforcement learning for multi-turn information seeking conversation systems.
Approach: They propose an efficient and effective multi-turn conversation model based on convolutional neural networks and extend it to adapt the knowledge learned from a resource-rich domain to enhance the performance.
Outcome: The proposed model performs better than the existing model on an industrial chatbot called AliMe Assist.
GradOT: Training-free Gradient-preserving Offsite-tuning for Large Language Models (2025.acl-long)

Copied to clipboard

Challenge: Existing methods for offsite-tuning of large language models require high computational costs and lack theoretical analysis.
Approach: They propose an offsite-tuning approach that selectively applies compression techniques such as rank compression and channel pruning to preserve the gradients of fine-tuned adapters while ensuring privacy.
Outcome: The proposed method surpasses existing OT methods in privacy protection and model performance.
LongHeads: Multi-Head Attention is Secretly a Long Context Processor (2024.findings-emnlp)

Copied to clipboard

Challenge: Large language models struggle to process lengthy inputs due to limited length generalization and attention’s quadratic computational demands.
Approach: They propose a training-free framework that allows each head to attend to important context chunks instead of allowing each head a full sentence .
Outcome: The proposed framework unlocks multi-head attention's untapped potential by allowing each head to attend to important context chunks instead of the full sentence.
ART: rule bAsed futuRe-inference deducTion (2023.emnlp-main)

Copied to clipboard

Challenge: Existing studies focus on language-based premises and deduce valid conclusions from visual observations.
Approach: They propose a rule-based deductive reasoning task that uses video to deduce the correct future event . they use commonsense knowledge to annotate video and a strong baseline to conduct reasoning .
Outcome: Empirical studies validate the rationality of ARTNet in deductive reasoning upon visual observations . ART is a method that rigorously follows a set of explicit constraints to deduce valid conclusions from empirical facts .
LLM-Based Multi-Agent Systems are Scalable Graph Generative Models (2025.findings-acl)

Copied to clipboard

Challenge: Social graphs are mathematical structures stem from pairwise interactions between entities through nodes and edges.
Approach: They propose a framework for dynamic, text-attributed social graph generation that simulates the temporal node and edge generation processes for zero-shot social graphs.
Outcome: The proposed framework improves macroscopic graph structure metrics by 11% . the proposed model can generate graphs with up to 100,000 nodes or 10 million edges .
Unleashing the Emergent Cognitive Synergy in Large Language Models: A Task-Solving Agent through Multi-Persona Self-Collaboration (2024.naacl-long)

Copied to clipboard

Challenge: Existing work on LLMs that only enhance reasoning abilities, but which lack factual hallucination and slow-thinking capabilities, argues that SPP is a cognitive synergist.
Approach: They propose a Solo Performance Prompting (SPP) that transforms a single LLM into a cognitive synergist by engaging in multi-turn self-collaboration with multiple personas.
Outcome: The proposed model reduces factual hallucination and maintains strong reasoning abilities on three challenging tasks .
Cross-Document Cross-Lingual NLI via RST-Enhanced Graph Fusion and Interpretability Prediction (2025.emnlp-main)

Copied to clipboard

Challenge: Despite the development of many subdirections, Cross-Document Cross-Lingual NLI remains largely unexplored.
Approach: They propose a novel paradigm that extends traditional NLI capabilities to multi-document, multilingual scenarios by integrating RST-enhanced graph fusion with interpretability-aware prediction.
Outcome: The proposed method improves on existing models and document-level NLI to multi-document, multilingual scenarios.
Boosting Policy and Process Reward Models with Monte Carlo Tree Search in Open-Domain QA (2025.findings-acl)

Copied to clipboard

Challenge: Experimental results show that our approach can effectively improve the performance of both the policy model and the reward model.
Approach: They propose to use Monte Carlo Tree Search for both policy model improvement and reward model improvement to bridge it to more subtle open-domain question answering.
Outcome: The proposed approach surpasses existing methods for annotation and training data with fewer data points and achieves better performance in test-time scaling strategies.
Discrete Argument Representation Learning for Interactive Argument Pair Identification (2021.naacl-main)

Copied to clipboard

Challenge: Existing research on monological argumentation covers claims generation, argument structure prediction, and essay scoring.
Approach: They propose to identify argument pairs from two posts with opposite stances to a certain topic.
Outcome: The proposed framework outperforms competing models on a large-scale dataset . it also proves that it is useful for analyzing argument pairs from two posts .
You Never Know a Person, You Only Know Their Defenses: Detecting Levels of Psychological Defense Mechanisms in Supportive Conversations (2026.findings-acl)

Copied to clipboard

Challenge: Psychological defenses are strategies people use to manage distress.
Approach: They propose a dialogue corpus with help seeker utterances labeled for defense level and a DMRS Co-Pilot pipeline that provides evidence-based pre-annotations.
Outcome: The proposed framework reduces annotation time by 24.0% in a counterbalanced study.
K-Adapter: Infusing Knowledge into Pre-Trained Models with Adapters (2021.findings-acl)

Copied to clipboard

Challenge: Existing methods for injecting knowledge into pre-trained models are inconsistent and can flush out knowledge when multiple kinds of knowledge are injected.
Approach: They propose a framework that retains the original parameters of pre-trained models fixed and supports the development of versatile knowledge-infused models.
Outcome: The proposed framework retains the original parameters of the pre-trained model fixed and supports the development of versatile knowledge-infused models.
Video Question Answering: Datasets, Algorithms and Challenges (2022.emnlp-main)

Copied to clipboard

Challenge: Recent advances in video question answering have led to a surge in popularity . despite the popularity, VideoQA remains one of the greatest challenges .
Approach: They categorize the video question-answer datasets into normal VideoQA, multi-modal VideoQA and knowledge-based VideoQA according to the modalities invoked in the question-announcement pairs.
Outcome: The proposed methods are mainly designed for Factoid QA and inference VideoQA . the proposed methods have been compared with other methods and are robust and interpretable.
Incorporating Causal Analysis into Diversified and Logical Response Generation (2022.coling-1)

Copied to clipboard

Challenge: Existing generation-based models generate generic and safe responses such as "So am I" or "I don't know"
Approach: They propose to predict the mediators to preserve relevant information and auto-regressively incorporate the mediator into generating process.
Outcome: The proposed model generates relevant and informative responses and outperforms the state-of-the-art in terms of automatic metrics and human evaluations.
Black-Box Tuning of Vision-Language Models with Effective Gradient Approximation (2023.findings-emnlp)

Copied to clipboard

Challenge: Large vision-language models are often not open-source due to preventing abuse or commercial factors.
Approach: They propose a method for parameter-efficient fine-tuning to improve model accessibility . large models are often not open-source due to preventing abuse or commercial factors . they propose implementing a lightweight adapter over the output feature of an inaccessible model .
Outcome: The proposed methods improve on 11 benchmarks and are made publicly available.
Benchmarking Fine-Grained Error Detection in Multimodal Reasoning (2026.acl-long)

Copied to clipboard

Challenge: Multimodal Process Reward Models (MPRMs) have emerged as a pivotal framework for enhancing the reasoning capabilities of Multimodal Large Language Models.
Approach: They propose a benchmark specifically designed to evaluate MPRMs’ proficiency in detecting erroneous reasoning steps across diverse error categories.
Outcome: The proposed model achieves up to 4.8% performance improvement through test-time scaling.
GRAPHIA: Harnessing Social Graph Data to Enhance LLM-Based Social Simulation (2026.acl-long)

Copied to clipboard

Challenge: Social graphs provide high-quality supervision signals that encode local interactions and global network structure, yet they remain underutilized for LLM training.
Approach: They propose a general LLM-based social graph simulation framework that leverages graph data as supervision for LLM training.
Outcome: The proposed framework improves micro-level alignment by 6.1% on three real-world networks compared to the strongest baseline.
SAM3-I: Segment Anything with Instructions (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for concept-level grounding and instruction-level reasoning use coarse representations and iterative mask filtering.
Approach: They propose an instruction-following extension of the Segment Anything Model 3 family that unifies concept-level grounding and instruction-level reasoning within a single segmentation framework.
Outcome: Experiments show that SAM3-I achieves appealing performance across referring and reasoning-based segmentation while maintaining its strong concept recall ability.
Long-context Language Models Fail in Basic Retrieval Tasks Without Sufficient Reasoning Steps (2025.findings-emnlp)

Copied to clipboard

Challenge: despite their extensive context window, long-context language models fail in some basic cases . a recent study shows that long-cot methods are not necessary for long-constituency tasks .
Approach: a new study evaluates long-context language models with a large context window . the authors propose a method that can be well addressed with arbitrary reasoning steps .
Outcome: The proposed methods are well addressed with a sufficient number of reasoning steps, guided by specific CoT prompts.
Language Generation with Multi-Hop Reasoning on Commonsense Knowledge Graph (2020.emnlp-main)

Copied to clipboard

Challenge: Existing approaches that integrate commonsense knowledge into pre-trained language models simply transfer relational knowledge while ignoring rich connections within the knowledge graph.
Approach: They propose a method that leverages structural and semantic information of the knowledge graph to generate commonsense-aware text.
Outcome: The proposed method outperforms baseline models on three text generation tasks that require reasoning over commonsense knowledge.
Generating Commonsense Explanation by Extracting Bridge Concepts from Reasoning Paths (2020.aacl-main)

Copied to clipboard

Challenge: Existing tasks that use commonsense reasoning as multi-choice reading comprehension lack direct assessment to machine commonsence and impede its practicability to realistic scenarios.
Approach: They propose a method that first extracts the underlying concepts which are served as bridges in the reasoning chain and then integrates these concepts to generate the final explanation.
Outcome: The proposed model outperforms the state-of-the-art models in automatic and human evaluation.
Cross-modal Contrastive Attention Model for Medical Report Generation (2022.coling-1)

Copied to clipboard

Challenge: Existing methods for medical report generation are unable to capture useful information from historical cases.
Approach: They propose a model that captures both visual and semantic information from similar cases.
Outcome: The proposed model outperforms the state-of-the-art models on almost all metrics on IU X-Ray and MIMIC-CXR benchmarks.
Keep it Consistent: Topic-Aware Storytelling from an Image Stream via Iterative Multi-agent Communication (2020.coling-main)

Copied to clipboard

Challenge: Existing methods for visual storytelling construct text description independently for each image and roughly concatenate them as a story, which leads to the problem of generating semantically incoherent content.
Approach: They propose a topic description task to detect the global semantic context of an image stream and a story is then constructed with the guidance of the topic description.
Outcome: The proposed framework can generate stories with higher quality compared to state-of-the-art methods on a VIST dataset.
DVAGen: Dynamic Vocabulary Augmented Generation (2025.emnlp-demos)

Copied to clipboard

Challenge: Existing dynamic vocabulary approaches struggle to generalize to novel or out-of-vocabulary words, limiting their flexibility in handling diverse token combinations.
Approach: They propose an open-source framework for training, evaluation, and visualization of dynamic vocabulary-augmented language models.
Outcome: The proposed framework validates the effectiveness of dynamic vocabulary-augmented language models on modern LLMs and shows support for batch inference significantly improving inference throughput.
Uncertainty Quantification for In-Context Learning of Large Language Models (2024.naacl-long)

Copied to clipboard

Challenge: Existing studies on in-context learning have focused on quantifying the uncertainty associated with the model's response, but they neglect the complexity of the LLM and the uniqueness of in-constitut learning.
Approach: They propose a method to quantify the uncertainty associated with in-context learning and propose corresponding estimation method to quantify both types of uncertainties.
Outcome: The proposed method offers an unsupervised way to understand the prediction of in-context learning in a plug-and-play fashion.
Incorporating Argument-Level Interactions for Persuasion Comments Evaluation using Co-attention Model (C18-1)

Copied to clipboard

Challenge: Existing research explores different text features of reply comments on word level and ignores interactions between participants.
Approach: They propose a co-attention mechanism based neural network to capture interactions between participants on argument level to better model dialogical argumentation.
Outcome: The proposed model outperforms state-of-the-art methods on a publicly available dataset showing that it extracts interactive argument pairs from the original post and the reply.
ProMind-LLM: Proactive Mental Health Care via Causal Reasoning with Sensor Data (2025.findings-acl)

Copied to clipboard

Challenge: Existing methods for mental health risk assessment rely on subjective textual records . however, these uncertainties can cause inconsistent and unreliable predictions .
Approach: They propose a method that integrates objective behavior data alongside subjective mental records for robust mental health risk assessment.
Outcome: The proposed approach achieves significant improvements over general LLMs.
Monte Carlo Tree Search Based Prompt Autogeneration for Jailbreak Attacks against LLMs (2025.coling-main)

Copied to clipboard

Challenge: Jailbreak attacks craft specific prompts or append adversarial suffixes to prompts, thereby inducing language models to generate harmful or unethical content and bypassing the model’s safety guardrails.
Approach: They propose a Monte Carlo Tree Search (MCTS) based Prompt Auto-generation (MPA) method to generate adversarial suffixes for valid jailbreak attacks.
Outcome: The proposed method outperforms existing methods on open-source and closed-source models and shows that it can generate harmful responses.
mPLUG: Effective and Efficient Vision-Language Learning by Cross-modal Skip-connections (2022.emnlp-main)

Copied to clipboard

Challenge: Existing pre-trained vision-language models suffer from inefficiency and linguistic signal overwhelmed by long visual sequences in cross-modal alignment.
Approach: They propose a vision-language foundation model with cross-modal skip-connections that can be pre-trained end-to-end on large-scale image-text pairs with both discriminative and generative objectives.
Outcome: The proposed model achieves state-of-the-art results on a wide range of vision-language downstream tasks, including image captioning, image-text retrieval, visual grounding and visual question answering.
Fine-grained Coordinated Cross-lingual Text Stream Alignment for Endless Language Knowledge Acquisition (D18-1)

Copied to clipboard

Challenge: a novel information network decipherment paradigm is proposed for fine-grained coordinated cross-lingual text stream alignment.
Approach: They propose to use Burst Information Networks as media to represent text streams . they propose a simple yet effective information network decipherment algorithm with diverse clues .
Outcome: The proposed approach outperforms existing approaches on bilingual lexicon extraction from coordinated text streams and can harvest high-quality alignments from large amounts of streaming data for endless language knowledge mining.
Enhancing Chinese Offensive Language Detection with Homophonic Perturbation (2025.emnlp-main)

Copied to clipboard

Challenge: Detecting offensive language in Chinese is challenging due to homophonic substitutions used to evade detection.
Approach: They propose to use HED-COLD to build a large-scale homophonic dataset for Chinese offensive language detection and a homophone-aware pretraining strategy to learn phonetics and orthography.
Outcome: The proposed framework achieves state-of-the-art performance on the COLD test set and the toxicity benchmark ToxiCloakCN.
Beyond Static Alignment: Adaptive Arbitration for Semantic Incongruence in Semi-Supervised Multimodal Sentiment Analysis (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for semantic incongruence in sentiment analysis are limited by label-limited settings.
Approach: They propose a framework for semi-supervised multimodal sentiment analysis that emphasizes stable cross-modal representations and reliable supervision.
Outcome: The proposed framework outperforms state-of-the-art methods under label-limited settings.
Generative Pretrained Structured Transformers: Unsupervised Syntactic Language Models at Scale (2024.acl-long)

Copied to clipboard

Challenge: Existing syntactic language models require a gold tree and sequential training to generate sentences.
Approach: They propose an unsupervised syntactic language model that incrementally generates a sentence with its syntaktic tree in a left-to-right manner.
Outcome: The proposed model outperforms existing models on grammar induction and comprehension tasks while holding a substantial acceleration on training.
Building an Ellipsis-aware Chinese Dependency Treebank for Web Text (L18-1)

Copied to clipboard

Challenge: ellipsis is a common linguistic phenomenon that some words are left out as they are understood from the context, especially in oral utterance.
Approach: They propose to use a Chinese dependency treebank to facilitate the parsing of web text . they propose to restore omissions and reserve contexts in the web text to improve dependency parsers .
Outcome: The proposed framework enables the parsing of web text from online microblogs.
Accelerate Parallelizable Reasoning via Parallel Decoding within One Sequence (2025.emnlp-main)

Copied to clipboard

Challenge: Existing methods for parallelizable reasoning tasks are inefficient, says a new study . generating lengthy reasoning sequences is computationally expensive and time-consuming, says the study authors .
Approach: They propose a method that decodes multiple tokens per forward pass using a tree-like attention mask . their method achieves nearly 100% speedup in decoding while basically maintaining the answer quality .
Outcome: Experimental results show that the method achieves nearly 100% speedup in decoding while maintaining the answer quality.
SRAP-Agent: Simulating and Optimizing Scarce Resource Allocation Policy with LLM-based Agent (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing research on the allocation of public scarce resources has limitations due to data scarcity and data scariness.
Approach: They propose a framework that integrates Large Language Models into economic simulations . they conduct extensive policy simulation experiments to verify the framework's effectiveness .
Outcome: The proposed framework bridges the gap between theoretical models and real-world dynamics by integrating large language models into economic simulations.
Cross2StrA: Unpaired Cross-lingual Image Captioning with Cross-lingual Cross-modal Structure-pivoted Alignment (2023.acl-long)

Copied to clipboard

Challenge: Current captioning models are limited to the English language due to the largescale paired image-caption datasets.
Approach: They propose to integrate the scene graph (SG) structures and the syntactic constituency trees into a captioner to improve captioning relevancy and fluency.
Outcome: The proposed model improves captioning relevancy and fluency on English-Chinese transfers.
Generating Visual Spatial Description via Holistic 3D Scene Understanding (2023.acl-long)

Copied to clipboard

Challenge: Existing VSD work focuses on skewed spatial understanding of target objects . Existing work merely models the 2D geometrical vision features .
Approach: They propose to incorporate 3D scene features into visual spatial description tasks by sampling topologically-diverse subgraphs from Go3D-S2G.
Outcome: The proposed framework outperforms baselines on two VSD datasets and produces more spatially-diversified generation.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations