Papers by Jianing Liu

17 papers
Mask What Matters: Mitigating Object Hallucinations in Multimodal Large Language Models with Object-Aligned Visual Contrastive Decoding (2026.eacl-srw)

Copied to clipboard

Challenge: Recent studies improve visual contrastive decoding (VCD) by constructing more informative auxiliary views.
Approach: They propose to construct an object-aligned auxiliary view that disrupts unsupported tokens and produces a stronger contrast signal.
Outcome: Empirically, the proposed method shows consistent gains on two popular object hallucination benchmarks across two MLLMs.
Do Large Language Models excel in Complex Logical Reasoning with Formal Language? (2025.emnlp-main)

Copied to clipboard

Challenge: Existing studies on LLMs have focused on formal language, but evaluations of their performance are limited.
Approach: They propose to use a formal language to evaluate LLMs across logical reasoning problems using formal languages.
Outcome: The proposed model outperforms Instruct models in three dimensions, taxonomy of tasks, and format of trajectories, and achieves the best generalization performance across other languages.
Revisiting and Advancing Chinese Natural Language Understanding with Accelerated Heterogeneous Knowledge Pre-training (2022.emnlp-industry)

Copied to clipboard

Challenge: Existing knowledge-enhanced pre-trained language models (KEPLMs) can capture internal knowledge, but can't understand external background knowledge.
Approach: They propose to use Chinese knowledge-enhanced pre-trained language models to improve context-aware representations via learning from structured relations in knowledge bases.
Outcome: Experiments show that Chinese knowledge-enhanced pre-trained language models outperform strong baselines over various benchmark NLP tasks and in different model sizes.
Weak2Wise: An Automated, Lightweight Framework for Weak-LLM-Friendly Reasoning Synthesis (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing approaches to finetuning large language models rely on expensive manual annotations or auxiliary models and fail to address the unique constraints of smaller "weak" LLMs.
Approach: Weak2Wise is a fully automated framework for synthesizing highquality, weak-LLM-friendly reasoning traces.
Outcome: Weak2Wise is a fully automated, lightweight framework for synthesizing highquality, weak-LLM-friendly reasoning traces.
Multilingual Encoder Knows more than You Realize: Shared Weights Pretraining for Extremely Low-Resource Languages (2025.acl-long)

Copied to clipboard

Challenge: XLM-R and mBART have advanced multilingualism in NLP, but low-resource languages such as Tibetan, Uyghur, Kazakh, and Mongolian are underserved.
Approach: They propose a framework for adapting multilingual encoders to text generation in extremely low-resource languages by reusing the weights between the encoder and the decoder.
Outcome: The proposed framework performs better on various downstream tasks even when compared with much larger models.
The Role of Visual Modality in Multimodal Mathematical Reasoning: Challenges and Insights (2025.acl-long)

Copied to clipboard

Challenge: Existing models that leverage visual information do not improve math reasoning performance . authors suggest that visual information is important for multimodal reasoning .
Approach: They propose a dataset to require image reliance for problem-solving and challenge models with similar, yet distinct, images that change the correct answer.
Outcome: The proposed model performance is unaffected by changes to or removal of images in the dataset.
LogicPro: Improving Complex Logical Reasoning via Program-Guided Learning (2025.acl-long)

Copied to clipboard

Challenge: LogicPro is a data synthesis method that uses LeetCode-style algorithm problems and their corresponding Program solutions to generate complex logic data.
Approach: They propose a new method which leverages LeetCode-style algorithm Problems and their corresponding Program solutions to synthesize complex logic data in text format.
Outcome: The proposed method outperforms existing models for BBH27, LogicBench, DROP, AR-LSAT, and GSM8K, and a wide range of reasoning datasets.
CMHG: A Dataset and Benchmark for Headline Generation of Minority Languages in China (2025.emnlp-main)

Copied to clipboard

Challenge: Minority languages in China face significant challenges due to their unique writing systems, which differ from international standards.
Approach: They propose a dataset specifically curated for headline generation tasks for minority languages in China . they propose 50,000 entries each for Uyghur and Mongolian, and a test set annotated by native speakers .
Outcome: The proposed dataset will help improve headline generation in minority languages . it includes 100,000 entries for Tibetan, 50,000 entries each for Uyghur and Mongolian .
MEDSYN: Benchmarking Multi-EviDence SYNthesis in Complex Clinical Cases for Multimodal Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Existing benchmarks for multimodal large language models do not capture real-world clinical complexity.
Approach: They evaluate multilingual, multimodal multimodal models of clinical cases with up to 7 distinct visual clinical evidence types per case.
Outcome: The proposed model outperforms human models on differential diagnosis (DDx) generation and final diagnosis (FDx) selection.
Rethinking Data Mixing from the Perspective of Large Language Models (2026.acl-short)

Copied to clipboard

Challenge: Existing methods to mix data with LLMs have relied on domain definitions derived from intuition.
Approach: They propose a reweighting framework that restructures data scheduling as a graph-constrained optimization problem.
Outcome: The proposed framework achieves competitive performance on GPT-2 models.
EasyNLP: A Comprehensive and Easy-to-use Toolkit for Natural Language Processing (2022.emnlp-demos)

Copied to clipboard

Challenge: Pre-Trained Models (PTMs) have reshaped the development of natural language processing (NLP) but it is not easy to obtain high-performing PTMs without a large amount of labeled training data and deploy them online with fast inference speed.
Approach: They propose to make it easy to build NLP applications with knowledge-enhanced pre-training and knowledge distillation.
Outcome: EasyNLP supports a comprehensive suite of NLP algorithms and features knowledge-enhanced pre-training, knowledge distillation and few-shot learning functionalities.
Multiple Character Embeddings for Chinese Word Segmentation (P19-2)

Copied to clipboard

Challenge: Chinese word segmentation is regarded as character-based sequence labeling task in most current work but it neglects important fact: Chinese characters contain both semantic and phonetic meanings.
Approach: They propose a shared bi-LSTM-CRF model which fuses linguistic features efficiently by sharing the LSTM network during the training procedure.
Outcome: The proposed model achieves state-of-the-art in AS and CityU corpora without external lexical resources.
FinRipple: Aligning Large Language Models with Financial Market for Event Ripple Effect Awareness (2025.findings-acl)

Copied to clipboard

Challenge: Financial markets exhibit complex dynamics where localized events trigger ripple effects across entities.
Approach: They propose a framework that empowers large language models to analyze ripple effects . they use financial theory-guided large-scale reinforcement learning to align LLMs with the market .
Outcome: The proposed framework allows LLMs to analyze ripple effects through financial theory-guided large-scale reinforcement learning.
Your Semantic-Independent Watermark is Fragile: A Semantic Perturbation Attack against EaaS Watermark (2025.findings-emnlp)

Copied to clipboard

Challenge: Embedding-as-a-Service (EaaS) is a successful business pattern but faces significant challenges related to various forms of copyright infringement.
Approach: They propose a semantic-independent watermarking scheme that exploits semantic perturbation tests to bypass verification.
Outcome: The proposed watermarking schemes possess semantic-independent characteristics and exploit semantic perturbation tests to bypass verification.
Prejudge-Before-Think: Enhancing Large Language Models at Test-Time by Process Prejudge Reasoning (2025.findings-emnlp)

Copied to clipboard

Challenge: Experimental results from competition-level complex reasoning demonstrate that bootstrapping with process prejudge can significantly enhance the reasoning ability of LLMs.
Approach: They propose a new process prejudge strategy for LLM reasoning that bootstraps with process prejudgment .
Outcome: The proposed method can be bootstrapped with process prejudge in LLM reasoning . it allows the model to anticipate errors rather than relying on trial and error.
FIER: Fine-Grained and Efficient KV Cache Retrieval for Long-context LLM Inference (2025.findings-emnlp)

Copied to clipboard

Challenge: Key-Value (KV) cache reading latency increases with context lengths hindering LLM inference . important tokens are sparsely distributed across the long context, making existing retrieval inaccurate .
Approach: They propose a method to retain a small fraction of KV cache based on token importance . important tokens are often sparsely distributed across the long context .
Outcome: The proposed method reduces decoding latency by 1.2 to 1.5.
InstructGraph: Boosting Large Language Models via Graph-centric Instruction Tuning and Preference Alignment (2024.findings-acl)

Copied to clipboard

Challenge: Existing large language models (LLMs) can solve graph reasoning and generation tasks with parameter updates without sacrificing performance.
Approach: They propose a structured format verbalizer to unify all graph data into a universal code-like format, which can simply represent the graph without any external graph-specific encoders.
Outcome: The proposed framework outperforms GPT-4 and LLaMA2 in graph reasoning and generation tasks by more than 13% and 38%, respectively.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations