Papers by Ke Jiang

21 papers
SILO-BENCH: A Scalable Environment for Evaluating Distributed Coordination in Multi-Agent LLM Systems (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks conflate coordination ability with role-based priors.
Approach: They propose a role-free benchmark for evaluating free-form collaboration under information silos.
Outcome: The proposed benchmark systematically probes coordination capabilities under information silos using 54 configurations and 3 frontier LLMs.
CAT: Confidence-Adaptive Thinking for Efficient Reasoning of Large Reasoning Models (2026.acl-industry)

Copied to clipboard

Challenge: Existing compression methods for large reasoning models rely on uniform length reduction or coarse-grained difficulty estimation, often leading to performance degradation on difficult problems.
Approach: They propose a framework that incorporates model’s intrinsic self-certainty signals as confidence into the preference optimization process, which autonomously modulates reasoning lengths based on problem difficulty.
Outcome: The proposed framework outperforms state-of-the-art models on reasoning accuracy across multiple benchmarks on different base models.
CoSQA: 20,000+ Web Queries for Code Search and Question Answering (2021.acl-long)

Copied to clipboard

Challenge: Using deep neural networks to find codes is difficult . we present a dataset that includes 20,604 labels for natural language queries and codes .
Approach: They introduce a contrastive learning method to enhance text-code matching . they find that CoSQA improves the accuracy of code question answering by 5.1% .
Outcome: The proposed method improves the accuracy of code question answering by 5.1% and improves by 10.5% on a CodeBERT model.
Magnet: Multi-turn Tool-use Data Synthesis and Distillation via Graph Translation (2025.acl-long)

Copied to clipboard

Challenge: Large language models have been shown to be effective in multi-turn interactions . however, their performance may be limited in complex, multi-turned interactions involving users and multiple tools.
Approach: They propose a framework for synthesizing high-quality training trajectories to enhance the function calling capability of large language model agents in multi-turn conversations with humans.
Outcome: The proposed model outperforms the teacher model by 68.01 on BFCL-v3 and 73.30 on ToolQuery.
Few-Shot Multimodal Named Entity Recognition Based on Mutlimodal Causal Intervention Graph (2024.lrec-main)

Copied to clipboard

Challenge: Existing methods for multimodal named entity recognition are limited due to limited resources.
Approach: They propose a Few-shot Multimodal Named Entity Recognition task to address these relation types by constructing a multimodal graph and a new multimodal causal intervention strategy.
Outcome: The proposed model improves on two multimodal named entity recognition datasets.
TS-Align: A Teacher-Student Collaborative Framework for Scalable Iterative Finetuning of Large Language Models (2024.findings-emnlp)

Copied to clipboard

Challenge: Mainstream approaches to aligning large language models heavily rely on human preference data.
Approach: They propose a framework that fine-tunes a policy model using pairwise feedback data automatically mined from its outputs.
Outcome: The proposed framework outperforms the base model with an average win rate of 69.7% across seven conversational or instruction-following datasets.
Take the essence and discard the dross: A Rethinking on Data Selection for Fine-Tuning Large Language Models (2025.naacl-long)

Copied to clipboard

Challenge: Existing studies focus on data selection but lack a clear, unified framework . variability in experimental settings complicates systematic comparisons .
Approach: They propose a three-stage scheme to standardize data selection for fine-tuning large language models . they propose unified comparison approach that incorporates ratio-based efficiency and ranking-based feasibility metrics to address inconsistencies across experiments.
Outcome: The proposed scheme outperforms existing methods in a dozen key studies and identifies key challenges.
Gated Mechanism Enhanced Multi-Task Learning for Dialog Routing (2022.coling-1)

Copied to clipboard

Challenge: Existing methods for dialog routing are mostly heuristic and cannot achieve high-quality performance.
Approach: They propose a multi-task learning framework with a dialog encoder and two tailored gated mechanism modules to solve this problem.
Outcome: The proposed model can play the role of hierarchical information filtering and is non-invasive to existing dialog systems.
SeqXGPT: Sentence-Level AI-Generated Text Detection (2023.emnlp-main)

Copied to clipboard

Challenge: Existing methods for sentence-level AIGT detection are weak . large language models (LLMs) can generate human-like content .
Approach: They propose a sentence-level AIGT detection challenge using LLMs as log probability lists . they propose 'check' GPT' method that uses log probability list features to detect AIGT .
Outcome: The proposed method surpasses baseline methods in sentence- and document-level detection challenges.
Watermarking LLMs with Weight Quantization (2023.findings-emnlp)

Copied to clipboard

Challenge: Large language models are being deployed at an astonishing speed, exposing users to high risks.
Approach: They propose a method that plants watermarks in quantization process of large language models without pre-defined triggers during inference.
Outcome: The proposed method protects model weights without pre-defined triggers . it works when the model is used in the fp32 mode and remains hidden when the models are quantized to int8 .
McBE: A Multi-task Chinese Bias Evaluation Benchmark for Large Language Models (2025.findings-acl)

Copied to clipboard

Challenge: Existing datasets on bias evaluation for large language models focus on English and North American culture and are limited to one task.
Approach: They propose to evaluate Chinese language models' biases from multiple perspectives using a multi-task Chinese Bias Evaluation Benchmark.
Outcome: The proposed model covers 12, 82 subcategories and 5 evaluation tasks covering a wide range of categories and content diversity.
InferAligner: Inference-Time Alignment for Harmlessness through Cross-Model Guidance (2024.emnlp-main)

Copied to clipboard

Challenge: Existing methods for enhancing harmlessness and helpfulness of large language models (LLMs) involve complex and resource-intensive training processes.
Approach: They propose a method that decouples harmlessness from helpfulness during inference phase.
Outcome: The proposed method significantly reduces the attack success rate (ASR) of harmful instructions and jailbreak instructions while maintaining almost unchanged performance in downstream tasks.
Comprehensive Benchmarking of Long-Form Speech Generation in Diverse Scenarios (2026.findings-acl)

Copied to clipboard

Challenge: Existing evaluation benchmarks for long-form speech are limited to limited domains, creating a significant gap with the diverse downstream applications.
Approach: They propose a benchmark that decomposes "long-form speech quality" into specific, disentangled dimensions.
Outcome: The proposed benchmark decomposes “long-form speech quality” into specific, disentangled dimensions.
From Text to Historical Ecological Knowledge: The Construction and Application of the Shan Jing Knowledge Base (2024.lrec-main)

Copied to clipboard

Challenge: Traditional Ecological Knowledge (TEK) is a shared cultural heritage and crucial instrument to tackle environmental challenges.
Approach: They propose to build a language resource based on Shanhai Jing (the classic of mountains and seas) written 2000 years ago and uses a stylized narrative and juxtaposition of knowledge from multiple domains to build the knowledge base.
Outcome: The proposed knowledge base contains 1432 systematically classified entities and 3294 relationships.
Fin-STAR: Structure-as-Semantics to Resolve Implicitness in Financial Retrieval (2026.findings-acl)

Copied to clipboard

Challenge: Existing Retrieval-Augmented Generation systems treat structure as a physical navigational skeleton rather than intrinsic semantic knowledge.
Approach: They propose a framework that redefining hierarchy as intrinsic semantics and uses snippets to enrich hierarchical lineage.
Outcome: The proposed framework outperforms state-of-the-art hierarchical and graph-based benchmarks on FinTierQA Gold.
Global Context or Local Detail? Adaptive Visual Grounding for Hallucination Mitigation (2026.findings-acl)

Copied to clipboard

Challenge: Large vision–language models suffer from object-existence hallucinations when multi-step deliberation decouples from visual evidence.
Approach: They propose a framework that allocates visual computation by uncertainty . they propose highlighting retains global context, while selective zoom-in performs local verification.
Outcome: The proposed framework reduces the complexity of multimodal reasoning by minimizing the operator trade-off.
When 20 Agents Fail to Sort: The Distributed Sorting Benchmark for Scalable Multi-Agent Systems (2026.findings-acl)

Copied to clipboard

Challenge: MAS-BENCH isolates coordination under explicit communication constraints . CAMOC significantly improves coordination success and efficiency across backends .
Approach: They propose a distributed-sorting benchmark that isolates coordination under explicit communication constraints.
Outcome: MAS-BENCH improves coordination success and efficiency across backends . CAMOC significantly improves efficiency under shared-state interaction .
DPEPO: Diverse Parallel Exploration Policy Optimization for LLM-based Agents (2026.acl-long)

Copied to clipboard

Challenge: Existing approaches to large language model (LLM) agents that follow the sequential "reason-then-act" paradigm suffer from limited exploration and incomplete environmental understanding as they interact with only a single environment per step.
Approach: They propose a paradigm that enables an agent to interact with multiple environments simultaneously and share cross-trajectory experiences.
Outcome: The proposed paradigm achieves state-of-the-art (SOTA) success rates while maintaining comparable efficiency to strong sequential baselines.
Why Agents Compromise Safety Under Pressure (2026.findings-acl)

Copied to clipboard

Challenge: Recent studies have focused on adversarial attacks, but this perspective overlooks a critical threat arising from the internal drive of the agent.
Approach: They propose a new concept called Agentic Pressure which characterizes tension when compliant execution becomes infeasible.
Outcome: The proposed model is able to achieve goal achievement while maintaining safety constraints.
Hyperlink-induced Pre-training for Passage Retrieval in Open-domain Question Answering (2022.acl-long)

Copied to clipboard

Challenge: Existing methods to train dense passage retrieval have a large data gap between upstream and downstream relevance.
Approach: They propose a method to pre-train the dense retriever with the text relevance induced by hyperlinks within Web documents.
Outcome: The proposed method outperforms existing methods under different scenarios and in the open-domain question answering domain.
FuseSearch: Learning Adaptive Parallel Execution for Efficient Code Localization (2026.findings-acl)

Copied to clipboard

Challenge: Existing parallel code localization agents suffer from a 34.9% redundant tool invocation rate . specialized localization agent that operate as dedicated search components is needed to achieve high localization accuracy.
Approach: They propose a parallel code localization system that reframes parallel code execution as a quality–efficiency co-optimization problem.
Outcome: The proposed method matches SOTA performance while being 93.6% faster.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations