Papers by Jiang Zhong

34 papers
WhiteningBERT: An Easy Unsupervised Sentence Embedding Approach (2021.findings-emnlp)

Copied to clipboard

Challenge: Pre-trained language models perform well on learning sentence semantics when fine-tuned with supervised data.
Approach: They conduct a thorough examination of pretrained model based unsupervised sentence embeddings.
Outcome: The proposed approach improves on whitening-based vector normalization with less than 10 lines of code.
MentalSeek-Dx: Towards Progressive Hypothetico-Deductive Reasoning for Real-world Psychiatric Diagnosis (2026.acl-long)

Copied to clipboard

Challenge: Mental health disorders represent a burgeoning global public health challenge . lack of ecological validity and fine-grained diagnostic supervision limits their utility .
Approach: They propose a medical-specialized LLM trained to internalize clinical reasoning process through supervised trajectory construction and curriculum-based reinforcement learning.
Outcome: The proposed model achieves state-of-the-art with only 14B parameters, establishing a clinically grounded framework for reliable psychiatric diagnosis.
Chart-MRAG: Benchmarking Multimodal Retrieval Augmented Generation on Chart-based Documents (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks focus on simple image-text interactions, overlooking complex visual formats like charts.
Approach: They propose a semi-automatic framework for generating evaluation samples through multi-modal keypoint extraction, knowledge graph construction, and qa pair synthesis.
Outcome: The proposed framework generates 4,738 question-answering pairs across 8 domains from real-world documents.
Enhancing Large Language Models for Scientific Multimodal Summarization with Multimodal Output (2025.coling-industry)

Copied to clipboard

Challenge: Scientific publications are becoming more multimedia, containing both text and visual content.
Approach: They propose a framework for Scientific Multimodal Summarization with Multimodal Output . it leverages the power of large language models and extends its capability to cross-modal understanding .
Outcome: The proposed framework outperforms uni- and multi-modality methods on two new datasets . it leverages the power of large language models and extends its capability to cross-modal understanding .
Reaction Miner: An Integrated System for Chemical Reaction Extraction from Textual Data (2023.emnlp-demo)

Copied to clipboard

Challenge: Reaction Miner is a system designed to extract chemical reactions from raw scientific PDFs.
Approach: They propose a system that extracts chemical reactions directly from raw scientific PDFs.
Outcome: The proposed system can extract chemical reactions from raw scientific PDFs.
Logic-Driven Context Extension and Data Augmentation for Logical Reasoning of Text (2022.findings-acl)

Copied to clipboard

Challenge: Existing methods for logical reasoning of text focus on contextual semantics while struggling to explicitly model the logical inference process.
Approach: They propose a logic-driven context extension framework and a data-driven augmentation algorithm that uses contrastive learning to better capture logical information.
Outcome: The proposed framework outperforms existing methods on two benchmark datasets, ReClor and LogiQA.
SARA: Salience-Aware Reinforced Adaptive Decoding for Large Language Models in Abstractive Summarization (2025.acl-long)

Copied to clipboard

Challenge: Existing decoding strategies neglect the explicit use of salient contextual information and rely on static hyperparameters to fix the balance between contextual and prior knowledge.
Approach: They propose a salience-aware reinforced adaptive decoding (SARA) which incorporates salient contextual information and allows the model to determine reliance on source document's context, salient context, and model's prior knowledge based on pointwise mutual information.
Outcome: The proposed model improves the quality and faithfulness of summaries across LLMs without modifying their weights.
AgentThink: A Unified Framework for Tool-Augmented Chain-of-Thought Reasoning in Vision-Language Models for Autonomous Driving (2025.findings-emnlp)

Copied to clipboard

Challenge: Vision-Language Models struggle with hallucinations, inefficient reasoning, and limited real-world validation hinders accurate perception and robust step-by-step reasoning.
Approach: AgentThink integrates Chain-of-Thought reasoning with dynamic, agent-style tool invocation for autonomous driving tasks.
Outcome: Experiments on the DriveLMM-o1 benchmark show AgentThink significantly boosts overall reasoning scores by 53.91% and enhances answer accuracy by 33.54% .
What Language Do Non-English-Centric Large Language Models Think in? (2025.findings-acl)

Copied to clipboard

Challenge: Despite their robust performance in English, these models often exhibit reduced proficiency in non-English languages, and their outputs may reflect an inherent bias toward English-centric perspectives.
Approach: They categorize non-English-centric large language models into two groups: CPMs and BLMs, which are pre-trained on a balanced mix of multiple languages from scratch.
Outcome: The proposed models exhibit a pronounced internal preference for English tokens when projected into the vocabulary space.
Helios: A Foundational Language Model for Smart Energy Knowledge Reasoning and Application (2026.eacl-long)

Copied to clipboard

Challenge: Enersys is a collaborative framework for end-to-end dataset construction that combines a large-scale pretraining, SFT, and RLHF datasets to improve performance.
Approach: They propose a large language model tailored to the smart energy domain and a collaborative framework to advance LLM research in this field.
Outcome: The proposed model improves domain knowledge mastery, task execution accuracy, and alignment with human preferences.
TermDiffuSum: A Term-guided Diffusion Model for Extractive Summarization of Legal Documents (2025.coling-main)

Copied to clipboard

Challenge: Recent studies have explored diffusion models for extractive summarization task, showcasing their remarkable capabilities.
Approach: They propose a term-guided diffusion model for extractive summarization of legal documents that incorporates legal terminology into the model via a well-designed multifactor fusion noise weighting schedule.
Outcome: The proposed model outperforms existing models on a self-constructed legal summarization dataset and achieves improvements of 3.10, 2.84, and 2.89 on three public datasets.
Neural CRF Model for Sentence Alignment in Text Simplification (2020.acl-main)

Copied to clipboard

Challenge: Text simplification systems are based on the quality and quantity of complex-simple sentence pairs extracted by aligning sentences between parallel articles.
Approach: They propose a neural CRF alignment model which leverages the sequential nature of sentences in parallel documents and utilizes a sentence pair model to capture semantic similarity.
Outcome: The proposed model outperforms previous work on monolingual sentence alignment task by more than 5 points in F1.
Temperature-Centric Investigation of Speculative Decoding with Knowledge Distillation (2024.findings-emnlp)

Copied to clipboard

Challenge: Speculative decoding is a novel method to expedite inference in autoregressive (large) language models.
Approach: They propose to use a smaller model as a draft model to speculate a block of tokens, which the target model then evaluates for acceptance.
Outcome: The proposed method can be used to accelerate inference in autoregressive (large) language models by using smaller models as draft models to speculate tokens for multiple inference steps.
P²Net: Parallel Pointer-based Network for Key Information Extraction with Complex Layouts (2025.findings-acl)

Copied to clipboard

Challenge: Existing methods for key information extraction are based on a limited set of entity categories and fixed layouts.
Approach: They propose a large-scale, human-annotated dataset for key information extraction . it is based on a human-annotated layout and 1,162 entity categories . they propose 'parallel pointer-based network' that leverages implicit relationships .
Outcome: Experiments on widely-used datasets show that the proposed model outperforms state-of-the-art methods while maintaining fast inference speeds.
ReactIE: Enhancing Chemical Reaction Extraction with Weak Supervision (2023.findings-acl)

Copied to clipboard

Challenge: Structured chemical reaction information is a vital tool for chemists engaged in laboratory work and advanced endeavors such as computer-aided drug design.
Approach: They propose a method which utilizes frequent patterns within the text as linguistic cues to identify specific characteristics of chemical reactions.
Outcome: The proposed model outperforms baselines and outperformed existing models.
Latent Distribution Decouple for Uncertain-Aware Multimodal Multi-label Emotion Recognition (2025.findings-acl)

Copied to clipboard

Challenge: Existing studies focus on improving fusion strategies and modeling modality-to-label dependencies, but they overlook the impact of aleatoric uncertainty, which is inherent noise in multimodal data.
Approach: They propose a latent emotional distribution decomposition with uncertainty perception framework to model aleatoric uncertainty in multimodal data.
Outcome: The proposed framework achieves state-of-the-art performance on the CMU-MOSEI and M3ED datasets, highlighting the importance of uncertainty modeling in MMER.
Chain-of-Specificity: Enhancing Task-Specific Constraint Adherence in Large Language Models (2025.coling-main)

Copied to clipboard

Challenge: Existing approaches to enhancing large language models fail to emphasize specific constraints and unlock the underlying knowledge.
Approach: They propose a method that emphasizes specific constraints and unlocks knowledge within LLMs by iteratively emphasising on specific constraints.
Outcome: The proposed method outperforms existing methods in enhancing generated content, especially in terms of specificity.
Reasoning Graph Enhanced Exemplars Retrieval for In-Context Learning (2025.coling-main)

Copied to clipboard

Challenge: Existing methods focus on semantic similarity between queries and candidate exemplars, while logical connections between reasoning steps can be beneficial to depict problem-solving process.
Approach: They propose a method to retrieve exemplars with semantic and structural similarity using a graph kernel.
Outcome: The proposed method is superior to state-of-the-art retrieval-based approaches on mathematics and logical reasoning tasks.
Learning to Edit: Aligning LLMs with Knowledge Editing (2024.acl-long)

Copied to clipboard

Challenge: Existing knowledge editing techniques rely on memorizing updated knowledge, impeding LLMs from effectively combining the new knowledge with their inherent knowledge when answering questions.
Approach: They propose a Learning to Edit framework that equips LLMs with the ability to apply updated knowledge to input questions through a two-phase process .
Outcome: The proposed framework outperforms existing methods in knowledge editing tasks and compares it with four benchmarks and two LLM architectures.
HoVer: A Dataset for Many-Hop Fact Extraction And Claim Verification (2020.findings-emnlp)

Copied to clipboard

Challenge: a dataset for many-hop evidence extraction and fact verification challenges models to reason with information from multiple Wikipedia articles.
Approach: They propose a dataset for many-hop evidence extraction and fact verification . they challenge models to extract facts from Wikipedia articles relevant to a claim .
Outcome: The proposed dataset shows that state-of-the-art models degrade as the number of reasoning hops increases.
100-LongBench: Are de facto Long-Context Benchmarks Literally Evaluating Long-Context Ability? (2025.findings-acl)

Copied to clipboard

Challenge: Existing benchmarks for long-context capability are too synthetic and do not represent the real world usage of LLMs.
Approach: They propose a length-controllable, real-life reflective benchmark that disentangles baseline knowledge from long-context capabilities.
Outcome: Experiments show that the proposed benchmarks disentangle baseline knowledge from long-context capabilities.
Syntax-Enhanced Pre-trained Model (2021.acl-long)

Copied to clipboard

Challenge: Existing methods that use syntax of text in pre-training and fine-tuning suffer from discrepancy between the two stages.
Approach: They propose a model that utilizes the syntactic structure of text in pre-training and fine-tuning stages.
Outcome: The proposed model achieves state-of-the-art on six public benchmark datasets.
LoRATK: LoRA Once, Backdoor Everywhere in the Share-and-Play Ecosystem (2025.findings-emnlp)

Copied to clipboard

Challenge: distributing LLMs without a proven track record like ‘meta-llama‘ or ‘qwen‘ rarely gains community traction.
Approach: They propose a simple, efficient, yet specific recipe for a backdoor LoRA to be injected into task-enhancing LoRAs and examine the mechanisms of such infections.
Outcome: The proposed model allows attackers to scale the distribution of compromised LoRAs with minimal effort by leveraging the rich pool of shared LoRA assets.
Fin-STAR: Structure-as-Semantics to Resolve Implicitness in Financial Retrieval (2026.findings-acl)

Copied to clipboard

Challenge: Existing Retrieval-Augmented Generation systems treat structure as a physical navigational skeleton rather than intrinsic semantic knowledge.
Approach: They propose a framework that redefining hierarchy as intrinsic semantics and uses snippets to enrich hierarchical lineage.
Outcome: The proposed framework outperforms state-of-the-art hierarchical and graph-based benchmarks on FinTierQA Gold.
FollowBench: A Multi-level Fine-grained Constraints Following Benchmark for Large Language Models (2024.acl-long)

Copied to clipboard

Challenge: Existing benchmarks focus on evaluating pure response quality, rather than assessing whether the response follows constraints stated in the instruction.
Approach: They propose a Multi-level Fine-grained Constraints Following Benchmark for Large Language Models that adds a single constraint to the initial instruction at each increased level.
Outcome: The proposed model can follow instructions with more constraints, and is deemed to have better instruction-following ability.
Efficient Knowledge Infusion via KG-LLM Alignment (2024.findings-acl)

Copied to clipboard

Challenge: Existing methods for knowledge infusion face knowledge mismatch and poor information compliance of LLMs with knowledge graphs.
Approach: They propose a three-stage alignment strategy to enhance the LLM's capability to utilize information from knowledge graphs.
Outcome: The proposed method outperforms baselines on biomedical question-answering datasets and outperformed existing methods.
From Past To Path: Masked History Learning for Next-Item Prediction in Generative Recommendation (2026.acl-long)

Copied to clipboard

Challenge: Generative recommendation models inherently bias towards local contexts, failing to capture deeper historical dependencies necessary for understanding complex user intents.
Approach: They propose a training framework that shifts the objective from simple next-step prediction to deep comprehension of history by entropy-guided masking policy and a curriculum learning scheduler to enhance the framework.
Outcome: The proposed framework outperforms state-of-the-art generative models on three public datasets and shows that it is more accurate than current models.
LogicalFactChecker: Leveraging Logical Operations for Fact Checking with Graph Module Network (2020.acl-main)

Copied to clipboard

Challenge: Existing methods for fact checking textual statements are not yet available.
Approach: They propose a neural network approach capable of leveraging logical operations for fact checking . they use a textual statement and semi-structured tables to generate a program from it .
Outcome: The proposed approach achieves state-of-the-art performance on TABFACT dataset . it derives a program (a.k.a. logical form) of the statement in semantic parsing manner .
T2R-BENCH: A Benchmark for Real World Table-to-Report Task (2025.emnlp-main)

Copied to clipboard

Challenge: Existing table benchmarks lack the capacity to adequately assess the practical application of table reasoning in industrial applications.
Approach: They propose a bilingual table-to-report task and a table-based benchmark to assess the quality of table reasoning.
Outcome: The proposed task is based on a bilingual benchmark with 457 industrial tables and evaluation criteria to measure the quality of report generation.
FedLEKE: Federated Locate-then-Edit Knowledge Editing for Multi-Client Collaboration (2025.findings-acl)

Copied to clipboard

Challenge: Existing methods for updating large language models are inefficient in multi-client scenarios . Existing approaches assume a single-user setting and are ineffective in multiclient scenarios.
Approach: They propose a new task that enables multiple clients to perform LEKE while preserving privacy and reducing computational overhead.
Outcome: The proposed framework outperforms existing LEKE frameworks on two benchmark datasets and retains 96% of performance.
DiffER: Diffusion Entity-Relation Modeling for Reversal Curse in Diffusion Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Existing large language models exhibit unidirectional behavior when processing bidirectional relationships . authors propose a solution to alleviate the reversal curse in Diffusion LLMs .
Approach: They propose a model that addresses the "reversal curse" of bidirectional behavior in large language models . they propose 'entity-aware training' and balanced data construction to alleviate asymmetry and missing relations .
Outcome: The proposed model alleviates the "reversal curse" in Diffusion LLMs . the proposed model employs whole-entity masking to mitigate entity fragmentation .
Planning, Creation, Usage: Benchmarking LLMs for Comprehensive Tool Utilization in Real-World Complex Scenarios (2024.findings-acl)

Copied to clipboard

Challenge: Existing benchmarks focus on simple synthesized queries that do not reflect real-world complexity, thereby offering limited perspectives in evaluating tool utilization.
Approach: They propose a benchmark to evaluate LLMs’ ability in tool utilization within real-world scenarios.
Outcome: The proposed benchmark improves LLMs’ ability in tool utilization within real-world scenarios and eliminates the restriction of pre-defined toolset.
Leveraging Declarative Knowledge in Text and First-Order Logic for Fine-Grained Propaganda Detection (2020.emnlp-main)

Copied to clipboard

Challenge: Existing methods for fine-grained propaganda detection are not based on input-output data, but instead use declarative knowledge to detect propagandistic text fragments.
Approach: They propose a method to inject declarative knowledge of fine-grained propaganda techniques into training data to get better representations of propagandistic texts.
Outcome: The proposed method achieves superior performance on a large dataset for propaganda detection.
Mixed-modality Representation Learning and Pre-training for Joint Table-and-Text Retrieval in OpenQA (2022.findings-emnlp)

Copied to clipboard

Challenge: Existing methods to retrieve evidences from corpus are difficult due to table-text discrepancy and data sparsity problem.
Approach: They propose an optimized OpenQA Table-Text Retriever to retrieve tabular and textual evidences from tabular resources.
Outcome: The proposed OpenQA Table-Text Retriever significantly outperforms existing methods on QA tasks.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations