Challenge: Existing rerankers perform poorly in complex ranking scenarios due to the scarcity of reasoning-intensive training data.
Approach: They propose an automated reasoning-intensive training framework which generates high-quality training labels from training queries and passages.
Outcome: The proposed model outperforms baselines significantly and achieves much lower latency than the pointwise reranker.

Similar Papers

GroupRank: A Groupwise Paradigm for Effective and Efficient Passage Reranking with LLMs (2026.findings-acl)

Copied to clipboard

Challenge: Existing rankers excel in lexical-matching scenarios, while they struggle with complex queries requiring deep reasoning.
Approach: They propose a new paradigm that balances flexibility and context awareness to unlock the full potential of groupwise reranking.
Outcome: The proposed approach achieves a state-of-the-art 65.2 NDCG@10 on BRIGHT and surpasses baselines by 2.1 points on R2MED while delivering a 6.4 inference speedup.
FIRST: Faster Improved Listwise Reranking with Single Token Decoding (2024.emnlp-main)

Copied to clipboard

Challenge: Existing listwise LLMs lack efficiency as they provide ranking output in the form of a generated ordered sequence of candidate passage identifiers.
Approach: They propose a listwise LLM reranking approach that leverages the first generated identifier to obtain a ranked ordering of the candidates.
Outcome: The proposed approach accelerates inference by 50% while maintaining robust ranking performance with gains across BEIR benchmark.
LimRank: Less is More for Reasoning-Intensive Information Reranking (2025.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to rerank information require large-scale fine-tuning, which is computationally expensive.
Approach: They propose an open-source pipeline for generating diverse, challenging, and realistic reranking examples.
Outcome: The proposed model performs competitively on two benchmarks, while being trained on less than 5% of the data typically used in prior work.
ProRank: Prompt Warmup via Reinforcement Learning for Small Language Models Reranking (2026.findings-acl)

Copied to clipboard

Challenge: Recent Large Language Models (LLMs) have demonstrated remarkable performance in document reranking tasks.
Approach: They propose a two-stage training approach for document reranking using reinforcement learning and fine-grained score learning.
Outcome: The proposed approach outperforms open-source and proprietary reranking models on BEIR benchmark.
CoRanking: Collaborative Ranking with Small and Large Ranking Agents (2025.findings-emnlp)

Copied to clipboard

Challenge: Listwise ranking based on Large Language Models (LLMs) has achieved state-of-the-art performance in Information Retrieval (IR) however, their effectiveness often depends on LLMs with massive parameter scales and computationally expensive sliding window processing, leading to substantial efficiency bottlenecks.
Approach: They propose a Collaborative Ranking framework (CoRanking) for LLM-based listwise ranking based on large language models with massive parameter scales and computationally expensive sliding window processing.
Outcome: The proposed framework reduces ranking latency by approximately 70% while improving effectiveness compared to the standalone large reranker.
REARANK: Reasoning Re-ranking Agent via Reinforcement Learning (2025.emnlp-main)

Copied to clipboard

Challenge: REARANK is a large language model-based listwise reasoning reranking agent . it explicitly reasons be- fore reranked results, significantly improving performance and interpretability.
Approach: They propose a large language model-based listwise reasoning reranking agent that explicitly reasons be- fore reranked lists.
Outcome: The proposed agent outperforms GPT-4 on reasoning-intensive benchmarks and surpasses GPL-4 on BRIGHT benchmarks.
HYRR: Hybrid Infused Reranking for Passage Retrieval (2024.lrec-main)

Copied to clipboard

Challenge: Existing passage retrieval systems typically adopt a two-stage retrieve-then-rerank pipeline.
Approach: They propose a framework for training robust reranking models using hybrid retrievers . they propose HYRR framework that allows users to select training data using hybrids .
Outcome: The proposed framework is robust to different first-stage retrieval settings.
Multi-view-guided Passage Reranking with Large Language Models (2025.emnlp-main)

Copied to clipboard

Challenge: Existing models rely on autoregressive generation and sliding window strategies to rank passages, which incur heavy computational overhead as the number of passages increases.
Approach: They propose a non-generative LLM-based reranking method that encodes query-passage information into diverse view embeddings without being influenced by external biases.
Outcome: The proposed model matches the performance of much larger 7B-scale fine-tuned models while achieving a 100x reduction in inference latency.
Reinforced Query Reasoners for Reasoning-intensive Retrieval Tasks (2025.emnlp-main)

Copied to clipboard

Challenge: Existing methods for retrieval of information excel at textual and semantic matching but struggle in reasoning-intensive retrieval tasks.
Approach: They propose a family of small-scale language models for query reasoning and rewriting in reasoning-intensive retrieval.
Outcome: The proposed model outperforms existing models on a BRIGHT benchmark with BM25 retrievers.
DeAR: Dual-Stage Document Reranking with Reasoning Agents via LLM Distillation (2025.findings-emnlp)

Copied to clipboard

Challenge: DeAR is an open-source framework that decouples the tasks of LLMs with holistic cross-document analysis.
Approach: They propose an open-source framework that decouples relevance scoring with holistic cross-document analysis.
Outcome: The proposed framework outperforms open-source frameworks in QA and open-domain QA.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations