Papers with expansion
SAFARI: A Community-Engaged Approach and Dataset of Stereotype Resources in the Sub-Saharan African Context (2026.eacl-short)
Copied to clipboard
Aishwarya Verma, Laud Ammah, Olivia Nercy Ndlovu Lucas, Andrew Zaldivar, Vinodkumar Prabhakaran, Sunipa Dev
| Challenge: | Existing data collection approaches to generative AI are inadequate to assess its safety and utility. |
| Approach: | They propose a multilingual stereotype resource that uses socioculturally-situated, community-engaged methods to assess the region’s linguistic diversity and traditional orality. |
| Outcome: | The proposed method covers four sub-Saharan African countries that are severely underrepresented in NLP resources: Ghana, Kenya, Nigeria, and South Africa. |
Gold Panning in Vocabulary: An Adaptive Method for Vocabulary Expansion of Domain-Specific LLMs (2024.emnlp-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) struggle when it comes to specialized domains due to limited domain-specific knowledge. |
| Approach: | They propose an adaptive method that automatically identifies valuable words from a given domain vocabulary. |
| Outcome: | The proposed method has been validated on three Chinese datasets and performed on general tasks. |
BERT-QE: Contextualized Query Expansion for Document Re-ranking (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods to expand query use pseudo relevance feedback (PRF) but they are under-equipped to evaluate the relevance of information pieces used for expansion. |
| Approach: | They propose a query expansion model that leverages the BERT model to select relevant document chunks for expansion. |
| Outcome: | The proposed model significantly outperforms existing models on the TREC Robust04 and GOV2 test collections. |
Effective Contrastive Weighting for Dense Query Expansion (2023.acl-long)
Copied to clipboard
| Challenge: | Verbatim queries that do not adequately express the user's search intent are often lexical inadequacies. |
| Approach: | They propose a contrastive weighting model that learns to select the most useful expansion embeddings for semantic search. |
| Outcome: | The proposed model outperforms existing methods while maintaining its efficiency. |
Hebbian-Guided Bi-Directional Rank Adaptation for Parameter-Efficient Fine-Tuning (2026.findings-acl)
Copied to clipboard
| Challenge: | Low-Rank Adaptation (LoRA) is a widely used method to fine-tune large language models . but its fixed-rank design cannot capture the varying importance across different layers . |
| Approach: | They propose a framework that bi-directionally reallocates low-rank capacity using Hebbian-inspired importance estimation. |
| Outcome: | Experiments show that HeBiRA improves performance over baselines. |
Knowledge-Infused Multi-Bit Watermarking for RAG Knowledge Bases (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing RAG watermarking methods are limited in their encoding capacity and potential degradation of performance or knowledge quality. |
| Approach: | They propose knowledge-infused and multi-bit watermarking (KMW) for RAG knowledge bases by benign knowledge completion and a tailored generative watermark algorithm. |
| Outcome: | The proposed method extracts watermarks from adversarial RAGs while remaining stealthy and secure. |
MT-Eval: A Multi-Turn Capabilities Evaluation Benchmark for Large Language Models (2024.emnlp-main)
Copied to clipboard
Wai-Chung Kwan, Xingshan Zeng, Yuxin Jiang, Yufei Wang, Liangyou Li, Lifeng Shang, Xin Jiang, Qun Liu, Kam-Fai Wong
| Challenge: | Existing evaluation frameworks focus on single-turn evaluations, overlooking the models’ capabilities in multi-turn interactions. |
| Approach: | They propose a benchmark to evaluate the multi-turn conversational abilities of large language models (LLMs) by analyzing human-LLM conversations and constructing multi-turned queries for each category using GPT-4. |
| Outcome: | The proposed model outperforms open-source models in multi-turn tasks while retaining and recalling historical information. |
Q2EI: Query-to-Entity Inference for Semantic Condensation in Domain-Specific Retrieval (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing generative expansions introduce redundancy or hallucinations that cause semantic drift. |
| Approach: | They propose a query rewriting strategy that reframes rewrite as semantic condensation rather than expansion. |
| Outcome: | The proposed method outperforms baselines on medical and legal benchmarks while reducing token consumption. |