Papers by Shayekh Islam

GenGO

Omakase Read Later

Search

Papers by Shayekh Islam

Findings

2024.findings-emnlp

hybrid adaptive retrieval method
RAG models
ChatGPT-RAG
Self-RAG
RAG 2.0
accuracy
inference speed
Retrieval Augmented Generation
reasoning capabilities
reasoning tasks

2024

Semantic Text Processing

1 papers

Open-RAG: Enhanced Retrieval Augmented Reasoning with Open-Source Large Language Models (2024.findings-emnlp)

Copied to clipboard

Shayekh Islam, Md Asib Rahman, K S M Tozammel Hossain, Enamul Hoque, Shafiq Joty, Md Rizwan Parvez

Semantic Text Processing

Challenge:	Existing methods to integrate Large Language Models with external knowledge suffer from limited reasoning capabilities, especially when using open-source LLMs.
Approach:	They propose a framework that transforms an arbitrary dense LLM into a parameter-efficient sparse mixture of experts (MoE) model capable of handling complex reasoning tasks.
Outcome:	The proposed framework transforms an arbitrary dense LLM into a parameter-efficient sparse mixture of experts (MoE) model capable of handling complex reasoning tasks, including both single- and multi-hop queries.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations