Papers by Peter Hraška
RAGthoven: A Configurable Toolkit for RAG-enabled LLM Experimentation (2025.coling-demos)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have significantly altered the landscape of Natural Language Processing (NLP), but their use as a baseline method has not been extensive. |
| Approach: | They propose a tool for automatic evaluation of RAG-based pipelines that provides a simple yet powerful abstraction. |
| Outcome: | The proposed tool provides an automatic evaluation of RAG-based pipelines. |
Prompterator: Iterate Efficiently towards More Effective Prompts (2023.emnlp-demo)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) use a process known as prompting to solve arbitrary language tasks. prompting is a non-trivial task that requires experimentation in order to arrive at a prompt that solves a specific task. |
| Approach: | They propose a tool that helps users iterate over different potential prompts and choose the best performing one based on human feedback. |
| Outcome: | The proposed tool is open source and easily extensible. |