Papers by Tobias Käfer
Evaluating the Performance of RAG Methods for Conversational AI in the Airport Domain (2025.naacl-industry)
Copied to clipboard
| Challenge: | a conversational AI system that answers standard airport queries and resolves airport terminology is ideal for airports from the top 20 in terms of annual passenger numbers. |
| Approach: | They propose a Conversational AI system that enables staff to communicate with flight systems . the system answers standard airport queries and resolves airport terminology . |
| Outcome: | The proposed system answers standard airport queries and resolves airport terminology, jargon, abbreviations and dynamic questions involving reasoning. |
Positional Overload: Positional Debiasing and Context Window Extension for Large Language Models using Set Encoding (2025.acl-long)
Copied to clipboard
| Challenge: | Large Language Models typically track the order of tokens using positional encoding, which causes two significant limitations: 1. Positional Bias: When processing long text sequences, the number of token can exceed the range the model was trained on. |
| Approach: | They propose a method that allows multiple pieces of text to be encoded in the same position, eliminating positional bias entirely. |
| Outcome: | The proposed method eliminates positional bias entirely and increases the size of the input an LLM can handle. |