Papers by Alexander Tsvetkov
Information Parity: Measuring and Predicting the Multilingual Capabilities of Language Models (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are increasingly used in user-facing applications worldwide, necessitating handling multiple languages across various tasks. |
| Approach: | They propose a metric called Information Parity (IP) that can predict an LLM’s capabilities across multiple languages in a task-agnostic manner. |
| Outcome: | The proposed metric can predict LLM’s capabilities across multiple languages in a task-agnostic manner. |