Papers by Oleg Somov
PAUQ: Text-to-SQL in Russian (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Semantic parsing is an important task that allows to democratize human-computer interaction. |
| Approach: | They construct and complement a Russian text-to-SQL dataset by integrating a spider query with a RAT-SqL and BRIDGE database. |
| Outcome: | The proposed datasets show that they perform well with monolingual training and improved accuracy in multilingual scenarios. |
Evolutionary Search for Automated Design of Uncertainty Quantification Methods (2026.acl-srw)
Copied to clipboard
Mikhail Seleznyov, Daniil Korbut, Viktor Moskvoretskii, Oleg Somov, Alexander Panchenko, Elena Tutubalina
| Challenge: | Qualitative analysis reveals that different LLMs employ qualitatively distinct evolutionary strategies for automating, interpretable hallucination detector design. |
| Approach: | They apply LLM-powered evolutionary search to discover unsupervised UQ methods represented as Python programs and apply them to atomic claim verification. |
| Outcome: | The proposed methods outperform strong manually-designed baselines while generalizing robustly out-of-distribution. |
When Punctuation Matters: A Large-Scale Comparison of Prompt Robustness Methods for LLMs (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are sensitive to subtle, non-semantic variations in prompt phrasing and formatting. |
| Approach: | They propose to evaluate 4 methods for improving prompt robustness within a unified experimental framework. |
| Outcome: | The proposed methods are compared to 8 models from Llama, Qwen and Gemma families and are generalized against multiple types of distribution shifts. |