Papers by Nikolay Ivanov
Fine-Grained Semantic Comparison of Legal Documents using LLMs (2026.acl-srw)
Copied to clipboard
Elisei Rykov, Nikolay Ivanov, Maria Bandulevich, Kseniia Petrushina, Valentin Malykh, Vasily Konovalov, Alexander Panchenko, Ilseyar Alimova
| Challenge: | Existing tools for detecting inconsistencies and contradictions in complex regulatory documents rely on character-level diffs. |
| Approach: | They propose a benchmark to evaluate span-aware semantic comparison of legal documents . legDiff is an annotated pair of legal paragraphs that is automatically generated . |
| Outcome: | The proposed benchmark evaluates span-aware semantic comparisons of legal documents . it generates synthetic training data that aligns with the manual annotations and mirrors the structure and label distribution of the benchmark . |
Adaptive Retrieval Without Self-Knowledge? Bringing Uncertainty Back Home (2025.acl-long)
Copied to clipboard
Viktor Moskvoretskii, Maria Marina, Mikhail Salnikov, Nikolay Ivanov, Sergey Pletenev, Daria Galimzianova, Nikita Krayko, Vasily Konovalov, Irina Nikishina, Alexander Panchenko
| Challenge: | Recent adaptive retrieval methods integrate LLMs’ intrinsic knowledge with external information appealing to LLM self-knowledge, but they often neglect efficiency evaluations and comparisons with uncertainty estimation techniques. |
| Approach: | They propose to integrate LLMs’ intrinsic knowledge with external information appealing to LLM self-knowledge but neglect efficiency evaluations and comparisons with uncertainty estimation techniques. |
| Outcome: | The proposed methods outperform complex pipelines in terms of efficiency and self-knowledge while maintaining comparable QA performance. |
Will It Still Be True Tomorrow? Multilingual Evergreen Question Classification to Improve Trustworthy QA (2025.emnlp-main)
Copied to clipboard
Sergey Pletenev, Maria Marina, Nikolay Ivanov, Daria Galimzianova, Nikita Krayko, Mikhail Salnikov, Vasily Konovalov, Alexander Panchenko, Viktor Moskvoretskii
| Challenge: | Large Language Models (LLMs) often struggle with question answering due to hallucinated answers. |
| Approach: | They propose a multilingual QA dataset with evergreen labels that can be used to evaluate and train large language models. |
| Outcome: | The proposed model performs well on 12 modern LLMs and EG-E5 classifiers. |
LLM-Independent Adaptive RAG: Let the Question Speak for Itself (2025.emnlp-main)
Copied to clipboard
Maria Marina, Nikolay Ivanov, Sergey Pletenev, Mikhail Salnikov, Daria Galimzianova, Nikita Krayko, Vasily Konovalov, Alexander Panchenko, Viktor Moskvoretskii
| Challenge: | Existing methods to retrieve Large Language Models (LLMs) are inefficient and impractical. |
| Approach: | They propose a lightweight adaptive retrieval method that leverages external information to achieve comparable quality while achieving significant efficiency gains. |
| Outcome: | The proposed methods achieve comparable quality while achieving significant efficiency gains on 6 QA datasets. |