Papers by Ilya Pershin
Cross-Modal Conceptualization in Bottleneck Models (2023.emnlp-main)
Copied to clipboard
Danis Alukaev, Semen Kiselev, Ilya Pershin, Bulat Ibragimov, Vladimir Ivanov, Alexey Kornaev, Ivan Titov
| Challenge: | Existing models that use text descriptions to predict labels are limited in their interpretations. |
| Approach: | They propose to use text descriptions to guide the induction of concepts in CBMs . they propose to employ a more moderate assumption and instead use text to guide induction . |
| Outcome: | The proposed model adopts a more moderate assumption and uses text descriptions to guide the induction of concepts. |
Enhancing RLHF with Human Gaze Modeling (2025.emnlp-main)
Copied to clipboard
| Challenge: | Reinforcement Learning from Human Feedback (RLHF) is a powerful paradigm for aligning language models with human values and preferences. |
| Approach: | They propose to use gaze-aware reward models and gaze-based distribution of sparse rewards to enhance RLHF. |
| Outcome: | The proposed models achieve faster convergence while maintaining or slightly improving performance, reducing computational requirements during policy training. |