Papers by Julia Farganus
Factual State Discovery Benchmark: Evaluating Fact Elicitation in Polish Tax Law (2026.acl-srw)
Copied to clipboard
Mateusz Bystroński, Kamil Tagowski, Denis Janiak, Julia Farganus, Lukasz Augustyniak, Monika Kajdanowicz, Tomasz Jan Kajdanowicz
| Challenge: | FSDBench is a benchmark for eliciting all relevant facts through dialogue . missing facts may lead the authority to apply the wrong provision or issue a ruling that is inapplicable to the actual situation. |
| Approach: | They propose a method to systematically elicit facts through dialogue from a simulated taxpayer . they use 500 narratives from official Polish tax interpretations to test their models . |
| Outcome: | The proposed model recovers only 77% of facts on easy and hard samples and under 49% on hard samples after 50 turns. |