Papers by Pieter Fivez
In Benchmarks We Trust ... Or Not? (2025.emnlp-main)
Copied to clipboard
Ine Gevers, Victor De Marez, Jens Van Nooten, Jens Lemmens, Andriy Kosar, Ehsan Lotfi, Nikolay Banar, Pieter Fivez, Luna De Bruyne, Walter Daelemans
| Challenge: | Existing benchmarks for Large Language Models (LLMs) are inadequate and lack a clear solution. |
| Approach: | They propose checklists to cover all aspects of benchmarking issues, both for benchmark creation and usage. |
| Outcome: | The proposed checklists cover all aspects of benchmarking issues, both for benchmark creation and usage. |
Mapping probability word problems to executable representations (2021.emnlp-main)
Copied to clipboard
Simon Suster, Pieter Fivez, Pietro Totis, Angelika Kimmig, Jesse Davis, Luc de Raedt, Walter Daelemans
| Challenge: | a recent paper addresses the problem of solving math word problems automatically . a number of approaches have been proposed for solving word problems . |
| Approach: | They employ a sequence-to-sequence model to generate intermediate representations for word problems . they then use a probabilistic programming system to provide the answer . their best performing model incorporates general-domain contextualised word representations . |
| Outcome: | The proposed model is the best performing on a declarative language and a probabilistic programming system. |
Conceptual Grounding Constraints for Truly Robust Biomedical Name Representations (2021.eacl-main)
Copied to clipboard
| Challenge: | Existing approaches to encoding biomedical names require lexical and domain-specific semantics to be robust. |
| Approach: | They propose a method which encodes biomedical names with lexical and domain-specific semantics . they use conceptual grounding constraints to align encoded names to pretrained embeddings of their concept identifiers a technique that is effective even when using a deep averaging network . |
| Outcome: | The proposed representations capture more domain-specific semantics while remaining universally applicable across biomedical corpora and domains. |