Papers by Mohammad Arvan
Exploring Variation of Results from Different Experimental Conditions (2023.findings-acl)
Copied to clipboard
| Challenge: | Recent research has shown that reproducibility of NLP experiments is not guaranteed by arbitrary factors like random seed and different data splits. |
| Approach: | They propose to run the training and testing pipeline for three neural text simplification models under varying experimental conditions using the same data and train/dev/test set splits. |
| Outcome: | The proposed pipeline yields a large number of results for three neural text simplification models under varying experimental conditions. |
Reproducibility in Computational Linguistics: Is Source Code Enough? (2022.emnlp-main)
Copied to clipboard
| Challenge: | a recent study finds that source code releases leave much to be desired . authors can include small-scale experiments and explicit scripts to generate each result . |
| Approach: | They propose that conferences require self-contained artifacts to evaluate their reproducibility . authors suggest authors include small-scale experiments and explicit scripts to generate results . |
| Outcome: | The authors find that source code releases leave much to be desired . authors can include small-scale experiments and explicit scripts to generate each result . |