Papers by Conor Lynch
Rethinking Sign Language Translation: The Impact of Signer Dependence on Model Evaluation (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Sign Language Translation evaluations remain largely signer-dependent, with overlapping signers across train/dev/test. |
| Approach: | We conduct signer-fold cross-validation on three leading SLT models . they find that under signer independent evaluation performance drops sharply . |
| Outcome: | a signer-dependent evaluation can substantially overestimate SLT capability, the authors say . they recommend adopting signer independent protocols to ensure generalisation to unseen signers . |