Papers by Vikas Pahuja
MAPS: A Multilingual Benchmark for Agent Performance and Security (2026.findings-eacl)
Copied to clipboard
Omer Hofman, Jonathan Brokman, Oren Rachmil, Shamik Bose, Vikas Pahuja, Toshiya Shimizu, Trisha Starostina, Kelly Marchisio, Seraphina Goldfarb-Tarrant, Roman Vainshtein
| Challenge: | Existing benchmarks do not provide a comprehensive, multi-domain, security-aware evaluation of multilingual agentic AI systems. |
| Approach: | They propose a multilingual benchmark suite to evaluate agentic AI systems across languages and tasks. |
| Outcome: | The proposed framework evaluates agentic AI systems across languages and tasks. |