Papers by Shifan Zhao
MuG: A Multimodal Classification Benchmark on Game Data with Tabular, Textual, and Visual Fields (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing multimodal classification systems use tabular, textual, and visual data to provide efficient and scalable services. |
| Approach: | They propose a multimodal classification benchmark MuG with eight datasets . they analyze label balance ratios, percentages of missing features, distributions of data within each modality . |
| Outcome: | The proposed benchmark is available on https://github.com/lujiaying/MUG-Bench . it includes eight datasets that allow researchers to evaluate and improve their models . |
More Data or Better Data? A Critical Analysis of Data Selection and Synthesis for Mathematical Reasoning (2025.emnlp-industry)
Copied to clipboard
| Challenge: | Despite various proposed data construction methods, their practical utility in real-world pipelines remains underexplored. |
| Approach: | They conduct a comprehensive analysis of open-source datasets and data synthesis techniques for mathematical reasoning under a unified pipeline designed to mirror training and deployment scenarios. |
| Outcome: | The proposed pipelines mirror training and deployment scenarios and are suitable for industrial applications. |