Papers by Shixin Hong
OpenHuEval: Evaluating Large Language Model on Hungarian Specifics (2025.findings-acl)
Copied to clipboard
Haote Yang, Xingjian Wei, Jiang Wu, Noémi Ligeti-Nagy, Jiaxing Sun, Yinfan Wang, Győző Zijian Yang, Junyuan Gao, Jingchao Wang, Bowen Jiang, Shasha Wang, Nanjun Yu, Zihao Zhang, Shixin Hong, Hongwei Liu, Wei Li, Songyang Zhang, Dahua Lin, Lijun Wu, Gábor Prószéky, Conghui He
| Challenge: | Recent advances in Large Language Models (LLMs) represent significant strides toward artificial general intelligence (AGI). |
| Approach: | They introduce OpenHuEval, the first benchmark for LLMs focusing on the Hungarian language and specifics. |
| Outcome: | The framework reveals intrinsic patterns and mechanisms of LLMs in non-English languages, with Hungarian serving as an example. |
Enhancing SQL Table Acquisition with Reverse Engineering for Text-to-SQL (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Text-to-SQL oriented table acquisition suffers from heterogeneous semantic gap. |
| Approach: | They propose a Reverse Engineering based table acquisition approach that reversely generates potentially-matched questions conditioned on table schemas instead of forward table search using queries. |
| Outcome: | The proposed approach achieves competitive performance on two benchmarks, including SpiderUnion and BirdUnion. |