Papers by Mengkang Hu
TaCube: Pre-computing Data Cubes for Answering Numerical-Reasoning Questions over Tabular Data (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing auto-regressive pre-trained language models are challenged by recent emerging numerical reasoning datasets due to the error-prone implicit calculation. |
| Approach: | They propose a pre-computation tool to pre-compute aggregation/arithmetic results for the table in advance, so they are handy and readily available for PLMs to answer numerical reasoning questions. |
| Outcome: | The proposed model improves on TAT-QA and T5 and BART-large on multiple benchmarks. |
Text2World: Benchmarking Large Language Models for Symbolic World Model Generation (2025.findings-acl)
Copied to clipboard
Mengkang Hu, Tianxing Chen, Yude Zou, Yuheng Lei, Qiguang Chen, Ming Li, Yao Mu, Hongyuan Zhang, Wenqi Shao, Ping Luo
| Challenge: | Recent studies have encountered limitations in leveraging large language models to generate symbolic world models. |
| Approach: | They propose a benchmarking framework based on planning domain definition language (PDDL) that employs multi-criteria, execution-based metrics for a more robust evaluation. |
| Outcome: | The proposed model outperforms models trained with large-scale reinforcement learning, but lacks the robustness needed to perform in world modeling. |
KET-QA: A Dataset for Knowledge Enhanced Table Question Answering (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing datasets that ignore the challenge of missing knowledge in TableQA are limited in their use. |
| Approach: | They propose to use a knowledge base as the external knowledge source for TableQA and construct a dataset with fine-grained gold evidence annotation. |
| Outcome: | The proposed model achieves remarkable performance improvements on three different settings, but still lags behind the human-level performance. |
X-WebAgentBench: A Multilingual Interactive Web Benchmark for Evaluating Global Agentic System (2025.findings-acl)
Copied to clipboard
| Challenge: | X-WebAgentBench evaluates the planning and interaction performance of language agents across multiple languages. |
| Approach: | They propose a multilingual agent benchmark that evaluates the interaction performance of language agents across multiple languages. |
| Outcome: | The proposed benchmark evaluates the planning and interaction performance of language agents across multiple languages. |
HiAgent: Hierarchical Working Memory Management for Solving Long-Horizon Agent Tasks with Large Language Model (2025.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to optimize agent performance by incorporating entire historical action-observation pairs into LLMs are redundant in long-horizon tasks. |
| Approach: | They propose a framework that leverages subgoals as memory chunks to manage working memory of LLM-based agents hierarchically. |
| Outcome: | The proposed framework achieves a twofold increase in success rate and reduces the average number of steps required by 3.8. |