Papers by Zifeng Ren
Doc2SoarGraph: Discrete Reasoning over Visually-Rich Table-Text Documents via Semantic-Oriented Hierarchical Graphs (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing work on document visual question answering fails to capture the differences and correlations between elements of a document and associated questions. |
| Approach: | They propose a document-visual question-answering challenge that exploits element-level semantics and employs hierarchical Graph structures to capture differences and correlations between elements. |
| Outcome: | The proposed model surpasses the state-of-the-art method and large language model in terms of Exact Match (EM) metric, demonstrating exceptional effectiveness. |
Ask-before-Plan: Proactive Language Agents for Real-World Planning (2024.findings-emnlp)
Copied to clipboard
| Challenge: | despite the advancements of large language models, the potential of LLM-powered agents to comprehend ambiguous user instructions is still under exploration. |
| Approach: | They propose a task that requires agents to predict clarification needs based on conversation and agentenvironment interaction and generate a plan to fulfill the user's demands. |
| Outcome: | The proposed framework is based on a new ask-before-plan benchmark dataset. |