Papers by Jiawen Wu
Towards Efficient NLP: A Standard Evaluation and A Strong Baseline (2022.naacl-main)
Copied to clipboard
Xiangyang Liu, Tianxiang Sun, Junliang He, Jiawen Wu, Lingling Wu, Xinyu Zhang, Hao Jiang, Zhao Cao, Xuanjing Huang, Xipeng Qiu
| Challenge: | Rather than pursuing the reachless SOTA accuracy, researchers are focusing on model efficiency and usability. |
| Approach: | They propose an evaluation and a public leaderboard for efficient NLP models that depicts the Pareto Frontier for various language understanding tasks. |
| Outcome: | The proposed model outperforms or performs on par with SOTA compressed and early exiting models. |
Do Large Language Models Know What They Don’t Know? (2023.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) have vast knowledge that allows them to excel in various NLP tasks. |
| Approach: | They propose an automated method to detect uncertainty in the responses of large language models and a dataset to measure their self-knowledge. |
| Outcome: | The proposed method detects uncertainty in the responses of large language models and provides a novel measure of their self-knowledge. |
LOHRec: Leveraging Order and Hierarchy in Generative Sequential Recommendation (2025.findings-emnlp)
Copied to clipboard
| Challenge: | generative recommenders focus on maximizing the prediction probability of the next item in the temporal sequence, ignoring diverse potential items. |
| Approach: | They propose a learning framework that leverages order and hierarchy in generative recommendation using quantized identifiers to further explore performance ceiling of lightweight generative recommenders. |
| Outcome: | The proposed learning framework outperforms strong prior baselines across multiple datasets. |
Depression Detection in Clinical Interviews with LLM-Empowered Structural Element Graph (2024.naacl-long)
Copied to clipboard
| Challenge: | Existing methods for assessing depression only capture part of relevant elements . scarcity of participant data constrains interview modeling due to privacy concerns . |
| Approach: | They propose a structural element graph (SEGA) that transforms clinical interviews into an expertise-inspired directed acyclic graph for comprehensive modeling. |
| Outcome: | The proposed model outperforms baseline methods and powerful LLMs on two real-world clinical datasets. |
Coarse-to-Fine: Hierarchical Multi-task Learning for Natural Language Understanding (2022.coling-1)
Copied to clipboard
Zhaoye Fei, Yu Tian, Yongkang Wu, Xinyu Zhang, Yutao Zhu, Zheng Liu, Jiawen Wu, Dejiang Kong, Ruofei Lai, Zhao Cao, Zhicheng Dou, Xipeng Qiu
| Challenge: | Existing methods to learn downstream tasks by stitches skill block lack rationality and interpretation. |
| Approach: | They propose a hierarchical framework with a coarse-to-fine paradigm for generalized text representations from the large-scale corpus. |
| Outcome: | The proposed model learns basic language properties from all tasks and boosts performance on relevant tasks. |
SplitThenMerge: Token-Level Skill-Compositional Sparse Mixture-of-Experts for Complex Domain-Specific Tasks (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing domain adaptation methods train heterogeneous skills together, making it difficult to reliably coordinate multiple skills when solving complex tasks. |
| Approach: | They propose a framework that decomposes domain competence into atomic skills and composes them dynamically during generation. |
| Outcome: | The proposed framework decomposes domain competence into atomic skills, trains them independently, and composes them dynamically during generation. |
Benchmarking Hallucination in Large Language Models Based on Unanswerable Math Word Problem (2024.lrec-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) are highly effective in various natural language processing tasks, but can produce unreliable conjectures in ambiguous contexts, which is known as hallucination. |
| Approach: | They propose a method to evaluate LLM hallucination in Question Answering based on the unanswerable math word problem (UMWP) . they combine text similarity and mathematical expression detection to determine whether LLM considers the question unanswered. |
| Outcome: | The proposed method combines text similarity and mathematical expression detection to determine whether the LLM considers the question unanswerable. |
Benchmarking Generation and Evaluation Capabilities of Large Language Models for Instruction Controllable Summarization (2024.findings-naacl)
Copied to clipboard
Yixin Liu, Alexander Fabbri, Jiawen Chen, Yilun Zhao, Simeng Han, Shafiq Joty, Pengfei Liu, Dragomir Radev, Chien-Sheng Wu, Arman Cohan
| Challenge: | Recent studies have found that large language models (LLMs) can achieve state-of-the-art performance on generic summarization benchmarks, but their performance on more complex summarizing task settings is less studied. |
| Approach: | They benchmark large language models on instruction controllable text summarization . they use 4 evaluation protocols and 11 LLMs to evaluate their performance . |
| Outcome: | The proposed model performs well on instruction controllable text summarization tasks with 4 evaluation protocols and 11 LLMs. |