Papers by Ying Jiao
Detection, Diagnosis, and Explanation: A Benchmark for Chinese Medial Hallucination Evaluation (2024.lrec-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have made significant progress in recent years, but their practical use is hindered by their tendency to generate hallucinations. |
| Approach: | They propose to use ICD-10 and MeSH to evaluate LLMs' ability to detect medical hallucinations and make accurate diagnoses in noisy environments. |
| Outcome: | The proposed benchmark can be used to evaluate LLMs’ ability to detect medical hallucinations, make accurate diagnoses in noisy conditions, and provide plausible explanations. |
Invocation Refiner: A Plug-and-Play Module for Rectifying LLM Tool Invocations (2026.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have shown remarkable capabilities in Tool-Integrated Reasoning (TIR) however, the practical application is often hindered by frequent errors in tool invocations, such as incorrect tool names, invalid parameters, wrong tool-call order, or malformed invocation formats. |
| Approach: | They propose a specialized post-processing module that performs independent reasoning on the input of a frozen upstream LLM and an advanced RL algorithm to improve the tool-use reliability of base LLMs. |
| Outcome: | The proposed module improves task completion rates and invocation accuracy over the raw outputs of various upstream LLMs on a diverse set of tool-use and reasoning benchmarks. |
From Shijing to English and German: Resources and Evaluation for LLM Translation of Early Chinese Poetry (2026.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) show promise in literary translation, but their performance in poetry remains unexplored. |
| Approach: | They propose a framework that integrates knowledge-driven, rule-based, and LLM-as-judge metrics into a Shijing corpus . their code, lexical KB, and corpus reconstruction protocols are available at https://github.com/ML-KULeuven/ShijingLLMTrans. |
| Outcome: | The proposed framework achieves higher human correlation than traditional metrics and high statistical stability. |
Integrating Physician Diagnostic Logic into Large Language Models: Preference Learning from Process Feedback (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing studies have shown that large language models can enhance response richness and coherence, but there is a pressing need to bolster the model’s capacity for diagnostic logic to ensure patient safety. |
| Approach: | They propose an approach termed preference learning from process feedback (PLPF) that integrates the doctor’s diagnostic logic into LLMs. |
| Outcome: | The proposed approach improves the diagnostic accuracy of the baseline model in medical conversations by 17.6%, surpassing the performance of traditional approaches. |