Papers with differentiation
A Layered Debating Multi-Agent System for Similar Disease Diagnosis (2025.naacl-short)
Copied to clipboard
| Challenge: | Traditional classification, contrastive learning, and large language models fail to detect subtle clues necessary for differentiation. |
| Approach: | They propose a framework that leverages Large Language Models to achieve accurate disease diagnosis . they structure patient information and integrate extensive medical knowledge to guide the analysis . |
| Outcome: | The proposed framework aims to identify subtle differences between similar diseases . the proposed framework can be used in clinical practice to improve accuracy . |
ALCUNA: Large Language Models Meet New Knowledge (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing benchmarks do not adequately measure large-scale language models’ capabilities when faced with new knowledge. |
| Approach: | They propose a benchmark called ALCUNA to evaluate LLMs' ability to handle new knowledge by altering existing entity attributes and relationships. |
| Outcome: | The proposed approach generates new knowledge by altering existing entity attributes and relationships, resulting in artificial entities distinct from real-world entities. |
Metric Calculating Benchmark: Code-Verifiable Complicate Instruction Following Benchmark for Large Language Models (2025.emnlp-main)
Copied to clipboard
| Challenge: | Recent frontier-level LLMs have saturated many previously difficult benchmarks, leaving little room for further differentiation. |
| Approach: | They propose a benchmark to evaluate whether LLMs can execute string-matching NLP metrics by strictly following step-by-step instructions. |
| Outcome: | The proposed benchmarks show that they can perform step-by-step execution, instruction adherence, numerical computation, and long-range consistency in handling intermediate results. |