Papers with auto-regression
Llama2Vec: Unsupervised Adaptation of Large Language Models for Dense Retrieval (2024.acl-long)
Copied to clipboard
| Challenge: | Dense retrieval requires discriminative embeddings to represent the semantic relationship between query and document. |
| Approach: | They propose an unsupervised approach that performs unsupervised adaptation of large language models for dense retrieval. |
| Outcome: | The proposed model improves on a variety of dense retrieval benchmarks and is available on github. |
CoAD: Automatic Diagnosis through Symptom and Disease Collaborative Generation (2023.acl-long)
Copied to clipboard
| Challenge: | Automated diagnosis (AD) is a critical application of AI in healthcare . despite its simplicity and superior performance, a decline in disease diagnosis accuracy is observed . |
| Approach: | They propose a new collaborative disease and symptom generation framework to improve automatic diagnosis. |
| Outcome: | The Transformer-based method achieves an average 2.3% improvement over previous state-of-the-art methods . it can be used to query patients about their symptoms and health concerns . |