Papers by Longjun Cai
Improve Decoding Factuality by Token-wise Cross Layer Entropy of Large Language Models (2025.findings-naacl)
Copied to clipboard
| Challenge: | Large language models (LLMs) often struggle with the issue of generating inaccurate or fabricated content even when they possess correct knowledge. |
| Approach: | They propose a decoding method that mitigates hallucinations without extra training . they propose entropy eNhanced decoding that leverages inner probability changes . |
| Outcome: | The proposed method improves the truthfulness and informativeness of generation while maintaining robust QA accuracy. |
Seq2Path: Generating Sentiment Tuples as Paths of a Tree (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing generative methods for extracting sentiment tuples do not have orders between the t-uples . a novel parallel generative framework for ABSA is proposed . |
| Approach: | They propose a parallel generative framework to generate sentiment tuples as paths of a tree . they train the model with an independent target and introduce a discriminative token . |
| Outcome: | The proposed method achieves state-of-the-art on AOPE, ASTE, TASD, UABSA, ACOS . it trains with the loss of ordinary Seq2Seq averaged over paths, and inferences automatically select valid paths. |