Papers by Violet Yao
A Streaming Approach For Efficient Batched Beam Search (2020.emnlp-main)
Copied to clipboard
| Challenge: | During decoding, candidates terminate or are pruned according to heuristics, a streaming method is used to "refill" the batch after it finishes translating some fraction of the current batch. |
| Approach: | They propose an efficient batching strategy for variable-length decoding on GPU architectures by streamlining the batching process. |
| Outcome: | The proposed method reduces runtime by 71% compared to a fixed-width beam search baseline and 17% compared with a variable-widness baseline while matching baselines’ BLEU. |
WikiChat: Stopping the Hallucination of Large Language Model Chatbots by Few-Shot Grounding on Wikipedia (2023.findings-emnlp)
Copied to clipboard
| Challenge: | a new few-shot LLM-based chatbot is able to provide factual and engaging responses . a novel hybrid human-and-LLM evaluation methodology is used to evaluate the system . |
| Approach: | They propose a few-shot LLM-based chatbot that almost never hallucinates . they distill WikiChat into a 7B-parameter LLaMA model with minimal loss of quality . |
| Outcome: | The proposed system outperforms retrieval-based and LLM-based systems on the Wikipedia corpus. |