Papers by Bin Gong
Llama SLayer 8B: Shallow Layers Hold the Key to Knowledge Injection (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods to augment pre-trained large language models require extensive computational efforts and massive data volumes, challenging the widespread accessibility of LLM research. |
| Approach: | They propose a post-pretraining strategy of selectively enhancing shallow layers while pruning less effective deep ones to augment pretrained large language models. |
| Outcome: | The proposed approach improves performance on the corpus of code & math and a legal corpus and is widely applicable. |
Inducing Argument Facets for Faithful Opinion Summarization (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Faithful opinion summarization task involves generating a summary that covers the majority and minority opinions in documents. |
| Approach: | They propose a facets-guided opinion summarization method that induces facets and partitions documents into multiple facet-specific sets. |
| Outcome: | The proposed method outperforms state-of-the-art methods and multiple LLMs on two representative datasets and shows it can be used in specialty domains. |