Papers by Fangcong Yin
Linguistic Compression in Single-Sentence Human-Written Summaries (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Summarizing texts involves significant cognitive efforts to compress information. |
| Approach: | They analyze linguistic patterns in human-written single-sentence summaries to find that they are generally written with morphological expansion, increased lexical diversity, and similar positional arrangements of specific words . |
| Outcome: | The results show that human summarizers are written with morphological expansion, increased lexical diversity, and similar positional arrangements of specific words compared to the source across different genres. |
Query-Focused Retrieval Heads Improve Long-Context Reasoning and Re-ranking (2025.emnlp-main)
Copied to clipboard
| Challenge: | Recent work has identified retrieval heads as a subset of attention heads responsible for retrieving salient information in long-context language models. |
| Approach: | They introduce a retrieval head that uses attention scores to enhance retrieval from long context . they use QRRetriever to select the most relevant parts with the highest retrieval scores . |
| Outcome: | The proposed retrieval heads outperform other retrieval-based retrieval retrievers on BEIR benchmarks. |