Papers by Junfeng Ran
LongAttn: Selecting Long-context Training Data via Token-level Attention (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to select long-context data often rely on sentence-level analysis, which can be greatly optimized in both performance and efficiency. |
| Approach: | They propose a token-level framework which quantifies long-range dependencies for LLMs by calculating token-based dependency strength and distribution uniformity of token scores. |
| Outcome: | The proposed framework quantifies long-range dependencies, enabling more accurate and efficient data selection. |
Learning to Rewrite: Generalized LLM-Generated Text Detection (2025.acl-long)
Copied to clipboard
| Challenge: | Existing detectors for Large Language Models (LLMs) struggle to generalize in open-world settings. |
| Approach: | They propose a framework to detect LLM-generated text with exceptional generalization to unseen domains by reinforcing LLMs’ inherent rewriting tendencies. |
| Outcome: | The proposed framework outperforms state-of-the-art detection methods by 23.04% in AUROC, 35.10% for out-of distribution tests, and 48.66% under adversarial attacks. |
RAFT: Realistic Attacks to Fool Text Detectors (2024.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) have exhibited remarkable fluency across tasks, but their unethical applications are unclear. |
| Approach: | They propose a grammar error-free black-box attack that exploits LLM embeddings at the word-level while preserving original text quality. |
| Outcome: | The proposed attack compromises all detectors across domains and is transferable across source models. |
FaGANet: An Evidence-Based Fact-Checking Model with Integrated Encoder Leveraging Contextual Information (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing evidence-based fact-checking efforts are time-consuming and challenging . however, relying on surface patterns of claims makes it difficult to identify subtle connections between claims and evidence. |
| Approach: | They propose a model that leverages sentence-level attention and graph attention network to enhance accuracy and fusing claims and evidence information for accurate identification of even well-disguised data. |
| Outcome: | The proposed model improves accuracy and state-of-the-art in the evidence-based fact-checking task. |
Chain-of-Thought Matters: Improving Long-Context Language Models with Reasoning Path Supervision (2025.findings-emnlp)
Copied to clipboard
Dawei Zhu, Xiyu Wei, Guangxiang Zhao, Wenhao Wu, Haosheng Zou, Junfeng Ran, null XWang, Lin Sun, Xiangzheng Zhang, Sujian Li
| Challenge: | Recent advances in Large Language Models (LLMs) have highlighted the challenge of handling long-context tasks. |
| Approach: | They propose a chain-of-thought framework that teaches models to generate high-quality reasoning paths for enhanced long-context performance. |
| Outcome: | The proposed framework generalizes across most long-context scenarios and amplifys with increasing context length. |