Papers by Beihong Jin
TITA: A Two-stage Interaction and Topic-Aware Text Matching Model (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing models for keyword-document matching do not define topic-aware relevance clearly. |
| Approach: | They propose a two-stage interaction and topic-aware text matching model to solve this problem . they propose to combine latent topic of document with deep neural representation to model complex interactions between keyword and document. |
| Outcome: | The proposed model outperforms other well-designed baselines and shows excellent performance in the recommendation system. |
A Topic Augmented Text Generation Model: Joint Learning of Semantics and Structural Features (D19-1)
Copied to clipboard
| Challenge: | Existing methods for text generation are limited in supervised setting and designed for specific applications. |
| Approach: | They propose a text generation model that learns semantics and structural features simultaneously . their model leverages a topic-based model to enhance the recognition of text semantics . |
| Outcome: | The proposed model outperforms state-of-the-art models in terms of text perplexity and topic coherence. |
Improving Document Representations by Generating Pseudo Query Embeddings for Dense Retrieval (2021.acl-long)
Copied to clipboard
| Challenge: | Existing retrieval models based on dense representations show better performance than sparse representations. |
| Approach: | They propose a method to mimic the queries to each of the documents by an iterative clustering process and represent the documents using multiple pseudo queries. |
| Outcome: | The proposed model achieves state-of-the-art results on a large dataset while remaining high efficiency. |
Enhancing Document Ranking with Task-adaptive Training and Segmented Token Recovery Mechanism (2021.emnlp-main)
Copied to clipboard
| Challenge: | Document Retrieval (DR) requires the machine to retrieve and rank documents according to their relevance with the query. |
| Approach: | They propose a ranking model DR-BERT which improves the Document Retrieval task by a task-adaptive training process and a Segmented Token Recovery Mechanism. |
| Outcome: | The proposed ranking model keeps in the top three on the MS MARCO leaderboard since 2020. |
CARE-STaR: Constraint-aware Self-taught Reasoner (2025.findings-acl)
Copied to clipboard
Zhiliang Li, Bo Tang, Yijun Niu, Beihong Jin, Qiwen Shi, Yuchen Feng, Zhiyu Li, Jie Hu, Mingchuan Yang, Feiyu Xiong
| Challenge: | Recent research on instruction following has demonstrated that LLMs can handle complex instructions. |
| Approach: | They propose to assign constraints to different levels of constraints in instructions . they use chain-of-thought and self-taught reasoner methods to identify constraints . |
| Outcome: | The proposed method outperforms supervised fine-tuning (SFT) on three instruction-following benchmarks. |