Papers with Clustering
Clustering and Ranking: Diversity-preserved Instruction Selection through Expert-aligned Quality Estimation (2024.emnlp-main)
Copied to clipboard
Yuan Ge, Yilun Liu, Chi Hu, Weibin Meng, Shimin Tao, Xiaofeng Zhao, Mahong Xia, Zhang Li, Boxing Chen, Hao Yang, Bei Li, Tong Xiao, JingBo Zhu
| Challenge: | Existing methods for instruction data selection have limitations such as relying on fragile external APIs, being affected by biases in GPT models, or reducing the diversity of the selected instruction dataset. |
| Approach: | They propose an industrial-friendly, expert-aligned and diversity-preserved instruction data selection method: Clustering and Ranking (CaR). |
| Outcome: | The proposed method outperforms Alpaca's existing methods by 32.1% in GPT-4 evaluations. |
Comprehensive Abstractive Comment Summarization with Dynamic Clustering and Chain of Thought (2024.findings-acl)
Copied to clipboard
| Challenge: | Recent work on news comment summarization has focused on extractive methods within constraints. |
| Approach: | They propose an enhanced fast clustering algorithm that maintains a dynamic similarity threshold to ensure high density of each comment cluster being built. |
| Outcome: | The proposed method improves the baseline methods and the test suite on real-world news comments. |
Leave No Document Behind: Benchmarking Long-Context LLMs with Extended Multi-Doc QA (2024.emnlp-main)
Copied to clipboard
Minzheng Wang, Longze Chen, Fu Cheng, Shengyi Liao, Xinghua Zhang, Bingli Wu, Haiyang Yu, Nan Xu, Lei Zhang, Run Luo, Yunshui Li, Min Yang, Fei Huang, Yongbin Li
| Challenge: | Existing benchmarks for evaluating long-context language models employ irrelevant noise texts to artificially extend the length of test cases, diverging from the real-world scenarios of long-constituency applications. |
| Approach: | They propose a long-context benchmark, Loong, aligning with realistic scenarios through extended multi-document question answering (QA) . |
| Outcome: | The proposed model can scale up the context window of large language models to perform in-depth analysis of multiple long documents. |
Autoencoding Keyword Correlation Graph for Document Clustering (2020.acl-main)
Copied to clipboard
| Challenge: | Existing representation learning models do not capture the intra-sentential and inter-sententential features of long-text. |
| Approach: | They propose a graph-based representation for document clustering that builds a Graph Autoencoder on a Keyword Correlation Graph. |
| Outcome: | The proposed graph autoencoder can achieve better clustering performance than existing features. |
Multilingual Clustering of Streaming News (D18-1)
Copied to clipboard
| Challenge: | a novel method for clustering news across languages is proposed . a key challenge in handling news streams is that they must be generated on the fly . |
| Approach: | They propose a method for clustering news across languages into monolingual and crosslingual clusters . they use real news datasets in multiple languages to find an ever growing number of cluster labels . |
| Outcome: | The proposed method produces state-of-the-art results on real news datasets in German, English and Spanish. |
CRaSh: Clustering, Removing, and Sharing Enhance Fine-tuning without Full Large Language Model (2023.emnlp-main)
Copied to clipboard
| Challenge: | Instruction tuning is an effective way of aligning large language models with private instruction data. |
| Approach: | They propose a training-free strategy to derive improved emulators from LLMs by using Offsite-Tuning (OFT) they propose CRaSh, which transfers transformer blocks between centralized LLM and downstream emulators . |
| Outcome: | The proposed technique boosts performance of large language models with billions of parameters. |
WARDEN: Multi-Directional Backdoor Watermarks for Embedding-as-a-Service Copyright Protection (2024.acl-long)
Copied to clipboard
| Challenge: | Prior studies have shown that EaaS can be prone to model extraction attacks, however, this concern could be mitigated by adding backdoor watermarks to the text embeddings. |
| Approach: | They propose a new method that removes backdoor watermarks while maintaining the high utility of embeddings. |
| Outcome: | The proposed approach increases the stealthiness of watermarks and has been empirically shown to be effective against CSE attacks. |
MPCG: Multi-Round Persona-Conditioned Generation for Modeling the Evolution of Misinformation with LLMs (2025.emnlp-main)
Copied to clipboard
| Challenge: | Misinformation evolves as it spreads, shifting in language, framing, and moral emphasis to adapt to new audiences. |
| Approach: | They propose a multi-round, persona-conditioned framework that simulates how claims are iteratively reinterpreted by agents with distinct ideological perspectives. |
| Outcome: | The proposed framework generates persona-specific claims across multiple rounds . it is based on an uncensored large language model and is scalable to multiple tasks . |