| Challenge: | Existing fingerprinting methods to fingerprint language models are limited to attributing organic text . however, fine-tuned LMs can generate long, coherent, and grammatically valid synthetic text. |
| Approach: | They conduct extensive experiments to demonstrate the limitations of existing fingerprinting approaches. |
| Outcome: | The proposed fingerprinting methods are limited to attributing synthetic text generated by 10 pre-trained LMs. |
Similar Papers
Matching Pairs: Attributing Fine-Tuned Models to their Pre-Trained Large Language Models (2023.acl-long)
Copied to clipboard
| Challenge: | generative large language models (LLMs) are widely used but fine-tuned to improve performance on downstream applications leads to violations of model licenses, model theft, and copyright infringement. |
| Approach: | They propose to trace back the origin of a model trained to its pre-trained base model . they use different knowledge levels and attribution strategies to find out how the model was trained . |
| Outcome: | The proposed method can trace back 8 out of 10 fine tuned models with different knowledge levels and attribution strategies. |
When Detection Fails: The Power of Fine-Tuned Models to Generate Human-Like Social Media Text (2025.findings-acl)
Copied to clipboard
| Challenge: | detecting AI-generated text on social media is difficult due to short text length and informal language of the internet . a recent study shows that detection of AI-generated posts is difficult under assumptions that an attacker has no knowledge of the generating model . |
| Approach: | They use open-source, closed-source and fine-tuned social media to detect AI-generated text . they use assumptions about knowledge of and access to the generating models to test detection . |
| Outcome: | a human study shows that detection of AI-generated social media posts is difficult . the study compared 505,159 posts from open-source, closed-source and fine-tuned models . |
Through the Looking Glass: Learning to Attribute Synthetic Text Generated by Language Models (2021.eacl-main)
Copied to clipboard
| Challenge: | Recent advances in natural language processing have enabled synthetic text generation that is often comparable to the organic text. |
| Approach: | They propose and test several ML-based methods to attribute authorship of synthetic text to language models (LMs) they propose to use a fine-tuned version of XLNet to achieve excellent accuracy . |
| Outcome: | The proposed method achieves excellent accuracy (91% to near perfect 98%) across a range of experiments where the synthetic text may be generated using pre-trained LMs, fine-tuned LM, or by varying text generation parameters. |
Unveiling the Generalization Power of Fine-Tuned Large Language Models (2024.naacl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have demonstrated exceptional multitasking abilities, but the comprehensive effects of fine-tuning on the LLMs’ generalization ability are not fully understood. |
| Approach: | They conduct extensive experiments across five distinct language tasks on different datasets to investigate whether fine-tuning affects the generalization ability intrinsic to LLMs. |
| Outcome: | The proposed model can generalize to different domains and tasks by integrating the in-context learning strategy during fine-tuning on generation tasks. |
From Text to Source: Results in Detecting Large Language Model-Generated Content (2024.lrec-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) generate human-like text, but have ethical and misuse concerns. |
| Approach: | They evaluate whether a classifier trained to distinguish between source and target LLMs can detect text from an LLM without further training. |
| Outcome: | The proposed method detects text from target LLMs without further training. |
Fine-tuning Large Language Models with Limited Data: A Survey and Practical Guide (2026.tacl-1)
Copied to clipboard
| Challenge: | Pre-trained language models provide strong foundations, but effective adaptation under data scarcity requires efficient and efficient fine-tuning techniques. |
| Approach: | They propose to review parameter-efficient fine-tuning techniques that lower training and deployment costs and domain and cross-lingual adaptation methods for both encoder and decoder models. |
| Outcome: | The proposed techniques lower training and deployment costs, domain and cross-lingual adaptation methods, and model specialization strategies. |
Improving the OOD Performance of Closed-Source LLMs on NLI Through Strategic Data Selection (2026.findings-eacl)
Copied to clipboard
| Challenge: | Existing methods to improve robustness require changing the fine-tuning process or large-scale data augmentation, which are infeasible or cost prohibitive for closed-source models. |
| Approach: | They propose to prioritize more complex examples or replace existing training examples with LLM-generated data to improve performance on OOD NLI datasets. |
| Outcome: | The proposed methods improve performance on difficult OOD datasets while training with synthetic data leads to substantial improvements on easier OOD data. |
Where Am I From? Identifying Origin of LLM-generated Content (2024.emnlp-main)
Copied to clipboard
| Challenge: | Generative models have produced high-quality content, but they pose security risks . a new framework for deep learning systems enables the tracing of AI-generated content back to its source . |
| Approach: | They propose a digital forensics framework that embeds a secret watermark into the generated output and a "depth watermark" this watermark strengthens the link between content and generator, enabling accurate tracing while maintaining the quality of the generated content. |
| Outcome: | The proposed framework ensures accurate tracing while maintaining quality of generated content. |
MAGE: Machine-generated Text Detection in the Wild (2024.acl-long)
Copied to clipboard
Yafu Li, Qintong Li, Leyang Cui, Wei Bi, Zhilin Wang, Longyue Wang, Linyi Yang, Shuming Shi, Yue Zhang
| Challenge: | Existing research has focused on evaluating detection methods for specific domains or language models. |
| Approach: | They build a testbed to detect texts from diverse human writings and LLMs using different detection methods. |
| Outcome: | Empirical results show that the top performing detector can identify 84.12% out-of-domain texts generated by a new LLM, indicating the feasibility for application scenarios. |
A Survey on Detection of LLMs-Generated Content (2024.findings-emnlp)
Copied to clipboard
Xianjun Yang, Liangming Pan, Xuandong Zhao, Haifeng Chen, Linda Petzold, William Yang Wang, Wei Cheng
| Challenge: | Recent advances in large language models have led to an increase in synthetic content generation . the ability to detect LLMs-generated content has become of paramount importance . |
| Approach: | They propose to provide a detailed overview of existing detection strategies and benchmarks, scrutinizing their differences and advocating for more adaptable and robust models to enhance detection accuracy. |
| Outcome: | The proposed model will be able to detect human-written content in real time. |