Table of Contents
1. Introduction
2. Parameter-Efficient Fine-Tuning Methods
3. Adapter Tuning
4. Prefix Tuning
5. Prompt Tuning
6. Low-Rank Adaptation (LoRA)
7. Conclusion
Introduction
Tuning plays a crucial role in the development and effectiveness of Language Models (LLMs). LLMs are pre-trained on vast amounts of text data to acquire