Prefix Tuning
Definition
Prefix Tuning is a parameter-efficient adaptation technique for pre-trained transformers. …
Fine-Tuning
Terms tagged with Fine-Tuning
P-Tuning
Definition
P-Tuning (Prompt Tuning) is a technique designed to adapt large pre-trained language …
Dataset:Jackrong/Qwen3.5 Reasoning 700X
Definition
This entry refers to a specific dataset repository identified by the identifier …
QLoRA
Definition
QLoRA combines Low-Rank Adaptation (LoRA) with 4-bit quantization to significantly reduce …
Supervised Fine-tuning
Definition
Supervised Fine-tuning (SFT) involves taking a large pre-trained model, such as a …
Adapter
Definition
Adapters are a parameter-efficient fine-tuning technique used primarily in large language …
Reinforcement Learning from Human Feedback
Definition
Reinforcement Learning from Human Feedback (RLHF) is a method used to fine-tune large …
LoRA
Definition
LoRA freezes pre-trained model weights and inserts trainable decomposition matrices into …