LoRA: Revision history

Jump to navigation Jump to search

Diff selection: Mark the radio buttons of the revisions to compare and hit enter or the button at the bottom.
Legend: (cur) = difference with latest revision, (prev) = difference with preceding revision, m = minor edit.

22 August 2023

  • curprev 14:2314:23, 22 August 2023StableTiger3 talk contribs 2,916 bytes +1,266 No edit summary
  • curprev 14:1114:11, 22 August 2023StableTiger3 talk contribs 1,650 bytes +1,650 Created page with "== Overview == Natural language processing includes large-scale pretraining and adaptation to specific tasks or domains. Full fine-tuning becomes impractical with large models. == Definitions == === Fine-Tuning === Refers to slight adjustments to a pre-trained model for specific tasks. Less feasible for larger models due to high cost and parameter count. === Low-Rank Adaptation (LoRA) === LoRA retains pre-trained weights and incorporates trainable rank decomposition ma..." Tag: Visual edit: Switched