Topic
Parameter Efficient Fine Tuning
3 episodes
-
Overview: Low Rank Adaptation
We finally do the episode we kept promising: a proper deep dive into Low-Rank Adaptation — LoRA — the technique that lets you customize a massive model for a fraction of the cost, by learning a tiny mathematical shortcut instead of retraining the whole thing.
-
Overview: Parameter Efficient Fine Tuning
We finally give Parameter Efficient Fine-Tuning, or P E F T, the full Overview treatment: why it exists, how LoRA and adapters work, and why tiny trainable add-ons can steer huge frozen models. We use one worked mental model all the way through so the idea lands without assuming you already speak fine-tuning fluently.
-
Introducing OpenRL: A self Hosted post training API for fine tuning LLMs | Google Open Source Blog
Justy and Cody discuss Google’s OpenRL, a self-hosted post-training API that tries to separate RL research loops from the Kubernetes and GPU infrastructure underneath them.