Topic
Llama 3 2
3 episodes
-
When is Your LLM Steerable?
A new paper investigates whether you can predict if a steering attempt will succeed by looking at the model's hidden states from just the first few tokens—before decoding the full response. The authors build ASTEER, a dataset of 1.4M steered generations labeled for success/failure across 150 concepts, then train a GBDT classifier on early hidden-state features to predict three outcomes: under-steer, success, or over-steer. The predictor hits ~0.7 macro-F1 on unseen concepts and cuts the cost of finding good steering strengths without expensive full rollouts.
-
Top 7 Small Language Models You Can Run on a Laptop MachineLearningMastery
Izzo and Boone explore seven small language models that run locally on laptops, diving deep into the technical trade-offs, hardware requirements, and real-world use cases. They break down everything from Phi-3.5 Mini's long-context capabilities to Llama 3.2's versatility, examining why local inference matters and how to choose the right model for your specific needs.
-
Self Hinting Language Models Enhance Reinforcement Learning
The paper explores how self-hinting language models can enhance reinforcement learning, particularly in overcoming the challenges faced when rewards are sparse. By introducing hints generated by the model itself during training, it reshapes the distribution of outcomes, allowing for better learning signals and improved performance on difficult prompts. This approach not only addresses existing limitations but also offers a novel way to adaptively guide the training process.