Topic
Gemma 3
2 episodes
-
Linear representations in language models can change dramatically over a conversation
This episode dives into the significant findings of recent research on how language models adjust their internal representations during conversations. We explore the implications of these changes for developers and practitioners in AI, discuss potential applications, and highlight the challenges they present for interpretability and reliability in AI outputs.
-
Differences That Matter: Auditing Models for Capability Gap Discovery and Rectification
The research introduces AuditDM, a novel framework to audit multimodal LLMs by identifying their capability gaps through reinforcement learning. This approach not only helps in discovering failure modes but also offers a pathway for model improvement without extensive annotation. The implications for developers are significant, as they can utilize these insights to enhance model performance and effectiveness in real-world applications.