Topic
Mit
5 episodes
-
AI memory framework MeMo skips LLM retraining
MIT's MeMo framework encodes new knowledge into a small dedicated memory model so teams can swap in a better LLM without retraining — and the performance gains are real. Justy and Cody break down how it actually works, what the benchmarks mean, and where the trade-offs bite.
-
New KV cache compaction technique cuts LLM memory 50x without accuracy loss
MIT researchers developed Attention Matching, a KV cache compaction technique that achieves 50x memory reduction in LLMs without accuracy loss, solving a critical bottleneck for enterprise applications handling long contexts.
-
Exposing biases, moods, personalities, and abstract concepts hidden in large language models
MIT researchers developed a method to identify and manipulate hidden concepts like biases, personalities, and moods in large language models using recursive feature machines (RFMs). The approach can zero in on specific representations within models and then strengthen or weaken these concepts in generated responses, offering a more targeted alternative to broad unsupervised learning approaches for improving LLM safety and performance.
-
MIT's new fine tuning method lets LLMs learn new skills without losing old ones
MIT researchers developed self-distillation fine-tuning (SDFT), a technique that lets large language models learn new skills without forgetting old ones. By using a model's own in-context learning abilities as both teacher and student, SDFT solves the catastrophic forgetting problem that forces companies to maintain separate models for each task.
-
Self Improving Language Models Are Becoming Reality with Mits Updated Seal
The emergence of self-improving language models, like MIT's SEAL, could revolutionize how AI processes and generates human-like text, increasing efficiency and adaptability in various applications.