Topic
Dspy
3 episodes
-
Automate Writing Your LLM Prompts | Towards Data Science
Cody and Justy dissect the argument that manual prompt engineering is obsolete in production, focusing on the DSPy framework's claim to automate prompt optimization. Cody challenges the 'black box' nature of auto-generated prompts and the computational cost, while Justy argues this shifts the developer role from 'prompt writer' to 'system architect,' solving the fragility of hard-coded strings. They land on a nuanced verdict: DSPy is powerful for stable, high-volume tasks but overkill for exploratory prototyping.
-
AgentSPEX: An Agent SPecification and EXecution Language
Justy and Cody dig into AgentSPEX, a YAML-based language and runtime for building LLM agents with explicit control flow, typed steps, reusable submodules, parallel execution, and state management. They focus on the gap between loose ReAct prompting and Python-heavy orchestration tools, then unpack how AgentSPEX separates workflow specification from execution while still supporting tools, sandboxing, checkpointing, replay, and visual editing. The conversation lands on who this is for, where it feels shippable, and what a solo builder could try this weekend.
-
How to Build Your Own Custom LLM Memory Layer from Scratch | Towards Data Science
In this episode, we explore innovative ways to enhance large language models (LLMs) with custom memory layers that improve user interactions. By enabling LLMs to remember past user interactions, we can drive personalization and efficiency in AI applications. Join us as we unpack how to build these memory systems from scratch and what this means for the future of conversational agents.