Topic
Token Counting And Optimization
3 episodes
-
Your Agent Is Only As Good As Your Infrastructure
Justy and Cody dig into CoreWeave's argument that agent quality in production is mostly an infrastructure story once workflows get long, bursty, and tool-heavy. They mostly buy the core claim, but Cody pushes on how much of this is genuine systems insight versus a cloud vendor setting up next week's pitch on KV caching and routing.
-
LLM Orchestration Frameworks Compared: LangChain vs. LlamaIndex vs. Raw API Calls MachineLearningMastery
Pippa and Tyler dig into the article’s real argument: these frameworks are not interchangeable, because each one sits at a different layer of the stack. They test the claims against production reality, especially overhead, debugging, and when abstraction stops paying for itself. The episode lands on a practical view: use the lightest layer that actually earns its keep, and don’t confuse orchestration with magic.
-
Evaluating performance and efficiency of the GitHub Copilot agentic harness across models and tasks
GitHub Copilot's agentic harness is a single cross-experience SDK component that orchestrates tools, context, and workflow across CLI, app, and code review. The team claims it delivers task-resolution parity with model-vendor harnesses while cutting token usage across several configurations, backed by public and internal benchmarks and real-world metrics. We debate technical validity, practical stakes for teams, and whether the harness should get most of the credit.