Topic

Apple

3 episodes

  1. Ep 599

    Apple Container 1.0 Released as a Native Docker Alternative for macOS

    Jessica and Cathy dig into Apple Container 1.0 as a native macOS alternative to Docker, focusing on the real product wedge: persistent Linux machines with host integration, not just another container runtime. They tease apart where the pitch is genuinely useful for Mac developers and where Docker’s ecosystem still makes Apple’s tool feel narrower and more specialized.

  2. Ep 483

    Apple Foundation Models

    Apple's Claude for Foundation Models is a Swift package that wraps Claude into Apple's Foundation Models framework, letting developers swap Claude in and out of the same LanguageModelSession API used for on-device models. Requests route directly to Anthropic's API (Apple doesn't see them), and developers pay standard Claude API rates. The package handles model capabilities, effort levels, structured output, client and server-side tools, vision, and error mapping — all with the same interface whether you're calling Claude or an on-device model.

  3. Ep 340

    Stochastic KV Routing: Enabling Adaptive Depth Wise Cache Sharing

    Justy and Cody dig into Stochastic KV Routing, a paper on cutting transformer KV cache memory by sharing caches across layers instead of only squeezing along the token axis. They unpack random cross-layer attention, why it helps models tolerate missing per-layer caches, and where this could matter in real serving stacks.

    InferenceAppleResearch Paper