Topic
Artificial Analysis
3 episodes
-
Ex Alibaba engineer's new startup Octen pairs 10 millisecond AI search with a $20 unlimited plan
Edmund and Geffen dig into Octen’s “10‑millisecond, $20 unlimited” AI search pitch: what generative retrieval actually does, where the pricing and speed numbers are real, and when this changes how you’d design agents versus just being nicer infra marketing.
-
Announcing Artificial Analysis Intelligence Index v5
Artificial Analysis updates its Intelligence Index with more private, agentic evaluations and a new companion Progress Index. Jessica and Cathy unpack why the score is more useful for choosing models, while also becoming harder to independently audit.
-
AA Briefcase: Agentic Knowledge Work Benchmark | Artificial Analysis
Justy and Cody dig into AA-Briefcase, Artificial Analysis's new agentic benchmark that tests models on real knowledge-work deliverables — spreadsheets, presentations, memos — across four multi-week scenarios. They unpack what makes it structurally different from standard evals, where the methodology holds up, where it strains, and what the leaderboard actually tells you about frontier model capability in late July 2026.