中文
AI Engineer World's Fair

Top-ten on the open leaderboard from a single GPU: DeepMind on when self-hosting Gemma 4 pays off, with a live demo.

Sovereign Escape Velocity: Ownership w Open Models — Gus Martins, & Ian Ballantyne, Google DeepMind · Gus Martins

21 min
AgentAI CodingEvalsAI Product

21 min total·Actually worth watching closely: ~8 min·3 must-watch clips

Orange = the 8 minutes worth watchingFor the rest, the guide is enough
Segment guide · 6 segments
  1. 0:15 4:00Listen

    Opening: the case for open models

    Gus opens on the Gemma 4 launch and frames where open models fit for enterprises and sovereign institutions — not chasing the frontier, but staying in control and self-sufficient.

    Most everyday and agentic tasks do not need a frontier model, which is the premise for everything that follows.

    Purely spoken setup with nothing critical on screen — fine to listen to like a podcast.▶ Jump to 0:15
    Speaker · Gus Martins
  2. 4:00 7:22Skim

    The Gemma 4 family and leaderboard standing

    Introduces the four new models: E2B/E4B for phones, the 26B mixture of experts (about 4B parameters' worth of memory), and the strongest, the 31B Dense — plus their LMArena open-model ranking.

    The two larger models sit around 4th and 7th among open models while everything near them is at least three times bigger — size efficiency is the differentiator.

    The payload is the LMArena slide at 324s; one glance at the chart gets you the point, and the rest can be skimmed.▶ Jump to 4:00
    Speaker · Gus Martins
  3. 7:22 11:17Listen

    Apache 2.0 and sovereign AI in practice

    The license moves from a custom Gemma license to Apache 2.0, removing the legal blocker, followed by sovereign AI examples: Ukraine's public services and Bulgaria's national LLM built on Gemma 2.

    The license change addresses a real adoption bottleneck — legal review that drags on for months and never lands — and sovereign deployments already exist.

    Both the license argument and the examples are spoken; nothing visual to watch.▶ Jump to 7:22
    Speaker · Gus Martins
  4. 11:17 14:25Watch

    Token economics and the phone demo

    Ian uses OpenRouter data to show how the agentic shift drives token cost up, with coding among the highest-consuming categories, arguing that high-consumption tasks are where self-hosting pays off most — then demos agent skills running directly on a phone.

    High-token work that means following very specific instructions — refactoring, analyzing, generating modular code — can be offloaded to a single GPU or your own personal hardware.

    The first half has the OpenRouter consumption chart, and the on-device agent demo lands at 836s — this section is not one to listen to blind.▶ Jump to 11:17
    Speaker · Ian Ballantyne
  5. 14:25 18:15Watch

    Local deployment options and the multi-agent demo

    Deployment choices from device to enterprise: the 26B with context takes roughly 26GB, so an M4 Mac with 48GB of unified memory runs it locally — closing with the headline demo of parallel translation by local agents compiled into a web page.

    The same local orchestrator-plus-sub-agents pattern carries over to any agentic task: file processing, data analysis, and more.

    The most visually dense stretch of the talk, with hardware measurements and the full multi-agent demo at 1046s — the screen is the argument.▶ Jump to 14:25
    Speaker · Ian Ballantyne
  6. 18:15 20:35Listen

    Getting started and the full cost of ownership

    Trying it costs almost nothing to migrate: point any OpenAI-compatible interface at Ollama or LMStudio and swap the model name. Then a four-part evaluation framework — capability, hardware, latency, cost — with the reminder to count GPU operation and infrastructure spend in that cost.

    Judge with your own eval suites rather than general benchmarks — how good a model is depends on how well it does on your task.

    Mostly a spoken summary of the framework and next steps; no need to watch the screen, so take notes as you listen.▶ Jump to 18:15
    Speaker · Ian Ballantyne