Todd Smith

Co-founder and CEO, TAHO Labs. Co-creator, diescope.

Todd Smith

Todd runs TAHO Labs, which builds software that routes workloads to the hardware best suited to run them. He also co-created diescope, an open source tool that measures how chips are used at the unit and engine level.

Todd Smith

Co-founder and CEO

TAHO Labs

Infrastructure software for utilizing unused capacity to solve AI's supply problem.

TAHO is our drop-in software that accesses far more from the capacity from the processors you already pay for. It works with the orchestration and hardware your team is currently using.

  • Splits workloads into smaller jobs
  • Routes each tiny job to the available processor
  • Runs on existing hardware
taholabs.com

Co-creator

diescope

Open source chip metrics for developers.

Most processors run drastically under-utilized while traditional tools report near full. diescope measures processors at the die level, so developers can maximize the use of every one.

  • Measures chip use at the unit and engine level
  • Open source
  • Built for developers
diescope.com

Thesis

It's the work, not the machine.

AI changed the shape of compute, and execution models never caught up. The next era will be won by fitting the work to the machines we already have.

  1. Scale was the answer

    For decades, nearly every major advance came from adding capacity. Scale was the answer, and it was the right one.

  2. The work changed shape

    Modern workloads run everywhere at once. The execution model didn't change with them.

  3. The mismatch is the cause

    When the work no longer fits, we layer on orchestration and management tools, and the systems grow more complex. What looks like a cost problem is usually the same mismatch.

  4. The bottleneck moved

    A growing share of our effort goes to coordinating work rather than running it. The bottleneck has moved from compute volume to compute fit.

The work changed shape. The execution model didn't. It's the work, not the machine.

Sources: NVIDIA datasheets, Volta through Blackwell Ultra, FP16 dense; Rubin projected. Best-tuned MFU from Meta Llama 3, 2024. Typical from Cast AI, 2026, across roughly 23,000 production clusters.

Background

Operations leadership at companies in periods of rapid scale.

  • Facebook

    Senior operations leadership

    Worked through extreme scale, including the Instagram and WhatsApp acquisition integrations.

  • Snap

    Senior operations leadership

    Worked through rapid growth, including the Bitstrips acquisition integration.

  • Docker

    VP of Operations

    ARR grew from approximately $60M to $175M in roughly 15 months.

Writing

In the press

Video appearances

Contact

Evaluating TAHO, building on it, or investing: write to Todd directly.

[email protected]