John Gowing Brief · On-prem frontier LLM · May 2026

I / VII · Verdict

A note to John Gowing · Gowings Bros · Companion to AI Datacentres ↗

The verdict

On-prem buys locality and sovereignty.
Not capability.

A ten-person Australian SME asked whether to build an on-prem frontier LLM — the question a portfolio company will eventually put to you. The hardware bar is achievable; the capability gap is not closable with hardware. Three named conditions flip the answer. Most SMEs satisfy none of them.

This brief is the companion to AI Datacentres. Both documents ask one investor's question — what does this capital precisely buy? There, the answer is a long-lived, leasable infrastructure asset, and the verdict is build. Here it is a fast-depreciating box that buys locality and sovereignty, not frontier capability — and the verdict defaults the other way. Same discipline, opposite scale, opposite answer: the control case that sharpens the build.

The default verdict, and the three flips

Default

Do not build. An 8× H200 stack meets the throughput bar, but the best open-weight model trails the closed frontier by three to fifteen points on the benchmarks that decide multi-step agentic work.

$1.59M / 3 yrs5–15 pt gap, frontier vs open

Unless all three hold

01 Workload

Bounded by retrieval and summarisation.

No novel reasoning at the edge, no high-fidelity agentic multi-step tool use. The open-weight gap collapses to under five points and the stack is fit for purpose.

Read the capability gap

02 Compliance

Air-gap, not sovereignty.

If the operative need is Australian-resident weights — not a physical air-gap — AWS Sydney or Azure Australia East delivers identical capability at 30–50% of the three-year TCO.

Read the cost comparison

03 Connectors

Notion, Gmail, Calendar, Word, Excel — not core.

Every named connector is OAuth-gated SaaS that routes data through US-domiciled cloud. If they drive the workflow, the on-prem story is already punctured.

Read the OAuth puncture

IIThe capability gap

open-weight trails the closed frontier by three to six months and five to fifteen points on agentic benchmarks

gap.html

IIIThe bandwidth floor

only the 8× H200 SXM HGX node meets the bar; DGX Spark and Mac Studio miss by one to two orders of magnitude

silicon.html

IVPro-sumer compute, compared

four off-the-shelf SKUs costed as deployable units against the smallest frontier-class box — how cheap silicon gets before frontier becomes its own line item

compare-compute.html

VThree-year TCO, on-prem vs cloud-sovereign

$1.59M midpoint on-prem against $400–700k for the cloud-sovereign alternative that also closes the capability gap

costs.html

VIThe OAuth puncture

five named connectors, five US-domiciled clouds, five OAuth boundaries that exit the building regardless of where the model lives

puncture.html

VIIWhere the verdict flips

the three conditions written as a threshold ledger, with the default probability each holds for an SME annotated

flips.html

LensRead as a capital-preservation test for an inter-generational, conservatively-geared book: $1.59M of three-year capex against a box that depreciates to the capability gap's pace, weighed as depreciating capex rather than durable underlying-asset value. On-prem buys neither leasable asset nor leverage — only locality.

SourceOn-prem frontier LLM briefing, 11 May 2026 — §Verdict and §Conditions under which the recommendation flips. AUD throughout; $ prefix on all figures. USD/AUD planning rate 1.50, RBA spot ≈ 1.38.