← Research

INFERENCE / MEASUREMENT / ECONOMICS

Model licences, speed commitments and inference margins

A companion methodology note on licences, pricing and service requirements

How model licence conditions, response-speed targets and cache billing change the inference margin calculation.

INTERTIE.ai Research · 28 October 2026 · v1.0 · Methodology note

A floating, translucent Goursat sculpture with pale crystal reflections and faint green edges.
Drag to explore

A faster response can require more capacity per customer. A model licence can add a commercial condition before any token is sold. Both belong in an inference business model alongside the GPU price.

This companion to From token throughput to billable revenue examines how those constraints change the calculation. The source observations below were checked on 28 October 2026. The numerical scenarios are explicitly hypothetical; they are not operating results or offers.

1. Read the exact model licence

Three published licences illustrate why downloadable weights do not imply identical commercial terms. These are selected conditions, not a complete licence review.

Model version What the published text says
DeepSeek V4.1 Flash-1017 MIT licence, with notice-preservation requirements and warranty disclaimers. It contains no revenue-share provision. [1]
GLM-5.3 If the licensee or an affiliate operates Model as a Service and their combined total revenue exceeds US$10 billion over any consecutive 12 months, any commercial use of the software or its derivatives requires first passing Z.AI's security review. The text specifies no revenue share. [2]
Kimi K3 If the licensee or any affiliate operates Model as a Service and their combined total revenue exceeds US$20 million over any consecutive 12 months, a separate Moonshot AI agreement is required before any commercial use of the software or its derivatives. No share percentage is specified. Section 4 exempts defined internal use and use through Moonshot AI’s official products or certified inference partners from Sections 2 and 3. Section 3 separately requires “Kimi K3” to be prominently displayed in the user interface of commercial products or services exceeding 100 million monthly active users or US$20 million monthly revenue. [3]

The two bespoke licences define Model as a Service as giving a third party access to inference or fine-tuning in a way that lets that third party exercise meaningful control over inputs, parameters or training data. They exclude end-user products whose model capabilities are solely embedded within specific features or harnesses, and mere relaying of requests to models hosted by others. Their Section 2 revenue thresholds cover the business and its affiliates, not only the named model's sales. Separate contracts may add conditions. This summary is not legal advice, and the K3 reading does not establish terms for K3.1 Pro.

2. Name the margin denominator

Let R be hypothetical token revenue per GPU-hour at a defined reference workload and price; U the fraction of allocated hours sold and served at that reference load; q an independent price multiplier; s a model-provider share of that revenue; and c the included cost per allocated GPU-hour, excluding the share. Revenue before the share is G = R × U × q.

This is a linear scenario with constant workload, billing mix and cost. A benchmark does not establish that its reference point is full capacity or that customers will fill it. U is not a device busy percentage; a rate already averaged over allocated hours must not be discounted for the same idle time again. In particular, v1.1’s R already averages over all allocated hours: when reusing that measured rate for the same window, set U = 100%.

Break-even U∗ = c / [R × q × (1 − s)]

The contribution G(1 − s) − c can be expressed against two different bases:

Before-share revenue basis: 1 − s − c/G
Retained-revenue basis: 1 − c/[G(1 − s)]

These are analytical ratios under the stated cost boundary, not a decision about accounting presentation. Include hardware, power, networking and other relevant service costs consistently; financing and taxes need separate treatment where excluded.

Hypothetical example: R = US$20, c = US$4, q = 1 and s = 30%. The 30% is chosen to illustrate the formula and is not attributed to any model licence. Break-even U∗ is 28.6%. At twice that load, 57.1%, the margin is 35% of before-share revenue, or 50% of retained revenue. Achieving 50% on the first basis takes 3.5U∗ = 100% in this example.

In general, a before-share margin target m requires U = c/[R × q × (1 − s − m)], with a positive denominator. If the required U exceeds 100%, the target is unattainable within this reference-load scenario. Revenue shares calculated on another contractual base require a different model.

3. Speed and cost must describe the same service

SemiAnalysis’s InferenceX GLM-5.3/B300 page reports the following frontier for its AgentX agentic coding workload, using Dynamo SGLang in FP4. The run window is 12–22 October 2026; the page was retrieved on 28 October. These are the tester's published measurements, not an independent reproduction. [4]

Per-user target, tokens/s Total tokens/s/GPU
50 34,534
75 24,345
100 20,709
150 14,310
200 9,558

At the 200-token/s target the published aggregate rate is 46.2% of the rate at 100. That comparison describes this workload and tested configurations. Each point selects the best measured engine and precision for that target; the frontier is a dated snapshot and can change. Total tokens are not all output tokens, and an interactivity target does not by itself guarantee first-token latency, reliability or application quality.

The same source's cost tiers must also retain their labels:

Hardware Ownership at large-hyperscaler volume Retail tier
B300 US$2.26/GPU-hour US$4.25/GPU-hour
MI355X US$1.50/GPU-hour US$2.90/GPU-hour
GB300 NVL72 US$2.31/chip-hour US$5.00/chip-hour

These SemiAnalysis AI Cloud total cost of ownership (TCO) model tiers were retrieved on 28 October 2026. They are model inputs published by their author, not executable on-demand quotes or contracted service costs. [4–6]

For two systems A and B with the same billable mix, price, revenue share and service requirements, a conditional comparison is:

U∗A / U∗B = (cA / cB) × (TB / TA)

Here T is comparable throughput on the same system boundary. A cheaper GPU-hour can still require more paid load if throughput is lower. Different precision, quality, cache behaviour or test windows can invalidate the shortcut. This note makes no chip ranking.

4. Cache billing changes the value of a token stream

DeepSeek's official Flash price page maps the service to V4.1-Flash-1017. At peak rates, uncached input, cached input and output cost US$0.30 / US$0.006 / US$1.20 per million tokens, respectively. Off-peak rates are half those amounts. Peak periods are 01:00–04:00 and 06:00–10:00 UTC on weekdays, excluding Chinese public holidays. Retrieved 28 October 2026. [7]

This is DeepSeek’s own API tariff, used here to illustrate cache-differentiated billing; it does not establish another host’s selling price.

For a hypothetical fixed stream of one million input tokens plus 100,000 output tokens, using those peak prices:

Input tokens billed as cache hits Input charge Output charge Total charge
0% US$0.3000 US$0.1200 US$0.4200
90% US$0.0354 US$0.1200 US$0.1554

At 90%, input charge is 0.1 × 0.30 + 0.9 × 0.006. The token stream is invented; the rates are the dated public observation. The example isolates token charges and assumes no other fees or credits. A hardware prefix-cache statistic cannot automatically be substituted for the billing counter. Higher cache reuse may free capacity, but the effect on margin also depends on cost and whether that capacity can be sold.

5. A proposed operating discipline

Before committing to a service price, record the exact licence and any separate agreement, benchmark the offered response-time requirement, join billable usage to the full allocated-capacity window, and compare the resulting revenue with costs on the same boundary. State the margin denominator beside every percentage.

The practical value of a benchmark is to expose which assumption needs testing next. Licence eligibility, an hourly cost tier and a token-rate headline each answer only part of the commercial question.

Sources and scope

Primary sources below were retrieved on 28 October 2026 (Asia/Singapore). Licence and price summaries are dated observations; performance figures are attributed test reports. Equations, the 46.2% comparison and both hypothetical examples are our calculations. The final section is a proposed method, not an empirical result.

  1. DeepSeek V4.1 Flash-1017 licence
  2. Z.AI GLM-5.3 licence
  3. Moonshot AI Kimi K3 licence
  4. InferenceX GLM-5.3 on B300
  5. InferenceX GLM-5.3 on MI355X — cost tiers only
  6. InferenceX GB300 NVL72 cost tiers
  7. DeepSeek Models and Pricing

Related methodology: From token throughput to billable revenue, v1.1.

6 pages · 456 KiB

Get the full report.

Enter your email to download the full report.

We record your email and this report request. This does not subscribe you to marketing emails. See our Privacy Policy. For questions or removal: partner@intertie.ai.