Inference supply

Frontier models,
served from our own fleet

Kimi K3.1 Pro, GLM-5.3, DeepSeek V4 and Qwen 3.8 on an OpenAI-compatible endpoint. Run on hardware we own and operate, with the price published in full.

Get an API key See pricing

1M context · 99.9% monthly availability target · zero retention by default · rate 1.00

# OpenAI-compatible. Change the base URL.
from openai import OpenAI

client = OpenAI(
  base_url="https://api.tokentoken.ai/v1",
  api_key="tt-...",
)

r = client.chat.completions.create(
  model="tt/kimi-k3.1-pro",
  messages=[{"role": "user", "content": "hi"}],
)

Anthropic Messages supported on the same key.

An aisle between rows of GPU server racks.

Illustrative. Generated with our own models on our own GPUs.

6 modelsFrontier open weights, live now
1M ctx1,048,576 tokens on five of six
99.9%Monthly availability target
3 regionsRouted to the nearest, or pinned
Why us

Production-grade serving, at a competitive price

One team owns the kernels, the scheduler, the fleet and the pager. That is what makes a route stay up under load — and what lets us price it competitively instead of marking up someone else's quota.

Where a request goes

One key, one endpoint. The gateway authorizes, reserves budget and routes; the fleet produces the tokens.

Your agent tt-… key Gateway authorize · reserve route · settle once no prompt stored Our fleet — self-hosted weights B300 · H200 · RTX 5090 · RTX 4090 own kernels · own scheduler · 24/7 ops Vendor API — coming soon Anthropic · OpenAI · Google · Z.ai · Moonshot labelled vendor_api in the response metered usage

Self-hosted routes are live. Vendor-API routes are being onboarded and are marked coming soon in the catalogue and in GET /v1/models.

Reliability is engineered

Every failure path is detect → remediate → verify, and each one is held by an automated gate that injects the fault and asserts the remediation fires. Detection without remediation counts as unfixed.

Operated around the clock

One directory per release, so the previous one is the rollback. Read-only code split from runtime state. One build SHA to every node. On call, with a named owner per service.

Scheduling that holds under load

Admission control, backpressure, retry budgets, slow-node demotion and overload shedding — so your p99 does not collapse when someone else's traffic spikes.

Deep inference optimization

Attention and GEMM kernels tuned per card, quantization, speculative decoding, continuous batching. This is where throughput per GPU comes from, and we do the work ourselves.

Capacity we own

Not resold quota. Reserved hardware is yours alone, and its idle time feeds the token pool — so supply and price move with our own engineering, not with a vendor's price list.

Known supply, verifiable

Every route declares its source in the API response. Prompts and outputs are not stored. Selected routes return a signed attestation your client checks before the prompt leaves.

Competitive, published pricing

Every price is a base price times one public multiplier, rate, currently 1.00. It is on this site, in the console and in the API — the same number we bill.

Support that answers

A named contact for business accounts, a request id on every response that ties a call to its line on the invoice, and status and incident notices you do not have to ask for.

Models

Frontier open weights on our own hardware. Vendor APIs are being onboarded.

All models and prices →
ModelWeightsContextInput /MOutput /MStatus
tt/kimi-k3.1-proKimi K3.1 Pro1M$1.50$7.50Available
tt/glm-5.3GLM-5.31M$0.95$3.00Available
tt/deepseek-v4-proDeepSeek V4-Pro1M$0.60$2.40Available
tt/deepseek-v4.1-flashDeepSeek V4.1-Flash1M$0.25$1.00Available
tt/glm-5.3-flashGLM-5.3-Flash1M$0.18$0.70Available
tt/qwen3.8-27bQwen3.8-27B262K$0.10$0.35Available
claude-opus-5-5Anthropic API1M——Coming soon
gpt-6-astraOpenAI API———Coming soon
gemini-4-argonGoogle API———Coming soon

Prices at rate 1.00. Vendor-API models will list at the vendor's published rate while we onboard them.

Price

Published in full, at rate 1.00

Full price list →

Output tokens, price per million

Where our self-hosted routes sit against each vendor's own published rate.

TokenToken self-hosted Vendor list price
gpt-6-astraOpenAI
$50.00
claude-opus-5-5Anthropic
$20.00
gemini-4-argonGoogle
$10.00
tt/kimi-k3.1-proSelf-hosted
$7.50
glm-5.3Z.ai vendor API
$4.40
tt/glm-5.3Self-hosted
$3.00
tt/deepseek-v4-proSelf-hosted
$2.40
$0$10$20$30$40$50
Table view and sources
ModelSourceInput /MOutput /M
tt/deepseek-v4-proTokenToken self-hosted$0.60$2.40
tt/glm-5.3TokenToken self-hosted$0.95$3.00
tt/kimi-k3.1-proTokenToken self-hosted$1.50$7.50
glm-5.3Z.ai published rate$1.40$4.40
gemini-4-argonGoogle published rate$2.00$10.00
claude-opus-5-5Anthropic published rate$4.00$20.00
gpt-6-astraOpenAI published rate$10.00$50.00

Vendor rates are each vendor's own published standard-tier price for requests inside their short-context band, read 6 November 2026; promotional rates and long-context bands differ. Our prices are shown at rate 1.00.

Dedicated compute

When you want the whole machine

Configure and request a quote →

Most teams start on the API and pay per token. When your load is steady enough to keep a card busy, reserve one: B300 in stock, by the month, power and bandwidth included. We quote within one business day.

Memory per GPU

What fits without splitting the model across cards.

B300
288 GB
H200
141 GB
5090
32 GB
4090
24 GB

HBM3e on B300 and H200; GDDR7 and GDDR6X on the RTX cards. Bars are to scale.

B300288 GB · from $6.50/GPU·hr
H200141 GB · from $2.60/GPU·hr
RTX 509032 GB · from $0.75/GPU·hr
RTX 409024 GB · from $0.45/GPU·hr
Request a quote

or sales@cflabs.ai

Built for agents

Your agents are the user

Agent setup and skills →

Wire itself up, then stay inside budget

Discovery, cost and limits are endpoints — nothing here needs a human to read docs.

Agent one tt- key discover estimate /v1/models ids, context, source label /v1/pricing unit prices + rate version /v1/cost/estimate cost before you spend it /v1/chat/completions Per-key caps models · spend · RPM

A model allowlist, a spend cap and a rate limit sit on the key itself, so an agent that loops cannot outspend its budget.

# Catalogue, prices and limits as data
curl https://api.tokentoken.ai/v1/models
curl https://api.tokentoken.ai/v1/pricing

# What will this call cost?
curl -X POST .../v1/cost/estimate \
  -d '{"model":"tt/glm-5.3","input_tokens":12000}'

# Agent-readable site index
curl https://tokentoken.ai/llms.txt

Streaming and tools

SSE, parallel tool calls and JSON-constrained output on every self-hosted route.

Drop-in SDKs

OpenAI and Anthropic client libraries work unchanged — base URL and key.

Ready-made skills

Copy-paste skill files for coding agents, with the limits already set.

Stable ids

A pinned tt/ id keeps serving the same weights and quantization.

Trust

Known supply. Nothing kept. Proof on request.

Data handling and compliance →

Zero retention by default

Prompts and outputs are not stored. Billing metadata is. Debug capture is opt-in per key and expires on its own.

Never used for training

No setting changes this and no discount is offered for allowing it.

Every route declares its source

Self-hosted, vendor API, cloud or licensed third party — in the API response, not only on this page. No account pools.

Attested inference Preview

Selected routes run in a hardware TEE and return an attestation your client verifies before the prompt leaves, plus a signed usage receipt.

Regional processing

Inference can be contracted to stay in North America, Southeast Asia or East Asia.

Credentials never logged

Authorization headers are dropped at the entry point, not redacted afterwards.

Documents on request

DPA with SCCs and UK Addendum, sub-processor list with 30 days' notice, security overview.