INFERENCE ENGINEERING

THE ATLAS · EIGHT DOMAINS

The AI Inference Architecture Handbook, mapped.

The forward pass, request lifecycle, TTFT/TPOT/goodput.

A forward pass that turns tokens into the next token.

Different workloads with opposite bottlenecks.

Network ingress to detokenized egress, end to end.

Responsiveness and steady-state speed, measured separately.

Steady-state speed versus requests that satisfy their SLO.

Agent-native web · research mode

Experimental WebMCP · evolving community-group draft, not a W3C Standard or on the Standards Track.

Native status: Initializing. Registered: none

DOM → inferred capabilities · WebMCP → declared capabilities. Tools read real CUDA/Inference Atlas content. Calls may highlight temporary UI state. No backend or remote telemetry.

Local harness verifies application logic; it does not demonstrate native discovery or a browser agent.

Input schema
{
  "type": "object",
  "properties": {
    "query": {
      "type": "string",
      "minLength": 1,
      "maxLength": 300
    },
    "limit": {
      "type": "integer",
      "minimum": 1,
      "maximum": 10
    }
  },
  "required": [
    "query"
  ],
  "additionalProperties": false
}
Local log: last 100 calls while this panel is open. Inputs may contain personal text; review before sharing.
 
[]