All runbooks
runbookuapiredacted view

UAPI Grok Cloud GPU Broker Contract Notes 2026-06-22

Grok cloud GPU broker contract notes covering leases, artifacts, timeouts, budgets, health, and failure modes.

Updated 2026-06-22·Freshness: Reference·Sensitive tokens or credentials were hidden before display.

UAPI Grok Cloud GPU Broker Contract Notes 2026-06-22

Grok cloud GPU broker contract notes covering leases, artifacts, timeouts, budgets, health, and failure modes.

Promotion Metadata

  • Source feedback id: 120
  • Source feedback ids: 120
  • Promotion request id: 51
  • Feedback category: beneficial
  • Feedback source: [REDACTED:high-entropy]
  • Feedback created at: 2026-06-22T18:27:40.281558+00:00
  • Target slug: [REDACTED:high-entropy]
  • Review state: review
  • Reviewer note: AI lane auto-promoted redacted feedback into internal catalog context.

Source Feedback Body

Feedback 120

  • Product: uapi
  • Category: beneficial
  • Related slug: [REDACTED:high-entropy]
  • Source: [REDACTED:high-entropy]
  • Created at: 2026-06-22T18:27:40.281558+00:00

Grok Cloud GPU Broker Contract Notes (2026-06-22)

ALIVE: true
Lane: Grok Worker A / UAPI cloud/Colab burst
Sources: agent-work-queue-v1-scaleout.md, [REDACTED:high-entropy].md, [REDACTED:high-entropy].md, hardware-autorouter-review.md, uapi-master-program-control.md, uapi-grok-hardware-autorouter-cloud-gpu.md + integrated plan contexts; public: https://research.google.com/colaboratory/faq.html, https://docs.runpod.io/serverless/overview, https://docs.runpod.io/serverless/endpoints/overview, https://www.runpod.io/articles/guides/ai-on-a-schedule.

Scope

UAPI-owned "cloud GPU broker" abstraction for transient burst (e.g. cloud.colab.gpu.burst). UAPI owns PlacementDecision, policy, adapters, records. Broker = lease + handoff contract only. All names UAPI-friendly; provider details in adapter config.

Conductor/adapters run on lease. Artifacts + Explorer = integration.

Job Lease

Request: job_id, friendly_route, resource_spec (GPU prefs, RAM), timeout, budget_ref, input_manifest. Grant: lease_id, ephemeral provider_ref, expiry, est_cost. Strictly time-bounded; auto-release on expiry/complete/cancel. Pre-lease health+budget check.

Artifact Handoff

All via durable UAPI artifacts/refs (in specs/ResultPackets). Inputs published to sink (Drive/GCS/S3) pre-lease; broker pulls. Outputs (results, logs, metrics, manifest) written to sink. No direct FS/pipe. Enables resume, audit, retry, lineage. Pre-warm small manifests (cold fetch wastes GPU time per patterns).

Timeout

Hard wall (Colab-realistic 4h + provider max). No-progress/idle shorter (15-30m). Dual enforced. On breach: partial artifacts if manifest, fail+release. UAPI fallback/retry.

Budget Cap

Per-job + lane aggregate (CU/$). Pre+mid checks. On breach: flush partial + spend, release. UAPI-side hard guard (Colab is soft). Every result reports spend delta.

Provider Health

Pre-dispatch: avail, queue, realized GPU, store latency, error rate. Ongoing proxy via status/artifacts (scale-to-zero beneficial). Degrade lane on poor signals; fallback or circuit-break.

Failure Modes

  • Disconnect/idle: resume from artifacts else fail+fallback.
  • Quota/deny/cooldown: immediate alternate or queue.
  • Overrun: cap + alert; no overspend.
  • Partial output: manifest validate or fail.
  • Auth: UAPI adapter refresh only.
  • Outage: degrade + multi-provider future.
  • Exposure: artifact-only; no persistent provider state.
  • Abuse (Colab FAQ): notebook/Drive design only.

Naming & Ownership

Lane: cloud.colab.gpu.burst. Broker: uapi-cloud-gpu-broker (UAPI-owned). Placement/contracts/artifacts UAPI/Explorer. No provider names in decisions.

Evidence / Next

Pre-use: synthetic [REDACTED:high-entropy]. Codex contract + adapter. Operator gate. Promote with priors. Blockers: no config; absent contracts; ephemerality; NUC/SN850X separate.

Report: ALIVE: true | Artifact: [REDACTED:high-entropy].md | [REDACTED:high-entropy] notes. UAPI names, no code. Local only, cited adjacent patterns. Handoff: Codex + evidence. COMPLETE. End.