AI Concept Atlas
FIELD NOTES / 01
Side by side

Agent Harness & Agent Runtime

The harness runs the agent loop around a model; the runtime executes that work durably in production, keeping sessions alive across failures, restarts, and long-running tasks.

Neither term has a canonical definition; check each author’s scope before comparing products.

OpenAI’s Agents API ships both layers in one product, which is why the terms are frequently conflated.

Credal’s analysis is vendor content; its layer split matches independent documentation but serves its product narrative.

Swap columns ⇄
DimensionAgent HarnessAgent Runtime
PurposeRuns the agent loop: assembles context, routes tool requests, and coordinates subagents.Executes agent work reliably: sessions, checkpointing, recovery, and isolation for long-running tasks. [LangChain][Credal]
Role in the systemApplication layer, typically owned by the team building the agent.Infrastructure layer, typically owned by a platform team; hosted options are provider-managed. [Credal][OpenAI]
Inputs and outputsTakes model responses and tool results; dispatches prompts and tool calls.Receives dispatched actions; runs them in isolated environments and returns results, telemetry, and audit logs. [Credal]
PersistenceManages conversation context inside a session, including compaction and summarization.Persists state across restarts, deploys, and failures so interrupted runs can resume. [OpenAI][Credal]
ExampleOpenAI hosts and maintains the Codex harness: compaction, tool search, and subagent coordination.The same API pairs that harness with managed sandboxes and durable sessions that run for hours or days. [OpenAI]
Boundary caveatsVendors bundle both layers: OpenAI describes its bundle as harness and infrastructure and never uses the word runtime.Scopes differ by author: LangChain treats LangGraph as a runtime, while Credal separates the layers and attributes subagent spawning to the harness. [OpenAI][LangChain][Credal]

Evidence for this distinction

Last editorial review: 2026-09-18.