From model to agent
Explain how a model run becomes part of a tool-using agent.
For newcomers to ai applications
Explore path From model to agent →Preparing the atlas… The full connection list is available below.
Explore how 40 evolving concepts connect, overlap, and diverge.
Showing 39 primary branches. Select a concept to reveal its cross-connections.
This distinction concerns who directs the process: model decisions or primarily prescribed code.
[Anthropic]Agent Harness contrasts with Evaluation Harness
An agent harness runs working interactions; an evaluation harness organizes tests and scoring.
[Anthropic][EleutherAI]Agent Skill uses Tool
A skill can instruct an agent in using available tools; the tools still execute operations.
[Agent Skills][Anthropic]Benchmark part of Evaluation
A benchmark can supply a defined task set for an evaluation.
[Hendrycks et al.]Computer Use uses Multimodal Model
The cited computer-use pattern interprets screenshots alongside text instructions.
[Anthropic]Computer Use uses Tool Calling
A screenshot-based computer-use loop requests interface actions through tools.
[Anthropic]Context Engineering uses Context Window
Context engineering selects information within the available context capacity.
[Anthropic]Context Engineering uses Memory
Context management can select retained notes for a later model interaction.
[Anthropic]Context Engineering uses Retrieval
Selecting external material through retrieval is one way to prepare useful context.
[Anthropic]Context Window contrasts with Memory
Retained information is distinct from the information supplied in the current context.
[LangChain]Context Window uses Token
Context capacity is measured in tokens.
[Anthropic]Delegation contrasts with Handoff
Delegation can return a subtask result; a handoff transfers control to another agent or stage.
[Hugging Face][LangChain]Delegation part of Orchestration
Assigning worker tasks is one responsibility within multi-agent coordination.
[Hugging Face]Delegation uses Sub-agent
A coordinator can assign a bounded task to a sub-agent.
[Hugging Face]Evaluation contrasts with Reward
Evaluation measures behavior against criteria; a training reward supplies an optimization signal.
[Anthropic][Hugging Face]Evaluation Harness enables Evaluation
The harness runs tasks and collects evaluation results.
[EleutherAI]Evaluation Harness uses Benchmark
A harness can run benchmark tasks using shared scoring conventions.
[EleutherAI]Evaluation Harness uses Inference
Testing a language model requires running it on the evaluation inputs.
[EleutherAI]Evaluation uses Trace
Execution records can help inspect an agent evaluation trial.
[Anthropic]Fine-tuning contrasts with Inference
Fine-tuning updates trainable parameters; inference runs the model on input.
[Hugging Face][Hugging Face]Fine-tuning contrasts with RAG
Fine-tuning adapts parameters; RAG supplies retrieved evidence for generation. They can be combined.
[Hugging Face][Lewis et al.]Fine-tuning uses Language Model
Language-model fine-tuning starts with an existing model and continues training.
[Hugging Face]An agent application can include checks around its inputs, outputs, or actions.
[LangChain]Handoff part of Orchestration
Transferring control between specialists is one coordination pattern.
[LangChain]Human-in-the-loop part of Agent
An agent workflow can pause selected actions for a human decision.
[LangChain]Human-in-the-loop part of Workflow
A workflow can pause a selected step until a person approves or edits it.
[LangChain]Inference uses Language Model
Inference runs a trained language model on supplied input.
[Hugging Face]Least Privilege part of Sandbox
Restricting a sandbox to necessary access applies least privilege to its permissions.
[NIST][Anthropic]Least Privilege part of Tool
Tool permission design can grant only the operations needed for an assigned task.
[NIST]LLM-as-a-Judge part of Evaluation
A model judge can supply judgments within a broader evaluation.
[Zheng et al.]LLM-as-a-Judge uses Language Model
The judge is a language model prompted to assess outputs against criteria.
[Zheng et al.]An application can retrieve saved information when it needs to recall it.
[LangChain]Mixture of Experts contrasts with Sub-agent
An MoE expert is an internal network; a sub-agent is an application-level worker.
[Hugging Face][LangChain]Mixture of Experts uses Token
A sparse language-model MoE routes tokens to selected internal experts.
[Hugging Face]Model Context Protocol enables Tool Calling
MCP can provide the integration through which an application discovers and calls tools.
[Model Context Protocol]Model Context Protocol enables Tool
MCP servers can expose tools to compatible AI applications.
[Model Context Protocol]Multimodal Model uses Language Model
In the cited LLaVA design, a vision encoder connects to a language model.
[Liu et al.]Orchestration uses Sub-agent
A manager-style orchestration can route tasks to specialist sub-agents.
[Hugging Face]Planning enables Delegation
A coordinator can use a plan to identify bounded tasks for workers.
[Hugging Face][Hugging Face]An agent may plan intended steps and revise that plan during its run.
[Hugging Face]Prompt Injection uses Retrieval
Retrieved documents can carry indirect instructions that attempt to redirect a model.
[OWASP]Prompt Injection uses Tool
An indirect injection may use a tool’s returned content as its delivery channel.
[OWASP]RAG uses Language Model
A generative model uses retrieved material to inform its output.
[Lewis et al.]Retrieval supplies external evidence to the generation process.
[Lewis et al.]Reinforcement Learning uses Reward
The learning objective is expressed through rewards received from interaction.
[Hugging Face]Reinforcement Learning uses Rollout
Sampled trajectories provide interaction experience for reinforcement learning.
[OpenAI]Agent uses Language Model
The model helps the agent choose its next action.
[Anthropic]Agent Harness part of Agent
In this example, the harness runs the agent’s model and tool interactions.
[Anthropic]Agent Harness uses Language Model
The harness invokes the model during execution.
[Anthropic]Agent Harness uses Tool
The harness dispatches requested tool operations.
[Anthropic]Agent Loop part of Agent Harness
The repeating interaction is implemented by the harness in this scoped example.
[Anthropic]Agent Harness often confused with Scaffold
Some authors distinguish execution from configuration; others use overlapping boundaries.
[Hugging Face]Tool Calling uses Tool
A structured request identifies an exposed tool operation.
[Anthropic]Agent uses Tool Calling
This tool-using agent requests actions and observes their results.
[Anthropic]Agent Skill often confused with Tool
A skill packages task guidance and resources; a tool exposes an operation.
[Agent Skills]For a language-model policy, sampling a rollout includes model inference steps.
[OpenAI][Hugging Face]An execution boundary lets an agent run tools within restricted access.
[Anthropic]A sub-agent is an agent operating as a worker within a larger system.
[LangChain]Supervised Fine-tuning is a Fine-tuning
Supervised fine-tuning is fine-tuning with training targets such as desired responses.
[Hugging Face]Workflow uses Language Model
A prescribed workflow can use a language model for individual steps.
[Anthropic]An agent is a system that uses a model to choose actions toward a goal, then responds to what happens. How much freedom it has depends on the application.
An agent harness runs interactions between a model and its tools. It supplies context, routes action requests, returns results, and manages when execution continues or stops.
An agent loop repeats a cycle of model decisions, actions, and feedback until a stopping condition is met. It lets the system adapt its next step to the result of an earlier action.
An Agent Skill packages instructions and optional resources for a recurring task. A compatible agent can discover it, load its instructions when needed, and use the included resources.
A benchmark is a defined set of tasks and scoring conventions used to compare performance. An AI benchmark measures selected capabilities under its particular test conditions.
Computer use lets an AI system interact with software through a graphical interface. A common implementation uses screenshots for observation and tool actions such as clicks, typing, and scrolling.
Context engineering is the practice of selecting, organizing, and maintaining the information a model receives while it works. It includes instructions, tool descriptions, retrieved material, and conversation state.
A context window is the token capacity available for a model’s current interaction. It limits how much supplied information and generated content can fit in that interaction, according to the model and service’s accounting rules.
Delegation assigns a task or responsibility to another worker. In an agent system, a coordinating agent can give a specialist a bounded job and use the returned result.
Evaluation is checking an AI system against defined tasks and success criteria. An evaluation may score an answer, inspect actions, or test whether the resulting environment matches the intended outcome.
An evaluation harness is software that runs evaluation tasks against models or systems and collects results. It connects task definitions, model execution, and scoring into a repeatable testing process.
Fine-tuning continues training from an existing model to adapt it to data, a task, or a domain. It changes trainable parameters, rather than only changing the input supplied for one request.
A guardrail is a check or control applied around an AI system’s inputs, outputs, or actions. It can block, transform, or route behavior according to a rule or a model-based assessment.
A handoff transfers control from one agent or stage to another. In a conversational system, it can change which specialist is responsible for handling the next interaction.
Human-in-the-loop introduces a person’s decision into an automated process. In an agent workflow, execution can pause at a review point so a person can approve, change, or reject a proposed action.
Inference is using an already trained model to produce an output from an input. For a text-generating language model, this usually means processing a prompt and generating tokens in sequence.
A language model learns patterns in language and uses supplied context to produce a response. In an agent application, it can propose the next action; surrounding software carries out that action.
Least privilege means giving an entity only the access and authority it needs for its assigned task. For an agent application, this can limit the tools, data, or operations available to it.
LLM-as-a-judge uses a language model to assess outputs against instructions or a rubric. It can produce scores, comparisons, or written judgments to support evaluation.
In agent applications, memory is retained information that can be reused later. It can include conversation state within a session or information saved across sessions, depending on the application.
A mixture-of-experts model uses multiple internal expert networks and a routing mechanism. In a sparse language-model implementation, the router sends each token through only a subset of those experts.
Model Context Protocol is a standard for connecting AI applications to external capabilities and information. It defines how compatible clients and servers exchange access to features such as tools, resources, and prompts.
A multimodal model works with more than one kind of information, such as images and text. Which combinations it accepts or produces depend on the particular model.
Orchestration coordinates the order, routing, and results of work across components. In a multi-agent system, it can determine which agent receives a task and how returned results are combined.
Planning organizes intended steps toward a goal before or during execution. An agent may create a plan, use it to guide actions, and revise it as new information arrives.
Prompt injection is an attempt to redirect an AI system through instructions embedded in input or external material. The system may treat that material as authoritative instructions instead of data to process.
Retrieval-augmented generation combines a generative model with retrieved external information. The retrieved material helps inform the response instead of relying only on information encoded in the model’s parameters.
Reinforcement learning trains an agent’s behavior using reward signals from interaction. The objective concerns expected cumulative reward, so an action’s value can depend on consequences that occur later.
Retrieval is finding relevant information from an external collection in response to a query. Its output can be documents or passages that an application supplies to a model.
A reward is a feedback signal used to guide learning or assess outcomes against an objective. In language-model training, a learned reward model can assign scores based on preference examples.
In reinforcement learning, a rollout is a sampled sequence of interaction: observations or states, actions, and resulting rewards. It provides experience for analysis or learning.
A sandbox is an execution environment that restricts what running code can access or change. For an agent’s tools, boundaries can include allowed files, directories, and network destinations.
Scaffold can describe the instructions, tool descriptions, and context setup that shape a model’s behavior. Some authors use the word for more of the surrounding agent software.
A sub-agent is an agent assigned a bounded role within a larger agent system. In a supervisor pattern, it receives work from a coordinating agent and returns a result.
Supervised fine-tuning adapts a pretrained model using examples of desired behavior. For language models, training can teach the model to produce target responses or continue supplied text.
A token is a unit that a tokenizer turns into an identifier for a model to process. In text models it may represent a word, part of a word, punctuation, or another text fragment.
A tool is an operation an AI application exposes for the model to request, such as searching documents or looking up a record. Its interface defines the information needed to use it.
Tool calling lets a model request an operation through a structured interface. The application executes the request and makes the result available to the model.
A trace records the operations involved in an execution so their sequence and relationships can be inspected. In distributed tracing, individual operations are represented as spans with timing and other recorded attributes.
In this Atlas, a workflow is an arrangement of steps whose control flow is primarily specified by application code. It may include language models, tools, branching, and repeated operations.
Follow a short path through the ideas, then put them to work in a scenario.
Explain how a model run becomes part of a tool-using agent.
For newcomers to ai applications
Explore path From model to agent →Separate testing, execution evidence, access boundaries, and human decisions.
For builders and reviewers of agent applications
Explore path Making an agent dependable →Distinguish current context, retrieved evidence, and retained memory.
For anyone designing prompts or knowledge assistants
Explore path What the model can see →Reviewed changes to the collection.
Project owner approved the current content for publication. Existing evidence scope and limitations remain applicable.
Project owner approved the current content for publication. Existing evidence scope and limitations remain applicable.
Project owner approved the current content for publication. Existing evidence scope and limitations remain applicable.