Guided learning path

Agentic Systems Engineer

Engineer bounded tool-using systems with explicit workflows state protocols evaluation observability security and human control.

29h estimated27 concepts
public
A connected AI engineering path moving through knowledge, labs, decisions, mastery gates, and production deployment.
0 of 31 evidence gates passed0%
Message Roles and Instruction Priority

How instruction sources and ordered messages establish conversational control context.

0%
not started
Prompt Structure

How clear goals constraints context examples and output contracts guide model behavior.

0%
not started
Structured Outputs

How schemas convert probabilistic text generation into validated application contracts.

0%
not started
Tool Calling

How models propose typed actions while applications retain execution authority and validation.

0%
not started
Context Engineering

How systems select assemble order compress and isolate information for each model call.

0%
not started
State and Memory

How applications persist working state history summaries facts and user-controlled records.

0%
not started
Workflow Orchestration

How explicit state transitions coordinate repeatable AI and software work.

0%
not started

Milestone: Agent building blocks

Establish tool context state and workflow contracts before autonomy.

Context and Tool Protocols

How standardized discovery invocation and data exchange connect model systems.

0%
not started
Agent Control Loop

How bounded observe decide act and verify cycles produce controlled autonomy.

0%
not started
Human Approval Boundaries

How consequence and reversibility determine when human authorization is mandatory.

0%
not started
AI Feedback and Correction

How interfaces expose progress uncertainty evidence and correction controls.

0%
not started
Rendering Tool Call Execution States

Designing UI states for tool callbacks: loading skeletons, success parameters, and execution progress bars.

0%
not started

Milestone: Bounded autonomy

Connect control loops protocols approvals and visible execution state.

LLM Evaluation

How task definitions datasets metrics rubrics judges and experiments measure system quality.

0%
not started
AI System Testing

How to combine deterministic software tests model evaluations adversarial checks and monitored production evidence.

0%
not started
AI Tracing

How correlated model retrieval tool and application spans expose system behavior.

0%
not started
Security and Privacy for LLM Systems

How untrusted inputs sensitive data tools and external knowledge expand the threat model.

0%
not started
Safety Evaluation and Response

How adversarial tests policy checks monitoring and response control harmful behavior.

0%
not started
AI Risk Governance

How ownership classification documentation and review control lifecycle risk.

0%
not started

Milestone: Trustworthy operation

Test trace secure and govern the complete agent control path.

Agent Evaluation

Evaluate agent trajectories, actions, outcomes, and policy compliance rather than judging only the final response.

0%
not started
Agent Failure Recovery

Design retries, compensation, escalation, and safe termination around typed agent failure states.

0%
not started
Agent State Checkpointing

Persist resumable agent state with explicit versions, side-effect boundaries, and replay semantics.

0%
not started
Agent Execution Budgets and Termination

Bound agent time, tokens, tools, cost, risk, and loop depth with explicit stop reasons.

0%
not started
Agent Action Verification

Verify intended and actual effects independently before an agent can declare success.

0%
not started
Tool Authorization

Authorize each proposed tool action against identity, scope, resource, parameters, and consequence at execution time.

0%
not started
Delegated Credentials for AI Tools

Use short-lived, audience-bound, least-privilege credentials without exposing secrets to model context.

0%
not started
Tool Sandboxing and Egress Control

Constrain tool execution with filesystem, process, network, resource, and data-exfiltration boundaries.

0%
not started
Tool Input and Output Validation

Validate typed tool arguments before execution and treat tool output as untrusted data afterward.

0%
not started

Milestone: Applied evidence

Demonstrate the path through current assessments, lab attempts, and project evidence.

Path outcomes

  • Choose between deterministic workflows and autonomous loops
  • Design typed tools bounded state stopping conditions and approvals
  • Evaluate multi-step outcomes traces and safety failure modes

Connected reference architectures