Guided learning path

RAG Engineer

Build evidence-carrying retrieval systems from ingestion and provenance through search reranking grounded generation and evaluation.

25h estimated21 concepts
public
A connected AI engineering path moving through knowledge, labs, decisions, mastery gates, and production deployment.
0 of 26 evidence gates passed0%
Tokens and Tokenization

How model inputs become discrete identifiers and why token boundaries affect cost and meaning.

0%
not started
Embeddings

How learned vectors encode useful similarity and support representation and retrieval.

0%
not started
Context Windows

How finite input and output budgets constrain attention state relevance and cost.

0%
not started
Context Engineering

How systems select assemble order compress and isolate information for each model call.

0%
not started
RAG versus Fine-Tuning

How knowledge access behavior adaptation and tool use solve different system problems.

0%
not started
Ingestion and Chunking

How parsing normalization segmentation metadata and updates create retrievable units.

0%
not started
Vector Search

How embeddings similarity indexes filters and recall tradeoffs retrieve semantic candidates.

0%
not started

Milestone: Representation and retrieval

Build the embedding chunk and candidate-retrieval mental model.

Hybrid Search and Reranking

How lexical semantic and learned ranking stages improve candidate precision and recall.

0%
not started
Knowledge Provenance

How origin ownership version and transformation metadata make knowledge auditable.

0%
not started
Grounded Generation and Citations

How answer synthesis constrains claims to evidence and preserves inspectable attribution.

0%
not started

Milestone: Evidence pipeline

Combine reranking provenance and grounded synthesis into an inspectable flow.

LLM Evaluation

How task definitions datasets metrics rubrics judges and experiments measure system quality.

0%
not started
Grounding and Hallucination

How unsupported claims arise and how evidence constraints and verification reduce them.

0%
not started
AI Tracing

How correlated model retrieval tool and application spans expose system behavior.

0%
not started
Security and Privacy for LLM Systems

How untrusted inputs sensitive data tools and external knowledge expand the threat model.

0%
not started
Cost Latency and Reliability

How budgets fallbacks retries routing and service targets balance operating outcomes.

0%
not started

Milestone: RAG operations

Evaluate trace secure and operate the retrieval system under real constraints.

Retrieval Evaluation

Measure whether retrieval finds sufficient, relevant, authorized, and fresh evidence before grading generation.

0%
not started
Index Lifecycle Operations

Operate ingestion, versioning, freshness, deletion, rebuild, rollback, and reconciliation as one index lifecycle.

0%
not started
Access-Aware Retrieval

Enforce tenant and document authorization before evidence enters ranking or model context.

0%
not started
Query Rewriting and Routing

Transform and route queries while preserving user intent, policy context, and evaluation traceability.

0%
not started
Multi-Tenant AI Data Isolation

Preserve tenant boundaries across retrieval, prompts, caches, tools, telemetry, evaluation, and support operations.

0%
not started
AI Retention, Deletion, and Audit

Make retention and deletion propagate through derived indexes, caches, traces, evaluations, and backups with auditable evidence.

0%
not started

Milestone: Applied evidence

Demonstrate the path through current assessments, lab attempts, and project evidence.

Path outcomes

  • Design corpus-specific ingestion retrieval and reranking experiments
  • Preserve provenance access controls and inspectable citations
  • Diagnose retrieval generation and grounding failures separately

Connected reference architectures