Learning discovery

Library

Search concepts, paths, labs, guides, and project tracks across the production AI stack.

601

artifacts

lesson

PostgreSQL MVCC & Tuple Visibility

Multi-Version Concurrency Control, tuple visibility horizon, transaction isolation levels, and VACUUM mechanics.

concept · lesson · current
lesson

Write-Ahead Logging (WAL) & Crash Recovery

Write-Ahead Logging architecture, LSN sequence numbers, checkpointing, and point-in-time recovery.

concept · lesson · current
lesson

B-Tree, BRIN, GIN & GiST Indexes

Comparative indexing strategies, B-Tree layout, BRIN range indexes for timeseries, and GIN inverted indexes.

concept · lesson · current
lesson

PgBouncer & Connection Pooling

Transaction vs session pooling, connection overhead, PgBouncer sidecars, and async pool sizing.

concept · lesson · current
lesson

Query Optimization & EXPLAIN ANALYZE

Cost-based query planner, EXPLAIN ANALYZE output reading, sequential scans vs index scans, and join strategies.

concept · lesson · current
lesson

Declarative Table Partitioning

Range, list, and hash table partitioning, partition pruning, and horizontal database sharding.

concept · lesson · current
lesson

Locking, Deadlocks & Advisory Locks

Table and row-level locks, deadlock detection graphs, PostgreSQL application advisory locks, and pessimistic concurrency.

concept · lesson · current
lesson

JSONB Storage & Expression Indexing

Binary JSON storage format, jsonb_path_ops GIN indexing, containment operators (@>), and expression indexes.

concept · lesson · current
lesson

Physical & Logical Replication

Streaming physical replication, logical WAL decoding, failover automation (Patroni/repmgr), and high availability.

concept · lesson · current
lesson

Full-Text Search with TSVector

Native text search engine, tsvector lexeme parsing, tsquery match operators, GIN indexes, and ranking algorithms.

concept · lesson · current
lesson

FastAPI + SQLAlchemy 2.0 Async Engine

AsyncEngine configuration, async_sessionmaker, AsyncSession lifecycle management, and AsyncPG driver integration.

concept · lesson · current
lesson

Schema Migrations with Alembic

Database revision histories, auto-generation DDL scripts, lock timeout safety, and zero-downtime migrations.

concept · lesson · current
lesson

Read/Write Split Engine & Routing

Multi-host database routing in FastAPI, session routing to primary for writes and replicas for reads.

concept · lesson · current
lesson

Redis Cache-Aside & Thundering Herd Defense

Cache-Aside pattern, TTL eviction, Redis distributed locking, and thundering herd stampede protection.

concept · lesson · current
lesson

Distributed Transactions & Saga Pattern

Two-Phase Commit (2PC) vs Saga pattern, compensating transactions, outbox pattern, and transactional messaging.

concept · lesson · current
lesson

FastAPI ASGI Server Internals

Uvicorn/Hypercorn event loop, worker process management, and socket multiplexing.

concept · lesson · current
lesson

WebSockets vs Server-Sent Events (SSE)

Duplex WebSocket framing, SSE streaming HTTP responses, and long-polling state machines.

concept · lesson · current
lesson

Rate Limiting & Thundering Herd Defense

Token Bucket, Leaky Bucket, and Redis sliding-window rate limiting algorithms.

concept · lesson · current
lesson

API Security & OAuth2 PKCE

OAuth2 PKCE authorization flows, JWT verification, and scope enforcement.

concept · lesson · current
lesson

CORS, CSP & Security Headers

Cross-Origin Resource Sharing (CORS), Content Security Policy (CSP), and browser security headers.

concept · lesson · current
lesson

Message Queues & Celery Task Pools

Celery asynchronous task distribution, Redis Streams, and background worker queues.

concept · lesson · current
lesson

Event-Driven RabbitMQ & Dead-Letter Queues

AMQP exchanges, message routing, consumer acknowledgments, and Dead-Letter Queues (DLQ).

concept · lesson · current
lesson

gRPC & HTTP/2 Streaming

Protocol Buffers schema compilation, HTTP/2 multiplexing, and bi-directional RPC streams.

concept · lesson · current
lesson

Reverse Proxies & Load Balancing

Nginx & Traefik TLS termination, keep-alive connections, and upstream load-balancing.

concept · lesson · current
lesson

GraphQL vs REST API Architecture

Schema stitching, N+1 query problem, DataLoader batching, and REST endpoint design.

concept · lesson · current
lesson

API Gateway Pattern & Circuit Breaking

Request routing, dynamic service discovery, rate limiting, and circuit breaker fault tolerance.

concept · lesson · current
lesson

HTTP/3 & QUIC Protocol

UDP-based QUIC transport, zero-RTT handshakes, and head-of-line blocking elimination.

concept · lesson · current
lesson

Webhook Delivery & HMAC Signatures

Asynchronous webhook delivery, exponential backoff retries, and HMAC SHA-256 signature verification.

concept · lesson · current
lesson

CDN Edge Caching & Invalidation

Edge Caching, Cache-Control headers (s-maxage, stale-while-revalidate), and instant purge invalidation.

concept · lesson · current
lesson

Real-Time Streaming Architecture

Comparative evaluation of WebSockets, gRPC-Web, and SSE for production streaming applications.

concept · lesson · current
lesson

Linux Process Lifecycle & IPC

fork(), execve(), Unix domain sockets, named pipes, and shared memory allocation.

concept · lesson · current
lesson

Virtual Memory & Paging Mechanics

Page tables, TLB cache hits, page faults (major/minor), and mmap() memory mapping.

concept · lesson · current
lesson

Linux I/O Multiplexing & epoll

select(), poll(), epoll() event loops, edge-triggered vs level-triggered notifications, and non-blocking file descriptors.

concept · lesson · current
lesson

Linux Control Groups & Namespaces

cgroups v2 resource controllers, Linux namespaces (pid, net, mnt), and container runtime isolation.

concept · lesson · current
lesson

eBPF Kernel Tracing & Observability

eBPF bytecode, perf events, kprobes, and low-overhead kernel profiling.

concept · lesson · current
lesson

Linux File Systems & Inodes

ext4 file system layout, inodes, directory entries, hard/soft links, and buffer page cache.

concept · lesson · current
lesson

CPU Cache Alignment & NUMA Nodes

L1/L2/L3 cache lines, false sharing, cache coherency protocols, and NUMA memory affinity.

concept · lesson · current
lesson

Linux Signals & Signal Handlers

Asynchronous signal delivery, signal masks, reentrant handlers, sigaction(), and graceful process termination.

concept · lesson · current
lesson

System Calls & Context Switches

User-to-kernel mode transitions, syscall instruction, vDSO acceleration, and CPU register saving.

concept · lesson · current
lesson

Linux Swap Subsystem & OOM Killer

Page swappiness, Out-Of-Memory (OOM) killer scoring (oom_score), and memory pressure cgroups.

concept · lesson · current
lesson

NVMe Storage & I/O Schedulers

Block I/O layer, storage schedulers (none, mq-deadline, kyber), direct I/O (O_DIRECT), and NVMe queues.

concept · lesson · current
lesson

Linux TCP/IP Stack & Socket Buffers

Socket buffers (sk_buff), TCP SYN cookies, ring buffers, and TCP congestion control (BBR/CUBIC).

concept · lesson · current
lesson

Threads & Futex Synchronization

POSIX threads (pthreads), clone() syscall flags, and Fast Userspace Mutexes (futex).

concept · lesson · current
lesson

Performance Profiling & Flamegraphs

CPU flamegraphs, off-CPU profiling, stack sampling, and bottleneck identification.

concept · lesson · current
lesson

Linux Capabilities & Seccomp Hardening

Linux POSIX capabilities (CAP_SYS_ADMIN), seccomp syscall filtering, and AppArmor profiles.

concept · lesson · current
lesson

Raft Consensus Protocol

Leader election, log replication, safety invariants, and split-brain resolution in distributed consensus.

concept · lesson · current
lesson

CAP Theorem & PACELC Trade-offs

Consistency, Availability, Partition Tolerance (CAP), and Latency vs Consistency (PACELC) trade-offs.

concept · lesson · current
lesson

Consistent Hashing & Virtual Nodes

Hash ring partitioning, virtual node rebalancing, and minimal key movement during cluster scaling.

concept · lesson · current
lesson

Distributed Locking & Redlock

Redis Redlock algorithm, etcd/ZooKeeper lease locks, and clock drift vulnerabilities.

concept · lesson · current
lesson

Vector Clocks & Logical Timestamps

Lamport timestamps, vector clocks, causal ordering, and concurrent conflict resolution.

concept · lesson · current
lesson

Gossip Protocol & Membership Discovery

SWIM protocol, anti-entropy state synchronization, failure detectors, and peer discovery.

concept · lesson · current
lesson

Two-Phase Commit (2PC) Protocols

Prepare and Commit phases, transaction coordinator failures, and blocking lock trade-offs.

concept · lesson · current
lesson

Distributed Tracing & OpenTelemetry

W3C traceparent context propagation, span hierarchies, and trace sampling strategies.

concept · lesson · current
lesson

Eventual Consistency & CRDTs

Conflict-free Replicated Data Types (State-based vs Operation-based CRDTs), LWW-Element-Set, and PN-Counters.

concept · lesson · current
lesson

Leader Election & Fencing Tokens

Lease-based leader election, split-brain isolation, and monotonic fencing tokens.

concept · lesson · current
lesson

WAL Streaming & Replication Slots

Physical vs logical WAL streaming, replication lag, and replication slots.

concept · lesson · current
lesson

Idempotency & Deduplication Keys

Idempotency keys, atomic request deduplication, and exactly-once processing semantics.

concept · lesson · current
lesson

Distributed Deadlock Detection

Wait-for graphs, edge chasing algorithms, and timeout-based deadlock resolution.

concept · lesson · current
lesson

Service Mesh Architecture & mTLS

Sidecar proxy pattern (Envoy), mutual TLS (mTLS) identity certification, and traffic splitting.

concept · lesson · current
lesson

Chaos Engineering & Fault Injection

Controlled failure testing, latency injection, packet loss, and pod termination.

concept · lesson · current
lesson

Kubernetes Control Plane Internals

API Server, etcd storage, Controller Manager reconciliation loops, and Kube-Scheduler mechanics.

concept · lesson · current
lesson

Kubernetes Pod Lifecycle & Probes

Pod phase transitions, startup/liveness/readiness probes, and preStop hooks for graceful shutdown.

concept · lesson · current
lesson

K8s Ingress & Gateway API

Ingress Controllers, Gateway API resource models (GatewayClass, Gateway, HTTPRoute), and TLS termination.

concept · lesson · current
lesson

K8s CRDs & Operator Pattern

Custom Resource Definitions (CRDs), Controller reconciliation loops, and automated operational knowledge.

concept · lesson · current
lesson

Helm Charts & Release Management

Helm chart templating, values file overrides, atomic rollbacks, and release versioning.

concept · lesson · current
lesson

Terraform / OpenTofu Infrastructure as Code

Declarative HCL syntax, state locking, plan execution, and reusable module architecture.

concept · lesson · current
lesson

Docker Multi-Stage & Distroless Images

Multi-stage build optimization, distroless base images, and minimizing container attack surfaces.

concept · lesson · current
lesson

GitHub Actions CI/CD & OIDC Authentication

Matrix build optimization, runner caching, OpenID Connect (OIDC) cloud authentication, and deployment protection gates.

concept · lesson · current
lesson

Zero-Downtime Blue/Green & Canary Deployments

Blue/Green environment swapping, Canary traffic splitting, and automated metric rollback gates.

concept · lesson · current
lesson

K8s Network Policies & Microsegmentation

Ingress and Egress NetworkPolicies, pod label selectors, and Calico CNI firewalling.

concept · lesson · current
lesson

K8s StatefulSets & Persistent Storage

StatefulSet ordinal indexing, PersistentVolumeClaims (PVC), StorageClasses, and dynamic volume provisioning.

concept · lesson · current
lesson

K8s Autoscaling (HPA & KEDA)

Horizontal Pod Autoscaler (HPA) CPU/memory scaling and KEDA event-driven autoscaling (queue depth/PromQL).

concept · lesson · current
lesson

GitOps & Declarative Delivery (ArgoCD)

GitOps core principles, ArgoCD / Flux synchronization controllers, and drift detection.

concept · lesson · current
lesson

Container Image Signing & SBOM Security

Software Bill of Materials (SBOM) generation (Syft/Trivy), Sigstore Cosign image signing, and Kyverno admission verification.

concept · lesson · current
lesson

Cloud IAM & Kubernetes RBAC Hardening

K8s Role/ClusterRole bindings, ServiceAccount token projection, and cloud IAM least-privilege policies.

concept · lesson · current
lesson

Vector Indexing (HNSW & IVF-Flat)

High-dimensional vector indexing, HNSW graph structures, IVF-Flat inverted files, and pgvector tuning.

concept · lesson · current
lesson

RAG Architecture & Hybrid Search

Retrieval-Augmented Generation pipelines, dense vector + BM25 sparse hybrid search, and Cross-Encoder re-ranking.

concept · lesson · current
lesson

LLM Context Window Management

Token budgeting, sliding-window context buffers, rolling conversation summaries, and KV cache allocation.

concept · lesson · current
lesson

Agentic Tool Use & Function Calling

OpenAPI JSON schema tool definitions, LLM tool execution loops, and Pydantic response validation.

concept · lesson · current
lesson

ReAct & Multi-Agent Planning Loops

Thought-Action-Observation loops, hierarchical multi-agent delegation, and task decomposition.

concept · lesson · current
lesson

LLM Guardrails & Prompt Injection Defense

Direct and indirect prompt injection mitigation, input sanitization, PII redaction, and output safety filters.

concept · lesson · current
lesson

Semantic Caching & Vector Similarity

Vector similarity caching, cosine distance thresholds, Redis vector stores, and sub-10ms LLM response serving.

concept · lesson · current
lesson

LLM Evaluation & RAGAS Evals

RAGAS metrics (Faithfulness, Answer Relevance, Context Recall), LLM-as-a-Judge, and synthetic test sets.

concept · lesson · current
lesson

Streaming Function Arguments & SSE

Partial JSON parsing, streaming tool call tokens via SSE, and progressive UI state rendering.

concept · lesson · current
lesson

Agent Memory & Graph Persistence

Episodic vs semantic agent memory, knowledge graph persistence, and memory retrieval scoring.

concept · lesson · current
lesson

Local LLM Inference & PagedAttention

PagedAttention virtual memory allocation, GGUF quantization, and vLLM continuous batching.

concept · lesson · current
lesson

Speculative Decoding & Draft Models

Speculative execution, small draft model generation, and target model verification loops.

concept · lesson · current
lesson

PEFT & LoRA Model Fine-Tuning

Parameter-Efficient Fine-Tuning (PEFT), Low-Rank Adaptation (LoRA) matrix decomposition, and dataset formatting.

concept · lesson · current
lesson

Multi-Modal Embeddings & Document Parsing

Cross-modal vision/text embeddings (CLIP/SigLIP), layout-aware PDF document parsing, and chunking.

concept · lesson · current
lesson

Agent Governance & Human-in-the-Loop

Human-in-the-loop (HITL) approval gates, tool execution permission scopes, and tamper-evident audit logging.

concept · lesson · current
lesson

Apache Kafka Storage & Zero-Copy

Commit log partitions, segment file indexing, zero-copy socket transfers (sendfile), and consumer group rebalancing.

concept · lesson · current
lesson

Event-Driven Stream Processing & Flink

Watermarks, event-time vs processing-time windowing, and exactly-once processing.

concept · lesson · current
lesson

Data Lakehouse Storage (Iceberg / Delta)

ACID transactions on object storage, hidden partitioning, and time-travel queries.

concept · lesson · current
lesson

Columnar Databases (ClickHouse / DuckDB)

Vectorized query execution, MergeTree engines, primary key sparse indexes, and dictionary compression.

concept · lesson · current
lesson

Change Data Capture (CDC) & Debezium

Transaction log mining, outbox patterns, and real-time database-to-warehouse replication.

concept · lesson · current
lesson

Data Quality & Contract Assertion

Schema validation, data anomaly detection, and automated pipeline assertion gates.

concept · lesson · current
lesson

Distributed Processing & Spark Catalyst

RDDs, DataFrames, Catalyst query optimizer, and shuffle join strategies.

concept · lesson · current
lesson

Real-Time OLAP Indexing (Pinot / StarRocks)

Inverted indexes, Star-Tree pre-aggregations, and sub-second analytical queries.

concept · lesson · current
lesson

Data Pipeline Orchestration (Airflow / Dagster)

DAG dependency graphs, asset-based orchestration, and backfilling strategies.

concept · lesson · current
lesson

Data Serialization (Parquet / Avro / ORC)

Columnar vs row-based binary layout, dictionary encoding, and Snappy/ZSTD compression.

concept · lesson · current
lesson

Object Storage Architecture (S3 / MinIO)

Multipart uploads, prefix partitioning, eventual vs strong consistency, and lifecycle rules.

concept · lesson · current
lesson

Vector Data Pipelines & Batch Embedding

Distributed GPU batch embedding pipelines, chunking strategies, and upsert deduplication.

concept · lesson · current
lesson

Data Warehousing & SCD Type 2

Fact tables, dimension tables, slowly changing dimensions (SCD Type 2), and surrogate keys.

concept · lesson · current
lesson

Stream Join Algorithms & RocksDB

Interval joins, temporal table joins, and state backend memory management (RocksDB).

concept · lesson · current
lesson

Data Governance & Lineage (OpenLineage)

End-to-end data provenance tracing, column-level lineage, and compliance auditing.

concept · lesson · current
lesson

Distributed Cache Invalidation Strategies

Cache-Aside, Write-Through, Write-Behind strategies with Redis and Memcached.

concept · lesson · current
lesson

Data Anonymization & Differential Privacy

Masking, k-anonymity, hashing, and differential privacy noise injection.

concept · lesson · current
lesson

Graph Databases & Cypher Queries

Property graphs, index-free adjacency, recursive path traversal, and graph algorithms.

concept · lesson · current
lesson

MPP Query Engines (Trino / Presto)

Massively Parallel Processing query execution, stage scheduling, and memory spill management.

concept · lesson · current
lesson

Data Mesh & Federated Governance

Domain-driven data products, self-serve data infrastructure, and federated computational governance.

concept · lesson · current
lesson

OAuth2 PKCE & OIDC Security

Authorization code flow with PKCE, JWT signatures, and JWKS key rotation.

concept · lesson · current
lesson

Mutual TLS & SPIFFE/SPIRE Identity

Cryptographic workload identity, X.509 SVID issuance, and Envoy mTLS proxying.

concept · lesson · current
lesson

Zero Trust Network Architecture (ZTNA)

Perimeter-less security, continuous micro-segmentation, and identity-aware proxies.

concept · lesson · current
lesson

Web Application Firewall & ModSecurity

OWASP Top 10 rule enforcement, rate limiting, and SQLi/XSS inspection.

concept · lesson · current
lesson

Secrets Management & HashiCorp Vault

Dynamic secret generation, transit secret engines, and automated secret rotation.

concept · lesson · current
lesson

Container Vulnerability Scanning & SBOM

Trivy container scanning, Syft SBOM generation, and Sigstore Cosign signing.

concept · lesson · current
lesson

eBPF Security Auditing & Tetragon

Real-time Linux kernel syscall auditing, process execution tracing, and network security policies.

concept · lesson · current
lesson

Cloud IAM & Least Privilege RBAC

AWS/GCP IAM policy evaluation, role assumptions, and K8s ServiceAccount token projection.

concept · lesson · current
lesson

Cryptography & Public Key Infrastructure

RSA vs ECC, TLS 1.3 handshakes, CRLs, and OCSP stapling.

concept · lesson · current
lesson

HSM & KMS Envelope Encryption

Envelope encryption, KMS key hierarchy, and tamper-resistant key storage.

concept · lesson · current
lesson

Content Security Policy & CORS Hardening

Tight CSP directives, nonce generation, and strict origin validation.

concept · lesson · current
lesson

DDoS Mitigation & Rate Limiting

SYN flood protection, BGP anycast routing, and sliding-window rate limiters.

concept · lesson · current
lesson

SIEM Log Aggregation & Sigma Rules

Log aggregation, audit log streaming, Sigma rules, and automated incident triage.

concept · lesson · current
lesson

Database Encryption (TDE & Column-Level)

AES-256 block encryption, TDE (Transparent Data Encryption), and client-side column encryption.

concept · lesson · current
lesson

Supply Chain Security & SLSA Framework

Source provenance, deterministic builds, and SLSA Level 3 compliance verification.

concept · lesson · current
lesson

Intrusion Detection Systems (Suricata / Snort)

Deep packet inspection (Suricata/Snort), signature matching, and inline packet dropping.

concept · lesson · current
lesson

K8s Pod Security Standards & Kyverno

Privileged container restriction, ReadOnlyRootFilesystem, and Kyverno admission controls.

concept · lesson · current
lesson

Enterprise SSO & Identity (SAML / SCIM)

SAML 2.0 assertion verification, SCIM user provisioning, and enterprise SSO integration.

concept · lesson · current
lesson

Secure SDLC & STRIDE Threat Modeling

Threat modeling (STRIDE), SAST/DAST pipeline integration, and security gates.

concept · lesson · current
lesson

Security Auditing & CVSS Management

Red team simulation, CVE vulnerability scoring (CVSS v3/v4), and automated remediation.

concept · lesson · current
lesson

Transformer Attention & FlashAttention

QKV projections, scaled dot-product attention, causal masking, and IO-aware FlashAttention CUDA kernels.

concept · lesson · current
lesson

Backprop & Autograd Computational Graph

Computational graphs, forward/backward passes, PyTorch autograd tape, and gradient accumulation.

concept · lesson · current
lesson

Optimizers (AdamW / Lion) & Schedulers

Stochastic Gradient Descent with Momentum, AdamW weight decay decoupling, Lion, and cosine warmup schedulers.

concept · lesson · current
lesson

CNN ResNets & Vision Transformers

Spatial convolutions, residual skip connections, patch embeddings, and Vision Transformer (ViT) self-attention.

concept · lesson · current
lesson

Sequence Models (LSTM / GRU / Mamba)

Vanishing/exploding gradients, gated recurrent units, and selective state-space models (Mamba).

concept · lesson · current
lesson

Loss Functions & Regularization

Cross-Entropy, Focal Loss, Contrastive InfoNCE Loss, Dropout, Label Smoothing, and Weight Decay.

concept · lesson · current
lesson

Model Quantization (INT8 / AWQ / GPTQ)

Uniform post-training quantization, Activation-aware Weight Quantization (AWQ), and GPTQ matrix decomposition.

concept · lesson · current
lesson

GANs & Generative Diffusion Models

Generator-Discriminator minimax games, score-based generative models, and DDPM noise scheduling.

concept · lesson · current
lesson

RLHF & Direct Preference Optimization

Reward model training, PPO policy gradient updates, and Direct Preference Optimization (DPO).

concept · lesson · current
lesson

Mixture-of-Experts (MoE) & Router Gating

Sparse router gating, Top-2 expert routing, token drop load balancing, and expert capacity factors.

concept · lesson · current
lesson

Hyperparameter Tuning & Optuna Bayesian

Random search, Optuna TPE (Tree-structured Parzen Estimator), and hyperband pruning.

concept · lesson · current
lesson

Model Distillation & Teacher-Student

Soft target cross-entropy loss, feature map alignment, and compact student model training.

concept · lesson · current
lesson

Self-Supervised Learning (CLIP / SimCLR)

Data augmentation pipelines, InfoNCE contrastive loss, and joint vision-language text pre-training.

concept · lesson · current
lesson

Graph Neural Networks (GCN / GAT)

Message passing frameworks, node embeddings, Graph Convolutional Networks, and Graph Attention Networks.

concept · lesson · current
lesson

Time Series Forecasting & Deep State Space

Autoregressive ARMA models, Temporal Fusion Transformers, and N-BEATS neural forecasting.

concept · lesson · current
lesson

Model Observability & Drift Detection

Covariate shift, concept drift, Kolmogorov-Smirnov statistical tests, and Evidently AI drift metrics.

concept · lesson · current
lesson

Distributed Training (DDP / FSDP / ZeRO)

PyTorch DDP, Megatron-LM tensor slicing, DeepSpeed ZeRO memory stage 1/2/3, and pipeline bubble reduction.

concept · lesson · current
lesson

Neural Architecture Search & Supernets

Supernet weight sharing, DARTS differentiable architecture search, and latency-constrained Pareto frontiers.

concept · lesson · current
lesson

Explainable AI (SHAP & LIME Feature Attribution)

Feature importance attribution, Shapley additive explanations, and local interpretable model-agnostic explanations.

concept · lesson · current
lesson

Model Registry & Governance (MLflow)

Model artifact versioning, lineage tracking, staging/production promotion, and containerized serving wrappers.

concept · lesson · current
lesson

Vector Database Internals (Milvus / Qdrant)

Segment indexing, HNSW graph partitioning, scalar filtering, and inverted file payload storage.

concept · lesson · current
lesson

LLM Gateway & Fallback Routing

Fallback routing, load balancing, rate limiting, token budget management, and multi-provider failover.

concept · lesson · current
lesson

Prompt Management, Versioning & Evals

Git-based prompt versioning, templating engines, parameter validation, and prompt regression testing.

concept · lesson · current
lesson

LLM Observability & OpenTelemetry Tracing

OpenTelemetry span tracing for LLM pipelines, prompt/completion token tracking, latency histograms, and root cause debugging.

concept · lesson · current
lesson

Model Serving & Dynamic Batching (Triton)

Dynamic batching, multi-model ensemble pipelines, GPU memory sharing, and Model Control API.

concept · lesson · current
lesson

Feature Stores for Real-Time AI (Feast)

Online (Redis) vs offline (Parquet/Snowflake) feature storage, point-in-time joins, and feature retrieval APIs.

concept · lesson · current
lesson

Agent Workflow Orchestration (LangGraph)

Stateful multi-agent graphs, durable workflow execution, human-in-the-loop checkpointing, and replay capability.

concept · lesson · current
lesson

Synthetic Data Generation & Data Curation

LLM-generated instruction datasets, rejection sampling, deduplication, and quality filtering filters.

concept · lesson · current
lesson

Fine-Tuning Infrastructure & 4-bit QLoRA

Memory-efficient LLaMA/Mistral fine-tuning pipelines, 4-bit QLoRA, and gradient checkpointing.

concept · lesson · current
lesson

Guardrail Serving Engines (NeMo Guardrails)

Programmable rails (Colang), input/output validation engines, and execution flow blocking.

concept · lesson · current
lesson

Embedding Model Serving & Optimization (TEI)

Tokenizer streaming, dynamic batching, FlashAttention, and sub-5ms embedding serving.

concept · lesson · current
lesson

AI Infrastructure Cost Engineering & FinOps

GPU utilization tracking, spot instance autoscaling, token cost allocation, and model quantization cost trade-offs.

concept · lesson · current
lesson

Local Vector Search & Embedded Databases

Disk-based columnar vector format (Lance), embedded DuckDB queries, and zero-server vector search.

concept · lesson · current
lesson

Agentic Code Execution Sandboxes (E2B)

Isolated gRPC code sandboxes, container lifetime management, and security firewalls for LLM code execution.

concept · lesson · current
lesson

Knowledge Graph RAG (GraphRAG)

Entity-relation extraction, community detection (Leiden algorithm), hierarchical graph summarization, and query traversal.

concept · lesson · current
lesson

Continuous Fine-Tuning & Eval Pipelines

Automated eval triggers, CI/CD regression gates for fine-tuned models, and dataset drift retraining.

concept · lesson · current
lesson

GPU Cluster Scheduling & KubeRay

KubeRay operator, heterogeneous GPU cluster scheduling, Ray Core actors/tasks, and placement groups.

concept · lesson · current
lesson

Multimodal Model Serving & Vision Pipelines

Image/video frame preprocessing, Vision-Language Model (VLM) tokenization, and multi-modal request batching.

concept · lesson · current
lesson

Audio & Speech AI Pipelines (Whisper / TTS)

Mel-spectrogram processing, streaming speech-to-text (STT), and low-latency text-to-speech (TTS) synthesis.

concept · lesson · current
lesson

AI Safety Auditing & Red Teaming (Garak)

Automated prompt injection fuzzing, jailbreak vulnerability scanning, and red team audit reports.

concept · lesson · current
lesson

Tree & Graph of Thoughts (ToT / GoT)

Tree search algorithms, backtracking, and branching decision evaluation.

concept · lesson · current
lesson

Reflexion & Dynamic Self-Correction

Dynamic memory reflection, error message analysis, and self-improving agent execution.

concept · lesson · current
lesson

LLM Task Planning & Sub-Goal Decomposition

Hierarchical planning, task breakdown, and dependency ordering for autonomous agents.

concept · lesson · current
lesson

Multi-Agent Debate & Consensus Mechanics

Multi-model debate loops, peer review verification, and consensus convergence.

concept · lesson · current
lesson

Environment Simulation & Gymnasium

Simulated environment wrappers, state observations, action spaces, and step rewards.

concept · lesson · current
lesson

Soft Actor-Critic (SAC) & Continuous RL

Actor-critic policy gradient algorithms, entropy regularization, and continuous action spaces.

concept · lesson · current
lesson

Deep Q-Networks (DQN) & Dueling Variants

Q-learning function approximation, experience replay buffers, and target network stabilization.

concept · lesson · current
lesson

Model-Based RL & World Models (Dreamer)

Latent dynamics world models, imagination training, and sample-efficient policy learning.

concept · lesson · current
lesson

Offline RL & Conservative Q-Learning

Batch offline reinforcement learning, out-of-distribution action penalties, and dataset learning.

concept · lesson · current
lesson

Multi-Agent RL (MARL & QMIX)

Cooperative multi-agent coordination, value factorizations, and credit assignment.

concept · lesson · current
lesson

Agent Evaluation Benchmarks (WebArena / GAIA)

End-to-end web agent benchmarks, environment grounding, and success rate metrics.

concept · lesson · current
lesson

Tool Retrieval & Dynamic Tool Indexing

Vector-based tool indexing, dynamic tool schema retrieval, and large toolset pruning.

concept · lesson · current
lesson

Long-Context Memory Compression

Memory token pruning, compressive memory banks, and recurrent state propagation.

concept · lesson · current
lesson

Spatial Reasoning & Embodied Agent Control

3D spatial grounding, visual-spatial reasoning, and robotic/embodied agent action loops.

concept · lesson · current
lesson

Automated Workflow Generation (DAGs)

Natural language task-to-DAG pipeline synthesis, validation, and execution.

concept · lesson · current
lesson

Human-Agent Co-Pilot Interfaces

Interactive approval flows, steering intervention, and real-time human feedback ingestion.

concept · lesson · current
lesson

Safety Alignment in RL (Constrained MDP)

Safety-constrained Markov decision processes, cost functions, and barrier certificates.

concept · lesson · current
lesson

Multimodal Vision-Language-Action (VLA)

Vision-Language-Action models, multi-modal perception, and action token generation.

concept · lesson · current
lesson

Enterprise Multi-Agent Governance

Multi-agent permission boundaries, secret isolation, and tamper-evident audit logs.

concept · lesson · current
lesson

Autonomous Agent CI/CD Integration & Evals

Automated agent regression test suites, deterministic mock environments, and eval gates.

concept · lesson · current
lesson

Apple Metal & MPS Acceleration (MLX)

Unified memory zero-copy allocations, Metal Performance Shaders, and MLX lazy graphs.

concept · lesson · current
lesson

ONNX Runtime & Execution Providers

Open Neural Network Exchange graph optimization, CUDA/TensorRT/CoreML execution providers.

concept · lesson · current
lesson

TensorRT GPU Kernel Compilation

Engine serialization, FP16/INT8 precision calibration, and CUDA kernel fusion.

concept · lesson · current
lesson

WebGPU In-Browser Neural Execution

In-browser GPU matrix multiplication, WebGPU compute shaders, and Transformers.js pipelines.

concept · lesson · current
lesson

Android NNAPI & CoreML On-Device Execution

Android Neural Networks API, CoreML model compilation, and mobile NPU delegation.

concept · lesson · current
lesson

NPU Architecture & Hardware Accelerators

Neural Processing Unit architecture, systolic arrays, and fixed-point activation units.

concept · lesson · current
lesson

Mobile LLM Quantization (Sub-3GB RAM)

Extreme 2-bit/3-bit quantization, 3GB RAM constraints, and mobile KV cache limits.

concept · lesson · current
lesson

Speculative Streaming on Edge Devices

Small on-device draft models, speculative verification, and streaming token generation.

concept · lesson · current
lesson

Edge Vector Search (SQLite-VSS)

In-process C/C++ vector extension libraries, embedded SQLite vector search, and SIMD distance.

concept · lesson · current
lesson

Edge-Cloud Hybrid Model Offloading

Dynamic request routing between on-device local models and cloud scale LLM APIs.

concept · lesson · current
lesson

Battery & Power-Aware AI Inference

Power draw profiling, thermal throttling management, and energy-efficient inference batching.

concept · lesson · current
lesson

Zero-Copy Unified Memory Interop (UMA)

CPU/GPU shared memory pointers, zero-copy buffer sharing on Apple Silicon UMA.

concept · lesson · current
lesson

Micro-Controller AI (TinyML / TFLite)

Sub-1MB RAM micro-controller neural networks, INT8 quantization, and sensor inference.

concept · lesson · current
lesson

Dynamic KV Cache Eviction (StreamingLLM)

Attention sinks, rolling KV cache eviction, and infinite sequence processing.

concept · lesson · current
lesson

Hardware-Aware NAS for Edge Devices

Hardware latency profiling, device-specific NAS, and latency Pareto frontiers.

concept · lesson · current
lesson

Real-Time Audio STT/TTS on Embedded Hardware

Local low-latency audio processing, embedded Whisper C++, and neural TTS engines.

concept · lesson · current
lesson

Local Privacy-Preserving Embedding Pipelines

On-device vector embedding generation, zero-cloud data leakage, and local privacy guarantees.

concept · lesson · current
lesson

Edge Model Weight Encryption & Security

Cryptographic model weight encryption, secure enclave decryption, and anti-reverse engineering.

concept · lesson · current
lesson

OTA Model Weights Update & Delta Syncing

Over-the-air binary delta weight patching, background downloading, and atomic model updates.

concept · lesson · current
lesson

Embedded Vision & Edge Object Detection

YOLOv8/MobileNet model optimization, camera stream frame capture, and edge object tracking.

concept · lesson · current
lesson

Quantum Machine Learning (PennyLane / Qiskit)

Variational Quantum Eigensolvers (VQE), Parameterized Quantum Circuits (PQC), and quantum feature maps.

concept · lesson · current
lesson

Quantum Neural Networks & Quantum Attention

Quantum state vectors, qubit entanglement gates, and quantum dot-product attention.

concept · lesson · current
lesson

Neuromorphic SNNs & Lava Framework

Leaky Integrate-and-Fire (LIF) neurons, event-driven spike timing dependence, and Intel Loihi architectures.

concept · lesson · current
lesson

Thermodynamic & Analog In-Memory Computing

Resistive RAM (ReRAM), memristor crossbar arrays, and energy-efficient analog matrix-vector multiplication.

concept · lesson · current
lesson

Reversible Computing & Adiabatic Logic

Zero-dissipation reversible logic gates, Landauer's principle, and energy-recycling adiabatic clocking.

concept · lesson · current
lesson

DNA & Biomolecular Computing

DNA strand displacement, molecular logic gates, and parallel bio-chemical sequence matching.

concept · lesson · current
lesson

Photonic Neural Networks & Optical Computing

Mach-Zehnder interferometers, optical phase shifters, and light-speed photonic tensor processing.

concept · lesson · current
lesson

Physics-Informed Neural Networks (PINNs)

Differential equation residual loss terms, Hamiltonian/Lagrangian neural networks, and physical conservation laws.

concept · lesson · current
lesson

Liquid Neural Networks & Continuous ODEs

Liquid Time-Constant (LTC) networks, continuous-depth ODE solvers, and adaptive time-step dynamics.

concept · lesson · current
lesson

Hyperdimensional Computing (VSA)

High-dimensional binary hypervectors, binding/bundling operations, and one-shot associative memory.

concept · lesson · current
lesson

Neuro-Symbolic AI & Inductive Logic

Knowledge graph inductive logic programming, neuro-symbolic reasoning engines, and formal logic verification.

concept · lesson · current
lesson

Spiking Convolutional & Recurrent Networks

Event-based vision sensor processing (DVS cameras) and spike-based temporal sequence processing.

concept · lesson · current
lesson

Quantum Error Correction (Surface Codes)

Logical qubits, syndrome measurement, and fault-tolerant quantum machine learning execution.

concept · lesson · current
lesson

Quantum Annealing & D-Wave QUBO

QUBO formulations, Ising spin glass Hamiltonians, and quantum tunneling optimization.

concept · lesson · current
lesson

Neuromorphic Edge Vision & Perception

Event-driven neuromorphic vision processing, sub-milliwatt object detection, and asynchronous spike routing.

concept · lesson · current
lesson

Energy-Efficient Thermodynamic Samplers

Thermal noise energy harvesting, Boltzmann machine physical implementations, and thermodynamic MCMC sampling.

concept · lesson · current
lesson

Topological Quantum Computing & Anyons

Non-Abelian anyon braiding, topological qubit protection, and fault-tolerant quantum gates.

concept · lesson · current
lesson

Optical Vector-Matrix Multipliers

Spatial light modulators, Wavelength Division Multiplexing (WDM), and petascale optical compute engines.

concept · lesson · current
lesson

Neuro-Vector Knowledge Integration

Symbolic triple embedding, hyperdimensional knowledge representation, and neuro-symbolic theorem proving.

concept · lesson · current
lesson

Frontier Hardware Co-Design & Compilers

Heterogeneous quantum-classical compilers, LLVM dialect passes for spatial accelerators, and hardware co-design.

concept · lesson · current
lesson

CUDA Memory Hierarchy & Shared Banking

Global, shared, L1/L2 cache, register file, and warp tile memory bank conflicts.

concept · lesson · current
lesson

CUDA Warp Primitives & Shuffle Sync

Warp synchronization, __shfl_sync, warp-level reductions, and warp divergence.

concept · lesson · current
lesson

C++23 Concurrency & Lock-Free Structures

std::atomic, memory ordering semantics (acquire/release/seq_cst), lock-free queues, and ABA prevention.

concept · lesson · current
lesson

Rust Async Runtime & Tokio Internals

Tokio multi-threaded work-stealing scheduler, Future polling state machines, and Epoll/Kqueue event loops.

concept · lesson · current
lesson

Rust Unsafe Memory & FFI Interop

Raw pointers, bindgen, C ABI interoperability, and sound unsafe abstractions.

concept · lesson · current
lesson

SIMD Vectorization (AVX-512 & ARM NEON)

Vector registers, compiler auto-vectorization, intrinsics, and alignment guarantees.

concept · lesson · current
lesson

Zero-Copy I/O (mmap & io_uring)

Asynchronous Linux kernel io_uring submission/completion queues and direct disk I/O.

concept · lesson · current
lesson

Cache Coherency & False Sharing (MESI)

MESI protocol, cache line invalidation, alignment padding (alignas(64)), and cache-conscious algorithms.

concept · lesson · current
lesson

Linux NUMA Architecture & Thread Affinity

Non-Uniform Memory Access (NUMA) node allocation, numactl, and CPU core pinning (sched_setaffinity).

concept · lesson · current
lesson

Low-Latency HFT Order Book Engine

L1/L2/L3 order book data structures, lock-free ring buffers, and sub-microsecond matching.

concept · lesson · current
lesson

Custom Memory Allocators (jemalloc / mimalloc)

Thread-local allocation arenas, memory fragmentation reduction, and custom pool allocators.

concept · lesson · current
lesson

GPU Matrix Multiplication (GEMM / CUTLASS)

Tiled matrix multiplication, double buffering, Tensor Cores (MMA), and CUTLASS C++ templates.

concept · lesson · current
lesson

eBPF XDP Network Packet Processing

eBPF eXpress Data Path (XDP), sub-microsecond packet filtering, and kernel bypass networking.

concept · lesson · current
lesson

DPDK Kernel Bypass Networking

Userspace PMD (Poll Mode Drivers), zero-copy packet buffers (rte_mbuf), and 100GbE line-rate networking.

concept · lesson · current
lesson

Rust Ownership, Lifetimes & Zero-Cost

Borrow checker mechanics, lifetime elision, move semantics, and monomorphization compiler output.

concept · lesson · current
lesson

C++ Metaprogramming & Compile-Time Evaluation

Template metaprogramming, concepts (std::concept), and compile-time lookup tables.

concept · lesson · current
lesson

High-Performance RPC Engines (Cap'n Proto)

Binary serialization benchmarks, flatbuffer zero-copy parsing, and multiplexed HTTP/2 frames.

concept · lesson · current
lesson

GPU Virtual Memory Management (VMM)

CUDA Virtual Memory Management API, dynamic VRAM allocation, and physical page mapping.

concept · lesson · current
lesson

CPU Branch Prediction & Branchless Patterns

Branch Target Buffer (BTB), branch misprediction penalties, and branchless programming patterns.

concept · lesson · current
lesson

Distributed Shared Memory & RDMA (RoCE v2)

InfiniBand RDMA Read/Write verbs, RoCE v2, and zero-CPU network DMA transfers.

concept · lesson · current
lesson

LSM-Tree Leveled & Tiered Compaction

LSM-Tree Leveled vs Tiered Compaction strategies, write amplification, and SSTable merges.

concept · lesson · current
lesson

RocksDB Block Cache & SSTables

RocksDB Block Cache, SSTable index block layout, and write buffer management.

concept · lesson · current
lesson

CockroachDB Multi-Raft & Range Leasing

CockroachDB Multi-Raft Consensus, Range Leasing, and distributed SQL transactions.

concept · lesson · current
lesson

ClickHouse MergeTree & Sparse Indexing

ClickHouse MergeTree Engine, sparse primary indexes, and columnar compression.

concept · lesson · current
lesson

DuckDB Vectorized Execution & Columnar

DuckDB Vectorized Execution engine, in-memory columnar data blocks, and SIMD filters.

concept · lesson · current
lesson

Google Spanner TrueTime & Consistency

Google Spanner TrueTime API, atomic clock uncertainty bounds, and external consistency.

concept · lesson · current
lesson

Cassandra Consistent Hashing & Handoff

Cassandra Wide-Column Storage, Consistent Hashing ring, and Hinted Handoff.

concept · lesson · current
lesson

Redis Cluster Hash Slots & Sentinel

Redis Cluster 16384 Hash Slots, Sentinel quorum voting, and failover promotion.

concept · lesson · current
lesson

DynamoDB Single-Table Design & GSI

DynamoDB Single-Table Design patterns, partition keys, and Global Secondary Indexes.

concept · lesson · current
lesson

PostgreSQL Patroni HA & etcd Failover

PostgreSQL Patroni HA architecture, etcd leader election, and DCS failover.

concept · lesson · current
lesson

Distributed Transactions (2PC, 3PC & Saga)

Two-Phase Commit (2PC), Three-Phase Commit (3PC), and Saga compensating transactions.

concept · lesson · current
lesson

HNSW Graph Construction & Vector Search

Hierarchical Navigable Small World (HNSW) graph construction, M links, and efSearch tuning.

concept · lesson · current
lesson

IVF-PQ Vector Index & Quantization

Inverted File Index with Product Quantization (IVF-PQ), nlist centroids, and codebooks.

concept · lesson · current
lesson

Copy-on-Write B-Trees & LMDB

Copy-on-Write B-Tree pages, Lightning Memory-Mapped Database (LMDB) MVCC, and mmap.

concept · lesson · current
lesson

WAL Fuzzy Checkpointing & ARIES Recovery

Write-Ahead Logging (WAL) fuzzy checkpoints, ARIES recovery (Analysis, Redo, Undo).

concept · lesson · current
lesson

TLS 1.3 0-RTT Handshake & Resumption

TLS 1.3 1-RTT handshake, 0-RTT early data resumption, and replay protection.

concept · lesson · current
lesson

HTTP/3 QUIC & Head-of-Line Removal

HTTP/3 QUIC UDP transport, independent stream multiplexing, and loss recovery.

concept · lesson · current
lesson

gRPC HTTP/2 Stream Multiplexing

gRPC HTTP/2 binary frame multiplexing, WINDOW_UPDATE flow control, and streaming.

concept · lesson · current
lesson

Envoy Proxy xDS Dynamic Config

Envoy Proxy xDS dynamic API protocols (LDS, RDS, CDS, EDS), and hot restarting.

concept · lesson · current
lesson

Consistent Hash Ring Load Balancing

Maglev & Consistent Hash Ring algorithms, virtual nodes, and uniform distribution.

concept · lesson · current
lesson

CDN Edge Caching & Stale-While-Revalidate

CDN Edge Caching directives, Cache-Control headers, and stale-while-revalidate.

concept · lesson · current
lesson

Rate Limiting (Leaky Bucket & Sliding Window)

Token Bucket, Leaky Bucket, and Sliding Window Counter rate limiting algorithms.

concept · lesson · current
lesson

Web Security (CSP, CORS, CSRF & SameSite)

Content Security Policy (CSP), CORS headers, CSRF tokens, and SameSite cookie security.

concept · lesson · current
lesson

API Gateway & BFF Pattern

API Gateway routing, Backend-for-Frontend (BFF) aggregation, and protocol translation.

concept · lesson · current
lesson

Circuit Breaker State Machine & Bulkheads

Circuit Breaker finite state machine (Closed, Open, Half-Open) and Bulkheading.

concept · lesson · current
lesson

WebSocket Connection Pooling & Keepalive

WebSocket TCP upgrade handshakes, frame fragmentation, and ping/pong keepalives.

concept · lesson · current
lesson

Server-Sent Events (SSE) & HTTP Streaming

Server-Sent Events (SSE) text/event-stream format, auto-reconnect, and streaming.

concept · lesson · current
lesson

Service Mesh mTLS & Traffic Shifting

Service Mesh (Istio/Linkerd) Envoy sidecars, mTLS encryption, and canary shifting.

concept · lesson · current
lesson

Anycast DNS Routing & Geo-DNS

Anycast BGP routing, Geo-DNS latency resolution, and DNSSEC validation.

concept · lesson · current
lesson

NGINX Event-Driven Architecture & Epoll

NGINX master/worker process architecture, non-blocking epoll loop, and upstream pools.

concept · lesson · current
lesson

Kafka Cooperative Sticky Rebalancing

Kafka Consumer Group Partition Assignment, Eager vs Cooperative Sticky Rebalancing.

concept · lesson · current
lesson

Kafka Exactly-Once Semantics (EOS)

Kafka Producer Idempotence, Transaction Coordinator, and Exactly-Once (EOS) processing.

concept · lesson · current
lesson

Flink Chandy-Lamport Checkpointing

Apache Flink Asynchronous Barrier Snapshotting (ABS), Chandy-Lamport algorithm.

concept · lesson · current
lesson

Flink Watermarks & Event-Time Windows

Flink Event-Time processing, Watermark generation, and Tumbling/Sliding windows.

concept · lesson · current
lesson

Spark Tungsten & Off-Heap Memory

Apache Spark Project Tungsten, off-heap memory management, and Whole-Stage Code Generation.

concept · lesson · current
lesson

Spark Adaptive Query Execution (AQE)

Spark Adaptive Query Execution (AQE), dynamic shuffle partition coalescing, and skew join handling.

concept · lesson · current
lesson

Delta Lake ACID Log & Time Travel

Delta Lake JSON transaction log (_delta_log), optimistic concurrency, and Time Travel.

concept · lesson · current
lesson

Apache Iceberg Hidden Partitioning

Apache Iceberg table format, hidden partitioning, schema evolution, and manifest files.

concept · lesson · current
lesson

Parquet Dictionary & RLE Encoding

Apache Parquet columnar file format, Dictionary Encoding, and Run-Length Encoding (RLE).

concept · lesson · current
lesson

Apache Arrow In-Memory Columnar Format

Apache Arrow in-memory zero-copy layout, RecordBatches, and C Data Interface.

concept · lesson · current
lesson

Debezium CDC & Log Tailing

Debezium Change Data Capture (CDC), database WAL log tailing, and Kafka Connect.

concept · lesson · current
lesson

dbt SQL Transformations & Data Quality

dbt SQL modular transformations, DAG lineage generation, and automated data testing.

concept · lesson · current
lesson

Airflow Architecture & Celery/K8s Executors

Apache Airflow Scheduler DAG parsing, CeleryExecutor vs KubernetesExecutor, and task queuing.

concept · lesson · current
lesson

Data Mesh Architecture & Data Products

Data Mesh decentralized domain ownership, Data-as-a-Product, and federated governance.

concept · lesson · current
lesson

Feast Feature Store Online/Offline Sync

Feast Feature Store, low-latency online serving (Redis) vs offline training (Parquet/Snowflake).

concept · lesson · current
lesson

Linux Virtual Memory Page Tables & MMU

Linux 4-level/5-level page table walk (PGD, P4D, PUD, PMD, PTE) and MMU translation.

concept · lesson · current
lesson

Linux Page Fault Handler & Demand Paging

Linux page fault exception handling, minor vs major page faults, and demand paging.

concept · lesson · current
lesson

Linux cgroups v2 & Resource Isolation

cgroups v2 unified controller hierarchy, memory pressure stall information (PSI), and limits.

concept · lesson · current
lesson

Linux Namespaces & Container Isolation

Linux Namespaces (PID, Mount, Network, IPC, UTS, User), clone(), and container isolation.

concept · lesson · current
lesson

epoll & kqueue Event Multiplexing

Linux epoll (epoll_create, epoll_ctl, epoll_wait) vs BSD kqueue event notification.

concept · lesson · current
lesson

Linux Kernel SLUB Memory Allocator

Linux Kernel SLUB allocator, kmem_cache, object allocation, and slab freelists.

concept · lesson · current
lesson

Linux Process Creation (fork, execve & CoW)

Linux process creation, fork(), execve(), Copy-on-Write (CoW) page table duplication.

concept · lesson · current
lesson

Linux Signals & Async-Signal-Safe Handlers

Linux POSIX Signals (SIGTERM, SIGKILL, SIGSEGV), signal masks, and async-signal-safe functions.

concept · lesson · current
lesson

Linux Page Cache & Dirty Page Flushing

Linux Page Cache, dirty page writeback kernel threads (flush/pdflush), and sync/fsync.

concept · lesson · current
lesson

Linux OOM Killer Score Calculation

Linux Out-Of-Memory (OOM) Killer, oom_score, oom_score_adj tuning, and cgroup memory limits.

concept · lesson · current
lesson

Linux Futex (Fast Userspace Mutex)

Linux futex system call (futex_wait, futex_wake), atomic lock contention, and wait queues.

concept · lesson · current
lesson

Linux Virtual Filesystem (VFS) & Inodes

Linux Virtual Filesystem (VFS) abstraction, dentries, inodes, and file operations.

concept · lesson · current
lesson

Seccomp-BPF System Call Filtering

Linux Seccomp-BPF system call filtering, SECCOMP_SET_MODE_FILTER, and sandboxing.

concept · lesson · current
lesson

Linux HugePages & Transparent HugePages

Linux 2MB/1GB HugePages, Transparent HugePages (THP), and TLB miss reduction.

concept · lesson · current
lesson

CPU Context Switch & Register Spill

CPU context switch mechanics, register spill/fill, TSS stack switching, and latency.

concept · lesson · current
lesson

Advanced TypeScript Types

Generics, discriminated unions, conditional types, and infer type mechanics.

concept · lesson · current
lesson

Python AsyncIO Event Loop

Event loop mechanics, coroutine scheduling, and non-blocking epoll multiplexing.

concept · lesson · current
lesson

Pydantic V2 & Rust Core Validation

Fast data parsing and schema validation with Pydantic V2 pydantic-core engine.

concept · lesson · current
lesson

Promises & Microtask Queue

JavaScript event loop, microtasks vs macrotasks, and async execution order.

concept · lesson · current
lesson

Python GIL vs Multiprocessing

Navigating CPython GIL limits with AsyncIO vs ProcessPoolExecutor CPU parallelism.

concept · lesson · current
lesson

FastAPI Dependency Injection

Request-scoped dependencies, yield cleanup generators, and test overrides.

concept · lesson · current
lesson

Modern ESM & Tree-Shaking

ECMAScript module resolution, TypeScript bundler mode, and tree-shaking dead code elimination.

concept · lesson · current
lesson

Python Memory Allocation & GC

PyMalloc arenas, reference counting, cyclic generational garbage collection, and GC tuning.

concept · lesson · current
lesson

ASGI Spec & High-Concurrency Servers

Low-level ASGI 3.0 protocol teardown, receive/send channels, and Uvicorn/Granian servers.

concept · lesson · current
lesson

TypeScript Decorators & Metadata

Stage 3 TC39 decorators, legacy experimental decorators, and reflect-metadata reflection.

concept · lesson · current
lesson

Python Protocols vs ABCs

Static structural subtyping with typing.Protocol vs nominal Abstract Base Classes.

concept · lesson · current
lesson

FastAPI Custom ASGI Middleware

Request processing chains, correlation IDs, ContextVars, and response header mutation.

concept · lesson · current
lesson

Strict Null Checks & Type Narrowing

Strict null checks, nullish coalescing, optional chaining, type predicates, and assertions.

concept · lesson · current
lesson

Context Managers & Generators

RAII resource cleanup with context managers and memory-efficient yield generators.

concept · lesson · current
lesson

FastAPI BackgroundTasks vs Worker Queues

In-process BackgroundTasks vs dedicated distributed task queues (Celery, ARQ, Redis Queue).

concept · lesson · current
lesson

Vector Spaces and Tensors

How coordinates shapes and transformations represent information numerically.

concept · lesson · current
lesson

Uncertainty and Calibration

How probability estimates express uncertainty and align with outcomes.

concept · lesson · current
lesson

Gradient Descent

How iterative optimization follows local objective information to update parameters.

concept · lesson · current
lesson

Complexity Analysis

How time and space growth guide algorithm and system choices.

concept · lesson · current
lesson

Concurrency Models

How asynchronous tasks threads processes and coordination affect correctness.

concept · lesson · current
lesson

Software Contracts

How interfaces invariants and tests preserve behavior across change.

concept · lesson · current
lesson

Web Rendering and State

How server and browser rendering strategies shape interactive applications.

concept · lesson · current
lesson

Reproducible Delivery

How automated builds tests images and releases create dependable deployments.

concept · lesson · current
lesson

Database Selection

How workload consistency access and scale determine storage choices.

concept · lesson · current
lesson

Data Contracts and Lineage

How schemas quality checks and provenance make pipelines trustworthy.

concept · lesson · current
lesson

Learning Paradigm Selection

How available signals feedback and objectives determine a learning approach.

concept · lesson · current
lesson

Generalization and Leakage

How evaluation design estimates future performance without contaminating evidence.

concept · lesson · current
lesson

Backpropagation

How gradients propagate through computational graphs to train neural networks.

concept · lesson · current
lesson

Computer Vision

Elective branch covering image representation recognition detection and generation.

concept · lesson · current
lesson

Speech and Audio AI

Elective branch covering recognition synthesis understanding and audio generation.

concept · lesson · current
lesson

Recommendation Systems

Elective branch covering ranking personalization feedback and marketplace effects.

concept · lesson · current
lesson

Time-Series AI

Elective branch covering forecasting anomaly detection and temporal decision systems.

concept · lesson · current
lesson

Robotics and Embodied AI

Elective branch covering perception planning control and physical interaction.

concept · lesson · current
lesson

Edge Model Optimization

How compression runtimes and hardware co-design enable constrained inference.

concept · lesson · current
lesson

Tokens and Tokenization

How model inputs become discrete identifiers and why token boundaries affect cost and meaning.

concept · lesson · current
lesson

Embeddings

How learned vectors encode useful similarity and support representation and retrieval.

concept · lesson · current
lesson

Transformer Architecture

How attention feed-forward blocks residual paths and positions transform sequences.

concept · lesson · current
lesson

Training versus Inference

How parameter learning differs from runtime generation and serving operations.

concept · lesson · current
lesson

Context Windows

How finite input and output budgets constrain attention state relevance and cost.

concept · lesson · current
lesson

Sampling and Decoding

How logits temperature top-p and deterministic choices shape generated sequences.

concept · lesson · current
lesson

Model Families and Lifecycle

How capability modality size versioning deprecation and routing affect model selection.

concept · lesson · current
lesson

Latency and Throughput

How queueing prompt processing generation batching and concurrency determine serving performance.

concept · lesson · current
lesson

Multimodal Fusion

How models align and combine text image audio and video representations.

concept · lesson · current
lesson

Message Roles and Instruction Priority

How instruction sources and ordered messages establish conversational control context.

concept · lesson · current
lesson

Prompt Structure

How clear goals constraints context examples and output contracts guide model behavior.

concept · lesson · current
lesson

Structured Outputs

How schemas convert probabilistic text generation into validated application contracts.

concept · lesson · current
lesson

Tool Calling

How models propose typed actions while applications retain execution authority and validation.

concept · lesson · current
lesson

Context Engineering

How systems select assemble order compress and isolate information for each model call.

concept · lesson · current
lesson

State and Memory

How applications persist working state history summaries facts and user-controlled records.

concept · lesson · current
lesson

Exact and Semantic Caching

How reusable computations reduce latency and cost while introducing freshness and correctness risks.

concept · lesson · current
lesson

RAG versus Fine-Tuning

How knowledge access behavior adaptation and tool use solve different system problems.

concept · lesson · current
lesson

Ingestion and Chunking

How parsing normalization segmentation metadata and updates create retrievable units.

concept · lesson · current
lesson

Vector Search

How embeddings similarity indexes filters and recall tradeoffs retrieve semantic candidates.

concept · lesson · current
lesson

Hybrid Search and Reranking

How lexical semantic and learned ranking stages improve candidate precision and recall.

concept · lesson · current
lesson

Grounded Generation and Citations

How answer synthesis constrains claims to evidence and preserves inspectable attribution.

concept · lesson · current
lesson

Knowledge Provenance

How origin ownership version and transformation metadata make knowledge auditable.

concept · lesson · current
lesson

Agent Control Loop

How bounded observe decide act and verify cycles produce controlled autonomy.

concept · lesson · current
lesson

LangGraph Pregel State Machine Loops

How LangGraph compiles agent control flows into deterministic Pregel bulk-synchronous parallel state machines.

concept · lesson · current
lesson

Multi-Agent Supervisor Pattern

Orchestrate specialized worker subgraphs using a central supervisor node for task delegation.

concept · lesson · current
lesson

Human-in-the-Loop & State Checkpoints

Pause agentic execution at explicit breakpoint gates for human inspection and state updates.

concept · lesson · current
lesson

Speculative Decoding & Verification

Accelerate LLM inference by using a small draft model to propose token candidate sequences verified by a target model.

concept · lesson · current
lesson

Hierarchical Indexing & RAPTOR Trees

Build multi-layer summarization trees over text passages to enable fine-grained chunk retrieval and broad document synthesis.

concept · lesson · current
lesson

Late-Interaction & ColBERT Retrieval

Retain fine-grained token-level matching precision using multi-vector token representations and sub-20ms MaxSim indexing.

concept · lesson · current
lesson

Model Context Protocol (MCP) Architecture

Establish an open client-server architecture for securely connecting AI models to tools, context resources, and prompts.

concept · lesson · current
lesson

Workflow Orchestration

How explicit state transitions coordinate repeatable AI and software work.

concept · lesson · current
lesson

Context and Tool Protocols

How standardized discovery invocation and data exchange connect model systems.

concept · lesson · current
lesson

Human Approval Boundaries

How consequence and reversibility determine when human authorization is mandatory.

concept · lesson · current
lesson

AI Feedback and Correction

How interfaces expose progress uncertainty evidence and correction controls.

concept · lesson · current
lesson

Streaming AI Interfaces

How incremental transport cancellation state and recovery create responsive experiences.

concept · lesson · current
lesson

LLM Evaluation

How task definitions datasets metrics rubrics judges and experiments measure system quality.

concept · lesson · current
lesson

Grounding and Hallucination

How unsupported claims arise and how evidence constraints and verification reduce them.

concept · lesson · current
lesson

AI Tracing

How correlated model retrieval tool and application spans expose system behavior.

concept · lesson · current
lesson

Cost Latency and Reliability

How budgets fallbacks retries routing and service targets balance operating outcomes.

concept · lesson · current
lesson

Security and Privacy for LLM Systems

How untrusted inputs sensitive data tools and external knowledge expand the threat model.

concept · lesson · current
lesson

Safety Evaluation and Response

How adversarial tests policy checks monitoring and response control harmful behavior.

concept · lesson · current
lesson

AI Risk Governance

How ownership classification documentation and review control lifecycle risk.

concept · lesson · current
lesson

Inference Serving Architecture

How routing batching caching autoscaling and accelerators serve model workloads.

concept · lesson · current
lesson

AI Unit Economics

How per-task value quality compute tokens and operational costs determine viability.

concept · lesson · current
lesson

Capability-Problem Fit

How uncertain model capabilities map to valuable testable user outcomes.

concept · lesson · current
lesson

Evidence Synthesis

How primary sources experiments and explicit confidence create durable knowledge.

concept · lesson · current
lesson

Information Entropy

How entropy and information measures describe uncertainty compression and representation.

concept · lesson · current
lesson

Predictive Processing

What hierarchical prediction and prediction error propose about perception and what AI engineers must not infer.

concept · lesson · current
lesson

Cognitive Architectures

How cognitive models decompose memory reasoning attention and action without becoming literal brain replicas.

concept · lesson · current
lesson

Language and Thought

How language structures communication and reasoning without equating fluent generation with complete understanding.

concept · lesson · current
lesson

Philosophy of Intelligence

How competing definitions of intelligence change system claims evaluation and responsible communication.

concept · lesson · current
lesson

Evidence and Replication

How to distinguish a result from a durable claim through replication synthesis and explicit uncertainty.

concept · lesson · current
lesson

Causal Inference

How interventions assumptions and identification separate causal questions from predictive accuracy.

concept · lesson · current
lesson

Reinforcement Learning

How policies learn sequential decisions from feedback and where reward design and distribution shift fail.

concept · lesson · current
lesson

Full-Stack AI Systems

How interfaces APIs orchestration data and model providers form one observable product system.

concept · lesson · current
lesson

Inference Engine Architecture

How schedulers KV-cache managers model runners and distributed executors determine serving behavior.

concept · lesson · current
lesson

MLOps Lifecycle

How versioned artifacts evaluation promotion monitoring rollback and retirement make model changes governable.

concept · lesson · current
lesson

Distributed AI Systems

How computation communication memory placement and failure domains shape large-scale AI platforms.

concept · lesson · current
lesson

AI System Testing

How to combine deterministic software tests model evaluations adversarial checks and monitored production evidence.

concept · lesson · current
lesson

Organizational AI Change

How capability ownership workflow redesign governance and feedback determine whether AI adoption produces value.

concept · lesson · current
lesson

Clinical Decision Support

How AI recommendations enter clinical workflows and why evidence oversight usability and escalation determine safety.

concept · lesson · current
lesson

AI in Financial Risk

How AI changes fraud risk and underwriting workflows under model-risk and consumer-protection constraints.

concept · lesson · current
lesson

AI-Assisted Learning

How AI can support practice feedback and synthesis without replacing learner effort or reliable assessment.

concept · lesson · current
lesson

AI for Scientific Discovery

How AI can accelerate search and experiment cycles while preserving measurement validity and reproducibility.

concept · lesson · current
lesson

AI-Assisted Software Engineering

How AI changes software throughput review burden system understanding and security risk.

concept · lesson · current
lesson

Industrial AI Automation

How AI interacts with physical constraints safety cases latency and operational recovery in industry.

concept · lesson · current
lesson

AI for Climate and Energy

How forecasting optimization and sensing support resource decisions while computation and rebound costs remain visible.

concept · lesson · current
lesson

Generative Media Systems

How models production tools rights provenance and human direction combine in responsible media systems.

concept · lesson · current
lesson

AI in Law and Public Services

How automation affects accountable decisions rights access explanation appeal and institutional legitimacy.

concept · lesson · current
lesson

AI Labor and Society

How AI changes tasks bargaining power institutions distribution and competitive dynamics beyond headline job counts.

concept · lesson · current
lesson

Consuming FastAPI StreamingResponse in React

How to parse and buffer raw chunked byte streams returned by FastAPI StreamingResponse using fetch and ReadableStream.

concept · lesson · current
lesson

Server-Sent Events with FastAPI EventSourceResponse

Implementing reliable Server-Sent Events subscriptions in React components using native EventSource or custom headers fetch.

concept · lesson · current
lesson

Chunk-by-Chunk Stream Buffering

Design patterns for client-side stream buffering, UTF-8 decoding, and incremental string assembly from raw model outputs.

concept · lesson · current
lesson

Typewriter Effects vs. DOM Flushing

Evaluating cognitive loading and paint performance differences between animated character increments and raw stream flushing.

concept · lesson · current
lesson

Real-Time Streaming Markdown Parsing

How to parse and render incomplete Markdown strings incrementally without causing layout reflows or syntax breakage.

concept · lesson · current
lesson

Incremental Syntax Highlighting

Applying real-time syntax styling to streaming code blocks using lightweight tokenizers and state-preserving parser frames.

concept · lesson · current
lesson

Streaming Math and LaTeX Markup

Dynamic rendering of incomplete mathematical formulas and LaTeX structures in stream blocks using KaTeX delimiters.

concept · lesson · current
lesson

Mid-Stream Client-Side Cancellation

Aborting active generation streams in React using AbortController and sending termination signals to FastAPI backends.

concept · lesson · current
lesson

Partial JSON Parsing for Streams

How to read, validate, and extract nested values from incomplete JSON streams using specialized chunk-aware parsers.

concept · lesson · current
lesson

Parallel Multi-Stream Orchestration

Managing react state trees when rendering multiple concurrent assistant streams from coordinate multi-agent backends.

concept · lesson · current
lesson

Client-Side Token Estimation

Implementing lightweight client-side BPE tokenizer engines in browser environments to calculate prompt token quotas.

concept · lesson · current
lesson

WebSockets vs. SSE in FastAPI

Comparing latency, state management, and connection durability of bi-directional WebSockets vs. SSE in python backends.

concept · lesson · current
lesson

Auto-Scroll Pinning and Interruption

Developing chat containers that pin scroll-to-bottom during streaming while pausing updates if the user scrolls up.

concept · lesson · current
lesson

Markdown Stream XSS Sanitization

Preventing cross-site scripting (XSS) when rendering raw, model-generated HTML or scripts in markdown stream components.

concept · lesson · current
lesson

System Prompt Delimiter Rendering

Strategies for stripping or styling specific parser markers and format indicators in client conversation feeds.

concept · lesson · current
lesson

Rendering Streaming Thought Blocks

Isolating and style-tagging hidden or structured thought blocks returned by modern reasoning models in frontends.

concept · lesson · current
lesson

Real-Time Audio Stream Decoding

Consuming and queueing raw binary audio chunks from FastAPI voice streams using browser Web Audio API contexts.

concept · lesson · current
lesson

Image Generation Progress States

UX patterns for displaying step-by-step progress, diffusion noise states, or preview frames during image generation cycles.

concept · lesson · current
lesson

Multi-Turn Chat State Serialization

Structuring and persisting multi-turn conversation arrays in React client state and syncing history to backends.

concept · lesson · current
lesson

Fallback Formatting for Broken JSON

Building client wrappers that recover and format partially outputted, malformed JSON schemas when generations terminate abruptly.

concept · lesson · current
lesson

Dynamic Generative UI Component Injection

Injecting interactive React components dynamically into chat windows based on model tool-call arguments.

concept · lesson · current
lesson

Rendering Tool Call Execution States

Designing UI states for tool callbacks: loading skeletons, success parameters, and execution progress bars.

concept · lesson · current
lesson

Human-in-the-Loop Intercept Components

Creating modal overlay checkpoints that block agent progress on the backend until client validation or approval is received.

concept · lesson · current
lesson

Optimistic State Updates in Agent Interfaces

Rendering user inputs and tentative agent actions immediately before network confirmations complete to lower perceived lag.

concept · lesson · current
lesson

Visualizing Agent DAGs with ReactFlow

Representing complex agent execution graphs and multi-path routes dynamically using ReactFlow canvas nodes.

concept · lesson · current
lesson

Dynamic Form Generation from JSON Schema

Translating model-returned JSON Schemas into accessible, interactive HTML forms with dynamic client-side validation.

concept · lesson · current
lesson

Client-Side Tool Call Validation

Performing frontend verification on tool arguments before dispatching them to FastAPI backend execution pathways.

concept · lesson · current
lesson

Dialogue Thread Branching and Forks

Designing UI patterns that allow users to fork previous chat states, edit parameters, and navigate dialogue trees.

concept · lesson · current
lesson

Interactive Code Sandbox Integration

Embedding client-side compilation environments (like WebContainers) to safely run model-generated code directly in browsers.

concept · lesson · current
lesson

Multi-Agent Coordination and Lock States

Visualizing execution loops across team agents, highlighting which specialized agent holds lock control.

concept · lesson · current
lesson

Context Window Quota Warning UI

Alerting users visually when dialogue context matches model limits and prompting for compression or branch actions.

concept · lesson · current
lesson

Background Agent State Sync

Synchronizing React application states with long-running server background execution tasks using SSE polling or websockets.

concept · lesson · current
lesson

Rendering Tables from Tool Results

Formatting tool output payload structures (e.g., CSV, raw array chunks) into accessible grid tables with sorting rules.

concept · lesson · current
lesson

React State Tuning for High-Frequency Runs

Avoiding component bottlenecks when handling frequent, parallel tool response updates using refs and selector hooks.

concept · lesson · current
lesson

Tool-Call Error Boundary Components

Gracefully intercepting database query errors or script failures in agent loops without crashing dialogue states.

concept · lesson · current
lesson

Nested Agent Subtask Hierarchy

Creating tree-hierarchy components that allow users to drill down into parent-child agent delegations.

concept · lesson · current
lesson

Client-Side File Attachment Processing

Preprocessing images, CSV files, and PDFs client-side (resizing, basic extraction) before sending to multimodal pipelines.

concept · lesson · current
lesson

Live Agent Execution Debug Consoles

Designing readable log-stream drawers for engineering users to inspect trace files during active runs.

concept · lesson · current
lesson

Drag-and-Drop Workflow Interfaces

Building clean workspace canvases where users coordinate prompt templates, models, and data steps visually.

concept · lesson · current
lesson

Interactive Prompt Template Mappers

Designing syntax input controls that dynamically highlight and bind template variables to schema models.

concept · lesson · current
lesson

WebGPU Browser Inference Acceleration

Understanding the WebGPU API role, capabilities, and device support boundaries for executing neural nets locally.

concept · lesson · current
lesson

Transformers.js React Integrations

Architecting React state hooks to load models, track compile steps, and invoke local pipelines using Transformers.js.

concept · lesson · current
lesson

Offloading Inference to Web Workers

Moving model weights compile and forward pass compute off the browser main thread into background Web Workers.

concept · lesson · current
lesson

Caching Model Weights with Cache Storage

Configuring the Cache Storage API to store large model weights files locally to prevent redundant downloads.

concept · lesson · current
lesson

WebAssembly vs. WebGPU Performance

Comparing memory limits, execution latency, and battery drain of Wasm-fallback vs. WebGPU accelerated edge runs.

concept · lesson · current
lesson

ONNX Runtime Web Orchestration

Integrating custom model files (.onnx format) into React apps, coordinating output tensors, and managing memory.

concept · lesson · current
lesson

Local Speech-to-Text with Whisper

Running Whisper models client-side in Web Workers for private, low-latency voice-transcription interfaces.

concept · lesson · current
lesson

Client-Side Embeddings Generation

Generating vector embeddings for search terms directly inside the browser using lightweight representation models.

concept · lesson · current
lesson

IndexedDB Local Vector Databases

Storing documents and their embedding vectors in IndexedDB and running similarity searches using JavaScript.

concept · lesson · current
lesson

Client-Side Query Routing Models

Using compact classifiers at the edge to categorize user intent before deciding to execute local or cloud models.

concept · lesson · current
lesson

Edge-Native PII Redaction Filters

Analyzing and filtering user input text client-side to strip personally identifiable information before API upload.

concept · lesson · current
lesson

Browser Model Quantization Trade-offs

Understanding the impact of 4-bit, 8-bit, and full-precision weights formats on browser memory usage and accuracy.

concept · lesson · current
lesson

Model Weight Download Progress Bars

Designing user interfaces that show chunked download progression of multi-gigabyte neural weight sets.

concept · lesson · current
lesson

Fallback Orchestrator: Edge to Cloud

Detecting missing WebGPU features or low browser memory and failing over to server-served models automatically.

concept · lesson · current
lesson

Local LLM Orchestration in the Browser

Running small language models (like Llama-3-8B) in edge memory using WebGPU, tracking generation rates (tokens/sec).

concept · lesson · current
lesson

Browser-Side Image Classification

Running image categorization and object detection models client-side on uploaded assets to support prompt styling.

concept · lesson · current
lesson

Local Text Summarization

Using edge-compiled summarizers to process copy-pasted blocks locally to minimize server payload footprints.

concept · lesson · current
lesson

Local Sentiment Analysis Hooks

Using edge models to gauge user sentiment mid-session, adapting interface layouts and themes reactively.

concept · lesson · current
lesson

Offline-First RAG Pipelines

Configuring a complete RAG system in the browser: edge chunks, local embeddings database, and local generation.

concept · lesson · current
lesson

Browser-Based Token Distillation

Designing patterns to distill long user inputs into compressed semantic tokens locally before transmission.

concept · lesson · current
lesson

Visualizing Model Confidence Intervals

UI paradigms for displaying model probability predictions, uncertainty indicators, and confidence ratings.

concept · lesson · current
lesson

Interactive Citation and Sources UI

Designing hover-cards, inline footnotes, and sidebar registries linking model claims to primary documents.

concept · lesson · current
lesson

Context Boundaries and Source Styling

Using color, containment, and visual boundaries to separate reliable grounding facts from assistant text.

concept · lesson · current
lesson

In-Line Response Correction UI

Designing interfaces where users can overwrite parts of responses, submitting corrections to refine systems.

concept · lesson · current
lesson

Message Role Design Conventions

Design styles for System, User, Assistant, and Tool messages to create dialogue boards.

concept · lesson · current
lesson

ARIA Live Regions for Streaming Chat

Configuring accessibility tags (aria-live, role, atomic) to ensure screen readers announce streams without stuttering.

concept · lesson · current
lesson

Keyboard Navigation in Conversational UI

Ensuring focus handles, escape keys, and prompt inputs follow accessibility standards for keyboard users.

concept · lesson · current
lesson

Visual Indicators for Safety Violations

Designing graceful alert messages, blocked prompts, and moderation warnings when safety gates block outputs.

concept · lesson · current
lesson

Explainability Highlighting in text

Color-mapping terms and phrases inside response blocks that triggered specific routing rules or classifications.

concept · lesson · current
lesson

Thumbs-Up/Down Feedback Loops

Designing high-conversion feedback triggers (positive/negative ratings, quick feedback tags) without disrupting chat flows.

concept · lesson · current
lesson

System Prompt Inspection Widgets

Building diagnostic controls that allow engineers to toggle on and review prepended system instructions.

concept · lesson · current
lesson

Skeletons vs. Spinners for Perceived Speed

Implementing content skeletons instead of loading spinners to maintain user context during inference delays.

concept · lesson · current
lesson

Safety Audit Labels and Scores

Designing trust summary tags showing alignment check passes, model provenance metadata, and verification signatures.

concept · lesson · current
lesson

Human Validation UI for Automated Edits

Designing dashboard side-panels that prompt editors to accept, reject, or adjust model-suggested codebase changes.

concept · lesson · current
lesson

System Errors vs. Model Refusals

Differentiating visual errors: showing network 502/timeout alerts vs assistant safety refusals.

concept · lesson · current
lesson

Token Probability Visualization

Building diagnostic color overlays showing token-by-token prediction probabilities to analyze model certainty.

concept · lesson · current
lesson

Localized Prompt Translation Layouts

Handling prompt translation layers in user interfaces, coordinating parallel language models behind screens.

concept · lesson · current
lesson

Accessible Streaming Tables and Code

Converting markdown cells into structured, accessible table matrices for screen readers.

concept · lesson · current
lesson

Focus Management during Stream Appends

Preventing browser focus drops or screen jumps when elements push dynamic content to active feeds.

concept · lesson · current
lesson

Model Version Metadata Stamping

Styling message containers with small metadata stamps displaying the model version, temperature, and generator parameters.

concept · lesson · current
lesson

Prompt Input Debouncing

Preventing excessive vector matches or autocomplete api triggers during active user prompt writing.

concept · lesson · current
lesson

Stream Keep-Alives and Reconnections

Handling TCP dropouts in React apps by implementing backoff reconnect algorithms on FastAPI stream endpoints.

concept · lesson · current
lesson

Chat History Caching with IndexedDB

Using IndexedDB databases instead of LocalStorage to store megabytes of conversation records and files locally.

concept · lesson · current
lesson

WebSocket Payload Optimization

Compressing client-server messages in WebSocket frames when handling heavy audio, image, or graph state exchanges.

concept · lesson · current
lesson

Caching Vector Indices Client-Side

Storing generated search index vectors in browser databases to bypass repeated embedding calls for recurring queries.

concept · lesson · current
lesson

Tree-Shaking AI Packages

Excluding massive server-only scripts, redundant tokenizers, and unused native bindings in frontend bundles.

concept · lesson · current
lesson

Service Workers for Offline Inference

Registering Service Workers to intercept model requests, fetch weights files from caches, and enable offline usage.

concept · lesson · current
lesson

HTTP/2 and HTTP/3 Stream Multiplexing

Utilizing HTTP/2 or HTTP/3 capabilities to request parallel text, image, and tool calls without connection blocks.

concept · lesson · current
lesson

Browser Paint Cycles Optimization

Coordinating browser redraws during fast streaming updates using requestAnimationFrame or CSS transition properties.

concept · lesson · current
lesson

Message Arrays Garbage Collection

Avoiding memory bloat in single-page chat apps by pruning outdated or large dialogue chunks from React state logs.

concept · lesson · current
lesson

Intent-Based Prompt Template Prefetching

Prefetching complex prompt layouts from servers as soon as user classification matches specific categories.

concept · lesson · current
lesson

Client-Side Rate-Limit Management

Managing API rate limits (HTTP 429) client-side by structuring retry delay arrays and visual cooldown trackers.

concept · lesson · current
lesson

Optimistic Rendering under Packet Loss

Developing chat layouts that buffer and render out-of-order stream packets smoothly over unstable mobile connections.

concept · lesson · current
lesson

Infinite Scroll Chat Virtualization

Using list virtualization libraries (like react-virtual) to render only visible text cells, keeping DOM trees fast.

concept · lesson · current
lesson

Measuring Time-to-First-Token

Recording time-to-first-token (TTFT) and token generation rates, reporting them to backend trace collectors.

concept · lesson · current
lesson

Local Prompt Text Compression

Running client algorithms to strip low-value stop-words or syntax before submitting text inputs to limit token costs.

concept · lesson · current
lesson

Stream Chunk Size Tuning

Analyzing performance trade-offs between frequent small packet streams (smoother UX) and larger, less-frequent packets.

concept · lesson · current
lesson

Multimodal Image Decompression

Using Web Workers to unpack and downsize large uploaded prompt images, keeping React interface animations smooth.

concept · lesson · current
lesson

Edge Inference Memory Profiling

Using Chrome DevTools memory allocation trackers to diagnose and prevent memory leaks during local inference runs.

concept · lesson · current
lesson

Hybrid Client-Server State Recovery

Restoring active conversation states and stream positions smoothly if client-server connection drops out mid-generation.

concept · lesson · current
lesson

Agent Evaluation

Evaluate agent trajectories, actions, outcomes, and policy compliance rather than judging only the final response.

concept · lesson · current
lesson

Agent Failure Recovery

Design retries, compensation, escalation, and safe termination around typed agent failure states.

concept · lesson · current
lesson

Agent State Checkpointing

Persist resumable agent state with explicit versions, side-effect boundaries, and replay semantics.

concept · lesson · current
lesson

Agent Execution Budgets and Termination

Bound agent time, tokens, tools, cost, risk, and loop depth with explicit stop reasons.

concept · lesson · current
lesson

Agent Action Verification

Verify intended and actual effects independently before an agent can declare success.

concept · lesson · current
lesson

Tool Authorization

Authorize each proposed tool action against identity, scope, resource, parameters, and consequence at execution time.

concept · lesson · current
lesson

Delegated Credentials for AI Tools

Use short-lived, audience-bound, least-privilege credentials without exposing secrets to model context.

concept · lesson · current
lesson

Tool Sandboxing and Egress Control

Constrain tool execution with filesystem, process, network, resource, and data-exfiltration boundaries.

concept · lesson · current
lesson

Tool Input and Output Validation

Validate typed tool arguments before execution and treat tool output as untrusted data afterward.

concept · lesson · current
lesson

Retrieval Evaluation

Measure whether retrieval finds sufficient, relevant, authorized, and fresh evidence before grading generation.

concept · lesson · current
lesson

Index Lifecycle Operations

Operate ingestion, versioning, freshness, deletion, rebuild, rollback, and reconciliation as one index lifecycle.

concept · lesson · current
lesson

Access-Aware Retrieval

Enforce tenant and document authorization before evidence enters ranking or model context.

concept · lesson · current
lesson

Query Rewriting and Routing

Transform and route queries while preserving user intent, policy context, and evaluation traceability.

concept · lesson · current
lesson

Model Serving Capacity Planning

Translate workload distributions and service objectives into accelerator, memory, queue, and redundancy capacity.

concept · lesson · current
lesson

Continuous Batching and Admission Control

Coordinate dynamic batches and admission limits to protect latency, memory, fairness, and throughput.

concept · lesson · current
lesson

Distributed Inference Parallelism

Choose replication, tensor, pipeline, data, or expert parallelism from model fit and service objectives.

concept · lesson · current
lesson

Inference Autoscaling and Backpressure

Scale from demand and saturation signals while bounding queues, retries, and cold-start instability.

concept · lesson · current
lesson

AI Service-Level Objectives

Define service objectives around successful, policy-compliant task outcomes as well as latency and availability.

concept · lesson · current
lesson

AI Incident Response

Detect, contain, investigate, recover, and learn from quality, safety, data, tool, and provider incidents.

concept · lesson · current
lesson

Model and Prompt Regression Monitoring

Detect behavior changes across model, prompt, retrieval, tool, policy, and grader versions.

concept · lesson · current
lesson

AI Data Classification and Minimization

Classify data by sensitivity and send, store, log, and retain only what each AI operation needs.

concept · lesson · current
lesson

Multi-Tenant AI Data Isolation

Preserve tenant boundaries across retrieval, prompts, caches, tools, telemetry, evaluation, and support operations.

concept · lesson · current
lesson

AI Retention, Deletion, and Audit

Make retention and deletion propagate through derived indexes, caches, traces, evaluations, and backups with auditable evidence.

concept · lesson · current
lesson

AI Product Discovery

Identify valuable workflows where probabilistic capability, evidence, and human control can improve outcomes.

concept · lesson · current
lesson

Capability-Fit Experimentation

Run staged experiments that test model capability, workflow value, operational fit, and risk before scaling.

concept · lesson · current
lesson

Ontology Engineering Fundamentals & Triple Models

Formal semantic modeling principles, Subject-Predicate-Object triples, RDF/OWL standards, and Open-World reasoning.

concept · lesson · current
lesson

Ontological Modeling for Software Systems & DDD

Mapping Domain-Driven Design (DDD) Bounded Contexts, Entity Classes, Invariants, and API Contracts using formal ontologies.

concept · lesson · current
lesson

Ontologies in Enterprise Data Engineering & Data Mesh

Semantic data catalogs, unified schema governance, FAIR data principles, and Knowledge Graphs over relational data (R2RML, SPARQL).

concept · lesson · current
lesson

Ontologies in AI, Neuro-Symbolic RAG & GraphRAG

Grounding LLMs with formal ontologies, ontology-driven prompt constraint schemas, Neuro-Symbolic AI, and deterministic reasoning boundaries.

concept · lesson · current
lesson

Ontology Evolution, Alignment & Schema Governance

Ontology versioning, mapping disparate domain schemas, automated SHACL constraint validation, and CI/CD ontology deployment.

concept · lesson · current
lesson

Blockchain State, Cryptography & Transaction Lifecycle

Accounts, cryptographic signers (secp256k1, Ed25519), Merkle Patricia Tries, state roots, and transaction execution flow.

concept · lesson · current
lesson

Distributed Consensus, Finality & Peer-to-Peer Networking

Nakamoto PoW, BFT Proof-of-Stake, Tendermint/CometBFT liveness vs safety trade-offs, slashing rules, and P2P GossipSub propagation.

concept · lesson · current
lesson

EVM Architecture, Opcode Execution & Gas Metering

Stack-based Ethereum Virtual Machine mechanics, memory vs storage layouts, gas calculation rules, and ABI encoding.

concept · lesson · current
lesson

Smart Contract Security, Auditing & Defense Patterns

Checks-Effects-Interactions pattern, reentrancy defense, delegatecall vulnerabilities, oracle manipulation, fuzz testing, and emergency controls.

concept · lesson · current
lesson

Layer-2 Rollups, Data Availability & Cross-Chain Bridges

Optimistic vs ZK-Rollups, EIP-4844 blobs, PeerDAS, modular DA (Celestia, EigenDA), and cross-chain bridge trust assumptions.

concept · lesson · current
lesson

Zero-Knowledge Proof Foundations & zkVM Architectures

ZK completeness, soundness, zero-knowledge, R1CS/PLONKish arithmetization, KZG/FRI commitments, ZK-SNARKs vs ZK-STARKs, and RISC-V zkVMs.

concept · lesson · current
lesson

Zero-Knowledge Machine Learning (zkML) & Verifiable AI

Quantizing ML models into arithmetic circuits, ZK proof generation of neural network inference M(X)=Y, and computational integrity vs semantic truth.

concept · lesson · current
lesson

Decentralized GPU Compute Networks & DePIN Architecture

GPU marketplaces (Akash, io.net, Render), scheduling, fault tolerance, and compute verification strategies (TEE attestation, redundant execution, ZK).

concept · lesson · current
lesson

Decentralized Data Oracles, Storage & AI Provenance

Oracles (Chainlink, Pyth), content-addressed storage (IPFS, Filecoin, Arweave), CIDs, and immutable AI dataset/model provenance.

concept · lesson · current
lesson

Autonomous On-Chain AI Agents & Protocol Economics

Secure agent execution pipelines, Account Abstraction (ERC-4337, EIP-7702), session keys, Policy Engines, Story Protocol IP Accounts, and tokenomics.

concept · lesson · current
lesson

LLM Systems Foundations

Build a connected mental model from tokens through retrieval evaluation security and operations.

path · 18 hours
lesson

Production LLM Engineer

Design an observable full-stack LLM product from capability validation through interfaces retrieval evaluation security and operations.

path · 35 hours
lesson

RAG Engineer

Build evidence-carrying retrieval systems from ingestion and provenance through search reranking grounded generation and evaluation.

path · 25 hours
lesson

Agentic Systems Engineer

Engineer bounded tool-using systems with explicit workflows state protocols evaluation observability security and human control.

path · 29 hours
lesson

AI Evaluation and Reliability

Turn product intent and risk into representative evaluations release gates traces service targets and continuously improving regression evidence.

path · 22 hours
lesson

Model Serving and Inference

Understand inference engines memory scheduling batching routing scaling distributed execution lifecycle controls observability and economics.

path · 23 hours
lesson

Ontology & Semantic Systems Engineering

Master formal semantic modeling, RDF/OWL triple stores, Domain-Driven Design integration, enterprise Data Mesh virtualization, and Neuro-Symbolic GraphRAG.

path · 12 hours
lesson

Blockchain & Decentralized AI Systems Engineer

Learn how blockchain systems execute and reach consensus, build and secure smart contracts, reason about rollups and data availability, understand zero-knowledge and verifiable computation, evaluate decentralized AI compute/storage systems, and design AI agents capable of safely interacting with programmable wallets and on-chain protocols.

path · 24 hours
lab

Tokenization and Context Window Visualizer

Inspect deterministic token approximations and allocate a finite context budget.

lab · v1
lab

Sampling and Decoding Explorer

Explore how temperature and top-p reshape a fixed token distribution.

lab · v1
lab

Prompt RAG Fine-Tuning or Tool-Use Decision Lab

Match system symptoms and constraints to an appropriate intervention strategy.

lab · v1
lab

RAG Pipeline and Retrieval Parameter Visualizer

Tune chunk size retrieval breadth hybrid weight and reranking in a deterministic pipeline.

lab · v1
lab

LLM Cost Latency and Reliability Simulator

Model request economics latency percentiles and fallback effects under disclosed assumptions.

lab · v1
lab

Evaluation Strategy Designer

Assemble a balanced evaluation plan from risks cases metrics review and release gates.

lab · v1
lab

Streaming JSON Repair & Buffer Playground

Visualise incomplete stream buffering, UTF-8 sequence cuts, and token-repair delimiters.

lab · v1
lab

OpenAI Codex Codebase & Control Path Visualizer

Trace interactive request logic, TUI UI steps, MCP integrations, and sandbox execution chains.

lab · v1
lab

Embedding Space Explorer

Inspect deterministic vector geometry similarity measures and ranking changes across a small semantic corpus.

lab · v1
lab

Chunking and Reranking Laboratory

Compare boundary-aware chunks candidate breadth reranker strength context cost and retrieval quality under explicit assumptions.

lab · v1
lab

Agent Loop and Tool Selection Simulator

Step through bounded agent states and select the correct action tool approval or stop condition for each observation.

lab · v1
lab

Evaluation Metric Comparison Lab

Match failure modes to deterministic metrics model graders human review and production measures without collapsing quality into one score.

lab · v1
lab

Inference Batching and Queueing Simulator

Model deterministic arrival rate batch size service time cache pressure throughput utilization and tail-latency trade-offs.

lab · v1
lab

Prompt-Injection Threat-Model Exercise

Classify direct and indirect injection paths then assemble independent authorization isolation validation and response controls.

lab · v1
lab

Account Abstraction & Policy Engine Lab

Simulate ERC-4337 smart account execution, Paymaster gas sponsorship, session keys, and Policy Engine security rules (allowlists, spending caps, HITL gates) under normal and adversarial prompt-injection workloads.

lab · v1
guide

AI Hardware Accelerators & Compute Architecture

A deep dive into NVIDIA H100/H200, AMD MI300X, and Google TPU v5p hardware architectures, HBM3e memory bandwidth, NVLink interconnects, and Roofline model execution.

architecture guide
guide

AI Observability and Incident Response

A telemetry and response architecture for tracing model, retrieval, tool, policy, quality, cost, and user-outcome failures.

architecture guide
guide

The Engineering Guide to Blockchain Architecture, Verifiable Computation & Decentralized AI

A comprehensive reference guide on blockchain state, EVM execution, smart contract security, Layer-2 rollups, EIP-4844 blobs, ZK-SNARKs/STARKs, RISC-V zkVMs, zkML inference, decentralized GPU compute, and secure autonomous on-chain AI agents.

architecture guide
guide

Cost and Reliability Engineering

A control system for optimizing cost per successful task while preserving quality, latency, safety, capacity, and fallback behavior.

architecture guide
guide

GPU Hardware Architecture, CUDA Optimization & LLM Inference Infrastructure

Production reference architecture guide covering NVIDIA H100/H200/B200 GPU hardware microarchitectures, TFLOPS/AIFLOPS precision math, TPS/TTFT/TPOT/MBU performance metrics, CUDA kernel optimization, and AI Infrastructure Engineering roles.

architecture guide
guide

Deep Research & Autonomous Agent Swarms Reference Architecture

Production architecture blueprint for multi-query research decomposition, iterative web crawling, evidence synthesis, agent swarm topologies, scratchpad state isolation, and Postgres checkpointing.

architecture guide
guide

Governed Agent Architecture

A bounded agent control plane for state, tool authorization, delegated credentials, approvals, verification, recovery, and audit.

architecture guide
guide

GraphRAG & Entity-Knowledge Networks Reference Architecture

Production architecture blueprint for GraphRAG pipelines—covering entity-relation extraction, community detection, sub-graph summarization, and hybrid graph-vector retrieval.

architecture guide
guide

LangGraph & Deep Agents Reference Architecture

Production architecture blueprint for multi-agent supervisor routing, Pregel state isolation, Postgres checkpointer persistence, human-in-the-loop breakpoints, and failure defenses.

architecture guide
guide

LLM Evaluation Control Plane

An evaluation architecture connecting capability claims, versioned datasets, deterministic checks, validated graders, release gates, and production outcomes.

architecture guide
guide

Model Serving Capacity Planning

A workload-first method for sizing accelerators, KV cache, admission, batching, redundancy, autoscaling, and failure reserve.

architecture guide
guide

Multi-Tenant AI Data Isolation

An end-to-end isolation architecture spanning identity, retrieval, caches, tools, prompts, traces, evaluations, exports, and deletion.

architecture guide
guide

The Engineering Guide to Ontologies in Software, AI, and Data Systems

A comprehensive guide on ontology engineering—analyzing formal triples, W3C standards (RDF/OWL/SHACL), Domain-Driven Design integration, enterprise Data Mesh virtualization, and Neuro-Symbolic GraphRAG.

architecture guide
guide

Production RAG Reference Architecture & Retrieval Pipeline Guide

Production architecture blueprint for multi-stage RAG pipelines—covering chunking strategies, hybrid search fusion (RRF math), cross-encoder re-ranking, vector database indexing, and evaluation guardrails.

architecture guide
guide

Quantization Frontiers & Hardware Execution Guide

A production guide for FP8, INT4, AWQ, GPTQ, and Unsloth model quantization, scaling factors, and Tensor Core GEMM kernel execution on H100 and A100 GPUs.

architecture guide
guide

Secure Tool Execution

An execution boundary for untrusted model proposals, typed validation, authorization, credentials, sandboxing, egress, approvals, and verification.

architecture guide
guide

SuperAgent Harness & Sandboxed Execution Architecture Teardown

Production reference architecture teardown of sandboxed SuperAgent execution harnesses—analyzing Docker container isolation, declarative SKILL.md dynamic parsing, bash guardrails, and durable state persistence.

architecture guide
researched

AI Architecture Decision Workbook

Produce evidence-backed architecture decisions for model access context tools state evaluation security and operations.

project · foundation
researched

Production AI System-Design Casebook

Design three constrained AI systems and defend boundaries data flows failure handling evaluation and operating choices.

project · intermediate
researched

Production RAG Blueprint

Specify an evidence-carrying RAG system from source onboarding and indexing through retrieval citations evaluation and operations.

project · intermediate
researched

Governed Agent Reliability Project

Design a bounded agent with typed tools observable state recovery budgets approvals adversarial tests and incident controls.

project · advanced
researched

AI Evaluation Control-System Project

Build the evaluation architecture that converts product goals risks and production feedback into trustworthy release decisions.

project · advanced
researched

Cost and Latency Optimization Project

Optimize an inference service against workload quality tail-latency throughput reliability capacity and unit-economic constraints.

project · advanced
researched

Verifiable Autonomous AI Agent Project

Design and verify an autonomous treasury management AI agent that monitors oracle metrics, runs policy engine checks, simulates transactions, requests operator approval above spending thresholds, and executes non-custodial rebalances via an ERC-4337/EIP-7702 smart account with ZK execution verification.

project · advanced