Production project
Production RAG Blueprint
Specify an evidence-carrying RAG system from source onboarding and indexing through retrieval citations evaluation and operations.
Project evidence
0/4 milestones · rubric 0% · pass 75%
Corpus contract
A source inventory with owners permissions freshness parsing and deletion requirements.
Acceptance criteria
- Every source class has identity ownership and update semantics
- Access rules survive chunking and indexing
Use: context · drivers · decision · alternatives · consequences · risks · validation · rollback · evidence
Retrieval blueprint
An ingestion search reranking and context assembly design with tunable parameters.
Acceptance criteria
- Candidate retrieval and reranking are evaluated separately
- Context budgets and abstention behavior are explicit
Use: context · drivers · decision · alternatives · consequences · risks · validation · rollback · evidence
RAG evaluation system
A dataset and gate covering retrieval recall citation support usefulness refusal latency and cost.
Acceptance criteria
- Cases represent corpus types roles and known failures
- Release gates include slice-level and severity criteria
Use: context · drivers · decision · alternatives · consequences · risks · validation · rollback · evidence
RAG operations
Monitoring incident replay reindex rollback and source deletion procedures.
Acceptance criteria
- Traces separate ingestion retrieval reranking and generation
- Incidents become versioned regression cases
Use: context · drivers · decision · alternatives · consequences · risks · validation · rollback · evidence
Criterion-level self-assessment
Project rubric
Architecture coherence
Architecture coherence for Production RAG Blueprint is explicit, testable, and connected to submitted evidence. · weight 20%
Current level: Missing or contradicted by the submitted evidence.
Implementation evidence
Implementation evidence for Production RAG Blueprint is explicit, testable, and connected to submitted evidence. · weight 15%
Current level: Missing or contradicted by the submitted evidence.
Evaluation quality
Evaluation quality for Production RAG Blueprint is explicit, testable, and connected to submitted evidence. · weight 20%
Current level: Missing or contradicted by the submitted evidence.
Operational readiness
Operational readiness for Production RAG Blueprint is explicit, testable, and connected to submitted evidence. · weight 15%
Current level: Missing or contradicted by the submitted evidence.
Security and privacy
Security and privacy for Production RAG Blueprint is explicit, testable, and connected to submitted evidence. · weight 20%
Current level: Missing or contradicted by the submitted evidence.
Decision communication
Decision communication for Production RAG Blueprint is explicit, testable, and connected to submitted evidence. · weight 10%
Current level: Missing or contradicted by the submitted evidence.
Portable evidence
Attach project records
Text, HTTPS links, repository paths, and imported Markdown/JSON/text are stored locally and included in exports.
Project review checklist
Unresolved risks
One risk per line. A passing score does not erase open risk.