PSF v1.0 Rationale and Development History
This document records the reasoning behind each PSF domain and the choices made during framework development. It is intended to help practitioners understand why the framework is structured as it is, and to provide the basis for community feedback on future versions.
Why eight domains
The eight-domain structure emerged from iterative analysis of documented AI production failures and near-misses collected during the framework’s development phase. The initial scoping exercise identified fourteen candidate domains. These were consolidated to eight through a process of merging domains where the engineering controls were substantially similar, and eliminating domains where the failure modes were adequately covered by existing non-AI-specific standards (such as ISO 27001 for general information security).
The eight remaining domains represent the areas where AI systems in production settings create failure modes that are meaningfully different from those of conventional software — either because the failure modes are novel (prompt injection, hallucination, model drift) or because existing standards do not provide sufficient specificity for AI deployment contexts (human oversight governance, output contract design).
Domain-level rationale
Design decisions and tradeoffs
Several design questions required explicit decisions during framework development. The reasoning behind the less-obvious choices is documented here.
Domain weighting in AIDA assessment
The 20-question AIDA exam was designed to reflect incident frequency data showing PSF-1 and PSF-2 as the most common failure domains. PSF-1 and PSF-2 are each represented by 3 questions rather than 2 to weight the exam toward the areas where real-world failures concentrate.
L4 autonomy level definition
L4 (fully autonomous) is marked not-recommended for high-stakes decisions rather than prohibited. This is because some fully autonomous operations on low-consequence tasks are appropriate, and prohibiting L4 categorically would create unnecessary compliance overhead for benign use cases. The framework relies on the high-stakes classification to carry the weight.
Vendor resilience as a deployer obligation
PSF-8 places vendor resilience as a deployer obligation rather than a provider responsibility. The reasoning is that deployers who depend on a single provider without fallback are making an active resilience decision — the risk materialises in their deployment regardless of where it originates. Framing it as a deployer concern makes it actionable.
Published by the Production AI Institute, August 2024. Licensed CC BY 4.0.
Related: Full Production Safety Framework · AIDA exam · All research