Printed from Production AI Institute public record

https://www.productionai.institute/insights/semantic-kernel-psf-assessment

Production AI Institute · Public recordRecord
Production AI Institute
Briefing
Briefing

Today's public AI briefing: what changed, what went wrong, and what the evidence says.

Open Briefing →
Today's AI briefingThe daily record of what changed and broke.Public record explorerSearch every incident, entity, and source.
Check
Check

Inspect tools, incidents, and data-use disclosures against the public record.

Open Check →
Check an AI toolWhat a tool actually does with your data.Run exposure checkTest your own stack against the record.Data-use indexDisclosures across the major AI tools.Incident registryDocumented production AI failures.
The Lab
The Lab

Independent research instruments: model and agent scorecards, moral-reasoning evals, and ecosystem assessments.

Open The Lab →
The LabHow frontier models and agents actually perform.AI Morality CompassTest models on hard moral cases.Agent readinessIs the agent ecosystem production-ready?Ecosystem assessmentsIndependent reviews of the AI stack.Model & agent evalsOpen evaluations and their results.Research libraryEvidence-led analysis and briefings.
Learn
Learn

The open standard, the tools built on it, and the research that interprets the record.

Open Learn →
The FrameworkThe open production safety framework, explained.AI Adoption GuideFive stages from gated access to safe autonomy.Production AI Deployment GuideBuild a governed production system on Microsoft or AWS.Five-Year Automation RoadmapSequence enterprise capability, controls, and value.WorkflowOS · open sourceBuild governed AI workflows.Workflow libraryReady-made governed workflows.InsightsResearch articles on the record.
Act
Act

Turn uncertainty into public evidence: ask, disclose, build evidence, or correct.

Open Act →
Ask for disclosureRequest a public data-use answer.Submit a correctionFlag something wrong or missing on the record.Save a watchTell PAI what to keep current for you.
Method
Method

How the public record is made, governed, corrected, cited, and kept independent.

Open Method →
How records are madeSourcing, review, and correction.
Check an AI tool
Record
Record
Check an AI tool
Production AI public record - EditorialMethod →
Ecosystem AssessmentPSF v1.1 · April 2026

Microsoft Semantic Kernel
PSF Assessment

Semantic Kernel is Microsoft's enterprise-grade AI orchestration SDK, with first-class support for .NET, Python, and Java. It is the default choice for organisations already invested in the Azure ecosystem. This assessment evaluates SK against all eight PSF domains as a standalone framework — before Azure-specific services are layered on top.

2
Strong
5
Partial
1
Gap
8
Domains assessed
Independence disclosure: PAI has no commercial relationship with Microsoft or any assessed company. This assessment was conducted independently against the published PSF v1.1 criteria. No payment was received. CC BY 4.0.

What is Semantic Kernel?

Semantic Kernel is an open-source SDK built and maintained by Microsoft. Originally .NET-first, it now has feature-parity Python and Java SDKs. SK's core model is the Kernel — a central orchestration object that manages AI services, plugins (callable functions), and memory. Agents are built by composing plugins and adding a planning layer.

SK is notable for being the orchestration layer underpinning Microsoft Copilot Studio and several Azure AI services. If you are building on the Microsoft stack — Azure OpenAI, Teams, M365 — Semantic Kernel is the natural and often prescribed integration point.

The framework has a mature enterprise posture: extensive documentation, long-term support commitments, and deep Azure integration for identity, secret management, and observability. The PSF assessment reflects SK as a standalone SDK; many Gap and Partial ratings improve substantially when Azure-native services are added.

PSF Scorecard

DomainRatingNotes
D1 · Input Governance
Partial
Kernel filters provide hook points; no built-in PII scanning or prompt injection defence
D2 · Output Validation
Partial
Function result hooks available; structured outputs depend on model + schema — not enforced by the framework
D3 · Data Protection
Gap
No managed PII handling; relies entirely on application layer and Azure services
D4 · Observability
Strong
First-class OpenTelemetry integration; Azure Monitor and App Insights fit naturally; function-level tracing built in
D5 · Deployment Safety
Partial
Azure hosting options provide canary and slot-based deployments; SK itself has no deployment primitives
D6 · Human Oversight
Partial
Step approval patterns documented for agent plans; not enforced — requires deliberate implementation
D7 · Security
Strong
Entra ID / Azure AD integration is native; RBAC, secret management via Azure Key Vault well-supported
D8 · Vendor Resilience
Partial
Model-agnostic connector layer is a genuine strength; however most production paths default to Azure OpenAI

D1 · Input Governance

Partial

SK provides Kernel filters — middleware-style hooks that intercept function calls, prompt rendering, and AI completions. These can be used to implement input validation, content filtering, or prompt injection detection. The hook point exists; the implementation does not.

There is no built-in PII detection, no prompt injection classifier, and no token budget enforcement out of the box. Azure AI Content Safety can be wired in as a plugin, but this requires deliberate configuration.

PRACTITIONER ACTION

Register a IPromptRenderFilter that runs a prompt injection classifier before every completion. For Azure deployments, wire in Azure AI Content Safety. Define a maximum token budget per request and enforce it in the filter chain.

D2 · Output Validation

Partial

SK supports structured outputs via JSON schema when the underlying model supports it. The IFunctionInvocationFilter can intercept function results and validate or transform them before they reach the calling agent.

There is no built-in output validation policy, content moderation on responses, or hallucination detection. Structured output schema enforcement is model-dependent. Teams building high-stakes outputs (financial calculations, medical summaries, legal language) need to implement their own validation layer.

D3 · Data Protection

Gap
UNIVERSAL FINDING ACROSS ALL FRAMEWORKS

No major agent framework — LangChain, CrewAI, AutoGen, or Semantic Kernel — provides built-in D3 compliance. Data protection is the practitioner's responsibility in every case. SK is consistent with this pattern.

SK has no PII detection, no data residency controls, no automatic redaction, and no consent tracking built into the framework. Text passed to prompts crosses into Azure OpenAI infrastructure by default.

Azure deployments do benefit from Microsoft's data processing addendum and GDPR commitments at the platform level. However, this does not substitute for application-layer D3 controls — particularly for prompt inputs that may contain PII extracted from business documents.

D4 · Observability

Strong

D4 is Semantic Kernel's strongest PSF domain. SK ships with first-class OpenTelemetry support — traces, metrics, and logs are emitted at the function invocation, prompt rendering, and model completion levels. Token usage, latency, and function call outcomes are all instrumented.

For Azure deployments, this telemetry flows naturally into Azure Monitor, Application Insights, and Log Analytics. Non-Azure teams can route the same telemetry to Langfuse, Grafana, Datadog, or any OpenTelemetry-compatible backend.

STANDOUT STRENGTH

SK's observability is production-grade out of the box. The combination of SK telemetry + Azure Application Insights provides end-to-end visibility with minimal configuration — arguably the strongest default observability story of any major agent framework.

D5 · Deployment Safety

Partial

SK has no deployment primitives — no canary release support, no feature flags, no rollback mechanisms. These are handled at the infrastructure layer (Azure App Service deployment slots, AKS rolling updates, Azure API Management). For teams on the Microsoft stack, these tools are readily available and well-documented.

The Partial rating reflects that the deployment safety story is available — but assembly required. SK does support configuration-driven model selection, which enables A/B testing between model versions without code changes.

D6 · Human Oversight

Partial

SK's AgentGroupChat and ProcessBuilder (introduced in SK v1.x) support approval steps — a human-in-the-loop agent that must confirm before plan execution continues. The pattern is documented and supported; it is not the default.

SK's stepwise planner can show its plan before executing — a useful oversight mechanism that many production teams will want to expose to human reviewers. Combined with the filter hooks in D1/D2, deliberate oversight architectures are straightforward to implement.

D7 · Security

Strong

Security is the second domain where SK earns a Strong rating. Microsoft Entra ID (formerly Azure Active Directory) integration is native — service principal authentication, managed identities, and RBAC are first-class patterns in SK's Azure-flavoured connectors.

Azure Key Vault integration for secrets is well-documented. Plugin permissions can be scoped. The SK team ships security advisories and follows Microsoft's SDL process.

The main caveat: SK's strong security story is largely an Azure story. Teams running SK against non-Azure models or in non-Azure environments will need to replicate these controls themselves.

D8 · Vendor Resilience

Partial

The SK architecture is designed to be model-agnostic. AI service connectors abstract the model layer — in principle you can swap Azure OpenAI for Anthropic, Ollama, or HuggingFace by changing a configuration line. This is a genuine architectural win for long-term resilience.

In practice, the D8 story is diluted by gravity. Most production SK deployments are on Azure OpenAI. The advanced features (assistant API, file handling, function calling reliability) are most tested against Azure OpenAI. Teams that genuinely need model portability will find the abstraction works, but the path of least resistance pulls toward Azure lock-in.

Semantic Kernel vs. the Field

DomainLangChainCrewAIAutoGenSem. Kernel
D1 Input Gov.
Partial
Gap
Partial
Partial
D2 Output Valid.
Partial
Gap
Partial
Partial
D3 Data Prot.
Gap
Gap
Gap
Gap
D4 Observability
Strong
Gap
Partial
Strong
D5 Deploy Safety
Partial
Gap
Partial
Partial
D6 Human Oversight
Partial
Partial
Strong
Partial
D7 Security
Partial
Gap
Partial
Strong
D8 Vendor Resil.
Strong
Partial
Strong
Partial

See the full four-way comparison guide →

When to Choose Semantic Kernel

CHOOSE SK WHEN
✓You are building on Azure and want native Entra ID, Key Vault, and App Insights integration
✓Your team is primarily .NET / C# and you want a framework with long-term Microsoft support
✓You are integrating with Microsoft 365, Teams, or Copilot Studio
✓Enterprise security and audit requirements demand a framework with a known vendor support path
✓You want strong observability without additional tooling investment
CONSIDER ALTERNATIVES WHEN
✗You need genuine multi-cloud or non-Azure model portability and will actively use non-Azure providers
✗Your team is Python-first and wants the broadest ecosystem of LangChain-compatible tooling
✗You need multi-agent coordination patterns that are more flexible than SK's current ProcessBuilder
✗You are not on Azure and cannot use the identity/security integrations that drive SK's D7 rating
✗Startup / fast-moving team — LangChain's larger community and more frequent releases may serve you better

PSF Deployment Checklist for Semantic Kernel

Before deploying a SK-based system to production, verify each item:

D1IPromptRenderFilter registered with prompt injection detection
D1Token budget enforced per request; no unbounded prompt growth
D2IFunctionInvocationFilter validates structured outputs against schema
D3PII scanner runs on all inputs before they reach the kernel (Microsoft Presidio or equivalent)
D3Data residency confirmed — Azure region, no cross-region transfer of regulated data
D4OpenTelemetry exporter configured; traces flowing to App Insights or equivalent
D4Token usage and cost metrics tracked per conversation session
D5Deployment slots or rolling update strategy defined for SK service
D5Model version pinned; upgrade path defined and tested
D6Human approval step implemented for any plan that mutates data or sends external communications
D7Service authenticates via Managed Identity (not API key strings in config)
D7All secrets in Azure Key Vault; no secrets in app config or environment variables
D8Fallback model configured; tested under simulated Azure OpenAI outage

Related assessments

LangChain PSF Assessment →CrewAI PSF Assessment →AutoGen PSF Assessment →Four-Way Framework Comparison →Explore the full ecosystem →
Public record

This record is maintained by PAI and free to cite. If something is wrong or missing, tell us. Corrections and source suggestions keep the record honest.

Follow policy changes ->Save a watch ->Submit a correction
Records are free to cite. citation guidance.
PAI
Production AI Institute

The public record and operating memory for production AI: what changed, what broke, and what the evidence says.

WorkflowOS · open source (MIT)
Navigate
Briefing
OverviewToday's AI briefingPublic record explorer
Check
Check an AI toolRun exposure checkData-use indexIncident registry
The Lab
The LabAI Morality CompassAgent readinessEcosystem assessmentsModel & agent evalsResearch library
Learn
The FrameworkAI Adoption GuideProduction AI Deployment GuideFive-Year Automation RoadmapWorkflowOS · open sourceWorkflow libraryInsights
Act
Ask for disclosureSubmit a correctionSave a watch
Method & trust
How records are madeCorrectionsHow to citeContact
© 2026 Production AI Institute · CC BY 4.0
AboutPrivacyTermsSecurityGovernanceIndependence