AI Assurance in UK Defence: Challenges in Operationalising JSP 936
2026-06-08 • Human-Computer Interaction
Human-Computer InteractionArtificial Intelligence
AI summaryⓘ
The authors studied how to apply JSP 936 Part 1, a UK Defence guideline for making sure AI systems are safe and trustworthy. They found eight main challenges, including proving AI works well, managing human roles, and handling ethics and security. Although JSP 936 is a good starting point, the authors note that actually using it is tricky due to technical, organizational, and assessment issues. They suggest more methods and guidance are needed to help Defence adopt AI safely and responsibly.
JSP 936AI assuranceUK Defencesystem of systemshuman-AI interactionAI safetyAI securityethical AIoperational environmentassurance methodologies
Authors
Callum Cockburn, Sam Farrow
Abstract
This report examines practical challenges in operationalising JSP 936 Part 1 for AI assurance in UK Defence. Using a structured interpretive review of the directive's requirements, the analysis identifies eight thematic challenge areas adequacy of evidence and argument, management of human interaction with AI, definition of the operational environment, integration of AI within systems of systems, assessment and maintenance of AI performance, analysis of safety and security, measurement of ethicality, and mitigation of the inherent complexities of AI. The report argues that JSP 936 provides a useful governance basis, but that implementation depends on unresolved technical, organisational, and assurance questions. These challenges stem from the socio-technical nature of AI-enabled systems, uncertainty in real-world deployment contexts, limitations in current assurance methodologies, and tensions between performance, safety, human oversight, security, and ethical acceptability. The report identifies areas where further methods, guidance, and organisational capability are needed for the ambitious, safe, and responsible adoption of AI across Defence. This is consistent with MOD's own framing of JSP 936 as requiring iterative implementation and supporting guidance.