Model Swap

The weights changed, the hash was never checked, and behavior drifted in exactly one dangerous direction. Find the drift, prove it with evidence rather than impression, and put a gate in front of the next swap.

Advanced · Several moving parts — expect trade-offs and a wrong turn or two.

Outcome · Detect a compromised model, adapter or dependency before it reaches production.

Launch the linux desktop Open the workbench only How this is graded

George · 5 lines

Roles

• AI security engineer

• MLOps engineer

Standards mapping

NICE T0484

ATLAS AML.T0010, AML.T0031

OWASP LLM03, LLM05

Publish gate

Manifest valid · release 1.0.0

AI connection

This activity runs entirely on the deterministic runtime. Optional live-model runtimes only affect dialog, coaching and wording — never checks or scoring.

Deterministic simulationmode 0

Nothing leaves the browser session.

Chrome built-in AImode 1

Prompts never leave the learner's machine.

Bring your own keymode 2

Lab prompts reach the learner's chosen provider only.

Organization-owned AImode 3

Customer tenancy; Cybrary sees metadata only.

Cybrary-managed AImode 4

Cybrary AI gateway; retention off by default.

Hybrid routingmode 5

Per-job — the router never sends restricted jobs off-tenant.

Lab manifest

The machine-readable release contract. Authors edit this; the console refuses to publish without checks, both regression suites and a reference solve.

schemaVersion: cybrary.ai-lab/v1
id: model-swap
release: 1.0.0
mode: ai-range
maturity: 3
roles:
  - ai-security-engineer
  - mlops-engineer
outcomes:
  niceTasks:
    - T0484
  atlasTechniques:
    - AML.T0010
    - AML.T0031
  owaspRisks:
    - LLM03
    - LLM05
aiAssets:
  models:
    - support-agent-model@2026.06
  prompts:
    - model-swap-system-prompt@1
  agents:
    - support-agent-orchestrator@3
  tools:
    - crm.lookup
    - ticket.update
    - email.send
    - refund.issue
  corpora:
    - support-kb@v4
enterpriseTopology: support-enterprise-v3
scenario:
  seed: model-swap-seed-1
  injects:
    - model-swap-inject-1
telemetry:
  requiredSignals:
    - ai.trace
    - rag.retrieval
    - tool.call
    - identity.auth
    - dlp.egress
    - siem.alert
evaluation:
  deterministicChecks:
    - model-swap-checks
  repeatedTrials: 20
  maliciousSuite: model-swap-attack-v1
  benignSuite: support-utility-v4
safety:
  networkEgress: deny
  maxTokens: 250000
  maxCostUsd: 20