Sentinel Signal

Model Validation & Governance

Production decision-support controls for scoring reliability, drift response, and secure runtime defaults.

Home Docs Home Console

Validation Baseline

Current release uses stratified simulation validation across workflow-specific cohorts and operating points.

Calibrated probability outputs with confidence signals in every score response.
Deterministic model versioning with per-request model_version visibility.
Regime-aware denial routing with explicit distribution_profile controls and response routing metadata.
Workflow-scoped details under details.denial, details.prior_auth, and details.reimbursement.
Runtime lock checks for model artifacts, calibration snapshots, and threshold snapshots before API startup.

Drift monitoring and downgrade alerting with structured scoring telemetry.
Support for explicit model_version pinning and fallback controls.
Readiness endpoint /readyz for dependency and startup health checks.
Metrics endpoint family: /metrics (public Prometheus scrape) and /metrics.json (protected operator snapshot with metrics:read).
Incident-first posture: if material degradation is detected, deployments roll back to known-good locked artifacts.

Local full 5-seed pack: denial 20/25, prior-auth 20/20, reimbursement 13/15, cross-model 35/35.
Fly fast 5-seed pack: denial 20/25, prior-auth 20/20, reimbursement 11/15, cross-model 30/35.
Fly dual-machine rerun held both API machines started through benchmark + simulation and produced overall p95 latency 529.02 ms.
Machine profile used in dual-machine rerun: API 2 x shared 4 vCPU / 4096 MB, DB shared 4 vCPU / 4096 MB, token service shared 2 vCPU / 1024 MB.

API auth is enabled by default with bearer token enforcement.
Token and API key issuance require admin-token protected flows.
TLS is enforced at the Fly edge via HTTPS-only routing.
Operational endpoints: /health, /readyz, and /metrics are public; /metrics.json requires metrics:read.

For API integration details and endpoint behavior: /portal/docs-home

For machine-readable schema: /openapi.json