Skip to content

Probe Configuration

Probe Configuration

The probe reads config/default.yaml at startup. Environment variables override YAML values.

govern:
api_url: https://govern-api.ben-c1f.workers.dev
# org_id: set via GOVERN_ORG_ID env var
# api_key: set via GOVERN_API_KEY env var
target:
url: http://localhost:8080/v1/chat/completions
proxy:
listen_port: 9090
timeout_ms: 30000
telemetry:
batch_interval_seconds: 60
buffer_size: 1000
policy:
sync_interval_seconds: 30
heartbeat:
interval_seconds: 30
drift:
baseline_days: 7
warning_threshold: 0.15
alert_threshold: 0.30
critical_threshold: 0.50
scoring:
mode: log
sampling_rate: 1.0

Telemetry

Telemetry is buffered in a ring buffer (max 1000 events) and flushed every 60 seconds. Each batch includes:

MetricUnitDescription
latency_p50_msmsMedian response latency
latency_p95_msms95th percentile latency
latency_p99_msms99th percentile latency
tokens_inputcountTotal input tokens in batch
tokens_outputcountTotal output tokens in batch
request_countcountNumber of requests in batch
error_rateratioFraction of requests with violations
security_score0-1Max security score in batch
bias_score0-1Max bias score in batch
accuracy_score0-1Max hallucination score in batch
cost_score0-1Cost budget utilization