Skip to content

Observability — events

Generated from the architecture model

This page is rendered from model/**/*.yaml by tools/docs_model during mkdocs build. Edit the YAML, not this page; hand-written design lives on the linked service, platform and plane pages.

Topics follow context.area.vN.event-name (ADR-0012 port, ADR-0014 envelope). The context segment is the producing bounded context's slug.

Event Producer Topic Scope Consumers
AlertRuleChanged AlertRuleService operations.alerts.v1.alert-rule-changed integration 2
AlertFired AlertRuleService operations.alerts.v1.alert-fired integration 5
AlertResolved AlertRuleService operations.alerts.v1.alert-resolved integration 3
RunProjectionUpdated DashboardService operations.projections.v1.run-projection-updated integration 2
OperationsDigestProduced DashboardService operations.projections.v1.operations-digest-produced integration 2
FeedbackRecorded FeedbackService evaluation.feedback.v1.feedback-recorded integration 2
DatasetPublished FeedbackService evaluation.datasets.v1.dataset-published integration 2
LearningProposalRaised FeedbackService evaluation.learning.v1.learning-proposal-raised integration 3
LearningProposalDecided FeedbackService evaluation.learning.v1.learning-proposal-decided integration 3
EvaluationSuiteActivated QualityScoreService evaluation.suites.v1.evaluation-suite-activated integration 2
EvaluationStarted QualityScoreService evaluation.runs.v1.evaluation-started integration 2
EvaluationCompleted QualityScoreService evaluation.runs.v1.evaluation-completed integration 6
EvaluationFailed QualityScoreService evaluation.runs.v1.evaluation-failed integration 2
DriftDetected QualityScoreService evaluation.runs.v1.drift-detected integration 4
SloDefined SloService operations.slos.v1.slo-defined integration 2
SloBreached SloService operations.slos.v1.slo-breached integration 5
SloRecovered SloService operations.slos.v1.slo-recovered integration 3
ServiceHealthChanged SloService operations.health.v1.service-health-changed integration 3

AlertRuleChanged

A rule was created, changed or deactivated.

Producer AlertRuleService (BC-21 Operations)
Scope / version integration / v1
Topic operations.alerts.v1.alert-rule-changed
Aggregate AlertRule
Consumers StudioBff, AuditService
Field Type Required Description
ruleId guid yes
tenantId string yes
name string yes
active bool yes

AlertFired

An alert fired (or re-occurred).

Producer AlertRuleService (BC-21 Operations)
Scope / version integration / v1
Topic operations.alerts.v1.alert-fired
Aggregate AlertInstance
Consumers StudioRealtimeGateway, FleetIncidentService, StudioBff, StudioNotificationService, DashboardService
Field Type Required Description
alertId guid yes
tenantId string yes
ruleId guid yes
severity enum:AlertSeverity yes
sourceRef string yes
dedupKey string yes

AlertResolved

An alert was resolved.

Producer AlertRuleService (BC-21 Operations)
Scope / version integration / v1
Topic operations.alerts.v1.alert-resolved
Aggregate AlertInstance
Consumers StudioRealtimeGateway, StudioBff, DashboardService
Field Type Required Description
alertId guid yes
tenantId string yes
resolvedBy string no

RunProjectionUpdated

A run projection changed.

Producer DashboardService (BC-21 Operations)
Scope / version integration / v1
Topic operations.projections.v1.run-projection-updated
Aggregate RunProjection
Consumers StudioRealtimeGateway, StudioBff
Field Type Required Description
runId guid yes
tenantId string yes
state string yes
lastEventSequence long yes

OperationsDigestProduced

Overview aggregates recomputed for a window.

Producer DashboardService (BC-21 Operations)
Scope / version integration / v1
Topic operations.projections.v1.operations-digest-produced
Aggregate OverviewProjection
Consumers StudioBff, SloService
Field Type Required Description
tenantId string yes
window string yes
computedAt datetime yes

FeedbackRecorded

Feedback exists on a subject.

Producer FeedbackService (BC-22 Evaluation & Learning)
Scope / version integration / v1
Topic evaluation.feedback.v1.feedback-recorded
Aggregate HumanFeedback
Consumers DashboardService, StudioBff
Field Type Required Description
feedbackId guid yes
tenantId string yes
subjectKind string yes
subjectRef string yes
kind enum:FeedbackKind yes
rating int no

DatasetPublished

A dataset version is available to suites.

Producer FeedbackService (BC-22 Evaluation & Learning)
Scope / version integration / v1
Topic evaluation.datasets.v1.dataset-published
Aggregate Dataset
Consumers QualityScoreService, StudioBff
Field Type Required Description
datasetId guid yes
tenantId string yes
name string yes
version int yes
taskCount int yes

LearningProposalRaised

A proposal with evidence awaits a maintainer.

Producer FeedbackService (BC-22 Evaluation & Learning)
Scope / version integration / v1
Topic evaluation.learning.v1.learning-proposal-raised
Aggregate LearningProposal
Consumers StudioBff, StudioNotificationService, AuditService
Field Type Required Description
proposalId guid yes
tenantId string yes
kind enum:ProposalKind yes
targetAssetId string yes
targetVersion string yes

LearningProposalDecided

A proposal was accepted (release candidate opened) or rejected.

Producer FeedbackService (BC-22 Evaluation & Learning)
Scope / version integration / v1
Topic evaluation.learning.v1.learning-proposal-decided
Aggregate LearningProposal
Consumers StudioBff, AuditService, AgentRegistryService
Field Type Required Description
proposalId guid yes
tenantId string yes
state enum:ProposalState yes
resultingReleaseId string no

EvaluationSuiteActivated

A suite version is active.

Producer QualityScoreService (BC-22 Evaluation & Learning)
Scope / version integration / v1
Topic evaluation.suites.v1.evaluation-suite-activated
Aggregate EvaluationSuite
Consumers StudioBff, AuditService
Field Type Required Description
suiteId string yes
version string yes
tenantId string yes
target enum:EvaluationTarget yes

EvaluationStarted

An evaluation run started.

Producer QualityScoreService (BC-22 Evaluation & Learning)
Scope / version integration / v1
Topic evaluation.runs.v1.evaluation-started
Aggregate EvaluationRun
Consumers StudioBff, DashboardService
Field Type Required Description
evaluationId guid yes
tenantId string yes
suiteId string yes
targetReleaseId string yes
baselineReleaseId string no

EvaluationCompleted

A verdict and evidence record exist.

Producer QualityScoreService (BC-22 Evaluation & Learning)
Scope / version integration / v1
Topic evaluation.runs.v1.evaluation-completed
Aggregate EvaluationRun
Consumers AgentRegistryService, ModelRouterService, FeedbackService, StudioBff, AuditService, DashboardService
Field Type Required Description
evaluationId guid yes
tenantId string yes
suiteId string yes
targetReleaseId string yes
verdict enum:Verdict yes
evidenceRef string yes
kind string yes capability-suite

EvaluationFailed

The evaluation could not complete (infrastructure).

Producer QualityScoreService (BC-22 Evaluation & Learning)
Scope / version integration / v1
Topic evaluation.runs.v1.evaluation-failed
Aggregate EvaluationRun
Consumers StudioBff, DashboardService
Field Type Required Description
evaluationId guid yes
tenantId string yes
reason string yes

DriftDetected

Production outcomes of a release drifted below its evaluated scores.

Producer QualityScoreService (BC-22 Evaluation & Learning)
Scope / version integration / v1
Topic evaluation.runs.v1.drift-detected
Aggregate EvaluationRun
Consumers StudioBff, AlertRuleService, FeedbackService, DashboardService
Field Type Required Description
tenantId string yes
targetReleaseId string yes
metric string yes
evaluated decimal yes
observed decimal yes

SloDefined

An objective was defined or changed.

Producer SloService (BC-21 Operations)
Scope / version integration / v1
Topic operations.slos.v1.slo-defined
Aggregate SloDefinition
Consumers StudioBff, AuditService
Field Type Required Description
sloId guid yes
tenantId string yes
subjectKind string yes
subjectId string yes
kind enum:ObjectiveKind yes
target decimal yes

SloBreached

An objective is breached or burning fast.

Producer SloService (BC-21 Operations)
Scope / version integration / v1
Topic operations.slos.v1.slo-breached
Aggregate SloDefinition
Consumers FleetRolloutService, FleetInventoryService, AlertRuleService, StudioBff, DashboardService
Field Type Required Description
sloId guid yes
tenantId string yes
subjectKind string yes
subjectId string yes
kind enum:ObjectiveKind yes
value decimal yes
state enum:SloState yes

SloRecovered

An objective is meeting again.

Producer SloService (BC-21 Operations)
Scope / version integration / v1
Topic operations.slos.v1.slo-recovered
Aggregate SloDefinition
Consumers FleetInventoryService, AlertRuleService, StudioBff
Field Type Required Description
sloId guid yes
tenantId string yes
kind enum:ObjectiveKind yes

ServiceHealthChanged

A host's health rollup changed.

Producer SloService (BC-21 Operations)
Scope / version integration / v1
Topic operations.health.v1.service-health-changed
Aggregate ServiceHealth
Consumers AlertRuleService, StudioBff, DashboardService
Field Type Required Description
hostId string yes
tenantId string yes
fromState enum:HealthState yes
toState enum:HealthState yes

Commands

Command Service Handled by Result events Summary
AcknowledgeAlert AlertRuleService AlertInstance
ResolveAlert AlertRuleService AlertInstance AlertResolved
SetAlertRule AlertRuleService AlertRule AlertRuleChanged
RebuildRunProjection DashboardService RunProjection RunProjectionUpdated
RecordFeedback FeedbackService HumanFeedback FeedbackRecorded
SnapshotDataset FeedbackService Dataset DatasetPublished
DecideLearningProposal FeedbackService LearningProposal LearningProposalDecided
StartEvaluation QualityScoreService EvaluationRun EvaluationStarted
WaiveEvaluation QualityScoreService EvaluationRun EvaluationCompleted
SetSlo SloService SloDefinition SloDefined

Consumed from other services

Consumer Event Producer Handler Purpose
AlertRuleService SloBreached SloService FireFromSlo Breaches and fast burns.
AlertRuleService SloRecovered SloService ResolveFromSlo Auto-resolve.
AlertRuleService ServiceHealthChanged SloService FireFromHealth Host health degradations.
AlertRuleService ToolEffectUncertain ToolAdapterService FireFromUncertain Uncertain effects need an operator.
AlertRuleService FindingRaised AuditService FireFromFinding High and Critical findings.
AlertRuleService DeliveryFailed ConnectorRegistryService FireFromDelivery Failed deliveries.
DashboardService RunAccepted RunControlService ProjectRun Open the run projection.
DashboardService RunStateChanged RunControlService ProjectRun State transitions.
DashboardService RunCompleted RunControlService ProjectRun Terminal state and duration.
DashboardService RunFailed RunControlService ProjectRun Terminal state and failure class.
DashboardService AttemptDispatched RunControlService ProjectAttempt Attempts and leases.
DashboardService AttemptOutcomeRecorded RunControlService ProjectAttempt Outcomes.
DashboardService AttemptPhaseChanged AgentRuntimeService ProjectAttempt Phases on the timeline.
DashboardService ModelInvoked ModelRouterService ProjectReceipt Model receipts, tokens, cost.
DashboardService ToolInvoked ToolAdapterService ProjectReceipt Tool receipts and outcomes.
DashboardService ContextAssembled ContextBuilderService ProjectContext Context snapshots and budgets.
DashboardService UsageRecorded CostUsageService ProjectUsage Usage by status.
DashboardService ReservationSettled CostUsageService ProjectUsage Settlement.
DashboardService StepRunStateChanged WorkflowEngineService ProjectWorkflow Workflow step states.
FeedbackService RunCompleted RunControlService HarvestTask Completed runs become dataset task candidates (learning loop §32).
FeedbackService EvaluationCompleted QualityScoreService RaiseFromEvaluation Failed gates and regressions raise proposals with evidence.
FeedbackService DriftDetected QualityScoreService RaiseFromDrift Drift raises re-evaluation and improvement proposals.
FeedbackService SkillCandidateProposed MemoryPromotionService RaiseSkillProposal Reinforced procedural memory becomes a skill-improvement proposal.
FeedbackService ArtifactValidated ArtifactService HarvestValidation Validator outcomes enrich dataset tasks.
QualityScoreService AssetReleaseSubmitted AgentRegistryService RunReleaseGate Evaluate every candidate release with the suite of its kind (publication gate).
QualityScoreService RunCompleted RunControlService ScoreEvaluationTask Score tasks of evaluation runs and feed production outcome statistics.
QualityScoreService AttemptOutcomeRecorded RunControlService CollectOutcome Outcome statistics per release for drift.
QualityScoreService AttemptOutcomeReported AgentRuntimeService CollectRuntimeStats Corrections, call counts.
QualityScoreService ModelInvoked ModelRouterService CollectModelStats Structured-output and tool-call reliability per deployment.
QualityScoreService ToolInvoked ToolAdapterService CollectToolStats Tool selection and argument validity.
QualityScoreService ContextAssembled ContextBuilderService CollectContextStats Context retrieval quality signals.
QualityScoreService RetrievalExecuted VectorMemoryService CollectRetrievalStats Retrieval quality.
QualityScoreService ArtifactValidated ArtifactService CollectValidationStats Validator outcomes (patch compile, tests).
QualityScoreService ApprovalDecided RunControlService ApplyWaiver Record waivers once approved.
SloService OperationsDigestProduced DashboardService EvaluateSlos Compute objective values from the overview digests.