Model & Compute Platform — data model

Generated from the architecture model

This page is rendered from model/**/*.yaml by tools/docs_model during mkdocs build. Edit the YAML, not this page; hand-written design lives on the linked service, platform and plane pages.

ComputePoolService

erDiagram
    ComputePool {
        string poolId PK
        string tenantId
        enum_PoolKind kind
        enum_PoolState state
        string region
        enum_SecurityBoundary securityBoundary
        string gpuType
        int gpuCount
        int vramGb
        int cpuCores
        int ramGb
        decimal pricePerHourUsd
        decimal utilization
        int queueDepth
        int coldStartSeconds
        string endpointRef
        long version
    }
    PlacementDecision {
        guid placementId PK
        string tenantId
        string deploymentId
        guid runId
        json requirements
        json candidates
        string chosenPoolId
        enum_PlacementOutcome outcome
        datetime decidedAt
    }
    CachedModel {
        string model

        datetime loadedAt

        datetime lastUsedAt

        int vramGb

    }
    ComputePool ||--o{ CachedModel : contains

Hold "Alt" / "Option" to enable pan & zoom

CachedModel (entity)

A model currently loaded on the pool.

Field	Type	Required	Description
model	string	yes
loadedAt	datetime	yes
lastUsedAt	datetime	yes
vramGb	int	yes

Tables: dbo.ComputePools, dbo.PoolModelCache, dbo.PlacementDecisions — see the DDL appendix.

ModelRouterService

erDiagram
    ModelProfile {
        string profileId PK
        string version
        string releaseId
        string tenantId
        enum_Modality modality
        json requiredCapabilities
        enum_PrivacyClass privacyClass
        enum_LatencyClass latencyClass
        int maxContextTokens
        int maxOutputTokens
        list_string allowedRegions
        list_string allowedDeployments
        list_string fallbackChain
        bool fallbackEnabled
        string embeddingCompatibility
        string priceBasis
    }
    ModelDeployment {
        string deploymentId PK
        string tenantId
        string provider
        string model
        string region
        enum_PrivacyClass privacyClass
        string endpointRef
        string computePoolId
        string capabilityEvidenceRef
        json licenseMetadata
        enum_DeploymentState state
        bool healthy
        long version
    }
    RoutePlan {
        guid routePlanId PK
        guid runId
        string tenantId
        string profileId
        string profileVersion
        string policyRevision
        list_string candidates
        json constraints
        datetime resolvedAt
    }
    InvocationReceipt {
        guid invocationId PK
        string tenantId
        string projectId
        guid runId
        guid attemptId
        string profileId
        string deploymentId
        guid routePlanId
        bool fallbackUsed
        hash requestHash
        string idempotencyKey
        guid policyDecisionId
        enum_InvocationOutcome outcome
        enum_UsageStatus usageStatus
        int inputTokens
        int outputTokens
        decimal estimatedCostUsd
        string pricingRevision
        int latencyMs
        string outputArtifactRef
        datetime startedAt
        datetime endedAt
    }
    CapabilityScore {
        string capability

        string verdict

        decimal score

        datetime evaluatedAt

        string suiteVersion

    }
    ModelDeployment ||--o{ CapabilityScore : contains

Hold "Alt" / "Option" to enable pan & zoom

CapabilityScore (entity)

One evaluated capability of a deployment.

Field	Type	Required	Description
capability	string	yes	tool-calling, parallel-tool-calling, strict-json, json-schema, instruction-following, agent-task-success, patch-success, reliable-context, file-editing, shell-tool-usage, multi-turn, planning, error-recovery
verdict	string	yes	pass
score	decimal	no
evaluatedAt	datetime	yes
suiteVersion	string	yes

Tables: dbo.ModelProfiles, dbo.ModelDeployments, dbo.CapabilityScores, dbo.RoutePlans, dbo.InvocationReceipts — see the DDL appendix.