Skip to content

Model & Compute Platform — microservices

Generated from the architecture model

This page is rendered from model/**/*.yaml by tools/docs_model during mkdocs build. Edit the YAML, not this page; hand-written design lives on the linked service, platform and plane pages.

Every logical service keeps its own design page and model entry; deployment granularity says how it is shipped at first (decision D23). Modules of a host are deployed inside that host until an extraction decision is recorded.

flowchart TB
    subgraph ModelGatewayHost["ModelGatewayHost (host)"]
        ComputePoolService["ComputePoolService"]
        ModelPolicyService["ModelPolicyService"]
        ModelRouterService["ModelRouterService"]
    end
    AzureOpenAIIntegrationService[("AzureOpenAIIntegrationService<br/>external")]
    OllamaIntegrationService[("OllamaIntegrationService<br/>external")]
    OpenAIIntegrationService[("OpenAIIntegrationService<br/>external")]
    classDef later stroke-dasharray: 4 4;
Hold "Alt" / "Option" to enable pan & zoom
Service Context Granularity Host Status Page
AzureOpenAIIntegrationService BC-07 external / canonical — unmodelled —
ComputePoolService BC-41 module of host ModelGatewayHost target design
ModelGatewayHost BC-07 standalone host — target design
ModelPolicyService BC-07 module of host ModelGatewayHost unmodelled —
ModelRouterService BC-07 module of host ModelGatewayHost target design
OllamaIntegrationService BC-07 external / canonical — unmodelled —
OpenAIIntegrationService BC-07 external / canonical — unmodelled —

AzureOpenAIIntegrationService

Existing ConnectSoft.Extensions.AI adapters; not services

Bounded context BC-07 Model Access
Granularity external / canonical · ref ext-extensions-ai
Former catalog group Integration Platform (external)
Status unmodelled
Design page not written yet

ComputePoolService

Model-serving compute pools, placement and warm state.

Bounded context BC-41 Compute Pools & Placement
Granularity module of host · host ModelGatewayHost
Former catalog group (added 2026-10-09) (module)
Status target
Modelled 2 aggregates · 5 REST + 2 gRPC · 5 events · 2 workers · 3 tables
Design page planes/model-compute/services/compute-pool-service/index.md

ModelGatewayHost

Model gateway pipeline host (in-process first; separate host when evidence requires).

Bounded context BC-07 Model Access
Granularity standalone host
Former catalog group (host added 2026-10-09) (module)
Status target
Modelled 0 aggregates · 2 REST + 0 gRPC · 0 events · 0 workers · 0 tables
Design page planes/model-compute/services/model-gateway-host/index.md

ModelPolicyService

Profile and policy revisions; merged into ModelRouterService (profiles are Published assets).

Bounded context BC-07 Model Access
Granularity module of host · host ModelGatewayHost
Former catalog group Control Plane (merge)
Status unmodelled
Design page not written yet

ModelRouterService

Model gateway pipeline (GW-04): route plans from capability evidence and policy, adapters with streaming and structured outputs, invocation receipts with usage status (BC-07).

Bounded context BC-07 Model Access
Granularity module of host · host ModelGatewayHost
Former catalog group Agent Mesh (module)
Status target
Modelled 4 aggregates · 8 REST + 4 gRPC · 7 events · 3 workers · 5 tables
Design page planes/model-compute/services/model-router-service/index.md

OllamaIntegrationService

Existing ConnectSoft.Extensions.AI adapters; not services

Bounded context BC-07 Model Access
Granularity external / canonical · ref ext-extensions-ai
Former catalog group Integration Platform (external)
Status unmodelled
Design page not written yet

OpenAIIntegrationService

Existing ConnectSoft.Extensions.AI adapters; not services

Bounded context BC-07 Model Access
Granularity external / canonical · ref ext-extensions-ai
Former catalog group Integration Platform (external)
Status unmodelled
Design page not written yet