Model & Compute Platform — microservices¶
Generated from the architecture model
This page is rendered from model/**/*.yaml by tools/docs_model during mkdocs build. Edit the YAML, not this page; hand-written design lives on the linked service, platform and plane pages.
Every logical service keeps its own design page and model entry; deployment granularity says how it is shipped at first (decision D23). Modules of a host are deployed inside that host until an extraction decision is recorded.
flowchart TB
subgraph ModelGatewayHost["ModelGatewayHost (host)"]
ComputePoolService["ComputePoolService"]
ModelPolicyService["ModelPolicyService"]
ModelRouterService["ModelRouterService"]
end
AzureOpenAIIntegrationService[("AzureOpenAIIntegrationService<br/>external")]
OllamaIntegrationService[("OllamaIntegrationService<br/>external")]
OpenAIIntegrationService[("OpenAIIntegrationService<br/>external")]
classDef later stroke-dasharray: 4 4;
| Service | Context | Granularity | Host | Status | Page |
|---|---|---|---|---|---|
| AzureOpenAIIntegrationService | BC-07 | external / canonical | — | unmodelled | — |
| ComputePoolService | BC-41 | module of host | ModelGatewayHost | target | design |
| ModelGatewayHost | BC-07 | standalone host | — | target | design |
| ModelPolicyService | BC-07 | module of host | ModelGatewayHost | unmodelled | — |
| ModelRouterService | BC-07 | module of host | ModelGatewayHost | target | design |
| OllamaIntegrationService | BC-07 | external / canonical | — | unmodelled | — |
| OpenAIIntegrationService | BC-07 | external / canonical | — | unmodelled | — |
AzureOpenAIIntegrationService¶
Existing ConnectSoft.Extensions.AI adapters; not services
| Bounded context | BC-07 Model Access |
| Granularity | external / canonical · ref ext-extensions-ai |
| Former catalog group | Integration Platform (external) |
| Status | unmodelled |
| Design page | not written yet |
ComputePoolService¶
Model-serving compute pools, placement and warm state.
| Bounded context | BC-41 Compute Pools & Placement |
| Granularity | module of host · host ModelGatewayHost |
| Former catalog group | (added 2026-10-09) (module) |
| Status | target |
| Modelled | 2 aggregates · 5 REST + 2 gRPC · 5 events · 2 workers · 3 tables |
| Design page | planes/model-compute/services/compute-pool-service/index.md |
ModelGatewayHost¶
Model gateway pipeline host (in-process first; separate host when evidence requires).
| Bounded context | BC-07 Model Access |
| Granularity | standalone host |
| Former catalog group | (host added 2026-10-09) (module) |
| Status | target |
| Modelled | 0 aggregates · 2 REST + 0 gRPC · 0 events · 0 workers · 0 tables |
| Design page | planes/model-compute/services/model-gateway-host/index.md |
ModelPolicyService¶
Profile and policy revisions; merged into ModelRouterService (profiles are Published assets).
| Bounded context | BC-07 Model Access |
| Granularity | module of host · host ModelGatewayHost |
| Former catalog group | Control Plane (merge) |
| Status | unmodelled |
| Design page | not written yet |
ModelRouterService¶
Model gateway pipeline (GW-04): route plans from capability evidence and policy, adapters with streaming and structured outputs, invocation receipts with usage status (BC-07).
| Bounded context | BC-07 Model Access |
| Granularity | module of host · host ModelGatewayHost |
| Former catalog group | Agent Mesh (module) |
| Status | target |
| Modelled | 4 aggregates · 8 REST + 4 gRPC · 7 events · 3 workers · 5 tables |
| Design page | planes/model-compute/services/model-router-service/index.md |
OllamaIntegrationService¶
Existing ConnectSoft.Extensions.AI adapters; not services
| Bounded context | BC-07 Model Access |
| Granularity | external / canonical · ref ext-extensions-ai |
| Former catalog group | Integration Platform (external) |
| Status | unmodelled |
| Design page | not written yet |
OpenAIIntegrationService¶
Existing ConnectSoft.Extensions.AI adapters; not services
| Bounded context | BC-07 Model Access |
| Granularity | external / canonical · ref ext-extensions-ai |
| Former catalog group | Integration Platform (external) |
| Status | unmodelled |
| Design page | not written yet |