Skip to main content

Enterprise Tier

Project and data plane management

A project is the boundary that keeps one team's or one application's setup separate from the next, and a data plane is the capacity that runs it. These guides cover the operator tasks for both: creating isolated projects, provisioning the gateways that serve them, deploying the data planes that host those gateways, and moving runtimes between data planes without disruption.

Three objects underpin every guide in this section. A short definition of each follows; the full treatment is in Key concepts and Planes and core components.

  • A project is the logical boundary that owns models, API keys, Model Context Protocol (MCP) servers and profiles, routing and policy, budgets, and members. It is also the isolation boundary: each project sees and serves only its own configuration.
  • A gateway is a single inference endpoint (one customer-facing URL) provisioned by a data plane and mapped to exactly one project. A project has no endpoint until a gateway is bound to it.
  • A data plane is the layer, deployed in a Kubernetes cluster, that provisions and manages gateways. One data plane can host many gateways, and one management plane can manage many data planes.

Set up a project

Create a project and grant models

Create the logical project and grant it the providers and models it may use.

Provision a gateway for a project

Give the project a live inference URL by provisioning and binding a gateway on a data plane.

Manage project members and access

Add members, assign roles, and keep project access separate from data-plane operations.

Issue a project-scoped API key

Create a key that works only against one project's gateway.

Grant MCP servers and profiles to a project

Scope MCP servers and profiles to a project under the same isolation as models.

Operate data planes

Deploy and register a data plane

Provision a data plane, install its credential, and connect it to the management plane.

Manage multiple gateways on a data plane

Review and assign the gateways a single data plane provisions and manages.

Migrate a gateway or upgrade its runtime

Move a gateway between data planes, or upgrade it in place, without changing its URL.