Alauda AI

Install Envoy AI Gateway

TOC

Download the Operator PackageUpload the Operator PackageInstalling Alauda Build of Envoy AI GatewayVerify the InstallationUpgrading Alauda Build of Envoy AI Gateway

Download the Operator Package

INFO

Alauda Build of Envoy AI Gateway Operator package can be retrieved from Customer Portal.

Please contact Customer Support for more information.

Upload the Operator Package

Download the Alauda Build of Envoy AI Gateway Operator installation file, for example envoy-ai-gateway.alpha.ALL.v0.4.x.tgz.

Use violet to upload the package to the platform repository:

violet push --platform-address=<platform-access-address> --platform-username=<platform-admin> --platform-password=<platform-admin-password> envoy-ai-gateway.alpha.ALL.v0.4.x.tgz
WARNING

Before installing the Operator, uninstall the existing Alauda Build of Envoy AI Gateway cluster plugin from the target cluster if it was previously installed as a cluster plugin. Go to Administrator -> Marketplace -> Cluster Plugins, find Alauda Build of Envoy AI Gateway, and uninstall it from the target cluster.

Installing Alauda Build of Envoy AI Gateway

In Administrator view:

  1. Go to Marketplace / OperatorHub.
  2. Select the destination cluster.
  3. Search for Alauda Build of Envoy AI Gateway.
  4. Click Install.
  5. Keep the default installation settings unless the environment requires a different namespace.
  6. Complete the installation.

Verify the Installation

After installation, verify that the operator is running:

kubectl get pods -n envoy-gateway-system | grep "ai-gateway"

The Envoy AI Gateway pods should be in Running state.

Upgrading Alauda Build of Envoy AI Gateway

  1. Upload the new version of the Alauda Build of Envoy AI Gateway Operator package using the violet tool.
  2. Go to the Administrator -> Marketplace -> OperatorHub page, find Alauda Build of Envoy AI Gateway, and click Confirm to apply the new version.