Seldon Enterprise Platform

Installing Seldon Enterprise Platform in a production environment.

You can install the Seldon Enterprise Platform in either a self-hosted Kubernetes cluster or a managed Kubernetes service provided by a cloud provider. For installation in a production environment, see cluster requirements.

In a production environment, before you proceed with the installation of Seldon Enterprise Platform you need to:

• Install Seldon Core 2

• Integrate managed Kafka services with Seldon Core 2. Or you can integrate a self-hosted Kafka with Seldon Core 2 for testing purposes.

• Seldon Enterprise Platform license key. You can reach out to Seldon's Support Team to get the license key.

To use Seldon Enterprise Platform you need to:

1. Install Seldon Enterprise Platform

2. Integrate Kafka with Seldon Enterprise Platform

Installing Seldon Enterprise Platform

Note: These configurations do not enable features such as Model Catalog, Monitoring and Alerting, Request logging, GitOps and others.

1. Install Knative Eventing core components in the Kubernetes cluster.

   kubectl apply -f https://github.com/knative/eventing/releases/download/knative-v1.12.2/eventing-crds.yaml
   kubectl apply -f https://github.com/knative/eventing/releases/download/knative-v1.12.2/eventing-core.yaml
   kubectl get crds | grep eventing.knative.dev

2. Create a YAML file to specify the initial configuration. For example, create the install-values.yaml file. Use your preferred text editor to create and save the file with the following content:

   image:
     image: seldonio/seldon-deploy-server:2.4.0
   
   rbac:
    opa:
      enabled:  false
    nsLabelsAuth:
      enabled:  true
   
   virtualService:
     create: false
   
   requestLogger:
     kafka_consumer:
       enabled: true
       bootstrap_servers: seldon-kafka-bootstrap.kafka.svc.cluster.local:9092
       group_id: metronome
       auto_offset_reset: earliest
   
   gitops:
     argocd:
       enabled: false
   
   enableAppAuth: false
   
   elasticsearch:
     basicAuth: false
   
   seldon:
     enabled: false
     knativeEnabled: false
   
   seldonCoreV2:
     enabled: true

3. Change to the directory that contains the install-values.yaml file and then install Seldon Enterprise Platform in the namespace seldon-system.

   helm install seldon-enterprise seldon-charts/seldon-deploy --namespace seldon-system  -f install-values.yaml --version 2.4.0

   When the installation is successful, you should see this:

   NAME: seldon-enterprise
   LAST DEPLOYED: Fri Jul 26 16:43:44 2024
   NAMESPACE: seldon-system
   STATUS: deployed
   REVISION: 1
   NOTES:
   1. Get the application URL by running these commands:
     export POD_NAME=$(kubectl get pods --namespace seldon-system -l "app.kubernetes.io/name=seldon-deploy,app.kubernetes.io/instance=seldon-enterprise" -o jsonpath="{.items[0].metadata.name}")
     echo "Visit http://127.0.0.1:8000/seldon-deploy/ to use your application"
     kubectl port-forward $POD_NAME 8000:8000 --namespace seldon-system

4. Check the status of the installation seldon-enterprise-seldon-deploy.

   kubectl rollout status deployment/seldon-enterprise-seldon-deploy -n seldon-system

   When the installation is complete you should see this:

   deployment "seldon-enterprise-seldon-deploy" successfully rolled out

5. Get the Pod that is running Seldon Enterprise Platform in the cluster and save it as $POD_NAME.

   export POD_NAME=$(kubectl get pods --namespace seldon-system -l "app.kubernetes.io/name=seldon-deploy,app.kubernetes.io/instance=seldon-enterprise" -o jsonpath="{.items[0].metadata.name}")

6. You can use port-forwarding to access your application.

   kubectl port-forward $POD_NAME 8000:8000 --namespace seldon-system

7. Open your browser and navigate to http://127.0.0.1:8000/seldon-deploy/ to access Seldon Enterprise Platform with Seldon Core 2 resources, operator, runtimes and servers.

   

   Seldon Enterprise Platform
8. Apply the trial license and click Activate. Upon a successful activation, you will be redirected to the Seldon Enterprise Platform dashboard.

Configuring Seldon Enterprise Platform

To integrate Kafka with Seldon Enterprise Platform.

1. Create secrets for the managed Kafka cloud services.

2. Update the initial configuration.

Azure Event Hub with SASL

Note: In these configurations you may need:

• set the value for username as $ConnectionString this is not a variable.

• replace <namespace> with the namespace in Azure Event Hub.

Update the initial configuration for Seldon Enterprise Platform in the install-values.yaml file. Use your preferred text editor to update and save the file with the following content:

image:
  image: seldonio/seldon-deploy-server:2.4.0

rbac:
 opa:
   enabled:  false
 nsLabelsAuth:
   enabled:  true

virtualService:
  create: false

requestLogger:
  kafka_consumer:
    enabled: true
    bootstrap_servers: <namespace>.servicebus.windows.net:9093
    protocol: SASL_SSL
    sasl:
      mechanism: "PLAIN"
      client:
        username: $ConnectionString
        secret: azure-kafka-secret
    ssl:
      client:
        secret:
        brokerValidationSecret:

gitops:
  argocd:
    enabled: false

enableAppAuth: false

elasticsearch:
  basicAuth: false

seldon:
  enabled: false
  knativeEnabled: false

seldonCoreV2:
  enabled: true

Confluent Cloud with SASL

Confluent Cloud with OAuth2.0

1. To enable Kafka Encryption (TLS) you need to reference the secret that you created in the security.kafka.ssl.client.secret field of the Helm chart values. The resulting set of values to include in install-values.yaml is similar to:

security:
  kafka:
    ssl:
      secret:
        brokerValidationSecret: kafka-broker-tls

1. Change to the directory that contains the install-values.yaml file and then upgrade Seldon Enterprise Platform in the namespace seldon-system.

   helm upgrade seldon-enterprise seldon-charts/seldon-deploy --namespace seldon-system  -f install-values.yaml --version 2.4.0 --install

Next

You may now explore the Model Explanations with Image Data feature in Seldon Enterprise Platform.