Seldon Enterprise Platform

Installing Seldon Enterprise Platform in a production environment.

You can install the Seldon Enterprise Platform in either a self-hosted Kubernetes cluster or a managed Kubernetes service provided by a cloud provider. For installation in a production environment, see cluster requirements.

In a production environment, before you proceed with the installation of Seldon Enterprise Platform you need to:

To use Seldon Enterprise Platform you need to:

  1. Install Seldon Enterprise Platform

  2. Integrate Kafka with Seldon Enterprise Platform

Installing Seldon Enterprise Platform

Note: These configurations do not enable features such as Model Catalog, Monitoring and Alerting, Request logging, GitOps and others.

  1. Install Knative Eventing core components in the Kubernetes cluster.

    kubectl apply -f https://github.com/knative/eventing/releases/download/knative-v1.12.2/eventing-crds.yaml
kubectl apply -f https://github.com/knative/eventing/releases/download/knative-v1.12.2/eventing-core.yaml
kubectl get crds | grep eventing.knative.dev

  2. Create a YAML file to specify the initial configuration. For example, create the install-values.yaml file. Use your preferred text editor to create and save the file with the following content:

    image:
  image: seldonio/seldon-deploy-server:2.4.0

rbac:
 opa:
   enabled:  false
 nsLabelsAuth:
   enabled:  true

virtualService:
  create: false

requestLogger:
  kafka_consumer:
    enabled: true
    bootstrap_servers: seldon-kafka-bootstrap.kafka.svc.cluster.local:9092
    group_id: metronome
    auto_offset_reset: earliest

gitops:
  argocd:
    enabled: false

enableAppAuth: false

elasticsearch:
  basicAuth: false

seldon:
  enabled: false
  knativeEnabled: false

seldonCoreV2:
  enabled: true

  3. Change to the directory that contains the install-values.yaml file and then install Seldon Enterprise Platform in the namespace seldon-system.

    helm install seldon-enterprise seldon-charts/seldon-deploy --namespace seldon-system  -f install-values.yaml --version 2.4.0

    When the installation is successful, you should see this:

    NAME: seldon-enterprise
LAST DEPLOYED: Fri Jul 26 16:43:44 2024
NAMESPACE: seldon-system
STATUS: deployed
REVISION: 1
NOTES:
1. Get the application URL by running these commands:
  export POD_NAME=$(kubectl get pods --namespace seldon-system -l "app.kubernetes.io/name=seldon-deploy,app.kubernetes.io/instance=seldon-enterprise" -o jsonpath="{.items[0].metadata.name}")
  echo "Visit http://127.0.0.1:8000/seldon-deploy/ to use your application"
  kubectl port-forward $POD_NAME 8000:8000 --namespace seldon-system

  4. Check the status of the installation seldon-enterprise-seldon-deploy.

    kubectl rollout status deployment/seldon-enterprise-seldon-deploy -n seldon-system

    When the installation is complete you should see this:

    deployment "seldon-enterprise-seldon-deploy" successfully rolled out

  5. Get the Pod that is running Seldon Enterprise Platform in the cluster and save it as $POD_NAME.

    export POD_NAME=$(kubectl get pods --namespace seldon-system -l "app.kubernetes.io/name=seldon-deploy,app.kubernetes.io/instance=seldon-enterprise" -o jsonpath="{.items[0].metadata.name}")

  6. You can use port-forwarding to access your application.

    kubectl port-forward $POD_NAME 8000:8000 --namespace seldon-system

  7. Open your browser and navigate to http://127.0.0.1:8000/seldon-deploy/ to access Seldon Enterprise Platform with Seldon Core 2 resources, operator, runtimes and servers.

    Seldon Enterprise Platform

  8. Apply the trial license and click Activate. Upon a successful activation, you will be redirected to the Seldon Enterprise Platform dashboard.

Configuring Seldon Enterprise Platform

To integrate Kafka with Seldon Enterprise Platform.

  1. Create secrets for the managed Kafka cloud services.

  2. Update the initial configuration.

Note: In these configurations you may need:

  • set the value for username as $ConnectionString this is not a variable.

  • replace <namespace> with the namespace in Azure Event Hub.

Update the initial configuration for Seldon Enterprise Platform in the install-values.yaml file. Use your preferred text editor to update and save the file with the following content:

  1. To enable Kafka Encryption (TLS) you need to reference the secret that you created in the security.kafka.ssl.client.secret field of the Helm chart values. The resulting set of values to include in install-values.yaml is similar to:

  1. Change to the directory that contains the install-values.yaml file and then upgrade Seldon Enterprise Platform in the namespace seldon-system.

Next

You may now explore the Model Explanations with Image Data feature in Seldon Enterprise Platform.

PreviousManaged KafkaNextIngress Controller

Last updated

Was this helpful?