Learning Environment

Installing Seldon Enterprise Platform in a learning environment.

You can install Seldon Enterprise Platform on your local computer that is running a Kubernetes cluster using kind.

Note: These instructions guide you through installing the Seldon Enterprise Platform on a local Kubernetes cluster, focusing on ease of learning. Ensure your kind cluster is running on hardware with at least 32GB of RAM. For installing Seldon Enterprise Platform in a production environment, see cluster requirements.

To install Seldon Enterprise Platform and Seldon Core 2 ecosystem components:

  1. Create namespaces

  2. Install Seldon Core 2

  3. Install Seldon Enterprise Platform

Prerequisites

  • Install a Kubernetes cluster that is running version 1.23 or later.

  • Install kubectl, the Kubernetes command-line tool.

  • Install Helm, the package manager for Kubernetes.

  • Seldon Enterprise Platform license key. You can reach out to Seldon support team to get a trial license key.

Creating Namespaces

  • Create a namespace to contain the main components of Seldon. For example, create the namespace seldon-system:

    kubectl create ns seldon-system || echo "Namespace seldon-system already exists"

  • Create a namespace to contain Kafka. For example, create the namespace kafka:

    kubectl create ns kafka || echo "Namespace kafka already exists"

  • Create a namespace to contain the components related to request logging. For example, create the namespace seldon-logs:

    kubectl create ns seldon-logs || echo "Namespace seldon-logs already exists"

  • Create a namespace that is accessible by Seldon Enterprise Platform, Seldon Core 2 runtime that defines core components required in each model, and Seldon Core 2 pre-configured servers to host the models. For example, create the namespace seldon:

    kubectl create ns seldon || echo "Namespace seldon already exists"

  • Annotate the namespace seldon so that it is accessible in the Seldon Enterprise Platform UI:

    kubectl label ns seldon seldon.restricted=false --overwrite=true

Installing Seldon Core 2

  1. Add and update the Helm charts seldon-charts to the repository.

    helm repo add seldon-charts https://seldonio.github.io/helm-charts/
helm repo update seldon-charts

  2. Install Custom resource definitions for Seldon Core 2.

    helm upgrade seldon-core-v2-crds seldon-charts/seldon-core-v2-crds \
--version 2.8.5 \
--namespace default \
--install

  3. Create a YAML file to specify the initial configuration for Seldon Core 2 Operator. For example, create the components-values.yaml file. Use your preferred text editor to create and save the file with the following content:

    controller:
  clusterwide: true

dataflow:
  resources:
    cpu: 500m

envoy:
  service:
    type: ClusterIP

kafka:
  bootstrap: seldon-kafka-bootstrap.seldon-mesh:9092
  topics:
    numPartitions: 4

opentelemetry:
  enable: false

scheduler:
  service:
    type: ClusterIP

serverConfig:
  mlserver:
    resources:
      cpu: 1
      memory: 2Gi

  triton:
    resources:
      cpu: 1
      memory: 2Gi

serviceGRPCPrefix: "http2-"

  4. Change to the directory that contains the components-values.yaml file and then install Seldon Core 2 operator in the namespace seldon-system.

     helm upgrade seldon-core-v2-components seldon-charts/seldon-core-v2-setup \
 --version 2.8.5 \
 -f components-values.yaml \
 --namespace seldon-system \
 --install

  5. Install Seldon Core 2 runtimes in the namespace seldon.

    helm upgrade seldon-core-v2-runtime seldon-charts/seldon-core-v2-runtime \
--version 2.8.5 \
--namespace seldon \
--install

  6. Create a YAML file to specify the initial configuration for Seldon Core 2 servers. For example, create the servers-values.yaml file. Use your preferred text editor to create and save the file with the following content:

    mlserver:
 replicas: 1

triton:
  replicas: 1

  7. Change to the directory that contains the servers-values.yaml file and then install Seldon Core 2 servers in the namespace seldon.

     helm upgrade seldon-core-v2-servers seldon-charts/seldon-core-v2-servers \
 --version 2.8.5 \
 -f servers-values.yaml \
 --namespace seldon \
 --install

Installating Seldon Enterprise Platform on a Kubernetes cluster

Note: These configurations do not enable features such as Model Catalog, Monitoring and Alerting, Request logging, GitOps and others.

  1. Install Knative Eventing core components in the Kubernetes cluster.

    kubectl apply -f https://github.com/knative/eventing/releases/download/knative-v1.12.2/eventing-crds.yaml
kubectl apply -f https://github.com/knative/eventing/releases/download/knative-v1.12.2/eventing-core.yaml
kubectl get crds | grep eventing.knative.dev

  2. Create a YAML file to specify the initial configuration. For example, create the install-values.yaml file. Use your preferred text editor to create and save the file with the following content:

    image:
  image: seldonio/seldon-deploy-server:2.4.0

rbac:
 opa:
   enabled:  false
 nsLabelsAuth:
   enabled:  true

virtualService:
  create: false

requestLogger:
  kafka_consumer:
    enabled: true
    bootstrap_servers: seldon-kafka-bootstrap.kafka.svc.cluster.local:9092
    group_id: metronome
    auto_offset_reset: earliest

gitops:
  argocd:
    enabled: false

enableAppAuth: false

elasticsearch:
  basicAuth: false

seldon:
  enabled: false
  knativeEnabled: false

seldonCoreV2:
  enabled: true

  3. Change to the directory that contains the install-values.yaml file and then install Seldon Enterprise Platform in the namespace seldon-system.

    helm install seldon-enterprise seldon-charts/seldon-deploy --namespace seldon-system  -f install-values.yaml --version 2.4.0

    When the installation is successful, you should see this:

    NAME: seldon-enterprise
LAST DEPLOYED: Fri Jul 26 16:43:44 2024
NAMESPACE: seldon-system
STATUS: deployed
REVISION: 1
NOTES:
1. Get the application URL by running these commands:
  export POD_NAME=$(kubectl get pods --namespace seldon-system -l "app.kubernetes.io/name=seldon-deploy,app.kubernetes.io/instance=seldon-enterprise" -o jsonpath="{.items[0].metadata.name}")
  echo "Visit http://127.0.0.1:8000/seldon-deploy/ to use your application"
  kubectl port-forward $POD_NAME 8000:8000 --namespace seldon-system

  4. Check the status of the installation seldon-enterprise-seldon-deploy.

    kubectl rollout status deployment/seldon-enterprise-seldon-deploy -n seldon-system

    When the installation is complete you should see this:

    deployment "seldon-enterprise-seldon-deploy" successfully rolled out

  5. Get the Pod that is running Seldon Enterprise Platform in the cluster and save it as $POD_NAME.

    export POD_NAME=$(kubectl get pods --namespace seldon-system -l "app.kubernetes.io/name=seldon-deploy,app.kubernetes.io/instance=seldon-enterprise" -o jsonpath="{.items[0].metadata.name}")

  6. You can use port-forwarding to access your application.

    kubectl port-forward $POD_NAME 8000:8000 --namespace seldon-system

  7. Open your browser and navigate to http://127.0.0.1:8000/seldon-deploy/ to access Seldon Enterprise Platform with Seldon Core 2 resources, operator, runtimes and servers.

    Seldon Enterprise Platform

  8. Apply the trial license and click Activate.

Note: After confirming that port-forwarding to the application is configured, you can open your browser and navigate to http://127.0.0.1:8000/seldon-deploy/ to access the Seldon Enterprise Platform deployed in the Kubernetes cluster at any time.

Next

To explore the features of Seldon Enterprise Platform, you need to complete the installation of other components in the following order:

  1. Integrating with Kafka

  2. Installing Istio

  3. Installing PostgreSQL

  4. Installing Prometheus

Additional Resources

PreviousSeldon Enterprise PlatformNextSelf-hosted Kafka

Last updated

Was this helpful?