Notebooks

Seldon Core Setup

• Install Seldon Core

• Install MinIO

Prepackaged Inference Server Examples

• Deploy a Scikit-learn Model Binary

• Deploy a Tensorflow Exported Model

• MLflow Pre-packaged Model Server A/B Test

• MLflow Open Inference Protocol End to End Workflow

• Deploy a XGBoost Model Binary

• Deploy Pre-packaged Model Server with Cluster's MinIO

• Custom Pre-packaged LightGBM Server

Python Language Wrapper Examples

• SKLearn Spacy NLP

• SKLearn Iris Classifier

• Sagemaker SKLearn Example

• TFserving MNIST

• Statsmodels Holt-Winter's time-series model

• Runtime Metrics & Tags

• Triton GPT2 Example

Specialized Framework Examples

• NVIDIA TensorRT MNIST

• OpenVINO ImageNet

• OpenVINO ImageNet Ensemble

• Triton Examples

Incubating Projects Examples

• Kubeflow Seldon E2E Pipeline

• H2O Java MoJo

• Outlier Detection with Combiner

• Stream Processing with KNative Eventing

• Kafka CIFAR10

• Kafka SpaCy SKlearn NLP

• Kafka KEDA Autoscaling

• CPP Wrapper Simple Single File

• Advanced CPP Buildsystem Override

• Environment Variables

Cloud-Specific Examples

• AWS EKS Tensorflow Deep MNIST

• Azure AKS Tensorflow Deep MNIST

• GKE with GPU Tensorflow Deep MNIST

• Alibaba Cloud Tensorflow Deep MNIST

• Triton GPT2 Example Azure

• Setup for Triton GPT2 Example Azure

Advanced Machine Learning Monitoring

• Real Time Monitoring of Statistical Metrics

• Model Explainer Example

• Model Explainer Open Inference Protocol Example

• Outlier Detection on CIFAR10

• Training Outlier Detector for CIFAR10 with Poetry

Batch Processing with Seldon Core

• Batch Processing with Argo Workflows and S3 / Minio

• Batch Processing with Argo Workflows and HDFS

• Batch Processing with Kubeflow Pipelines

MLOps: Scaling and Monitoring and Observability

• Autoscaling Example

• KEDA Autoscaling example

• Request Payload Logging with ELK

• Custom Metrics with Grafana & Prometheus

• Distributed Tracing with Jaeger

• CI / CD with Jenkins Classic

• CI / CD with Jenkins X

• Replica control

Production Configurations and Integrations

• Example Helm Deployments

• Max gRPC Message Size

• Deploy Multiple Seldon Core Operators

• Protocol Examples

• Configurable timeouts

• Custom Protobuf Data Example

• Disruption Budgets Example

AB Tests and Progressive Rollouts

• Istio AB Test

• Ambassador AB Test

• Seldon/Iter8 - Progressive AB Test with Single Seldon Deployment

• Seldon/Iter8 - Progressive AB Test with Multiple Seldon Deployments

Complex Graph Examples

• Chainer MNIST

• Custom pre-processors with the Open Inference Protocol

• Graph Examples

Ingress

• Ambassador Canary

• Ambassador Shadow

• Ambassador Headers

• Istio Examples

• Istio Canary

Infrastructure

• Patch Volumes for Version 1.2.0 Upgrade

Benchmarking and Load Tests

• Service Orchestrator Overhead

• Tensorflow Benchmark

• Argo Workflows Benchmarking

• Python Serialization Cost Benchmark

• KMP_AFFINITY Benchmarking Example

• Kafka Payload Logging

Upgrading Examples

• RClone Storage Initializer - testing new secret format

• RClone Storage Initializer - upgrading your cluster (AWS S3 / MinIO)