Observability

Being able to see what is happening within the Seldon Deployments provides benefits for debugging, performance profiling, and many other things.

Metrics

Seldon Core provides out of the box Prometheus metrics for monitoring. These include operational metrics like request latency and feedback on predictions.

The Seldon Enterprise Platform UI provides a number of dashboards exposing both these metrics and more about model and deployment usage. You can also access these directly via the Prometheus UI or other tools that integrate with Prometheus, such as Grafana.

Detailed demos showing monitoring are available in the Demos.

You can learn more about the Seldon Core documentation.

Tracing

Seldon Core also provides out of the box OpenTelemetry tracing.

You can learn more about the Seldon Core documentation.