Inference

A comprehensive guide to Seldon's Open Inference Protocol API specification for standardized inference server implementations.

Learn about the API specification implemented in all Seldon inference servers. The specification ensures consistency and interoperability across different inference server implementations.

Seldon inference servers must respect the following API specification.

• Seldon, KServe, NVIDIA V2 Inference API Spec

In future, Seldon may provide extensions for use with Pipelines, Experiments and Explainers.