FAQ

Can Seldon Core 2 be used with Seldon Core V1

The two projects are able to be run side by side. Existing users of Seldon Core can update to deploy their models using Seldon Core 2 as needed to take advantage of the new functionality. Both will be supported.

Should I choose V1 APIs or V2 APIs

This depends on your use case. V2 APIs are not yet at GA so might contain breaking changes in future releases.

Use V1 for:

• Tight integration to Seldon V1 protocol

• Tensorflow Server requirements

• Need managed istio integration

Use V2 for:

• Multi-model serving

• More expressive DAG inference pipelines

• Data-centric (Kafka)

• Service mesh agnostic

• Simpler single model usage

• V2 Protocol

Can I do payload logging in Seldon Core 2?

By default, the input and output of every step in a pipeline (as well as the pipeline itself) is logged in Kafka. From there it's up to you what to do with the data. You could use something like Kafka Connect to stream the logs to a datastore of your choice.

Note that there is no automatic request logging for models being accessed directly over REST or gRPC. Requests need to be sent via pipelines to be recorded in Kafka.