FAQ
Can Seldon Core 2 be used with Seldon Core V1
The two projects are able to be run side by side. Existing users of Seldon Core can update to deploy their models using Seldon Core 2 as needed to take advantage of the new functionality. Both will be supported.
Should I choose V1 APIs or V2 APIs
This depends on your use case. V2 APIs are not yet at GA so might contain breaking changes in future releases.
Use V1 for:
Tight integration to Seldon V1 protocol
Tensorflow Server requirements
Need managed istio integration
Use V2 for:
Multi-model serving
More expressive DAG inference pipelines
Data-centric (Kafka)
Service mesh agnostic
Simpler single model usage
V2 Protocol
Can I do payload logging in Seldon Core 2?
By default, the input and output of every step in a pipeline (as well as the pipeline itself) is logged in Kafka. From there it's up to you what to do with the data. You could use something like Kafka Connect to stream the logs to a datastore of your choice.
Note that there is no automatic request logging for models being accessed directly over REST or gRPC. Requests need to be sent via pipelines to be recorded in Kafka.
Last updated
Was this helpful?