Canary

With a canary rollout traffic is split between a main model, which receives a majority of traffic, and a new version, which is given a fraction of traffic until it is decided whether to promote the model. The features for this can be seen in full in the Demos section of the documentation under Deploying, Load Testing and Canarying Seldon Core Servers. The key features in particular are:

1. A wizard to add a canary:

Canary configuration wizard

1. Visualizing metrics for both default and canary models:

View metrics for default and canary models

1. Promotion of the Canary to be the main model.

Promote canary confirmation model

1. Request logs include any requests that go to the canary, with the responses.