LogoLogo
v2.9
latestv2.9v2.8
v2.9
latestv2.9v2.8
  • About
    • Production-ready ML Serving Framework
    • Seldon Core Features
    • Concepts
    • Architecture
  • Installation
    • Installation Overview
    • Learning Environment
      • Self-hosted Kafka
    • Production Environment
      • Kafka Integration
      • Managed Kafka
      • Ingress Controller
    • Test the Installation
    • Advanced Configurations
      • Helm Configuration
      • Server Config
      • Server Runtime
      • Seldon Config
      • Pipeline Config
    • Upgrading
  • User Guide
    • Kubernetes Resources
    • Servers
      • Resource allocation
        • Example: Serving models on dedicated GPU nodes
    • Models
      • Multi-Model Serving
      • Inference Artifacts
      • Scheduling
      • rClone
      • Parameterized Models
      • Pandas Query
      • Storage Secrets
    • Inference
      • Inference Server
      • Run Inference
      • OIP
      • Batch
    • Pipelines
    • Scaling
      • Model Autoscaling
      • Server Autoscaling
      • HPA Autoscaling in single-model serving
    • Data Science Monitoring
      • Dataflow with Kafka
      • Model Performance Metrics
      • Drift Detection
      • Outlier Detection
      • Explainability
    • Operational Monitoring
      • Operational Metrics
      • Observability
      • Usage Metrics
      • Local Metrics
      • Tracing
    • Experiments
    • Examples
      • Local examples
      • Kubernetes examples
      • Huggingface models
      • Model zoo
      • Artifact versions
      • Pipeline examples
      • Pipeline to pipeline examples
      • Explainer examples
      • Custom Servers
      • Local experiments
      • Experiment version examples
      • Inference examples
      • Tritonclient examples
      • Batch Inference examples (kubernetes)
      • Batch Inference examples (local)
      • Checking Pipeline readiness
      • Multi-Namespace Kubernetes
      • Huggingface speech to sentiment with explanations pipeline
      • Production image classifier with drift and outlier monitoring
      • Production income classifier with drift, outlier and explanations
      • Conditional pipeline with pandas query model
      • Kubernetes Server with PVC
  • Integrations
    • Service Meshes
      • Ambassador
      • Istio
      • Traefik
      • Secure Model Endpoints
  • Resources
    • Security
    • APIs
      • Internal
        • Chainer
        • Agent
      • Inference
        • Open Inference Protocol
      • Scheduler
      • Seldon CLI
        • CLI
        • Seldon
          • Config
          • Config Activate
          • Config Deactivate
          • Config Add
          • Config List
          • Config Remove
        • Experiment
          • Experiment Start
          • Experiment Status
          • Experiment List
          • Experiment Stop
        • Model
          • Model Status
          • Model Load
          • Model List
          • Model Infer
          • Model Metadata
          • Model Unload
        • Pipeline
          • Pipeline Load
          • Pipeline Status
          • Pipeline List
          • Pipeline Inspect
          • Pipeline Infer
          • Pipeline Unload
        • Server
          • Server List
          • Server Status
    • FAQs
    • Development
      • License
      • Release
Powered by GitBook
On this page

Was this helpful?

Edit on GitHub
Export as PDF
  1. User Guide
  2. Models

Parameterized Models

PreviousrCloneNextPandas Query

Last updated 4 months ago

Was this helpful?

The Model specification allows parameters to be passed to the loaded model to allow customization. For example:

# samples/models/choice1.yaml
apiVersion: mlops.seldon.io/v1alpha1
kind: Model
metadata:
  name: choice-is-one
spec:
  storageUri: "gs://seldon-models/scv2/examples/pandasquery"
  requirements:
  - mlserver
  - python
  parameters:
  - name: query
    value: "choice == 1"

This capability is only available for MLServer custom model runtimes. The named keys and values will be added to the model-settings.json file for the provided model in theparameters.extra Dict. MLServer models are able to read these values in their load method.

Example Parameterized Models

Pandas Query