# User Guide

- [Quickstart](https://docs.seldon.ai/seldon-core-2/user-guide/quickstart.md): Learn how to deploy an AI application with Seldon Core 2.
- [Kubernetes Resources](https://docs.seldon.ai/seldon-core-2/user-guide/resources.md): Learn about the Kubernetes Resources offered by Seldon Core 2.
- [Servers](https://docs.seldon.ai/seldon-core-2/user-guide/servers.md): Learn how to configure and manage inference servers in Seldon Core 2, including MLServer and Triton server farms, model scheduling, and capability management.
- [Resource allocation](https://docs.seldon.ai/seldon-core-2/user-guide/servers/resource-allocation.md): Learn more about using taints and tolerations with node affinity or node selector to allocate resources in a Kubernetes cluster.
- [Example: Serving models on dedicated GPU nodes](https://docs.seldon.ai/seldon-core-2/user-guide/servers/resource-allocation/example-serving-models-on-dedicated-gpu-nodes.md): This example illustrates how to use taints,  tolerations with nodeAffinity or nodeSelector to assign GPU nodes to specific models.
- [Models](https://docs.seldon.ai/seldon-core-2/user-guide/models.md): Models in Seldon Core 2.
- [Multi-Model Serving](https://docs.seldon.ai/seldon-core-2/user-guide/models/mms.md): Learn how to configure multi-model serving in Seldon Core, including resource optimization and model co-location.
- [Inference Artifacts](https://docs.seldon.ai/seldon-core-2/user-guide/models/inference-artifacts.md): Learn how to manage model artifacts in Seldon Core, including storage, versioning, and deployment workflows.
- [Scheduling](https://docs.seldon.ai/seldon-core-2/user-guide/models/scheduling.md): Learn how to configure model scheduling in Seldon Core, including resource allocation, scaling policies, and deployment strategies.
- [rClone](https://docs.seldon.ai/seldon-core-2/user-guide/models/rclone.md): Learn how to configure and use Rclone for model artifact storage in Seldon Core, including cloud storage integration and authentication.
- [Parameterized Models](https://docs.seldon.ai/seldon-core-2/user-guide/models/parameterized-models.md): Parameterized Models in Seldon Core 2.
- [Pandas Query](https://docs.seldon.ai/seldon-core-2/user-guide/models/pandasquery.md): Learn how to use PandasQuery for data transformation in Seldon Core, including query configuration and parameter handling.
- [Storage Secrets](https://docs.seldon.ai/seldon-core-2/user-guide/models/storage-secrets.md): Learn how to configure storage secrets in Seldon Core 2 for secure model artifact access using Rclone, including AWS S3, GCS, and MinIO integration.
- [Inference](https://docs.seldon.ai/seldon-core-2/user-guide/inference.md): Inference in Seldon Core 2.
- [Inference Server](https://docs.seldon.ai/seldon-core-2/user-guide/inference/inference.md): Learn how to perform model inference in Seldon Core using REST and gRPC protocols, including request/response formats and client examples.
- [Run Inference](https://docs.seldon.ai/seldon-core-2/user-guide/inference/inference-1.md)
- [Batch](https://docs.seldon.ai/seldon-core-2/user-guide/inference/batch-examples-k8s.md)
- [Open Inference Protocol](https://docs.seldon.ai/seldon-core-2/user-guide/v2.md): Open Inference Protocol in Seldon Core 2.
- [REST](https://docs.seldon.ai/seldon-core-2/user-guide/v2/rest.md): REST in Seldon Core 2.
- [Health](https://docs.seldon.ai/seldon-core-2/user-guide/v2/rest/health.md)
- [Inference](https://docs.seldon.ai/seldon-core-2/user-guide/v2/rest/inference.md)
- [Metadata](https://docs.seldon.ai/seldon-core-2/user-guide/v2/rest/metadata.md)
- [Models](https://docs.seldon.ai/seldon-core-2/user-guide/v2/rest/models.md)
- [Pipelines](https://docs.seldon.ai/seldon-core-2/user-guide/pipelines.md): Learn how to create and manage ML inference pipelines in Seldon Core, including model chaining, tensor mapping, and conditional logic.
- [Autoscaling](https://docs.seldon.ai/seldon-core-2/user-guide/scaling.md)
- [Seldon Core Autoscaling](https://docs.seldon.ai/seldon-core-2/user-guide/scaling/core-autoscaling.md): Autoscaling with Seldon Core 2.
- [Autoscaling Models](https://docs.seldon.ai/seldon-core-2/user-guide/scaling/core-autoscaling/core-autoscaling-models.md): Learn how to leverage Core 2's native autoscaling functionality for Models
- [Autoscaling Servers](https://docs.seldon.ai/seldon-core-2/user-guide/scaling/core-autoscaling/core-autoscaling-servers.md): Learn how to leverage Core 2's native autoscaling functionality for Servers
- [Using HPA for Autoscaling](https://docs.seldon.ai/seldon-core-2/user-guide/scaling/hpa-overview.md): Overview of Horizontal Pod Autoscaler (HPA) scaling options in Seldon Core 2
- [Exposing Metrics for HPA](https://docs.seldon.ai/seldon-core-2/user-guide/scaling/hpa-overview/hpa-setup.md): Learn how to implement request-per-second (RPS) based autoscaling in Seldon Core 2 using Kubernetes HPA and Prometheus metrics.
- [Model Autoscaling with HPA](https://docs.seldon.ai/seldon-core-2/user-guide/scaling/hpa-overview/model-hpa-autoscaling.md): Configuring HPA manifests in Seldon Core 2.
- [Model and Server Autoscaling with HPA](https://docs.seldon.ai/seldon-core-2/user-guide/scaling/hpa-overview/single-model-serving-hpa.md): Learn how to implement HPA-based autoscaling for both Models and Servers in single-model serving deployments
- [Scaling Seldon Services](https://docs.seldon.ai/seldon-core-2/user-guide/scaling/scaling-core-services.md): This page provides guidance about scaling Seldon Core 2 services
- [Data Science Monitoring](https://docs.seldon.ai/seldon-core-2/user-guide/data-science-monitoring.md): Data Science Monitoring in Seldon Core 2.
- [Dataflow with Kafka](https://docs.seldon.ai/seldon-core-2/user-guide/data-science-monitoring/dataflow.md): Explore how Seldon Core 2 uses data flow paradigm and Kafka-based streaming to improve ML model deployment with better scalability, fault tolerance, and data observability.
- [Model Performance Metrics](https://docs.seldon.ai/seldon-core-2/user-guide/data-science-monitoring/performance-tests.md): Learn how to run performance tests for Seldon Core 2 deployments, including load testing, benchmarking, and analyzing inference latency and throughput metrics.
- [Drift Detection](https://docs.seldon.ai/seldon-core-2/user-guide/data-science-monitoring/drift.md): Learn how to implement drift detection in Seldon Core 2 using Alibi-Detect integration for model monitoring and batch processing.
- [Outlier Detection](https://docs.seldon.ai/seldon-core-2/user-guide/data-science-monitoring/outlier.md): Learn how to implement outlier detection in Seldon Core using Alibi-Detect integration for model monitoring and anomaly detection.
- [Explainability](https://docs.seldon.ai/seldon-core-2/user-guide/data-science-monitoring/explainers.md): Learn how to implement model explainability in Seldon Core using Alibi-Explain integration for black box model explanations and pipeline insights.
- [Operational Monitoring](https://docs.seldon.ai/seldon-core-2/user-guide/operational-monitoring.md): Operational Monitoring in Seldon Core 2.
- [Operational Metrics](https://docs.seldon.ai/seldon-core-2/user-guide/operational-monitoring/operational.md): Learn how to monitor operational metrics in Seldon Core, including model performance, pipeline health, and system resource usage.
- [Observability](https://docs.seldon.ai/seldon-core-2/user-guide/operational-monitoring/observability.md): Installing kube-prometheus-stack in the same Kubernetes cluster that hosts the Seldon Core 2.
- [Usage Metrics](https://docs.seldon.ai/seldon-core-2/user-guide/operational-monitoring/usage.md): Learn how to monitor Seldon Core usage metrics, including request rates, latency, and resource utilization for models and pipelines.
- [Local Metrics](https://docs.seldon.ai/seldon-core-2/user-guide/operational-monitoring/local-metrics-test.md): Learn how to test and validate metrics collection in Seldon Core locally, including Prometheus setup and Grafana dashboards.
- [Tracing](https://docs.seldon.ai/seldon-core-2/user-guide/operational-monitoring/tracing.md): This guide walks you through setting up Jaeger Tracing for Seldon Core v2 on Kubernetes. By the end of this guide, you will be able to visualize inference traces through your Core 2 components.
- [Performance Tuning](https://docs.seldon.ai/seldon-core-2/user-guide/performance-tuning.md): Introduction in Seldon Core 2.
- [Models](https://docs.seldon.ai/seldon-core-2/user-guide/performance-tuning/models.md): Model Performance Tuning in Seldon Core 2.
- [Load Testing](https://docs.seldon.ai/seldon-core-2/user-guide/performance-tuning/models/load-testing.md): Load testing Seldon Core 2.
- [Inference](https://docs.seldon.ai/seldon-core-2/user-guide/performance-tuning/models/inference.md): Inference in Seldon Core 2.
- [Infrastructure Setup](https://docs.seldon.ai/seldon-core-2/user-guide/performance-tuning/models/infrastructure-setup.md): Infrastructure Setup for Seldon Core 2 usage.
- [Pipelines](https://docs.seldon.ai/seldon-core-2/user-guide/performance-tuning/pipelines.md): Pipeline Performance Tuning in Seldon Core 2.
- [Testing Pipelines](https://docs.seldon.ai/seldon-core-2/user-guide/performance-tuning/pipelines/testing-pipelines.md): Pipelines in Seldon Core 2.
- [Core 2 Configuration](https://docs.seldon.ai/seldon-core-2/user-guide/performance-tuning/pipelines/core-2-configuration.md): Reducing Data Processing Overheads when using Seldon Core 2.
- [Scalability of Pipelines](https://docs.seldon.ai/seldon-core-2/user-guide/performance-tuning/pipelines/scalability-pipelines.md): Pipeline Scalability Guide in Seldon Core 2.
- [Experiments](https://docs.seldon.ai/seldon-core-2/user-guide/experiment.md): Experiments in Seldon Core 2.
- [Examples](https://docs.seldon.ai/seldon-core-2/user-guide/examples.md): Examples in Seldon Core 2.
- [Local examples](https://docs.seldon.ai/seldon-core-2/user-guide/examples/local-examples.md): Examples of Seldon Core 2 used in a local environment.
- [Kubernetes examples](https://docs.seldon.ai/seldon-core-2/user-guide/examples/k8s-examples.md)
- [Huggingface models](https://docs.seldon.ai/seldon-core-2/user-guide/examples/huggingface.md)
- [Model zoo](https://docs.seldon.ai/seldon-core-2/user-guide/examples/model-zoo.md)
- [Artifact versions](https://docs.seldon.ai/seldon-core-2/user-guide/examples/multi-version.md)
- [Pipeline examples](https://docs.seldon.ai/seldon-core-2/user-guide/examples/pipeline-examples.md): Pipeline examples in Seldon Core 2.
- [Pipeline to pipeline examples](https://docs.seldon.ai/seldon-core-2/user-guide/examples/pipeline-to-pipeline.md): Pipeline to pipeline examples in Seldon Core 2.
- [Cyclic Pipeline](https://docs.seldon.ai/seldon-core-2/user-guide/examples/pipeline-cyclic.md): Cyclic Inference Pipeline in Seldon Core 2.
- [Explainer examples](https://docs.seldon.ai/seldon-core-2/user-guide/examples/explainer-examples.md): Learn how to implement model explainability in Seldon Core using Anchor explainers for both tabular and text data
- [Custom Servers](https://docs.seldon.ai/seldon-core-2/user-guide/examples/custom-servers.md)
- [Local experiments](https://docs.seldon.ai/seldon-core-2/user-guide/examples/local-experiments.md)
- [Experiment version examples](https://docs.seldon.ai/seldon-core-2/user-guide/examples/experiment-versions.md)
- [Tritonclient examples](https://docs.seldon.ai/seldon-core-2/user-guide/examples/tritonclient-examples.md)
- [Batch Inference examples (local)](https://docs.seldon.ai/seldon-core-2/user-guide/examples/batch-examples-local.md): Batch Inference examples (local) in Seldon Core 2.
- [Checking Pipeline readiness](https://docs.seldon.ai/seldon-core-2/user-guide/examples/pipeline-ready-and-metadata.md)
- [Multi-Namespace Kubernetes](https://docs.seldon.ai/seldon-core-2/user-guide/examples/k8s-clusterwide.md)
- [Huggingface speech to sentiment with explanations pipeline](https://docs.seldon.ai/seldon-core-2/user-guide/examples/speech-to-sentiment.md): Huggingface speech to sentiment with explanations pipeline in Seldon Core 2.
- [Production image classifier with drift and outlier monitoring](https://docs.seldon.ai/seldon-core-2/user-guide/examples/cifar10.md): Tutorial of deploying an image classifier with drift and outlier monitoring in Seldon Core 2.
- [Production income classifier with drift, outlier and explanations](https://docs.seldon.ai/seldon-core-2/user-guide/examples/income.md)
- [Conditional pipeline with pandas query model](https://docs.seldon.ai/seldon-core-2/user-guide/examples/pandasquery.md): Conditional pipeline with pandas query model in Seldon Core 2.
- [Kubernetes Server with PVC](https://docs.seldon.ai/seldon-core-2/user-guide/examples/k8s-pvc.md)


---

# Agent Instructions: Querying This Documentation

If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question.

Perform an HTTP GET request on the current page URL with the `ask` query parameter:

```
GET https://docs.seldon.ai/seldon-core-2/user-guide.md?ask=<question>
```

The question should be specific, self-contained, and written in natural language.
The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.
