> For the complete documentation index, see [llms.txt](https://docs.seldon.ai/seldon-core-2/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://docs.seldon.ai/seldon-core-2/user-guide/performance-tuning/models.md).

# Models

Model Performance Tuning in Seldon Core 2.

This section covers various aspects of optimizing model performance in Seldon Core 2, from initial load testing to infrastructure setup and inference optimization. Each subsection provides detailed guidance on different aspects of model performance tuning:

## [Load Testing](https://docs.seldon.ai/seldon-core-2/user-guide/performance-tuning/models/load-testing.md)

Learn how to conduct effective load testing to understand your model's performance characteristics:

* Determining load saturation points
* Understanding closed-loop vs. open-loop testing
* Determining the right number of replicas based on your configuration (model, infrastructure, etc.)
* Setting up reproducible test environments
* Interpreting test results for autoscaling configuration

## [Inference](https://docs.seldon.ai/seldon-core-2/user-guide/performance-tuning/models/inference.md)

Explore different approaches to optimize inference performance:

* Choosing between gRPC and REST protocols
* Implementing adaptive batching
* Optimizing input dimensions
* Configuring parallel processing with workers
* Understanding CPU vs. GPU utilization
* Optimizing your model artefact

## [Infrastructure Setup](https://docs.seldon.ai/seldon-core-2/user-guide/performance-tuning/models/infrastructure-setup.md)

Understand how to configure the underlying infrastructure for optimal model performance:

* Choosing between CPU and GPU deployments
* Setting appropriate CPU specifications
* Configuring thread affinity
* Managing memory allocation
* Optimizing resource utilization

Each of these aspects plays a crucial role in achieving optimal model performance. We recommend starting with [load testing](https://docs.seldon.ai/seldon-core-2/user-guide/performance-tuning/models/load-testing.md) to establish a baseline, then using the insights gained to inform your [infrastructure setup](https://docs.seldon.ai/seldon-core-2/user-guide/performance-tuning/models/infrastructure-setup.md) and [inference optimization](https://docs.seldon.ai/seldon-core-2/user-guide/performance-tuning/models/inference.md) strategies.
