# Annotation Based Configuration

You can configure aspects of Seldon Core via annotations in the SeldonDeployment resource and also the optional API OAuth Gateway. Please create an issue if you would like some configuration added.

## SeldonDeployment Annotations

### gRPC API Control

* `seldon.io/grpc-max-message-size` : Maximum gRPC message size (bytes)
  * Locations : SeldonDeployment.spec.annotations
  * Default is MaxInt32
  * [gRPC message size example](https://github.com/SeldonIO/seldon-core/blob/master/docs-gb/reference/model_rest_grpc_settings.md)
* `seldon.io/grpc-timeout` : gRPC timeout (msecs)
  * Locations : SeldonDeployment.spec.annotations
  * Default is no timeout
  * [gRPC timeout example](https://github.com/SeldonIO/seldon-core/blob/master/docs-gb/reference/model_rest_grpc_settings.md)

### REST API Control

.. Note:: When using REST APIs, timeouts will only apply to each node and not to the full inference graph. Therefore, each sub-request for each individual node in the graph will be able to take up to `seldon.io/rest-timeout` milliseconds.

* `seldon.io/rest-timeout` : REST timeout (msecs)
  * Locations : SeldonDeployment.spec.annotations
  * Default is no overall timeout but will use Go's default transport settings which include a 30 sec connection timeout.
  * [REST timeout example](https://github.com/SeldonIO/seldon-core/blob/master/docs-gb/reference/model_rest_grpc_settings.md)

### Service Orchestrator

* `seldon.io/engine-separate-pod` : Use a separate pod for the service orchestrator
  * Locations : SeldonDeployment.metadata.annotations, SeldonDeployment.spec.annotations
  * [Separate svc-orc pod example](https://github.com/SeldonIO/seldon-core/blob/master/docs-gb/reference/model_svcorch_sep.md)
  * Locations : SeldonDeployment.metadata.annotations, SeldonDeployment.spec.annotations
* `seldon.io/executor-logger-queue-size` : Size of request logging worker queue
  * Locations: SeldonDeployment.metadata.annotations, SeldonDeployment.spec.annotations
* `seldon.io/executor-logger-write-timeout-ms` : Write timeout for adding to logging work queue
  * Locations: SeldonDeployment.metadata.annotations, SeldonDeployment.spec.annotations

### Misc

* `seldon.io/svc-name` : Custom service name for predictor. You will be responsible that it doesn't clash with any existing service name in the namespace of the deployed SeldonDeployment.
  * Locations : SeldonDeployment.spec.predictors\[].annotations
  * [custom service name example](https://github.com/SeldonIO/seldon-core/blob/master/docs-gb/reference/custom_svc_name.md)


---

# Agent Instructions: Querying This Documentation

If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question.

Perform an HTTP GET request on the current page URL with the `ask` query parameter:

```
GET https://docs.seldon.ai/seldon-core-1/reference/annotations.md?ask=<question>
```

The question should be specific, self-contained, and written in natural language.
The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.