# LLM Module

## latest

- [Getting started](https://docs.seldon.ai/llm-module/introduction.md)
- [Installation](https://docs.seldon.ai/llm-module/introduction/installation.md)
- [Quickstart](https://docs.seldon.ai/llm-module/introduction/quickstart.md)
- [Models](https://docs.seldon.ai/llm-module/components/models.md)
- [API](https://docs.seldon.ai/llm-module/components/models/api.md)
- [OpenAI](https://docs.seldon.ai/llm-module/components/models/api/openai.md)
- [Gemini](https://docs.seldon.ai/llm-module/components/models/api/gemini.md)
- [Local](https://docs.seldon.ai/llm-module/components/models/local.md)
- [Chat](https://docs.seldon.ai/llm-module/components/models/local/chat.md)
- [Multimodel serving](https://docs.seldon.ai/llm-module/components/models/local/mms.md)
- [Quantization](https://docs.seldon.ai/llm-module/components/models/local/quantization.md)
- [Prompting](https://docs.seldon.ai/llm-module/components/models/prompting.md)
- [Streaming](https://docs.seldon.ai/llm-module/components/models/streaming.md)
- [OpenAI Client](https://docs.seldon.ai/llm-module/components/models/openai-client.md)
- [Memory](https://docs.seldon.ai/llm-module/components/memory.md)
- [Example](https://docs.seldon.ai/llm-module/components/memory/example.md)
- [Retrieval](https://docs.seldon.ai/llm-module/components/retrieval.md)
- [Example](https://docs.seldon.ai/llm-module/components/retrieval/example.md)
- [Embeddings](https://docs.seldon.ai/llm-module/components/embeddings.md)
- [Example](https://docs.seldon.ai/llm-module/components/embeddings/example.md)
- [Advanced Use Cases](https://docs.seldon.ai/llm-module/components/embeddings/advanced.md)
- [Prompting](https://docs.seldon.ai/llm-module/components/prompting.md)
- [Example](https://docs.seldon.ai/llm-module/components/prompting/example.md)
- [Retrieval Augmented Generation](https://docs.seldon.ai/llm-module/use-cases/rag.md)
- [Chat Bot](https://docs.seldon.ai/llm-module/use-cases/chat-bot.md)
- [Function Calling](https://docs.seldon.ai/llm-module/use-cases/function-calling.md)
- [OpenAI Function Calling](https://docs.seldon.ai/llm-module/use-cases/function-calling/openai-func-call.md)
- [Guardrails](https://docs.seldon.ai/llm-module/use-cases/guardrails.md)
- [Agents](https://docs.seldon.ai/llm-module/use-cases/agentic-workflows.md)
- [Tool Use](https://docs.seldon.ai/llm-module/use-cases/agentic-workflows/tool-use.md)
- [Planning](https://docs.seldon.ai/llm-module/use-cases/agentic-workflows/planning.md)
- [Monitoring](https://docs.seldon.ai/llm-module/use-cases/monitor-runtime.md)
- [Routing (with LiteLLM)](https://docs.seldon.ai/llm-module/use-cases/litellm.md)
- [Reference](https://docs.seldon.ai/llm-module/resources/reference.md)
- [API](https://docs.seldon.ai/llm-module/resources/reference/api.md)
- [Conversational Memory](https://docs.seldon.ai/llm-module/resources/reference/memory.md)
- [Local](https://docs.seldon.ai/llm-module/resources/reference/local.md)
- [Retrieval](https://docs.seldon.ai/llm-module/resources/reference/retrieval.md)
- [PromptUtils](https://docs.seldon.ai/llm-module/resources/reference/prompt-utils.md)
- [Changelog](https://docs.seldon.ai/llm-module/resources/changelog.md)

## v0.6

- [Getting started](https://docs.seldon.ai/llm-module/v0.6/introduction.md)
- [Installation](https://docs.seldon.ai/llm-module/v0.6/introduction/installation.md)
- [Quickstart](https://docs.seldon.ai/llm-module/v0.6/introduction/quickstart.md)
- [Models](https://docs.seldon.ai/llm-module/v0.6/components/models.md)
- [API](https://docs.seldon.ai/llm-module/v0.6/components/models/api.md)
- [OpenAI](https://docs.seldon.ai/llm-module/v0.6/components/models/api/openai.md)
- [Gemini](https://docs.seldon.ai/llm-module/v0.6/components/models/api/gemini.md)
- [Local](https://docs.seldon.ai/llm-module/v0.6/components/models/local.md)
- [Chat](https://docs.seldon.ai/llm-module/v0.6/components/models/local/chat.md)
- [Multimodel serving](https://docs.seldon.ai/llm-module/v0.6/components/models/local/mms.md)
- [Quantization](https://docs.seldon.ai/llm-module/v0.6/components/models/local/quantization.md)
- [Embeddings](https://docs.seldon.ai/llm-module/v0.6/components/models/local/embeddings.md)
- [Prompting](https://docs.seldon.ai/llm-module/v0.6/components/models/prompting.md)
- [Streaming](https://docs.seldon.ai/llm-module/v0.6/components/models/streaming.md)
- [Memory](https://docs.seldon.ai/llm-module/v0.6/components/memory.md)
- [Example](https://docs.seldon.ai/llm-module/v0.6/components/memory/example.md)
- [Retrieval](https://docs.seldon.ai/llm-module/v0.6/components/retrieval.md)
- [Example](https://docs.seldon.ai/llm-module/v0.6/components/retrieval/example.md)
- [Embeddings](https://docs.seldon.ai/llm-module/v0.6/components/embeddings.md)
- [Example](https://docs.seldon.ai/llm-module/v0.6/components/embeddings/example.md)
- [Advanced Use Cases](https://docs.seldon.ai/llm-module/v0.6/components/embeddings/advanced.md)
- [Prompting](https://docs.seldon.ai/llm-module/v0.6/components/prompting.md)
- [Example](https://docs.seldon.ai/llm-module/v0.6/components/prompting/example.md)
- [Retrieval Augmented Generation](https://docs.seldon.ai/llm-module/v0.6/use-cases/rag.md)
- [Chat Bot](https://docs.seldon.ai/llm-module/v0.6/use-cases/chat-bot.md)
- [Function Calling](https://docs.seldon.ai/llm-module/v0.6/use-cases/function-calling.md)
- [OpenAI Function Calling](https://docs.seldon.ai/llm-module/v0.6/use-cases/function-calling/openai-func-call.md)
- [Guardrails](https://docs.seldon.ai/llm-module/v0.6/use-cases/guardrails.md)
- [Agents](https://docs.seldon.ai/llm-module/v0.6/use-cases/agents.md)
- [Monitoring](https://docs.seldon.ai/llm-module/v0.6/use-cases/local.md)
- [Reference](https://docs.seldon.ai/llm-module/v0.6/resources/reference.md)
- [API](https://docs.seldon.ai/llm-module/v0.6/resources/reference/api.md)
- [Conversational Memory](https://docs.seldon.ai/llm-module/v0.6/resources/reference/memory.md)
- [Local](https://docs.seldon.ai/llm-module/v0.6/resources/reference/local.md)
- [Retrieval](https://docs.seldon.ai/llm-module/v0.6/resources/reference/retrieval.md)
- [PromptUtils](https://docs.seldon.ai/llm-module/v0.6/resources/reference/prompt-utils.md)
- [Changelog](https://docs.seldon.ai/llm-module/v0.6/resources/changelog.md)

## v0.5

- [Getting started](https://docs.seldon.ai/llm-module/v0.5/introduction.md)
- [Installation](https://docs.seldon.ai/llm-module/v0.5/introduction/installation.md)
- [Quickstart](https://docs.seldon.ai/llm-module/v0.5/introduction/quickstart.md)
- [Models](https://docs.seldon.ai/llm-module/v0.5/components/models.md)
- [API](https://docs.seldon.ai/llm-module/v0.5/components/models/api.md)
- [OpenAI](https://docs.seldon.ai/llm-module/v0.5/components/models/api/openai.md)
- [Gemini](https://docs.seldon.ai/llm-module/v0.5/components/models/api/gemini.md)
- [Local](https://docs.seldon.ai/llm-module/v0.5/components/models/local.md)
- [Chat](https://docs.seldon.ai/llm-module/v0.5/components/models/local/chat.md)
- [Multimodel serving](https://docs.seldon.ai/llm-module/v0.5/components/models/local/mms.md)
- [Quantization](https://docs.seldon.ai/llm-module/v0.5/components/models/local/quantization.md)
- [Prompting](https://docs.seldon.ai/llm-module/v0.5/components/models/prompting.md)
- [Memory](https://docs.seldon.ai/llm-module/v0.5/components/memory.md)
- [Example](https://docs.seldon.ai/llm-module/v0.5/components/memory/example.md)
- [Retrieval](https://docs.seldon.ai/llm-module/v0.5/components/retrieval.md)
- [Example](https://docs.seldon.ai/llm-module/v0.5/components/retrieval/example.md)
- [Retrieval Augmented Generation](https://docs.seldon.ai/llm-module/v0.5/use-cases/rag.md)
- [Chat Bot](https://docs.seldon.ai/llm-module/v0.5/use-cases/chat-bot.md)
- [Function Calling](https://docs.seldon.ai/llm-module/v0.5/use-cases/function-calling.md)
- [OpenAI Function Calling](https://docs.seldon.ai/llm-module/v0.5/use-cases/function-calling/openai-func-call.md)
- [Monitoring](https://docs.seldon.ai/llm-module/v0.5/use-cases/local.md)
- [Reference](https://docs.seldon.ai/llm-module/v0.5/resources/reference.md)
- [API](https://docs.seldon.ai/llm-module/v0.5/resources/reference/api.md)
- [Conversational Memory](https://docs.seldon.ai/llm-module/v0.5/resources/reference/memory.md)
- [Local](https://docs.seldon.ai/llm-module/v0.5/resources/reference/local.md)
- [Retrieval](https://docs.seldon.ai/llm-module/v0.5/resources/reference/retrieval.md)
- [PromptUtils](https://docs.seldon.ai/llm-module/v0.5/resources/reference/prompt-utils.md)
- [Changelog](https://docs.seldon.ai/llm-module/v0.5/resources/changelog.md)

## v0.7

- [Getting started](https://docs.seldon.ai/llm-module/v0.7/introduction.md)
- [Installation](https://docs.seldon.ai/llm-module/v0.7/introduction/installation.md)
- [Quickstart](https://docs.seldon.ai/llm-module/v0.7/introduction/quickstart.md)
- [Models](https://docs.seldon.ai/llm-module/v0.7/components/models.md)
- [API](https://docs.seldon.ai/llm-module/v0.7/components/models/api.md)
- [OpenAI](https://docs.seldon.ai/llm-module/v0.7/components/models/api/openai.md)
- [Gemini](https://docs.seldon.ai/llm-module/v0.7/components/models/api/gemini.md)
- [Local](https://docs.seldon.ai/llm-module/v0.7/components/models/local.md)
- [Chat](https://docs.seldon.ai/llm-module/v0.7/components/models/local/chat.md)
- [Multimodel serving](https://docs.seldon.ai/llm-module/v0.7/components/models/local/mms.md)
- [Quantization](https://docs.seldon.ai/llm-module/v0.7/components/models/local/quantization.md)
- [Prompting](https://docs.seldon.ai/llm-module/v0.7/components/models/prompting.md)
- [Streaming](https://docs.seldon.ai/llm-module/v0.7/components/models/streaming.md)
- [Memory](https://docs.seldon.ai/llm-module/v0.7/components/memory.md)
- [Example](https://docs.seldon.ai/llm-module/v0.7/components/memory/example.md)
- [Retrieval](https://docs.seldon.ai/llm-module/v0.7/components/retrieval.md)
- [Example](https://docs.seldon.ai/llm-module/v0.7/components/retrieval/example.md)
- [Embeddings](https://docs.seldon.ai/llm-module/v0.7/components/embeddings.md)
- [Example](https://docs.seldon.ai/llm-module/v0.7/components/embeddings/example.md)
- [Advanced Use Cases](https://docs.seldon.ai/llm-module/v0.7/components/embeddings/advanced.md)
- [Prompting](https://docs.seldon.ai/llm-module/v0.7/components/prompting.md)
- [Example](https://docs.seldon.ai/llm-module/v0.7/components/prompting/example.md)
- [Retrieval Augmented Generation](https://docs.seldon.ai/llm-module/v0.7/use-cases/rag.md)
- [Chat Bot](https://docs.seldon.ai/llm-module/v0.7/use-cases/chat-bot.md)
- [Function Calling](https://docs.seldon.ai/llm-module/v0.7/use-cases/function-calling.md)
- [OpenAI Function Calling](https://docs.seldon.ai/llm-module/v0.7/use-cases/function-calling/openai-func-call.md)
- [Guardrails](https://docs.seldon.ai/llm-module/v0.7/use-cases/guardrails.md)
- [Agents](https://docs.seldon.ai/llm-module/v0.7/use-cases/agentic-workflows.md)
- [Tool Use](https://docs.seldon.ai/llm-module/v0.7/use-cases/agentic-workflows/tool-use.md)
- [Planning](https://docs.seldon.ai/llm-module/v0.7/use-cases/agentic-workflows/planning.md)
- [Monitoring](https://docs.seldon.ai/llm-module/v0.7/use-cases/local.md)
- [Reference](https://docs.seldon.ai/llm-module/v0.7/resources/reference.md)
- [API](https://docs.seldon.ai/llm-module/v0.7/resources/reference/api.md)
- [Conversational Memory](https://docs.seldon.ai/llm-module/v0.7/resources/reference/memory.md)
- [Local](https://docs.seldon.ai/llm-module/v0.7/resources/reference/local.md)
- [Retrieval](https://docs.seldon.ai/llm-module/v0.7/resources/reference/retrieval.md)
- [PromptUtils](https://docs.seldon.ai/llm-module/v0.7/resources/reference/prompt-utils.md)
- [Changelog](https://docs.seldon.ai/llm-module/v0.7/resources/changelog.md)