PromptUtils

PromptUtilsSettings

prompt_options: Optional[PromptOptions]

Description: Prompt options. Default: None

tensor_name_outputs: Optional[List[str]]

Description: Optional list of output tensor names. Not used at the moment. Default: None

model_type: Optional[ModelType]

Description: Target format to be used for parsing the input data. Default: None

PromptOptions

uri: str

Description: URI to the prompt template file. This must be a relative URI (aka path) to the model-settings.json file.

tokens: Dict[str, str]

Description: Tokens to be used in the prompt template. These are key-value pairs that will be used to render the template. Default: {}

type: Litera["jinja"]

Description: The type of the prompt compiler to use. Default: "jinja"