Models

Models

1

Pick your model

Click "add a model" to start setting up

2

Model configurations

Select the model you want to work with (have guardrails, trusted badge, etc), and give it a name.

3

Set timeouts

In short - how long should the model try before giving up.

Timeout - milliseconds for model to timeout with no stream functionality. If field is left empty, default will be used. Default is 60 000ms. Stream timeout - milliseconds for model to timeout with stream functionality. If field is left empty, default will be used. Default is 300 000ms.

4

Fallback models

Add backup models in order of preference. If your main model fails, it automatically switches to the next best option.

5

Trusted models

These are organization-wide approved models that follow your company's policies.

As an admin, you have the power to showcase which models are the safest to use with sensitive information.

6

Save and add more models

Repeat the process with all needed models, and edit or delete them anytime from "models" tab.