Connect to your own LLM
Complete the following steps to configure a connection to your LLM:
Provide your API key in the API key field.
Provide your API base URL in the API URL field. Defaults to https://api.anthropic.com/v1 if left blank.
Use the Model menu to select or enter your LLM model.
Provide your API key in the API key field.
Provide your API base URL in the API URL field. Defaults to https://api.openai.com/v1 if left blank.
Optional. Enter your organization ID in the Organization ID field if your OpenAI account has multiple organizations.
Optional. Enter a project ID in the Project ID field if your OpenAI account has multiple projects.
Use the Model menu to select or enter your LLM model.
Provide your API key in the API key field.
Provide your Azure service endpoint URL in the Endpoint URL field.
Use the Model menu to select or enter your LLM model.
Enter the Azure API version to use in the API Version field. Defaults to 2024-08-01-preview if left blank.
Provide your AWS access key ID in the AWS Access Key ID field.
Provide your AWS secret access key in the AWS Secret Access Key field.
Optional. Enter the AWS session token for temporary credentials in the AWS Session Token field.
Use the AWS Region menu to select where your Bedrock model is hosted.
Use the Model menu to select or enter your LLM model.
Last updated: