mlflow--mlflow/examples/gateway/ai21_labs

Example endpoint configuration for AI21 Labs

To set up your MLflow configuration file, include a single endpoint for the completions endpoint as shown in the AI21 labs configuration YAML file.

Obtaining and Setting the AI21 Labs API Key

To obtain an AI21 Labs API key, you need to create an account and subscribe to the service at AI21 Labs.

After obtaining the key, you can export it to your environment variables. Make sure to replace the '...' with your actual API key:

export AI21LABS_API_KEY=...