Vocareum GenAI Gateway allows you to efficiently add, distribute, budget, and manage your Generative Artificial Intelligence (GenAI) services. The platform provides a streamlined and secure way to handle your AI access credentials, ensuring that your keys are allocated appropriately and remain protected with optimal control and oversight.

GenAI Gateway can only be accessed by Organization Administrators.

The Dashboard page of the AI Gateway presents a comprehensive overview of your organization's usage and expenditure of GenAI resources. Additionally, the Dashboard provides detailed breakdowns of daily or monthly spend across various courses within your organization, allowing you to track and manage resource usage efficiently.

You can add and manage API keys from your chosen service providers on the GenAI Services page. Vocareum currently supports the following services:

To add a service, click the "Add Service" button, select the service type, and fill out the corresponding form.

All Service entries require an API key from your provider, a name to identify the Service within your Vocareum Organization, and an overall budget you would like applied to the key.

The forms for some service types, such as Azure and Custom GenAI APIs, also require an API URL endpoint and some details on the available models.

All Services for your Organization are listed in the API Services table below the form.

If the "Key" column contains a green checkbox, the API validation was successful for that entry and you can begin using the Service. If the "Key" column contains a red checkbox, an error occurred during validation.

The VOC Endpoint column lists the API endpoint you will use with all budgeted keys generated by Vocareum for that Service. When you send requests to the VOC Endpoint rather than directly to the service provider, Vocareum is able to enforce your chosen budgets and policies for the service.

On the GenAI Policies page, you can view and manage all Policies in your organization..

When you grant users access to GenAI resources through User Keys or Courses, you will specify a Policy. Policies apply restrictions to Services, such as limiting which models are available to users. You can also use a Policy to bundle access to models from multiple Services.

A Default Policy is automatically generated for each Service you add to GenAI Gateway. Default Policies grant access to all models available from a given Service.

You can add custom Policies by providing a Policy name and specifying which Services to include. Once that step is complete, you can add model restrictions to the Policy as needed.

Courses are most the streamlined solution for granting groups of users access to GenAI resources. However, if you wish to distribute a budgeted, managed GenAI key to an individual user, creating a custom User Key is a convenient alternative.

Additionally, a user must have a User Key assigned to them in order to access the GenAI Assistant Builder.

To create a User Key for a new user, follow these steps

Now the user will have access to a GenAI Key, and you will be able to see their spend, as well as control their allowed budget. They will also be able to access Assistants and the Assistant Builder in the Apps section of your Control Center.

Vocareum Courses offer a streamlined solution for granting groups of users access to GenAI resources.

In a traditional classroom setting, a Vocareum Course is the unit used to manage student access to digital learning sandboxes and assignments. However, Courses can also be used to grant a group of users managed access to custom environments and resources for any purpose, such as research, training, or professional development.

To enable GenAI Resources for a Course:

You will be presented with your key, or list of available key. You can then set the budget allowed per student in for this part of the assignment.

Optionally, you can associate a model with each key and set custom budget constraints per prompt and completion.