Vocareum GenAI Gateway allows you to efficiently add, distribute, budget, and manage your Generative Artificial Intelligence (GenAI) services. The platform provides a streamlined and secure way to handle your AI access credentials, ensuring that your keys are allocated appropriately and remain protected with optimal control and oversight.

Admin users can centrally manage all GenAI resources connected to your Vocareum organization through GenAI Gateway.

GenAI Gateway can only be accessed by Organization Administrators.

The Dashboard page of the AI Gateway presents a comprehensive overview of your organization's usage and expenditure of GenAI resources. Additionally, the Dashboard provides detailed breakdowns of daily or monthly spend across various courses within your organization, allowing you to track and manage resource usage efficiently.

You can add and manage API keys from your chosen service providers on the GenAI Services page. Vocareum currently supports the following services:

To add a service, click the "Add Service" button, select the service type, and fill out the corresponding form.

All Service entries require an API key from your provider, a name to identify the Service within your Vocareum Organization, and an overall budget you would like applied to the key.

The forms for some service types, such as Azure and Custom GenAI APIs, also require an API URL endpoint and some details on the available models.

All Services for your Organization are listed in the API Services table below the form.

If the "Key" column contains a green checkbox, the API validation was successful for that entry and you can begin using the Service. If the "Key" column contains a red checkbox, an error occurred during validation.

The VOC Endpoint column lists the API endpoint you will use with all budgeted keys generated by Vocareum for that Service. When you send requests to the VOC Endpoint rather than directly to the service provider, Vocareum is able to enforce your chosen budgets and policies for the service.

On the GenAI Policies page, you can view and manage all Policies in your organization..

When you grant users access to GenAI resources through User Keys or Courses, you will specify a Policy. Policies apply restrictions to Services, such as limiting which models are available to users. You can also use a Policy to bundle access to models from multiple Services.

A Default Policy is automatically generated for each Service you add to GenAI Gateway. Default Policies grant access to all models available from a given Service.

You can add custom Policies by providing a Policy name and specifying which Services to include. Once that step is complete, you can add model restrictions to the Policy as needed.

The Group Control Center offers a streamlined solution for granting groups of users access to GenAI resources outside of a course.

This solution is ideal for cases where groups of users need access to budgeted, managed GenAI API keys, including:

Please refer to this article for details on Using the Group Control Center For Resource Management.

Courses and Groups are the most streamlined solution for granting groups of users access to GenAI resources. However, if you wish to distribute a budgeted, managed GenAI key to a single user, creating a custom User Key is a convenient alternative.

The most common use case for individual User Keys is granting access to the Vocareum Assistant Builder and Assistants to create and test custom AI agents. These features can only be accessed by a user with at least one Group or User Key (provisioned outside the context of a Vocareum Course).

You can view and manage User Keys in the User Control Center, which is accessible only to Organization Admins.

If a user does not yet have any AI API keys outside of a Vocareum course, you will need to add the user before generating a key.

To create a new user, follow these steps:

Now the user will have access to a GenAI Key, and you will be able to see their spend, as well as control their allowed budget. They will also be able to access Assistants and the Assistant Builder in the Apps section of your Control Center.

The Vocareum Notebook lab type offers a wide range of AI-enabled tools to support curriculum content creation, teaching, and learning. To use AI features within assignments, GenAI must first be enabled at the course level by an Admin.

To enable GenAI Resources for a Course:

GenAI is now enabled for your course. For more details on enabling and using GenAI in assignments, refer to GenAI in Vocareum Labs.