Setup
Accessing your workspace
Login to Portkey at app.portkey.ai with the Single-sign-on option using your NYU NetID. Once you're in, you'll be placed in the "Shared Workspace" by default. You can navigate to your workspace by selecting it from the workspace drop-down list from the top of the left sidebar.
API Keys
The first task we recommend that you perform is to create a "User" API key for yourself. Click on the "API Keys" item on the left sidebar. Once you hit the create button you'd be able to choose the type (User/Service), optional items like config and metadata. In addition, you are free to choose as many or as few permissions you'd provide the API key.
Having a "User" API key is a pre-requisite for using the prompt playground where you can collaboratively tune prompts and compare the responses from multiple LLMs.
The only difference between user and service keys is that the logs with user key will have the NetID of the user as part of the metadata while the services will not. We recommend service keys to be used when you're creating end user applications like chatbots and stick to user keys otherwise.
ModelCatalog
You can view the LLMs you have access to via the ModelCatalog item on the left sidebar. Once in the ModelCtalog panel, you'll be able to view a list of providers and models. Each provider facilitates access to one or more LLMs and has a budget limit that can be increased upon request.
You now have everything you need to send your first request to an LLM. The next section demonstrates an example.