Set up Generative AI Hub in SAP AI Core
Set up Generative AI Hub in SAP AI Core.
Overview
You will learn
- How to setup SAP AI Core to get started with Generative AI Hub.
- How to get your Orchestration URL
Prerequisites
Prerequisites
- A BTP global account If you are an SAP Developer or SAP employee, please refer to the following links ( for internal SAP stakeholders only ) - How to create a BTP Account (internal) SAP AI Core If you are an external developer or a customer or a partner kindly refer to this tutorial
- A BTP global account, For more details, refer to: BTP global account
- To continue this tutorial, you should have a BTP subaccount
Steps
Pre-read
In this tutorial, youβll learn how to set up Generative AI Hub in SAP AI Core to start consuming Large Language Models (LLMs). By the end of the steps, youβll have your Orchestration URL ready to use.
SAP AI Core and SAP AI Launchpad are services which you can link to your BTP global account. SAP AI Core offers a powerful AI runtime which is natively integrated with SAP AI Launchpad. The launchpad offers an easy-to-use interface to manage AI workflow administration, processes, and tasks.
The Generative AI Hub incorporates generative AI into your AI activities in SAP AI Core and SAP AI Launchpad. The generative AI hub is available only with the extended service plan in SAP AI Core.
If you are an existing SAP AI Core tenant with free tier or standard plan, you can upgrade to extended plan without losing your data or work.
Note: Upgrading from free tier to extended incur cost
Boosters is available for SAP AI Core. Boosters are a set of guided interactive steps that enable you to select, configure, and consume services on SAP BTP. In this tutorial, we’ll use the SAP AI Core booster to to provision SAP AI Core in your subaccount with the extended plans.
Remember, Generative AI Hub is available only for SAP AI Core extended plan.
If you are an existing SAP AI Core tenant with free tier or standard plan, you can upgrade your instance to extended plan without losing your data or work. Upgrading from free Tier to extended incur cost.
If you are an SAP employee, recommended to use sap-internal SAP AI Core plan instead of extended.
Entitlements and quota are managed at the global account and directory levels, distributed to directories and subaccounts, and consumed by the subaccounts. See also Entitlements and Quotas.
Entitlements are your right to provision and consume a resource. They refer to what youβre entitled to use (for example, which services and service plans).
Quota is the numeric quantity that defines the maximum allowed consumption of that resource. In other words, how much of a service plan youβre entitled to use.
Open the SAP BTP cockpit, access your global account and go to your subaccount.

Check the entitlements for your subaccount by clicking Entitlements and searching for SAP AI Core.
Your current SAP AI Core entitlements will be shown. In this screenshot, you can find only standard plan is available

Click Configure Entitlements > Add Service Plans.


Select SAP AI Core and the extended service plan.

Save your new entitlement.

Choose Boosters from the navigation pane. Find and choose the booster for SAP AI Core from the selection.

The booster tile contains information about SAP AI Core. Click Start when you are ready.
When you start a booster, a wizard opens up which guides you through the required steps.

Choose the scenario Select Subaccount and click Next

In the Configure Subaccount, select extended plan and your subaccount in which you want to provision SAP AI Core and click Next.
Note:
If you are SAP employee select the plan sap-internal instead of extended

Review your configuration and click Finish.


After the execution completes, follow the steps shown to navigate to your subaccount.

In the subaccount section of SAP BTP Cockpit, choose Services from the left navigation menu and Instances and subscriptions from the page.

To see the details of your new SAP AI Core extended plan instance, click the chevron on the entry.
To create the keys that you need to access your instance, click the three dots > Create Service Key.

Enter a Key Name of your choice and click Create.


Once your keys have been created, you can view or download them at any time by locating the key and clicking the three dots and choosing from the available options.

As part of the SAP AI Core onboarding process, an orchestration deployment is automatically created in the default resource group.
This means you can start using orchestration in the Generative AI Hub right awayβno need to create a separate deployment.
Retrieve Orchestration URL
Get Auth Token:
Note: Refer to the fields such as
url,clientid,clientsecret, andAI_API_URLin your SAP AI Core service key, and replace the corresponding placeholder values in the curl requests below.
curl --request POST \
--url <replace with the url field from your SAP AI Core service key>/oauth/token \
--header 'Content-Type: application/x-www-form-urlencoded' \
--data grant_type=client_credentials \
--data 'client_id=<replace with the clientid from your service key>' \
--data 'client_secret=<replace with the clientsecret from your service key>'From the response, note the value of the access_token. Youβll use this token in the next step to retrieve your deployments using the following example curl request:
curl --request GET \
--url <replace with the AI_API_URL from your SAP AI Core service key>/v2/lm/deployments \
--header 'AI-Resource-Group: default' \
--header 'Authorization: Bearer <replace with the access_token from get token response>'In the response, search for the deployment where the configurationName is defaultOrchestrationConfig, and note the deploymentUrl associated with this deployment. The deploymentUrl is your orchestration Url.

Once you have the Orchestration Url you can proceed to the Orchestration Tutorial to learn how to consume generative AI models using the orchestration capabilities available in the Generative AI Hub.
Resources
Discussion
Share feedback on this tutorial or join the conversation in SAP Community.