Introducing the SAP Cloud SDK for AI 🎉 (JavaScript/TypeScript)

We are excited to announce the initial release of the SAP Cloud SDK for AI.

Integrate generative AI capabilities into your SAP Business Technology Platform (BTP) applications and leverage the Generative AI Hub in SAP AI Core.

If you’re developing on SAP BTP, the SAP Cloud SDK for AI is designed to make AI integration more accessible and impactful in your applications. With features that streamline deployment management, enhance content safety, and simplify model orchestration, this SDK allows you to quickly incorporate advanced AI capabilities without extensive setup. Whether you need flexible workflows, secure data handling, or seamless integration with generative models, this SDK offers powerful tools to bring AI-driven functionality to your SAP BTP solutions.

In this blog post, we will introduce you to the key packages and their features.

AI Orchestration with @sap-ai-sdk/orchestration

Leverage the generative AI Hub orchestration service and configure templating, content filtering, and data masking for your applications with the @sap-ai-sdk/orchestration package.

With the orchestration service, you can streamline AI interactions and ensure compliance with content safety guidelines.

Templating: Create dynamic prompts with placeholders to customize AI interactions based on user inputs.Content Filtering: Apply filters to ensure input and output adhere to content safety guidelines.Data Masking: Anonymize and pseudonymize sensitive information.Grounding: Integrate external data sources to provide contextually relevant information (planned for Q4 2024).

AI Management with @sap-ai-sdk/ai-api

Automate processes such as creating artifacts, configurations, and deployments, executing batch inference jobs, as well as managing Docker registries and object storage for training data.

The @sap-ai-sdk/ai-api package provides comprehensive tools for managing scenarios and workflows in SAP AI Core.

Artifact Management: Register and manage datasets and other model artifacts.Configuration Management: Set up configurations for different models and use cases.Deployment Management: Deploy AI models and manage their lifecycle within SAP AI Core.

LangChain Integration with @sap-ai-sdk/langchain

The @sap-ai-sdk/langchain package provides LangChain-compatible clients for Azure OpenAI models deployed in SAP AI Core, enabling sophisticated AI pipelines within your SAP BTP applications.

Seamless Integration: Built on SAP Cloud SDK for AI’s foundation model clients, ensuring compatibility with SAP AI Core and LangChain’s ecosystem.Flexible Clients: Easily initialize chat and embedding clients with support for advanced features like templating and output parsing.RAG Support: Implement Retrieval-Augmented Generation workflows by combining embedding capabilities with LangChain’s text splitters and vector stores.

Generative AI with @sap-ai-sdk/foundation-models

The @sap-ai-sdk/foundation-models package offers streamlined access to specific generative AI models accessible via Generative AI Hub.

It provides a more focused interface compared to the full orchestration capabilities, concentrating on direct model interactions.

This package is ideal for developers who need direct access to foundation models for inference and embedding requests without the additional layers of templating, content filtering, or data masking provided by the orchestration service.

Getting Started

You will need Node v20 or higher and an ESM (ECMAScript Modules) compatible application to use the packages.
To explore these packages further, check out our sample code, which shows the usage of the various SDK packages.

Support and Feedback

We value your feedback on this initial release!

If you need support or want to share your thoughts and ideas, go ahead and open an issue on GitHub.

Latest News

Visit sap.com/ai and explore our portfolioExplore the available AI capabilities on SAP Discovery Center.Discover the latest announcements in the SAP TechEd Press Release and the SAP TechEd News Guide.Review the SAP Road Map Explorer for a detailed view of upcoming product innovations.Join the SAP Community page to connect with experts and share knowledge.

We are excited to announce the initial release of the SAP Cloud SDK for AI.Integrate generative AI capabilities into your SAP Business Technology Platform (BTP) applications and leverage the Generative AI Hub in SAP AI Core. If you’re developing on SAP BTP, the SAP Cloud SDK for AI is designed to make AI integration more accessible and impactful in your applications. With features that streamline deployment management, enhance content safety, and simplify model orchestration, this SDK allows you to quickly incorporate advanced AI capabilities without extensive setup. Whether you need flexible workflows, secure data handling, or seamless integration with generative models, this SDK offers powerful tools to bring AI-driven functionality to your SAP BTP solutions. In this blog post, we will introduce you to the key packages and their features.AI Orchestration with @sap-ai-sdk/orchestrationLeverage the generative AI Hub orchestration service and configure templating, content filtering, and data masking for your applications with the @sap-ai-sdk/orchestration package.With the orchestration service, you can streamline AI interactions and ensure compliance with content safety guidelines.Templating: Create dynamic prompts with placeholders to customize AI interactions based on user inputs.Content Filtering: Apply filters to ensure input and output adhere to content safety guidelines.Data Masking: Anonymize and pseudonymize sensitive information.Grounding: Integrate external data sources to provide contextually relevant information (planned for Q4 2024).AI Management with @sap-ai-sdk/ai-apiAutomate processes such as creating artifacts, configurations, and deployments, executing batch inference jobs, as well as managing Docker registries and object storage for training data.The @sap-ai-sdk/ai-api package provides comprehensive tools for managing scenarios and workflows in SAP AI Core.Artifact Management: Register and manage datasets and other model artifacts.Configuration Management: Set up configurations for different models and use cases.Deployment Management: Deploy AI models and manage their lifecycle within SAP AI Core.LangChain Integration with @sap-ai-sdk/langchainThe @sap-ai-sdk/langchain package provides LangChain-compatible clients for Azure OpenAI models deployed in SAP AI Core, enabling sophisticated AI pipelines within your SAP BTP applications.Seamless Integration: Built on SAP Cloud SDK for AI’s foundation model clients, ensuring compatibility with SAP AI Core and LangChain’s ecosystem.Flexible Clients: Easily initialize chat and embedding clients with support for advanced features like templating and output parsing.RAG Support: Implement Retrieval-Augmented Generation workflows by combining embedding capabilities with LangChain’s text splitters and vector stores.Generative AI with @sap-ai-sdk/foundation-modelsThe @sap-ai-sdk/foundation-models package offers streamlined access to specific generative AI models accessible via Generative AI Hub.It provides a more focused interface compared to the full orchestration capabilities, concentrating on direct model interactions.This package is ideal for developers who need direct access to foundation models for inference and embedding requests without the additional layers of templating, content filtering, or data masking provided by the orchestration service.Getting StartedYou will need Node v20 or higher and an ESM (ECMAScript Modules) compatible application to use the packages. To explore these packages further, check out our sample code, which shows the usage of the various SDK packages.Support and FeedbackWe value your feedback on this initial release!If you need support or want to share your thoughts and ideas, go ahead and open an issue on GitHub.Latest NewsVisit sap.com/ai and explore our portfolioExplore the available AI capabilities on SAP Discovery Center.Discover the latest announcements in the SAP TechEd Press Release and the SAP TechEd News Guide.Review the SAP Road Map Explorer for a detailed view of upcoming product innovations.Join the SAP Community page to connect with experts and share knowledge. Read More Technology Blogs by SAP articles

#SAP

#SAPTechnologyblog