Set token limits for your GenAI APIs

Estimated read time 1 min read

Post Content

​ Use GitHub Copilot for Azure and Copilot Edits to set token limits for your Generative AI APIs to effectively manage your quota/ tokens.

Resources:
To get started, download and install the GitHub Copilot extension from: https://aka.ms/GetGitHubCopilotForAzure
azd CLI: https://learn.microsoft.com/azure/developer/azure-developer-cli/
Azure API Management token limit policy: https://learn.microsoft.com/en-us/azure/api-management/azure-openai-token-limit-policy
Sample: https://github.com/Azure-Samples/genai-gateway-apim   Read More Microsoft Developer 

You May Also Like

More From Author