October 30, 2024
Quick review of a great Microsoft blog post yesterday and what it means. 📄 Blog – https://azure.microsoft.com/blog/accelerate-scale-with-azure-openai-service-provisioned-offering/ 🔢 Example PTU to token map – https://learn.microsoft.com/azure/ai-services/openai/concepts/provisioned-throughput#how-much-throughput-per-ptu-you-get-for-each-model 🔎 […]