AzureFeeds

Veeam Data Cloud (VDC) provides cloud-native, SaaS-based data resilience for mission-critical environments including Microsoft 365, Entra ID, Azure, and Salesforce. As enterprise data protection needs to evolve, so does the intelligence behind it. With Veeam Intelligence, VDC is leveraging the power of generative AI that helps users get the most value from VDC services using an advanced AI assistant, with the vision to deliver real-time insights through backup telemetry in the future

To build an assistant delivers accurate, reliable, and safe responses, the VDC team partnered with Azure AI Foundry, Microsoft’s AI application development platform which provides built-in responsible AI evaluation and testing  at scale.

From Backup to Breakthrough: Enabling Smart, Safe AI Assistance

Veeam Intelligence’s mission is clear: provide accurate, easy-to-understand answers to user questions while maintaining the highest safety standards. But with every new feature release or model update, there’s a risk of introducing harmful regressions or vulnerabilities, especially as AI systems scale and evolve.

To mitigate this, the VDC team adopted Azure AI Foundry early in development. Foundry equips Veeam’s product developers with automated testing workflows that ensure the assistant’s responses remain clear and accurate, without generating harmful or unwanted content. This is especially critical when working with enterprise-grade AI that interacts with sensitive backup data and identity services.

Building In Trust with Azure AI Foundry

The first step in integrating Foundry was establishing an automated suite of evaluations triggered with every GitHub commit as part of their CI/CD workflows. As new code is introduced, Foundry’s quality evaluators simulate a range of real-world user queries to verify that the assistant’s responses are both helpful and concise. Simultaneously, risk and safety evaluators are run to ensure that no harmful, toxic, or otherwise inappropriate content is returned.

This constant testing and validation loop helps Veeam ship confidently, knowing that AI-generated interactions upholds enterprise standards of safety and performance.

Why Foundry? Evaluation That Scales

VDC’s AI engineering team conducted a comprehensive review of available AI evaluation solutions, and Foundry stood out. Its extensive suite of evaluators delivered consistent results across a broad range of edge cases, while still being easy to configure and integrate into existing pipelines.

Additionally, advanced features like AI Red Teaming gave the team deeper assurance that Veeam Intelligence could defend against adversarial prompts and jailbreaking attempts, which is an essential capability for any enterprise-grade assistant.

What’s Next: Toward Continuous Monitoring and Real-Time Quality

Looking ahead, VDC is exploring Foundry’s Continuous Monitoring capabilities to maintain the assistant’s quality in live environments. One area of particular interest is real-time alerting for any degradation in safety or accuracy metrics, especially in response to novel threats such as jailbreaking attacks.

 Another challenge the team is addressing involves monitoring AI response quality post-deployment, when ground-truth answers are no longer accessible. Utilizing Foundry’s comprehensive suite of quality evaluators, the VDC team aims to maintain rigorous oversight on performance to ensure users consistently receive reliable answers.

Veeam also participated in the session  AI and Agent Observability in Azure AI Foundry and Azure Monitor at Microsoft Build 2025, where they demonstrated their use of the Azure AI Foundry Evaluations SDK in action. This collaboration highlights how, with Veeam Intelligence, VDC is setting a new standard for data resilience — powered by responsible, enterprise-ready AI. And with Azure AI Foundry as a partner, the team has the tools to test, validate, and monitor their AI systems with confidence, staying one step ahead of risk.

Learn more about Azure AI Foundry and how it can help your team scale AI responsibly.