AzureFeeds

Special credit to Rory Preddy for creating the GitHub resource that enable us to learn more about Azure Sora. Reach him out on LinkedIn to say thanks.

Introduction

Artificial Intelligence (AI) is revolutionizing content creation, and video generation is at the forefront of this transformation. OpenAI’s Sora, a groundbreaking text-to-video model, allows creators to generate high-quality videos from simple text prompts. When paired with the powerful infrastructure of Azure AI Foundry, you can harness Sora’s capabilities with scalability and efficiency, whether on a local machine or a remote setup.

In this blog post, I’ll walk you through the process of generating AI videos using Sora on Azure AI Foundry. We’ll cover the setup for both local and remote environments.

Requirements:

1. Azure AI Foundry with sora model access


2. A Linux Machine/VM. Make sure that the machine already has the package below:

• 
  
  
  
  • Java JRE 17 (Recommended) OR later
  
  
  • Maven
  
  
  
  

Step Zero – Deploying the Azure Sora model on AI Foundry

Navigate to the Azure AI Foundry portal and head to the “Models + Endpoints” section (found on the left side of the Azure AI Foundry portal) > Click on the “Deploy Model” button > “Deploy base model” > Search for Sora > Click on “Confirm”.

Give a deployment name and specify the Deployment type > Click “Deploy” to finalize the configuration.

You should receive an API endpoint and Key after successful deploying Sora on Azure AI Foundry. Store these in a safe place because we will be using them in the next steps.

Step one – Setting up the Sora Video Generator in the local/remote machine.

Clone the roryp/sora repository on your machine by running the command below:

git clone https://github.com/roryp/sora.git
cd sora

Then, edit the application.properties file in the src/main/resources/ folder to include your Azure OpenAI Credentials.

Change the configuration below:

azure.openai.endpoint=https://your-openai-resource.cognitiveservices.azure.com
azure.openai.api-key=your_api_key_here

If port 8080 is used for another application, and you want to change the port for which the web app will run, change the “server.port” configuration to include the desired port.

Allow appropriate permissions to run the “mvnw” script file.

chmod +x mvnw

Run the application

./mvnw spring-boot:run

Open your browser and type in your localhost/remote host IP (format: [host-ip:port]) in the browser search bar. If you are running a remote host, please do not forget to update your firewall/NSG to allow inbound connection to the configured port. You should see the web app to generate video with Sora AI using the API provided on Azure AI Foundry.

Now, let’s generate a video with Sora Video Generator. Enter a prompt in the first text field, choose the video pixel resolution, and set the video duration. (Due to technical limitation, Sora can only generate video of a maximum of 20 seconds).

Click on the “Generate video” button to proceed.

The cost to generate the video should be displayed below the “Generate Video” button, for transparency purposes. You can click on the “View Breakdown” button to learn more about the cost breakdown.

The video should be ready to download after a maximum of 5 minutes. You can check the status of the video by clicking on the “Check Status” button on the web app.

The web app will inform you once the download is ready and the page should refresh every 10 seconds to fetch real-time update from Sora. Once it is ready, click on the “Download Video” button to download the video.

Conclusion

Generating AI videos with Sora on Azure AI Foundry is a game-changer for content creators, marketers, and developers. By following the steps outlined in this guide, you can set up your environment, integrate Sora, and start creating stunning AI-generated videos. Experiment with different prompts, optimize your workflow, and let your imagination run wild!

Have you tried generating AI videos with Sora or Azure AI Foundry? Share your experiences or questions in the comments below. Don’t forget to subscribe for more AI and cloud computing tutorials!