EN

How I Made a Movie with Sora, Kling, ElevenLabs & Udio — Full AI Workflow Tutorial

#AI Tools
2025-08-06 19:199 min read

Content Introduction

In this video, the creator discusses the workflow behind their AI short film titled 'When I Sleep, I Leave My Body.' They explain the tools and techniques used for image generation, audio creation, and video editing, emphasizing the use of AI technology. The creator outlines their process for using Sora to generate images and converting them into videos using Cling. They also detail the audio recording and character voice transformation through 11 Labs, as well as the importance of scene control and transitions for effective storytelling. The video further explores various scenes, editing strategies, and personal reflections on improving the film with AI assistance, ultimately encouraging viewers to explore their creativity using AI in filmmaking.

Key Information

  • This tutorial discusses the workflow behind creating the AI short film 'When I Sleep, I Leave My Body.'
  • The film utilized AI tools like Sora for generating images and 11 Labs for voice synthesis.
  • The creator highlights the flexibility Sora offers in scene control and image generation.
  • Audio recording was done by the creator, followed by transforming their voice to match characters through 11 Labs.
  • The process included creating short video clips and lip-syncing audio for character interactions.
  • The workflow involved transitioning between different scenes, maintaining continuity, and using various camera angles.
  • The creator emphasizes the importance of having a mix of dialogue and silence to enhance emotional impact in the film.
  • A seamless transition effect was achieved, adding to the dreamlike quality of the narrative.
  • Challenges included generating specific character expressions and maintaining visual consistency throughout the film.
  • The creator plans to continue evolving their work with new AI technologies and invites viewers to create with AI tools.

Timeline Analysis

Content Keywords

AI Short Film

The video discusses the workflow of creating an AI short film titled 'When I Sleep, I Leave My Body.' It includes a high-level overview of the film creation process and details on generating images using Sora and audio using 11 Labs.

Sora

Sora is a tool used to generate images for the film. The speaker appreciates its scene control feature, which enhances the creative process during filming.

Cling

Cling is mentioned as the software used to compile the images into short videos, incorporating voice recordings and syncing the audio with video clips.

11 Labs

11 Labs is utilized for voice transformation to create the character's voices and manage sound effects for the film.

Workflow Overview

The workflow is detailed from generating images and audio to compiling them into a cohesive video. Insights into character design and scene transitions are also shared.

AI Tools

The video explains how AI tools are leveraged in filmmaking, with a discussion on generating unique scenes and sound effects that contribute to the film's atmosphere.

Creative Process

The speaker reflects on the creative process of filmmaking using AI, including challenges faced during production and adjustments made to improve overall quality.

Character Design

The speaker describes the design of characters, particularly focusing on a scene involving a transformation into an alien character to enhance storytelling.

Audio Visual Syncing

Detailed explanation of syncing audio recordings with video clips to create a seamless viewing experience, emphasizing the importance of timing and character movements.

Film Production Challenges

The speaker shares their struggles and successes with AI-generated images, particularly with finding ways to effectively animate characters and create transitions.

Final Product

Discussion about the end product and the importance of iterative improvements, highlighting the desire to revisit and refine the film as AI technology advances.

Related questions&answers

What is the tutorial about?

This is the workflow tutorial for how I made the AI short film, 'When I Sleep, I Leave My Body.'

What AI tools did you use to create the film?

I generated all of the images using Sora, recorded audio with 11 Labs, and did the music in Udo.

How did you bring the images to life in the film?

I turned the images into videos in Cling and synchronized them with recorded audio.

What were some challenges you faced in creating the film?

One challenge was making sure the characters' dialogue matched the visual transitions. I needed to ensure smooth transitions between shots.

How did you approach the scene control aspect?

I utilized scene control features in Sora to manipulate camera angles and perspectives, adding depth to the storytelling.

Can you explain the significance of audio in the film?

I focused on using audio to enhance the emotional depth of the film, ensuring that character expressions corresponded with their dialogue.

What themes did you explore in the film?

The film explores themes of dreams, existence, and the feeling of being trapped in a dream state.

What kind of sound effects did you include?

I used various sound effects from 11 Labs to create an immersive atmosphere, enhancing the tension in scenes.

What do you suggest for those interested in AI filmmaking?

Experiment with available tools to find what works best for your creative vision, and don't be afraid to iterate on your projects as technology evolves.

What’s next for your filmmaking projects?

I plan to continue exploring AI in filmmaking, potentially remaking this movie as technology progresses.

More video recommendations

Share to: