Create Ai VFX (Visual Effects) | With Runway Gen-3 | Full Tutorial

Introduction

In this article, I’m going to show you how to create some mind-blowing VFX shots and seamlessly blend them into your own footage using AI technology. With this method, you can create eye-catching social media posts or elevate your storytelling. I’ll share some of my favorite tips, and I’ll showcase a short film I made using these effects. So, let’s dive in!

Getting Started with Runway Gen-3

To create these VFX shots, we will be using Runway's Gen-3 video generator. The first step is to shoot a video. For our example, I thought it would be cool to create an explosion effect. I filmed myself getting into my car and will generate the car exploding right after I get in.

Preparing Your Footage

For best practices, ensure your camera is locked on a tripod or, in my case, I propped my phone on a stable table. It is essential to lock the focus on the object you want to remain in focus, to avoid any autofocus issues that may distort the shot. Make sure auto white balance is off to prevent shifts in color tone throughout the video.

Next, take a snapshot or still frame from the video where you want the effect to take place—right when I get into the car in this example.

Generating VFX with Runway

1. Go to Runway's website and click on "Get Started."
2. Upload the screenshot of the car you took.
3. Choose whether this image will be your first frame or last frame in the video. For the first option, the image starts the video and changes from there, while the last frame starts the shot at the final state.

For a static shot, use terms like "still" or "static" in your prompt. For example, set the prompt to “still tripod shot of a car exploding. The camera remains still,” and let it generate.

Exploring Other Effects

You can also experiment with other VFX concepts like growth transformations. For instance, I drew inspiration from Runway's video where a plant grows while being sprayed. I found success using prompts like “static shot of a plant, the plant morphs, grows, and transforms into a larger plant.”

Moreover, I recorded myself spraying a plant and successfully merged this footage with the video of the plant growing. Always remember to create a clean plate by taking another shot without you in the frame for smooth integration.

Experiments with Floating and Simulations

Try to create a floating effect: I took a picture of an old guitar and prompted “the guitar starts floating.” After stitching this footage together, it looked impressive, complete with realistic shadows.

Runway also excels at simulating elements like paint falling, where I generated a video of green paint dropping onto a car. The realism of the paint's simulation was remarkable.

Animation of Images

You can animate images in your video as well. For example, I used a bird image from a book and prompted “camera is still, the image on the book comes alive.” The results were fantastic, allowing for the animation of any artwork or images.

Editing the VFX Footage with Original Footage

You can use any video editor, but in this tutorial, I’m using CapCut. First, import the original footage and the VFX footage. Adjust the color grading to match both footages and ensure they sync at the correct time in the timeline.

Using the masking tool is essential for merging different clips. For instance, I masked part of my hand while spraying to incorporate the growing plant and hide the unwanted sections.

Once you’ve done this, experiment with keyframes for camera movements, adding filters, and creating cinematic black bars for a more polished look.

Conclusion

Using these techniques, I created a captivating short film blending all the effects described. It illustrates that you don’t need a large budget to produce stunning visual effects. I encourage you to test out these tools and let your creativity flow.

Keywords

• VFX
• Runway Gen-3
• Video Generator
• Visual Effects
• Masking
• Simulation
• Color Grading
• Camera Movement

FAQ

1. What is Runway Gen-3?
Runway Gen-3 is an AI video generation tool that allows users to create high-quality visual effects for videos.

2. How do I ensure my footage blends well with VFX?
To blend VFX seamlessly, ensure your camera is locked, focus is stable, and the color grading matches your original footage after editing.

3. Can I animate images with Runway?
Yes, you can animate still images within your footage by using specific prompts tailored to your desired effect.

4. What video editors can I use with Runway's generated VFX?
You can use any video editor, but this tutorial specifically demonstrates using CapCut and Premiere Pro.

5. What types of VFX can I create with Runway?
You can create a variety of effects like explosions, transformations, floating objects, and more advanced simulations like paint falling or liquids filling containers.