AI VFX & Motion: Crafting Visual Wonders with AI

Overview

This workshop offers a case study journey into the world of AI-enhanced VFX and motion graphics. Explore leading tools like Firefly, Runway, and Leonardo, along with a suite of third-party add-ons designed to automate and innovate. From animating images and characters to fixing flaws, you'll learn to harness AI for a myriad of purposes.

Dive into the AI-driven facets of rotoscoping, face swapping, hyper-slow motion, ultra-resolution, and generative content. Harness AI to craft lifelike images and animate effortlessly in After Effects. While computers are capable creators, true creativity still lies beyond their grasp. Artificial Intelligence (AI) can generate breathtaking visuals in moments, streamline post-production, and alleviate monotonous tasks. Yet, it lacks the intrinsic understanding and critical judgment of quality.

By the workshop's conclusion, you'll gain a nuanced understanding of AI's role in contemporary VFX and practical ways to integrate these advancements into your projects.

During this workshop, we won't extensively cover the historical background, technical details, ethical considerations, future speculations, or the skill of crafting text prompts for AI models. Our primary focus is on practical applications and creative implementation of AI in VFX and motion graphics.

Objectives

Upon completion of this course, students will be able to:

• Animate AI-generated images with finesse
• Bring characters to life with movement and speech
• Produce videos from images and text prompts
• Transform 2D elements into immersive 3D scenes
• Expedite rotoscoping, masking, and tedious post processes
• Employ AI for tasks like blurring faces, depth creation, and enhancing resolution.

Who Should Attend

• Motion Graphic Designers and Animators
• Visual Effects Artists
• Film and Video Editors
• Digital Media Students and Educators
• Digital Content Creators
• Advertising and Marketing Professionals

Course Outline

Note: The course curriculum listed below is typically covered in class. The instructor may, at their discretion, adjust the lesson plan to meet the needs of the class.

Lesson 1: Animating an AI Image

• Using text prompts to create an image based on a client brief
• Improving the result with upscaling and generative fill
• Splitting to layers for animation
• Faking 3D parallax using 2D effects

Lesson 2: Bringing Characters to Life

• Creating an avatar for animation
• Creating a clean plate
• Generating a depth map using neural effects
• Automatic lip-sync options
• Making 3D displacement
• Compositing

Lesson 3: 2D & 3D Objects

• Generate video based on image/text
• Integrate 2D with 3D
• Create 3D animated characters based on text prompts
• Create a 3D object from an Image

Lesson 4: Common Post Tasks

• Removing backgrounds (Rotoscoping)
• Generating content
• Super slow motion
• Ultra-resolution tools
• Blurring faces
• Using depth tools

Tools Used

• Firefly
• Dall•E
• Leonardo
• Midjourney
• Runway
• Pika
• DiD
• ZoeDepth
• Mootion
• LeiaPix
• ElevenLabs
• Adobe Photoshop
• Adobe After Effects
• Topaz Labs
• Mootion
• SpeedX
• ScaleUp
• Depth Scanner
• Mask Prompter
• Blace

Note: A premium Midjourney membership is not required; users can simply utilize the free plan offer.

Technical Requirements

Computer Hardware:
A modern computer (laptop or desktop) with 16GB RAM and an 8GB VRAM graphics card.
Software:
Adobe Photoshop and After Effects, and specific AI tools (a list will be provided).
Operating System:
A recent version of Windows (10 or later) or macOS (Catalina or later).
Internet Connection:
A stable and high-speed internet connection for using cloud-based AI tools.
Storage Space:
At least 20GB free for installing software and storing workshop materials and projects.
Software Skills:
Basic proficiency in standard VFX and motion graphics software.
Miscellaneous:
Access to specific websites and platforms that might be used for downloading tools or resources, ensuring participants can bypass any potential access restrictions (like firewalls).