AI & Filmmaking
We understand that the conversation around AI can be confusing and controversial. This page is to give you information about some AI programmes that are currently out there that you might use to help in your creative process.
​
If you are creating films for our Film Challenges, as part of our challenge rules you need to identify in the credit sequence if you used AI to help aid your project so that those judging can make an informed decision if they are voting for your film.
​
Plus, it gives a good conversation starter to let others know how you created your film!
​
The list below was created using ChatGPT (yes, we do understand the irony!)
Introduction to Editing Workshop
1. Scriptwriting & Story Development
ChatGPT (OpenAI): Assists with generating ideas, drafting dialogue, and shaping narratives.
ScriptBook: AI script analysis tool that predicts the commercial success of a screenplay and offers suggestions for improvement.
AI Dungeon: Helps generate creative narrative ideas and dialogue through interactive storytelling.
Plotagon: Allows users to create animated stories by typing dialogue, and it automatically generates scenes and character actions.
Celtx AI: Provides scriptwriting assistance, suggesting elements like plot twists, character development, and formatting.
2. Casting & Character Generation
Casting Networks (AI-Powered Tools): AI-driven platforms help filmmakers choose the right actors based on their past performance metrics, appearances, and roles.
Synthesia: Creates AI-generated characters with video synthesis technology, allowing virtual actors to perform.
Metahuman (Epic Games): AI-driven tool that allows the creation of highly realistic human avatars, useful for casting and animation in films.
3. Pre-Visualization (Previs)
NVIDIA Omniverse: AI-powered collaborative platform for 3D simulation, design, and visualization, helping create virtual environments for pre-production.
Previs Pro: Uses AI to assist with the planning of scenes and visual elements in film by creating storyboards and animations.
Autodesk ShotGrid: AI-enhanced project management and pre-visualization tool for film production.
4. Animation & CGI
DeepMotion: AI-driven motion capture platform that turns 2D videos into 3D animations, making it easier to animate characters.
RunwayML: AI-based creative tool that helps filmmakers generate video effects, animations, and artistic style transformations.
Ziva Dynamics: AI-powered platform for realistic character animation, particularly used for facial animations and muscle simulations.
Eisko: Generates 3D models and facial animations using AI from photographs, simplifying character creation for CGI.
5. Visual Effects (VFX)
Wonder Studio: Uses AI to automatically animate, light, and compose CGI characters into real-life environments, replacing traditional VFX pipelines.
Adobe After Effects (AI Tools): AI-based features like Content-Aware Fill and Puppet Pin Tool for creating special effects and animations.
Autodesk Maya: Integrates AI-enhanced tools to speed up modeling, simulation, and rendering processes in visual effects.
Jellyfish Pictures: AI-driven studio that uses machine learning for automated VFX processes like rotoscoping and scene matching.
6. Video Editing & Color Grading
Adobe Premiere Pro (AI-Powered Features): Offers AI-based tools like Auto-Reframe, Lumetri Color, and Speech-to-Text to automate video editing processes.
Blackmagic Design DaVinci Resolve: Integrates AI tools for color correction, face detection, object removal, and intelligent video editing.
RunwayML: Also offers advanced AI video editing capabilities such as background removal and video upscaling.
Magisto: AI-powered video editor that automatically assembles videos from clips, adds transitions, music, and effects.
Pond5 Visual Search (AI): Helps video editors find the right stock footage using visual similarity search powered by AI.
7. Sound Design & Music Composition
AIVA (Artificial Intelligence Virtual Artist): AI music composition tool that creates original soundtracks and scores tailored to the mood and themes of a film.
Amper Music: AI music composition software that allows users to create and customize original music for their films.
Endel: AI-based sound design tool for generating ambient soundscapes and dynamic film scores.
Sonalysts Media (AI Sound Design): AI-powered tools for automated sound design, Foley, and environmental soundscapes.
Soundraw: AI-based tool to generate unique music compositions for specific moods or scenes.
8. Dialogue Dubbing, Subtitling & Language Translation
DeepDub: AI-driven voice dubbing platform that replicates actors' voices for international markets, allowing seamless localization.
Respeecher: AI-based voice cloning software that allows filmmakers to recreate voices and dialogue with natural-sounding AI-generated voices.
Veritone: Offers AI-driven solutions for translating and dubbing film dialogues into multiple languages using synthetic voice technology.
Sonantic: AI speech generation platform for creating human-like voices for dubbing, allowing real-time voice edits.
9. Real-Time Motion Capture & Virtual Production
Vicon: AI-enhanced motion capture technology used for real-time 3D character animation in virtual production environments.
Mo-Sys: AI-driven camera tracking technology used for virtual production, allowing real-time compositing of live actors into digital backgrounds.
Unreal Engine (AI Tools): Integrates AI to assist in real-time rendering and virtual production, especially for live-action VFX.
10. Post-Production Automation
ClearView Flex (Sohonet): AI-driven tool for remote collaboration in post-production, allowing real-time feedback on editing, color grading, and VFX.
Frame.io: Cloud-based review and collaboration platform with AI features like automatic transcription, making post-production workflows faster.
AI-powered Rotobrush (Adobe): Automates the tedious process of rotoscoping (cutting out subjects from backgrounds) using machine learning.
11. Audience Testing & Feedback
Cinelytic: AI platform that analyzes audience data to predict the commercial success of a film and helps with decision-making in the production and distribution phases.
Gower Street Analytics: Provides AI-based box office forecasting and market analysis for films.
ScriptAI (IBM Watson): Uses AI to gauge audience sentiment, predict film reception, and provide insights into potential script improvements.
12. AI for Distribution & Marketing
TrailerAssist (20th Century Fox): AI-driven system for creating trailers by analyzing the emotional beats and structures of successful trailers and generating new ones.
Mirriad: AI-powered product placement tool that seamlessly integrates brands into films post-production by analyzing visual scenes.
Vidooly: AI-based analytics tool for predicting and optimizing film trailers' performance on social media platforms.
Synthetik (AI-Powered Market Segmentation): AI tools used for identifying target audiences and customizing marketing efforts for specific demographics.
​
Know of an AI programme?
We will constantly be looking to update this list so get in touch if there's an AI programme that you use that you think should be added to the list.