How does generative AI filmmaking work? Artist Paul Trillo shows you how he does it (2024)

How does generative AI filmmaking work? Artist Paul Trillo shows you how he does it (1)

Wake up! It’s time for your Monday morning brAIn dump! THIS one’s a big one. Before we start, I’m excited to announce an important new resource my team and I built for you “brAIn-iacs” to get even smarter about how AI will transform media and entertainment (including your roles and jobs in it).

Introducing my new companion “the brAIn” PODCAST (now you can listen instead of read)!

At long last, I’m pleased to officially launch my new “the brAInpodcast. Now for those of you who’d rather listen than read, this one’s for you. Plus I add more personal “flavor”(and occasionally slip up too because I am, after all, human — not AI). I’ll also occasionally feature exclusive interviews with leading players in the world of generative AI. AND, check this out, my podcast features original theme music by legendary artist Mark Mothersbaugh of DEVO — whose entire career is defined by expanding creative palettes with tech. He’s the perfect match! Check out Episode 1 here or on your favorite podcast network (it’s sure to be a collector’s item!). And once you find it and like it, please be sure to follow it, rate it, and share it with your friends and colleagues. Help me spread the word. Appreciate it!

LISTEN TO EPISODE 1!

Get "the brAIn" on Apple

Get "the brAIn" on Spotify

Okay, with that out of the way, here we go with this week’s newsletter!

First, as always, “the AI:10” - last week’s 10 key AI-focused headlines impacting media and entertainment. Next, this week’s “mAIn event” (leading AI artist Paul Trillo’s “must watch” video where he reveals only to you brAIn-iacs his generative AI filmmaking secrets). Then, details about my first “AI Breakthrough” luxury weekend retreat in San Diego, October 4th-6th (hint: it’s game-changing; and limited to 12; with a special newsletter-only offer that ends June 30th). Followed by “the co*cktAIl” - my special AI event mixology. Finally, the “AI legal case tracker” - updates on the key genAI copyright infringement cases that you need to know.

How does generative AI filmmaking work? Artist Paul Trillo shows you how he does it (2)

I. the AI:10 - the 10 key AI headlines from last week

(1) It’s generative AI video wars! OpenAI’s Sora gets all the press. But others want to play in that sandbox too. Two young upstarts you should know — Luma AI and Runway ML — want to play in those video games. Luma AI just released its new “Dream Machine” AI video generation model. Not to be outdone, Runway unveiled its own hyper realistic AI video model Gen-3 Alpha. But do they stand a chance against Big Tech’s trillions? Well, it’s been a tough start so far. Luma AI’s first videos “borrowed” (cough, cough) Disney content when doing it. Never a good thing to do. Read here about Luma AI’s little dispute with Mickey and friends.

(2) Drumroll please — watch the winners of AI LA’s big “AI on the Lot” genAI film festival, “Cinema Synthetica.” The event took place a few weeks ago, but now you can watch them here for the first time. And you should. These videos showcase the state of the AIrt.

(3) But can AI really generate creative works that aren’t just novel, but wholly original? It’s a fair question. The New York Times’ Ezra Klein certainly doesn’t think so, and he’s one smart dude (I live in San Diego so, yes, that’s our lingo … it really is, by the way). One of Klein’s recent podcasts tackled the subject with renowned iconoclastic artist Holly Herndon. It’s a “must listen.” You can get the episode here.

(4) Google’s DeepMind AI can now generate music videos AND create full-blown soundtracks. That’s the headline that Digital Music News recently screamed. And they weren’t alone. Countless composers and music supervisors joined in that collective yelp for help upon hearing the news.

(5) To scrape (copyrighted works), or not to scrape? THAT is THE question! Well, actually, the question is a bit more nuanced. Is the scraping licensed? Or not? Upstart startup OpenOrigins says it’s here to “safeguard the world’s content.” Sounds great, but how? The company says that its “trust layer ensures you can always prove what is real by securing your archive and proving your media ingest is human-made and copyright compliant through decentralized proofs.” Huh, what does that mean? It just means that you content/IP owners out there should check it out. And UK-based news production company ITN is one of the first to take the bAIt, signing up to protect its video archive from unlicensed AI training. Read more about it here.

(6) What, me worry? Surprisingly, Michael Huppe — CEO of SoundExchange — isn’t worried about generative AI’s impact on the music industry. SoundExchange is one of the largest music organizations that collects royalties on behalf of artists. And Huppe argues that AI is not the new Napster. You can read why here via Forbes.

(7) Meanwhile, Universal Music Group (UMG) — the largest music company in the world — just announced a deal that hands over the “voice data” of its artists for genAI training. Yes, you heard me right! UMG is working with SoundLabs for fully licensed genAI music. But UMG artists, don’t worry. Only consenting artists participate — and they retain control over ownership and output (and also have full artistic approval rights). You can read it here.

(8) Legendary artist Flavor Flav believes the price of music fame may be getting too high. And he’s probably right. He felt the need to defend artist Megan Thee Stallion after an AI generated sex tape circulated across social media. Earlier this year, of course, Taylor Swift - and countless other celebrities and non-celebs alike - were victimized. Does anyone have an answer? Read more here.

(9) If he can do it, we can do it, right? Fast Company reported that classical composer Kerry Muzzey just brought down a Chinese state-run YouTube channel over copyright infringement. No, this didn’t involve genAI. But Muzzey’s larger “David v. Goliath” story is inspirational and shows the power of individual creators when they are hyper vigilant. An important ongoing lesson as genAI accelerates and evolves.

(10) Ponder this! Wanna know how generative AI develops from now until 2034? Now you can (at least from one senior former OpenAI “insider”). Read 10 key take-aways from former OpenAI super-alignment team member Leopold Aschenbrenner’s 165-page epic “situational awareness” essay via Axios.

[NOTE TO READERS: My goal with my “AI:10” is not to stoke fear about AI. It’s important to be stoic about this new technology that will transform media and entertainment, point out the need to do it both legally and ethically, and then encourage everyone to advocate & take action. Like any new transformational technology, there is much power amidst the chaos.]
How does generative AI filmmaking work? Artist Paul Trillo shows you how he does it (3)

II. “the mAIn event” — Filmmaker Paul Trillo reveals his generative AI recipe for creating one of his latest films, “Notes To My Future Self”

Paul Trillo is one of the leading experimental filmmakers in the world of generative AI. I’ve showcased his work before because he constantly pushes AI tech’s creative possibilities. One of Paul’s recent genAI films is titled “Notes To My Future Self.” Watch that short film first (a process that took him 10 days), and then watch his special “behind the scenes” scene-by-scene breakdown of how he did it. It’s fascinating — a sneak peek of today’s state of the art for genAI filmmaking (a state of the art that is accelerating fast, with Paul being at the forefront every step of the way).

WATCH "NOTES TO MY FUTURE SELF"

Now watch how Paul did it using all the AI tools available to him.

WATCH HOW PAUL DOES IT

Send me your thoughts to peter@creativemedia.biz.

How does generative AI filmmaking work? Artist Paul Trillo shows you how he does it (4)

III. Transform your AI knowledge & possibilities in 3 unforgettable days! Get to the front of the generative AI line at my first AI breakthrough weekend in beautiful San Diego at the Ailila Marea Luxury Beach Resort (Oct. 4th - 6th).

I’m excited to share this opportunity with you subscribers first here. My team and I have personally designed and curated this weekend breakthrough experience for immediate and transformational ROI and overall impact (not to mention a simply amazing and memorable October weekend SoCal escape). I’m confident it will be game-changing for you — and am gratified that others agree (read the Testimonials below).

Reserve your spot now (only 12 spots available). Special newsletter-only pricing ends June 30th (that’s in less than 1 week!).

GET DETAILS HERE

Click on the “Get Details Here” button, or feel free to reach out to me directly at peter@creativemedia.biz for more information. We’ll get back to your promptly!

Testimonials:

“In a time of great fear and optimism, Peter is the perfect convener and translator to help unpack what it will take from a business, legal and technical perspective to make these exciting AI breakthroughs enterprise grade and a business reality for the entertainment industry.” Scott Rupp, Founding General Partner, BITKRAFT Ventures

“Peter knows more than just about anyone on the planet about how generative AI is transforming media and entertainment. And his network is second to none. He knows - and can reach - just about anyone.” Eric Tu, Co-Founder, EST Media & OPEN SuperApp

“Peter gave us powerful insights into the future of the media and entertainment space – the players, technologies, challenges and business models.” Andrew Inesi, Global Head of Policy & Business Affairs, Dolby Labs

“Peter is smart, innovative, dedicated and highly connected. He gets things done and has proven himself time and time again.” Larry Mestel, CEO, Primary Wave

“No one sums up the current media maelstrom better than Peter Csathy. His insights are brilliant and compelling.” Brent Lang, Variety

“Peter navigates the wild west of digital media with skill and precision. His salient insights are delivered in a way that is compelling, entertaining and completely accessible.” David Ng, Los Angeles Times

“Peter is one of the smartest guys in new media.” Jefferson Graham, USA Today

How does generative AI filmmaking work? Artist Paul Trillo shows you how he does it (5)

IV. the co*cktAIl — my mixology of “must attend” AI events

After all, it’s always happy hour somewhere!

COMING SOON - LESS THAN ONE MONTH AWAY IN JULY! It’s Digital Hollywood’s first major comprehensive generative AI-focused conference, “The Digital Hollywood AI Summer Summit”, taking place July 22nd - 25th. It’s all virtual and entirely FREE. Learn more here via this link. So many sessions, so many great speakers. I moderate two great panels filled with superstars. No exaggeration.

How does generative AI filmmaking work? Artist Paul Trillo shows you how he does it (6)

V. the AI legal case tracker - updates on key AI litigation

I lay out the facts - and the latest developments - via this link to the “AI case tracker” tab on “the brAIn” website. You’ll get everything you need (including my detailed analysis of each case). These are the cases I track:

(1) The New York Times v. Microsoft & OpenAI

(2) Sarah Silverman, et al. v. Meta

(3) Sarah Silverman v. OpenAI

(4) Universal Music Group, et al. v. Anthropic

(5) Getty Images v. Stability AI and Midjourney

NOTE: Check out the “AI case tracker” tab at the top of the page at “the brAIn” website.
How does generative AI filmmaking work? Artist Paul Trillo shows you how he does it (7)

Check out my firm Creative Media to learn more about the unique power, reach and impact of our business consulting and development services, together with my corporate speaking and AI business workshops (both virtual and IRL).

Learn more about Creative Media

Send feedback to bizdev@creativemedia.biz.

How does generative AI filmmaking work? Artist Paul Trillo shows you how he does it (2024)

FAQs

How is AI used in filmmaking? ›

AI is revolutionizing film production by automating various tasks such as script analysis, video editing, CGI generation, and even virtual actors. It is streamlining workflows, reducing costs, and enabling filmmakers to create unique and engaging content.

What is the AI artificial intelligence movie about? ›

What movie was completely made with AI? ›

The Frost: Considered the first AI-generated film in the world, The Frost is a 12-minute film in which every shot is generated by an image-making AI called DALL-E 2, based on a script written by a human. The film uses another AI tool called D-ID to animate the still images.

What happens to David at the end of AI? ›

David only has one day to spend time with his mother before her reanimated corpse dies once more. David plays games, draws, and even has a birthday. The film ends with narration over David falling asleep in his Mother's dying arms. And yet, the ending feels so bitter in a Kubrickian way.

What is generative AI in film? ›

Generative AI tools are transforming the field of film production, enabling filmmakers to automate and enhance various aspects of the filmmaking process. By leveraging the power of machine learning, these tools can help generate ideas, augment creativity, and speed up the production process.

How does AI video generation work? ›

Users provide input data to the AI video generator, which can include text scripts, images, or audio recordings. The AI algorithm analyzes and processes this data to extract relevant information and identify key elements for inclusion in the video.

What movie does the AI control the world? ›

Colossus: The Forbin Project — Among the first films about sentient AI that tries to take over the world, it's brilliant and an inspiration for The Terminator series.

What movie did AI become self aware? ›

Films like The Terminator, 2001: A Space Odyssey, and Ex Machina delve into the dangerous consequences of AI becoming self-aware and surpassing human capabilities.

What movie did a man fall in love with an AI? ›

When Spike Jonze's Her came out in 2013, the film about a lonely man falling for an artificially intelligent operating system won widespread praise.

How intelligent will AI become by 2030? ›

By 2030, AI will be unfathomably more powerful than humans in ways that will transform our world. It will also continue to lag human capabilities in other ways.

What movie is AI replacing humans? ›

I, Robot is a science fiction film released in 2004 starring Will Smith, set in a future where robots serve humans. In it, the takeover by robots is instigated by an artificial intelligence system known as VIKI, designed to ensure the survival and well-being of humanity.

Who invented AI? ›

Birth of AI: 1950-1956

Alan Turing published his work “Computer Machinery and Intelligence” which eventually became The Turing Test, which experts used to measure computer intelligence. The term “artificial intelligence” was coined and came into popular use.

Does A.I.: Artificial Intelligence have a happy ending? ›

Artificial Intelligence." The ending in particular was deemed divisive, in that it shows David (Haley Joel Osment) spending an ideal final day with his adoptive mother, in an apparent subversion of the typical Kubrickian bleakness.

What is the message of the movie AI? ›

Movie Review. The themes of A.I.: Artificial Intelligence are simple: the need to be real and the desire to be loved.

Who are the beings at the end of AI? ›

Plus, quite a few critics in America misunderstood the film, thinking for instance that the Giacometti-style beings in the final 20 minutes were aliens (whereas they were robots of the future who had evolved themselves from the robots in the earlier part of the film) and also thinking that the final 20 minutes were a ...

How is AI used in video editing? ›

With the emergence of AI technology, editors can use AI to automate tasks and streamline some of the more tedious chores involved in the editing process. AI tools can help editors create transcripts, manage color levels, adjust audio, and remove unwanted pauses.

How will AI change video production? ›

AI can automate many repetitive and time-consuming tasks in the editing process, enabling editors to work more efficiently and effectively. Additionally, AI can be used to enhance the creative possibilities of post-production, enabling editors to create new and innovative video content.

How does AI enhance video? ›

AI Video Upscaling Software is a sort of software that improves the resolution and quality of videos by utilizing artificial intelligence (AI) and machine learning algorithms. The software analyzes video frames and uses powerful algorithms to forecast and generate new pixels based on the surrounding pixels.

How could generative AI enable a new era of filmmaking? ›

“AI in film not only accelerates the creative process, but also democratizes it.” During production, AI again becomes a co-collaborator, creating visual effects (VFX), generating realistic CGI, and even simulating complex scenes that would be too costly (or dangerous) to shoot in real life.

Top Articles
Latest Posts
Article information

Author: Arielle Torp

Last Updated:

Views: 6147

Rating: 4 / 5 (61 voted)

Reviews: 92% of readers found this page helpful

Author information

Name: Arielle Torp

Birthday: 1997-09-20

Address: 87313 Erdman Vista, North Dustinborough, WA 37563

Phone: +97216742823598

Job: Central Technology Officer

Hobby: Taekwondo, Macrame, Foreign language learning, Kite flying, Cooking, Skiing, Computer programming

Introduction: My name is Arielle Torp, I am a comfortable, kind, zealous, lovely, jolly, colorful, adventurous person who loves writing and wants to share my knowledge and understanding with you.