Coming at it from the 3d end of things, Luma has been up to outright magic as far as our industry is concerned and now they’ve entered the text to video fray.
Luma’s other offerings are ‘Capture’ and ‘Genie’ both of which are transformatively powerful in and of themselves. ‘Capture’ uses AI to help you capture realistic 3d scenes, essentially gaussian splatting I expect.
Check out these captures.
This is super useful for location scouting, pre-viz, not to mention tourism and family memories. Wouldn’t it be interesting to have your childhood room captured like that?
Genie seems to be a decent text-3d object generator. I haven’t used it per se as I’m not actively doing any 3d work right now but it sure can be a fast way to create 3d mock ups and maybe even more. Textures are so easy to create these days. Definitely worth exploring further especially for gaming purposes.
The point is, these guys are 3d guys. And now they’ve come out with a text-to-video model that displays really great coherence and realism. Kaboom. I had no idea they were up this. They call their model Dream Machine, it’s free to play with, I’ve been having some fun with it myself.
Big on my list is can this thing generate establishing shots? Like, of buildings or city aerials or the like? Because often finding just the right stock is tricky. And expensive.
Like the island of Santorini from a boat?
Devil is in the details…
How about the ‘Denver Museum of Art in winter?’
Damn trees, all that fine detail is the bane of every lens, every camera movement, every compression scheme, and yes, of AI too.
But so close.
How about ‘a Christmas market in a french town?’
Humans. So many of them. So tricky. And those high contrast details really make the artifacts pop amongst the christmas lights. Definitely unusable.
But so so promising.
Of course I had to generate the de rigueur test these days for AI video generation. Will Smith eating spaghetti.
No.
Okay so maybe it isn’t going to generate establishing shots for me just yet, and maybe that’s always a low level of interacting with a new technology (trying to get it to emulate an old one). So what happens if we get a little more creative with it?
In honour of the upcoming release of LISSA’S TRIP I took a still of Lissa flying over LA and was interested to see what would happen to it.
Doesn’t it seem like she suddenly woke up flying above LA and reacts in horror to her predicament? Instant sentience and horror. I love it.
Staying on theme I asked ‘Dream machine’ (do I really have to call it that?) for a blonde woman tripping through Hollywood in a psychedelic style.
Psychedelics and AI really do work well together don’t they?
And this is just freaking weird.
Fun times.
I guess it is a lot of fun to play with it for a cinematographer
Wow!