there's a brand new text to video AI model and it's from the company Runway the leading text to video AI model they've been around for quite a while they had something called gen 1 then they had something called Gen 2 and this new model is called gen 3 everything I'm showing you here on screen is actually just text prompts turned into video from their demo reel and I'm going to show you exactly how to use it it's available for everyone right now and we could use it right now inside of Runway ml.com and one thing that gen 3 has that I've never seen before it has lip sync so you could type in a script and it will have the character that you generate actually read that script using AI voices I'll show you that too now my background is in film making I run a video production company to this day that I've had for over a decade and I work as a cinematographer and a director for well over 15 years mostly in the commercial world so this is kind of an exciting tool it's a little bit scary at the same time but let me show you exactly how it works so Runway ml.com is the website if you've never used the before Runway actually has a library of AI tools so you could go ahead and click try gen 3 it's in Alpha right now and then login with an account and then it's going to bring you to this page now gen 3 does require a subscription that I believe starts if you pay monthly at $15 and then I'll show you how the credits work it's based on credits video generation is extremely expensive but Runway has different tiers depending on how much you're going to use it if you're using it for more creative film type projects it may require you to buy the higher end level and if you want to kind of dabble with it maybe make a small commercial you could probably start with the smaller plan I have the middle tier here in my account okay I'll get started here with Gen 3 and I want to specifically show you how to prompt it correctly and I have a prompt that I'll put in the description that you could copy and paste and actually use chat GPT or Claud as a prompt generator for this very specific platform using their specific prompting technique but the page is very very simple right now they don't have many options at all so right here this is where the box for the prompt goes and if you click this drop down for some reason if you're on gen two which was a pretty good model too but Gen 3 is like at a whole different level make sure you choose gen 3 first I'll show you prompting in a second we're going to put that in here on the left side that's where your prompt goes but there are some settings option that I'll cover and then there's some custom presets but right now let's go ahead and type in a basic prompt and I'll just go ahead and generate from here and since open a I Sora is still not available this is supposed to be the best text to video model available but it's still not out yet we're going to use the prompts from there so here's a prompt and I'm going to go ahead and copy this prompt and let me take it into Runway and I'll paste it here now right here on the bottom you could actually generate clips that are 5 Seconds or 10 seconds so Sora claims they could do 60 seconds but we'll see and 5-second video clips only take about a minute to actually render out and show you here where you could download them directly from this page 10 seconds takes about 120 seconds to generate now as far as how many credits they take if you look on top right here on the top right every time you generate with Gen 3 which is what I'm showing you it takes 10 credits for one second so a 10sec clip is a 100 credits so it is pretty expensive if you generate quite a bit of different uh Clips here with it but I'll just go ahead and create this 10c clip I'll press generate again really not much the settings of it Gen 2 has ton of different settings so I'm sure a lot of those are going to roll in but as of right now this is all you have is the prompt so you got to get good at prompting I'll show you a prompting technique right after this generates okay there we go we got our generation it took about 60 seconds in this case let me go ahead and go to full screen let me press play here and let's take a look okay some of these people are morphing a little bit in the background and okay for some reason it went all the way to the feet and then it start to morph in a weird way but for about 5 Seconds of it it was not too bad it's definitely nowhere near Sora and I've generated this maybe three or four times let me show you a couple of different Generations here's the first one I generated here this one had much better results it still looks a little bit cartoony but this was a 5-second generation pretty good now this one I actually used a lip sync option I just have it on mute right now so not bad very similar to the other one but this one the Li Li are moving and actually reading a text prompt now let me show you the prompting guide they have here it's actually pretty good but this requires pretty manual prompting because you don't have any type of settings to change you can't change the speed you have to describe things you have to describe camera movement you have to describe lighting you have to describe all kinds of different things if you want a very specific output but the prompt basically is very simple it has three parts to it and you usually want to do it exactly like this first this describe the camera movement I'm going to show you they have a whole list down here then you're establishing the scene then any additional details so in those three parts is how you want to create that so right here is an example low angle static shot that's the camera movement so low angle is the angle static shot means it's not moving the camera is angled up at a woman wearing orange and there's a little bit of more detail here after that now if you go down a little bit more it's going to tell you all kinds of different camera Styles lighting Styles all kinds of different things with an example so if you're not familiar obviously my background is in cinematography so it's easier for me to come up with all these different type of terms but for lighting for example diffused lighting if you describe that it's going to give you nice soft lighting or silhouette's going to give you this kind of silhouette shadow look right so you got lots of different options in this page so I'll put this page in the description below this video so you can read more about it and they actually have another page here under the same menu where you could actually see more about it so it's going to give you actual prompts that you could just copy and paste from here with some more examples okay now to come up with the next prompt I want to give you this prompt because then you could use chat GPT or Claud as your prompt generator just type this prompt or paste this prompt from the description below this video and all it's doing is saying you are a prompt generator responsible for creating prompts for text to video model and then it's going to tell it the structure from that page so always structure your prompt based on these three things and then give it more details based on angles and lighting and I told it to not break it up into different sections because we want it as one chunk of text under 400 characters the limit is technically 500 but sometimes chat GPT just doesn't know character count so I went on the lower side of that and then all you have to do is right here type in a very simple prompt so I'll just type submarine in deep ocean that's it right super simple prompt and as you see right here it's going to take that so Dolly shot that's the camera movement a submarine navigates through an ocean then it's going to describe some filter lighting the different things the details that it sees so I could go ahead and copy and paste this here into Runway and this time I'll just generate a 5-second shot so I'm not eating up all my credits here generate now while that's going let me show you the settings menu the only thing that's available here that's worth looking at obviously you want to remove the runway Watermark here that's checked on but what a seed is is this number if you go ahead and turn this on your next generation will be a close rendering of what you're seeing in this generation every time you have this off and you generate again it might be wildly different so by default it is wildly different but if you want to create something or shots within the same scene you typically might want to turn on the seed and see what kind of results you get there and then this other option you have you could actually create custom prompts so these basically save your prompt here you can name it as a preset so then you could keep generating it based on this by actually using it as a template okay let's take a look at this one here okay interesting looking submarine doesn't look like a submarine I've seen before but uh yeah nothing wrong with this shot this looks pretty good now let me take one more from Sora from the open AI page this one is a pretty detailed prompt and it looks really really good let's see what we get out of Runway with that now this one I have a 500 character limit so that was a little bit too long so I'll take some out generate a 5-second clip and while that's generating every time you get a generation it's really simple here to download it they just have a download tab right here you could also favorite it here so it's really easy to find and if you want to save it to a folder they actually have a nice folder structure so I've created one for all my gen 3 generations you could just create folders from here and save them and then when you go to your dashboard all your Generations will be in one place because every time you refresh this page these won't appear over here but while you're on the same session all your generation show up like this 1 2 3 4 and so on okay let's go ahead full screen on that let's press play play okay that did not turn out good at all it's just going backwards here overall though the lighting is nice really cinematic backlit here the car looks a little bit weird but obviously the movement doesn't work at all I could probably take this into a editing program and reverse it and it might work but by default this motion doesn't make any sense right so it's a hid and miss here right now inside of gen 3 you're not going to get exactly what you want every time and it's pretty expensive to generat but if you're p and you're willing to spend the credit I found one out of three is pretty good so far and I've generated maybe 20 30 clips and I think that's about the rate that's kind of the hit and Mis rate that I'm getting okay here I'll start with a really simple prompt closeup tripod shot of a female news anchor reading the news directly to camera I'm going to generate a 10-second clip of this then I'll show you the lip sync option okay let me just preview this to make sure it looks okay okay not too bad nothing alarming here okay let's go ahead and try the lip sync option that's down here I'm going to click this it's going to take a few seconds here to show up on the left side and here all I have to do is upload an audio file you could actually record your own audio upload it there you could record audio directly from here in this case I'm going to use AI generated audio so I'm just going to type in my text here so this is just something I got out of chat GPT for an opening of the 5:00 news and I'm going to press right here on on the left side because you have ton of different voices available I'll just press play on one of these here this one's a news so I'll just choose the news category Katie hi there I absolutely love telling stories okay I don't know if I like that one so much let me try this one good evening I was actually hoping to run into you okay I like this one a little bit more for this new Zanker and I'm going to just press right here generate lip sync now this uses new credit because it's generating a whole different clip and this is going to take the length of the script I noticed some times if the script was too long and my Generations was only 10 seconds it just kind of reversed the clip again okay there we go we have this one let me go ahead and go full screen on it and let's take a listen good evening I'm Mary and welcome to the 5:00 news here are tonight's top stories first a major breakthrough in okay so it's all right it's not very good I think hey Jen which is an avatar generator does a better job than this you could actually clone yourself in that but it did technically sync up the text I put here with the face and change the face right before the face wasn't moving at all I was just kind of sitting here looking down again this is just an alpha right now gen 3 Alpha so the video quality is getting really good it's a hit and miss right now the lip sync is not quite there yet but interesting option that they have they're kind of thinking ahead there and I also want to show you this course that we have it's called making movies with AI and this is basically our most popular creative course course on skill leap and it combines multiple different things it combines the power of creating a shot list with chat GPT creating images with mid Journey then using Runway with gen two to bring it to life but we're going to add some gen 3 in there when it's appropriate even teaches you how to edit all of that together using Da Vinci resolve to actually create commercials or kind of practical movies all using AI we use this to create short films and commercials for example and it's a 22 video course pretty straightforward it's part of our free trial too so if you're not part of skill Lea you could just start a free trial here check out this course and along with mid journey and Dolly these are some of our popular creative courses on skill leap so I'll link that in the description below thanks so much for watching this video and I will see you on the next one