Transcript for:
Self-Hosted Media AI Toolkit Overview

it's time for you to cancel all of your expensive monthly API subscriptions because in this video I'm going to show you how you can set up a private API that is almost entirely free and gives you unlimited use this can save you hundreds or even thousands of dollars in monthly subscriptions you're probably paying for but don't actually need it's like the Swiss Army knife for AI automations i've got an NAND automation I'm going to walk through to demonstrate the features of this free API so you can get an idea of how it works then I'll show you how to install this free toolkit and where to get this NADN template now let me explain this free toolkit in 15 seconds now you see companies like OpenAI who sell chat GPT they write code and they deploy that code on servers and then they allow you to use those servers and running that code doesn't cost very much to them but they sell it back to us at an extreme markup and they make a lot of money and we end up having to pay for it but it turns out a lot of this code is free and we can deploy this code into our own server and we can access our own server at the same cost that it costs them and so in this video I'm going to show you how to access this free code which is right here on GitHub it's called the no code architects toolkit and I'll show you those features by walking you through this NAN automation all right so let's walk through this this isn't actually a real automation all this is is different nodes that are connected up to different features of the toolkit like some of the most common ones you might think of is like how do you transcribe a video so here is an 88N node that will do just that so we're calling a backend API again we've deployed this code in this particular case to digital ocean and it's running here so you don't need to understand all of these little details but we're basically sending this particular endpoint which does video transcriptions or audio transcriptions a remote file we're asking for the transcription we're also asking for the SRT file and if we test this endpoint it's going to take this video here of me on the school games and it's going to bring back that transcript and it's also going to bring back that SRT file that you can use for captions you might also want to caption your videos so this endpoint here will take that same video and it will actually put captions on that video for free we can run that endpoint and you can see it responded back to us with a URL i can take that and I can go ahead and play it and you can see that it is already highlighting the active word and it has added the captions so now I'll just continue to walk through some of these cool features this endpoint here will actually get us a thumbnail from any point in that video we can define what second we want to pull that thumbnail from if you test this endpoint simply going to respond back with an image and here you can see that image in this module here we have a endpoint that will combine two videos together here I've got that same school clip that's going to be combined into one so over here on the original you can see it was 9 seconds and over here it is 19 it just plays the same clip twice in this case in this module here we can actually make cuts into a video so we can take certain segments out of the video that particular API call works really good with this one down here in the media section which will detect silence in a video and this endpoint here we can detect silence that is longer than.1 seconds it returns those specific moments in the video and then you could simply cut those out with this endpoint here you pass in those cuts here this endpoint here will actually cut a single video into multiple parts so we have that school clip in this case you can see that it returned two separate files one for each of the clips that we requested we can also trim video if you want to remove the beginning and the ending from a particular video and there's also a very powerful endpoint that is called ffmpeg compose which uses the ffmpeg tool i really encourage you to check out ffmpeg it's what most of these different endpoints actually use behind the scenes it's the free code that we deployed on our server this particular tool is very flexible and it exposes everything that this tool is able to do like this endpoint here we can actually crop videos from others so here is a YouTube video in typical horizontal format but if we were to run this endpoint we can actually crop out a particular section and then also scale it for a vertical video on platforms like Tik Tok and then we can take a look at the vertical video that it created from the horizontal video we can also add a logo to a video here's that same clip of me on the school games and a link to a logo you can go ahead and run that and there you have the same video but now with my logo on the bottom left you can also create your own tweet pics here I've got a thumbnail that was created from the same school games video clip and a tweet pic i'll show you the template so we have this tweet pic that we generated and now we can overlay it onto this other video thumbnail so there you can see we can overlay images on other images you could also overlay a tweet pick on a video itself just like this where we have the video and now the image overlaid you can even build those reaction style videos where one person is reacting to another video we'll test this out in this case it's taking the video that we're reacting to and then the video where we actually react to it and it's going to assemble a final video that looks similar to the ones you've seen online where one person is sitting here watching this other video and then they respond and then here's that example output i'm actually watching my own video in this case on the school games and then here here's an example of where you can overlay some text on a template certificate so we have this certificate that we use inside of our community the no code architect and when someone finishes a level on one of our courses we give them that certificate and so we can actually process that here and then you can see here we fill in the member information with the instructor and the date we can also add in the logo there's other things you can do as well that are more self-explanatory like you can convert any audio or video into an MP3 we already showed you the transcribe function and the detect silence function for using with the cuts or something else you can also download videos off of platforms like Tik Tok or Instagram here I have my own Tik Tok link here i'm going to go ahead and run the endpoint it's also going to download the thumbnail and what's cool here is you can always look at your server and the logs and you can see what it's doing and how it's responding to all of your requests it gives you a bunch of information about the video including the description the thumbnails it'll actually give you the view count as well and then you can look at the video there it is it's actually one of my YouTube videos that I turned into a Tik Tok and you can notice as well it doesn't have the Tik Tok watermark you can also convert any type of file to another type if you want to convert an MP4 to AOV or some type of audio into any other type of audio it will allow you to do that you can also get the metadata for any video so if I run that on that clip of me at the school games here we can see the bit rate the audio channels the audio sampling rate the duration the file size the format frames per second whether it has audio and video the height obviously the width the resolution everything that you could ever want about any given type of media and you can do the same for audio you can also convert images into video this is cool when you want some slight automation and you want to turn your image into a video and get that slight zoom in effect like Ken Burns here you can see an image that I generated with AI and then I gave it that slight zoom in effect you can also run Python code and you can also upload files to different cloud providers you can also combine audio like we did with video and now that I've shown you a bunch of the different features which are pretty much unlimited with this ffmpeg compose i want to show you how the toolkit actually works so far I've been showing you how to execute the automations in line where when the automation runs it runs and it takes a few seconds to process and then it will respond and then you can use it in the next node there are also two different ways that you can use the toolkit other than the inline method that we just showed you which can sometimes be problematic if the process is going to take much longer because it's a much longer video maybe it's a 45minute video that you're processing it's going to take longer so another way that you can use the toolkit is with web hooks here I've got another N8N automation sitting here waiting and it's simply got a web hook so I can go ahead and test that web hook and come back here and now I've set up this particular node that is combining two pieces of audio when it's done it's going to send that request back to this specific web hook URL which is this web hook here so we'll go ahead and test this step it's going to respond right away in this scenario and just tell us that it's processing it's going to process in the background and then once it's done it will send that request to the web hook for processing and then we can see the result here and we have the concatenated audio file right here so this is great for longer running processes that aren't appropriate to try to process in a shorter time frame where your automation is quickly moving along and finishing so that's if you want to process it as a web hook there's also another way that you can process longunning processes or requests if you want it to take place in a single automation like this in this case here we're captioning a video and it's going to respond right away except in this case we passed an empty string to the web hook URL that allows the toolkit to process in the background and then instead of sending that result to another web hook it's going to respond with its status and then we can continually check to see if the status is done and when it is done we can go ahead and download that file otherwise we can wait a few seconds and then check the job status again and then when it's done we can finally download it so now let's go ahead and test the scenario where it's running in the background and we wait for it to complete here we issued the command for caption notice it responded right away we check the status and now it is in a loop while it is waiting for that job to be done and then when it is done it will go ahead and download the file so again this is good if you have a longer running process where you want to run the entire automation in the same automation instead of using the web hook and there you see it finished we can actually look at the response and the job status is done and then it responded back with our captioned video so there's a ton of different features here as you can see there's a few that I also skipped in the beginning which are there to help you test the toolkit when you install it to test the authentication and also to test file uploads and then there's two endpoints here which allow you to see all of the different jobs that the toolkit is working on if I click this it will show us all of the jobs a lot of these jobs are the ones that we just ran in this demo today and then you can also check the status of individual jobs so if I were to grab this specific job ID here and go into this endpoint here and paste it into the endpoint and run the test here we're going to see the details about that specific job and the response and everything about it so now I'm going to go ahead and show you how to install the toolkit on Digital Ocean the instructions that I'm giving you are the most easy instructions now there are lots of different ways you can actually deploy this especially if you're concerned about costs there are very cheap ways of deploying this right now I'm going to show you the easiest way but if you're looking for a lot more help on this toolkit make sure to jump into the no code architects community it's an engaged group of people and we can answer all of your questions on the NCA toolkit all right so now to install the NCA toolkit I am in the digital ocean platform if you don't already have an account you'll want to sign up once you've created an account you'll want to create a new project i already have one here called APIs i actually already have an NCA toolkit already pre-installed but I'm going to go ahead and install a new one so I'm going to come up here to create and we're going to go ahead and use the app platform and we're going to create an app for deployment source we're going to go ahead and use container image and we are going to use DockerHub for the repository I'm going to jump over into my community and copy and paste this into that box i'll link that in the description below but you could also take a second and copy it from here steven G Pope/nood architect toolkit with dashes not underscores and then for the image tag or digest you'll just type latest and then you can leave the credentials alone then you'll go ahead and click next now because the name is a bit long it's going to automatically show an error here so we have to correct that here we're going to go to edit and we're simply going to remove that extra dash here so now we're good to go we're going to create a web service then we can go ahead and click close and then for the size here I'm going to go ahead and increase this to this $50 a month instance now you don't have to create an instance that is this size but for installation and just getting things going I find it's easier just to pick something that's a little bit larger so you don't run into issues but you can always experiment with picking a smaller instance the size that you pick is going to determine how big of a file you can process and how long it takes and so just for testing it's nice to start off with something that we know that works and it's going to process everything fairly quickly and again this is the monthly price so you can install this today and delete it literally 2 hours from now and not pay this entire amount but it's just a lot easier to get up and running i'm going to go ahead and move the containers to one and then we'll go ahead and close it for deployment settings you can leave those alone for the network you can leave that alone now we do need to add in a few different variables so I'm going to go ahead and click edit make sure that when you add these you do it just as I do and make sure you don't have any spaces before or after the values that you put here and make sure you're using underscores and not dashes that's one of the biggest mistakes I see people make as they're trying to set this up i'm going to go ahead and type API key and for testing I'm going to go ahead and use test 1 2 3 this is something that you'll want to change later we'll go ahead and add another environment variable next we're going to use S3 endpoint URL now in order to get the value for this we do need to come over to the spaces object storage and create a new space i'm going to open up a new window just so I don't have to leave where I'm at now and lose all the work I've put in i'm going to come over to spaces object storage i'm going to create a new bucket you can go ahead and leave New York as the default and then for the bucket name I'm going to put NCA install demo and we'll leave it in the project that we created earlier i'll go ahead and create the spaces bucket now from here I'm going to head over to settings and I'm going to create an access key we're going to create full access you can go ahead and give it a name if you'd like going to call it the NCA install demo-key i'm going to create the access key it's going to create it right here now it's only going to show this to you one time so make sure you don't move away from this before you grab it first things first I'm going to grab the URL right here because that was the first variable that we were setting up going to come back to our setup here for the S3 endpoint URL i'm going to drop that here again just make sure there's no spaces before or after it'll save you a lot of time and trouble add new variable we'll add the next key this will be the S3 access key and then for the value we'll jump back to our new space and we'll grab the access key here paste that into the value here in our server then we're going to add another variable in this case we are going to add S3 secret key we'll come back to our space this time we're going to grab this key here and we'll drop that value right here again just make sure there's no spaces before or after we'll save you a lot of time on both the key and the value then we'll go ahead and add another variable this time for the key we're going to use S3 bucket name we'll come back to our bucket we can copy this into the value again make sure there's no spaces before or after on both sides then we got one more variable to add this is going to be the S3 region and then for this the value will be NYC3 again just make sure there's no spaces before and after once you're done you can come back once you have the region the bucket name the key the access key the endpoint and the API key you can go ahead and click close you can leave this part alone for the region go ahead and pick San Francisco and then you can go ahead and pick a unique name if you'd like otherwise you can use their default and from there you can go ahead and create your new app now this is going to take a few minutes to deploy the first time go ahead and wait every once in a while I have found that I had to refresh the screen to actually see that it was done go ahead and wait till it's done and then we can move on to the next step all right so once you see this you know your app is live couple of things to point out before I show you how to test to make sure it's working you can always look at the overview here it gives you a bit of information about your server you can also check out the insights this is going to show you the CPU and the memory utilization so that you can detect whether or not your server is overloaded or if something is wrong you can also check out the runtime logs you should see something like this at this time when the API calls are coming through you will be able to see them here and you'll be able to monitor how they are operating and then you also have the console here which allows you to actually log into your server and type commands but you probably won't need to use this and then of course you have the settings for this server so now in order to test this what I recommend doing is going to a service called Postman i'm going to open up a new tab here i'm going to go to postman.com you're going to want to sign up for a free account i'm going to go ahead and sign in i'm going to use a Google account and now this is pretty much an empty workspace now in the description below I gave you a link to a Postman URL that will give you access to something that looks much like this and what this is is it's a template to not only help you test to make sure that the toolkit is installed but it's also a set of pre-made APIs that you can test and explore so the toolkit does a lot more than just transcribe videos and create SRT files or create captions it allows you to do a lot with advanced media manipulation concatenating videos clipping cropping creating thumbnails adding logos to videos you can draw text on videos or images you can transform video into audio so make sure you explore all the different features that the toolkit will allow you to do for now we're going to focus in on making sure that the authentication is correct and that this test endpoint is working correctly again there's a link in the description below once you're logged into Postman you can come up to your browser and drop in that link you're going to see that version one and all the different tests along the left hand side here if you come up to the three dots here you will be able to create your own fork go ahead and click on that it's going to ask you to name your fork go ahead and do that and then fork the collection it's going to load up that new collection here you can go ahead and expand this and then go ahead and expand the toolkit these are the two endpoints that we need to test just to make sure everything is working as expected now what we're going to do is we're going to come over here to environments let me expand this a little bit here so we can see everything a little bit better we're going to come up to environment we're going to create environment you can rename it if you'd like right here you can just type digital ocean now we're going to add a couple of variables here one of them is going to be x-appi- key and then for the initial value you're going to want to put in the test one two three which is what we set in our environment variable when we set up the toolkit so here you're going to type test 1 2 3 that's going to copy over to the current value and remember it's x-appi- key not underscores and I'm pointing that out because the next one we're going to add it which is base URL is a little bit different so here we're going to type base URL we're going to jump back to our Digital Ocean server we're going to grab this URL right here copy link address come back to Postman we're going to drop that into the initial value that's going to copy over to the current value and then we're going to make sure to save this because if you don't save it then it won't register so make sure you save it once you save it you should be able to come down to the authenticate and this should now be gray if for some reason it's still red then you can always just cut and paste this URL directly into that test here so you could erase this and just put the URL directly it's a lot nicer to use the environments because under all of these different examples here it will use this environment and it will insert that dynamically same goes for the headers if I come to the header here and we have the X API key here that value is coming through here so that you don't have to cut and paste that into every single one of all of these different examples which would be a pain but you can come into the headers here and just type in the value test 1 2 3 or you could copy that URL directly into this box here so I'm going to go ahead and test this we'll click send as long as you see a success then you are good to go if not then that likely means that either this base URL is wrong or the API key that you set up when you deployed this server is different than what you have set up in this environment variable here but I'm using the same things that I've told you to use test 123 so it should be the same thing as long as you're doing exactly what I'm doing so once you do the authenticate again you click send as long as you see success you're good to go now all you need to do is come down to test again you're going to see this as a gray variable as well as in the headers now we can go ahead and click send and you should see a success it's going to give you a test file here if you go ahead and copy and paste this into your browser it should download it if you open that up here we should see you have successfully installed the NCA toolkit API great job as long as you're seeing that you're good to go and you can move on with the video all right so now that you've seen how easy it is to install the toolkit I also want to show you how easy it is to add more features so again this is an open-source project so this is totally free and it's not just me who is building out this tool there are other contributors that are working on this tool as well you can also come over here and make your own requests for features in the toolkit and there are other people that are also submitting new features all the time here's a cool feature that Harrison is putting together that is going to take screenshots from a website so I just want to make this clear that this is not only a free tool but it is also something that you can make requests to if you want something put into this tool that isn't already there and me or somebody else could actually add that feature in there for you because it's going to benefit everybody now if you want more help on the toolkit make sure to jump into the No Code Architects community we've got a bunch of different courses including how to launch your AI automation business a bunch of automation templates that you can download and install a lot of these use the toolkit you just saw like this video here that helps you generate AI video plus B-roll and music there's faceless video generators in here and we promise to solve 100% of all of our members tech questions plus there's calls with me almost every single day i hope to see you inside the community either way I hope you enjoyed this video and I'll see you on the next