Transcript for:
Prais and AI Chat Tool Overview

this is amazing now we have prais and AI chat using this you are able to talk to a large language models using Gro using LM Studio using open AI using olama and much more you can use 100 plus large language models in one interface so once you log into this interface you can set the model name of your choice then ask your question give me a meal plan for me today and it's going to generate response you can run this completely locally on your computer or any server of your preference that's exactly what we're going to see today let's get [Music] started hi everyone I'm really excited to show you about praison AI chat starting this is super easy just type praison AI chat and it will automatically start the server by the end of this video you will know how to set up this interface how you can integrate with Gro how you can integrate with ol and how you can integrate with 100 plus large language models but before that I regularly create videos on C to Artificial Intelligence on my YouTube channel so do subscribe and click the Bell icon to stay tuned make sure you click the like button so this video can be helpful for many others like you so first step pip install pra a chat and then click enter this will install the main package now after this let's start with the basics export your open AI API key like this and then click enter first we are going to see how you can integrate chat GPT with this so after exporting the key just type phasing AI chat and then click enter then you will be presented with a screen like this as a default you username and password type admin and then admin and click continue then you can see the user interface here if you go to the settings by default the model is GPD 3.5 turbo now I'm going to change that to GPD 40 and then confirm now I'm going to ask what is your base model then you can see the response from GPT 40 model now let's integrate this with Gro so coming back to our terminal just stop the previous run by pressing contrl C now after this export your Gro API key like this and then click enter after this same as before type praise and AI chat now coming back to our interface just in the settings panel set Gro Lama 370b 8194 you can get the name of the model from Gro documentation as you can see here I'm using this model and then click confirm now I'm going to ask what is your base model and you can see the performance is super fast next to set up ol just download ol from ama.com then coming back to our terminal AMA pull JMA 2 to download the JMA 2 model and it has been downloaded then going to our interface and in the settings just type /j 2 and then click confirm now just type what is your base model and it's coming from Gemma here you can see I am Gemma and open weights AI assistant similarly you can use hundreds of logge language model because at the back end this uses light llm using the this you are able to integrate with 100 plus large language models and you have all the documentation available here you have multiple providers starting from open AI Azo anthropic mistal Nvidia deep seek replicate and much more and integration is super easy just export the API key as per the documentation and mention the model name as simple as that now you are able to integrate 100 plus large language models from multiple providers in one user interface not only that you can host it yourself internal to your company with your custom model you can host this on your own website you can also run this locally on your computer all the data gets stored in the same directory where you loaded prais chat in threats. DB so if I open threats. DB database you can see the data all the conversation is available here it's very transparent for you to use it you are able to run this as a private Network locally on your computer as a local network within your own company within all the team members and also you can host this publicly on a server I'm really excited about this I'm going to create more videos similar to this so stay tuned I hope you like this video do like share and subscribe and thanks for watching