Transcript for:
Creating a Custom Meeting Summarizer

All right, welcome to another AI workflow tutorial. I always enjoy doing these as this is as concrete and practical as it gets. Usually on this channel we talk about specific releases and tools that come out, but today we'll be combining a multitude of these tools to achieve something a bit greater. A custom Notebook LM with your very own voice. I mean, sort of. Notebook LM has these podcast conversations. Here it's just one speaker. but it's fully custom. So you can change the prompts in the background. You can change the voices. You can change the style. You can change the workflow. It's set up to automatically fetch the files and create these summaries rather than Notebook LM where you have to work manually with it. So it might not be exactly like Notebook LM, but as close as we could get. And it's fully customizable and almost free depending on which components you pick here, of course. If you want the highest quality, it'll cost a little bit. So essentially what happens here is you go from a meeting summary. to a custom audio file that sounds exactly like you in both tone and style and the voice. Instead of me just explaining this to you, let me show you the resulting audio file, and then let's get into the step-by-step of how to set this up and do it yourself. All right, so this is the resulting audio file. It's a recap of a team meeting that we hold on a weekly basis. Anybody that misses it can listen to this instead of reading the transcript or a lengthy summary. Hey team, welcome back. This is Igor with the recap of the AIA weekly team meeting from October 28th, 2024. Okay, let's get into it. Raluca brought up the need for standardized PowerPoint templates for events with consistent branding. Matthias supported the importance of color consistency, but noted that structures can vary. I confirmed that we have templates on Notion and suggested we collaborate on a new one. Okay, isn't this cool? I just want to note this voice is pulled from my News You Can Use videos. So we extracted all the transcript and customized the style of GPT-4 with a fine tune. We'll talk more about that soon. To sound just like me in the YouTube videos. Hey team, just to summarize topic four of our meeting. Matthias reported... back on the success of our no code ethics talk and replet agents events. So as you can see, this is pretty damn good. And the very last thing before we get into this, I just want to say a big thank you to make for collaborating with us on this project. It's something that we're actually using within the company. And when they reached out to collaborate, we were like, awesome, this is a great opportunity to show in great detail what's possible with their product. All right, with that being said, let's get into this. And we'll begin with a little checklist that I prepared for you on what you will need to make this happen. First up, you will need a Dropbox account. That's how we built this automation. You can certainly customize it to work with Google Drive, OneDrive, or any other file storage system you're using, but we wanted to switch it up. The last Make tutorial on YouTube we did was with Notion. This one is going to happen inside of Dropbox. Next up, you need an account with Make. And here you can sign up for free with the link in the description below to give this a shot. You don't need to... pay to actually try how this automation works and to set it up. If you're going to be using it regularly, you might want to upgrade to the $10 plan as I have done on this account here. Next up, you need the blueprints that we prepared for this video. You can freely download this inside of our public Google Drive folder, also linked below, and simply import this entire automation into Make, making it really simple to get up and running with this. Hey there, Editing Igor here. We tested the results of this video with somebody who had no experience in automation, and it turns out it might be a bit too complex for somebody just getting into it. For that reason, we're actually adding a second file that will make it way simpler for you. So the original workflow is, hey, you need a Google Gemini meeting recording file, export it to Markdown, bring it into the Dropbox, and then have the automation, move it through the workflow, and you get a resulting audio file. But if you don't have a Gemini meeting file, you would need to either custom prompt it in a way for it to change. or you would need to change the format of your document differently. That's a bit cumbersome. And that's why we created the second automation, which includes the custom prompt that changes the formatting for you. So you're not compromising any of the quality because to me, that seems really important that, hey, it starts with a formal intro. It starts with the date. It starts with a structure you want it to have. So it sounds more professional. So you were not compromising all of that, but we gave you a second blueprint that will automatically change any summary you might have. into this exact format that works with the automation. All right, I hope that makes sense. And let's get back into the more advanced tutorial. Just be aware that there's a second file now in the description that is more beginner friendly. I would recommend you start out with that one if you don't have extensive experience with this stuff. All right. And there's two more items on my checklist. One of them is a 11 Labs account with a custom voice created in there. You don't have to create a custom voice. Hey team, welcome back. This is Igor with the recap of the AIA weekly team meeting, but it certainly adds to this project. We'll talk about that in a second. And then lastly, you will need a fine-tuned model inside of OpenAI's platform. In this case, we fine-tuned the GPT-4 model on my own transcripts. Again, more details on that in a second here. Okay, so let's go through this checklist one by one and let's exactly show you what goes into these points and what it costs. So first up, Dropbox, I created a brand new account here, just logged in with my Google email address. And on the onboarding screen, you can skip the paid plan. And if you do that, you get signed up for a free account with two gigabytes of storage that you can now use for this automation. Excellent. That's Dropbox right there. Secondly, same thing for Make. You can just sign up with the link in the description below. for a free account. Once you have your free account, as I mentioned, you will also want to get the blueprints that we prepared for you. Simply go to the link in the description and then download it to your local machine. We'll be using that in a second here. Okay, two more items left on the checklist. One of them is a 11 Labs custom voice. Here you can sign up for free, but this won't allow you to create a custom voice. If you want to do the best version of this and you want your custom voice. I would recommend the creator plan that comes in at $22 a month, although you can do it on a starter plan there. The voice just won't be as high quality, but essentially this allows you to upload a recording of your own voice, how you speak. And then usually within 24 hours, they will come back to you and then they will create the highest quality voice clone that is available on the market right now. I think right now, this is the consensus opinion that 11 Labs is just the best at this. This is a thing that I won't be going through step-by-step here because it's really simple. Once you're on the paid plan, you just head on over to voices, say add new voice. And here under professional voice clone, you can upload a 30 minute audio file or longer of your voice. And then they create it. I'll give you a tip though. One of the best things you can do is take some recording when you weren't purposefully talking just to record. So if you ever were on a podcast episode or inside of a meeting, or you held some sort of lecture, that's a really good voice recording to take. Just make sure nobody else is. speaking in there. You will want to manually edit out all the parts where other people are not speaking. Honestly, you need to do this manually. No automatic software is good enough to really catch everything, and this file needs to be perfect. Then you upload it here, and it creates a replica of your very own voice that you can then use in our make scenario here. Okay, and last on our checklist, and probably most excitingly, you need a fine-tuning. Fine-tuning is something we talked about before on the channel, but it's something that most people overlook. And if you ever wondered how to get the very best custom style out of an LLM like GBT-40, well, this is the way. And no matter how you prompt these models inside of ChatGPT or Fudo API, it doesn't matter what you put in there. It doesn't matter how detailed your instructions are. It doesn't matter how many examples of your writing or speaking you provide. A fine-tune will always be the depth of the style replication that happens here. Now, this is not a video just about fine-tuning, but trust me on this. If you want to replicate your style, fine-tuning is the way. And it is quite simple by now. All you need to do is you need to go to platform.openai.com, log in with your OpenAI account. can be a completely free one and then you will want a few dollars in your account five dollars suffice to fine-tune a gpt 4.0 model on your own writing so just make sure under billing you add some credits here and then you want to head on over to dashboard fine tuning and up here under create all you do is select the base model here and what you want to do is gpt 4.0 not mini not 3.5 4.0 this works the best especially for something a bit more in-depth like the summaries that we're working with here If you're on a budget or just want to play around with this, I would recommend Mini as that is the cheapest. And then once you're here, all you need to do is give it its training data. And this is where really a lot of the magic with fine tuning is hidden. Everything else you can keep as default. But right now, I'll put up a screenshot of the training data that we have used for my very own fine tuning here. This is a bit of an in-depth workflow. And inside of our community, we're even developing an entire course on fine tuning because there is so many options here. But basically what we did here for this case is... We pulled every transcript from the news you can use video that we have done for over a year now on this channel every single Friday. Then we compiled a big table of all those transcripts in different fields and paired them with input values as you can see here. You can totally steal this formatting and adjust this to some of your own recordings. Again, you will need some transcripts of you speaking. So you can run some AI up to transcribe your next meetings and from there you can pull out the way you speak, a transcript of you speaking. or you can put in your own writing too if you have some it's just important that it comes in this format and then what you can do you can upload this excel file to this free tool novelcrafter.com tools fine tunes link in the description below also this is completely free and as you upload this it will turn your excel file with all the examples into this json l format that i showed you which you can then upload into here and as you upload this file and hit create at the bottom it will take a few minutes to train a brand new model like these right here. And then you can link that model inside of the automation to use a custom version of GPT-4.0 together with the custom voice from 11 Labs, pulling files from the Dropbox folder and all of that happening automatically. And that's a checklist. That's all you need to prepare for this. Once you prepared the items on the checklist, we can move on to bringing it all together inside of the make automation. And as we created this blueprint for you, you can simply create a new scenario like so inside of your account. And all you want to do is go to the bottom here, click the three dots and say import blueprint. I'll simply choose a file. And here on my desktop, I have the meaning summary blueprint where I just click open and check this out. If I just hit save, it imports this entire automation for me. And now all the work here that is left is linking your various accounts that we prepared in the checklist step to this automation. And this thing can run in the background indefinitely as long as you have made credits in your account. So let's start with the Dropbox tab as we need to do one more thing for this to work. We need a bit of a file structure here and I'll do this by creating a few folders. The main one will be Igor's custom meeting summarizer and inside of that I will create one that is called to do, one that is called in progress and a third one that is called completed summaries. With this structure literally all that is left now is linking all of it up inside of this automation. So I'll go to my first step say create connection as I haven't linked the Dropbox account here and then as I'm logged into Dropbox in my account already I simply have to allow this and the connection has been set up. Inside of here I just have to navigate to the folder. where the meeting summary files will be placed. Well, and that is the Igor's custom meeting summarizer folder that we just set up. And then inside of that, we want a to-do folder. If I ever place something in a to-do folder, this step that watches files inside of that folder will automatically start this entire automation. Next step, we pick our connection again, continue. And then as you can see, a lot of these other steps will be preset by default. I just click OK here. This is fine. Again, I will not be going into every intricate detail of this automation and how to customize it. I'm just showing you how to set this blueprint and this automation flow up for yourself. Okay, next Dropbox step. Again, add the connection. Allow this. And this we have to do one thing, which is set up the in progress folder as this moves the file from to do to in progress. So I'll go to Igor's custom meeting summarizer. And then here I'll pick the in progress folder. Excellent. This entire next row is something specific to Google Meet summaries with their Gemini AI that we use. So all of these steps pretty much take apart the format. that this meeting file comes in for our automation to work even more reliably. But if you're just coming in with a generic summary, you could just delete this entire row and directly link the Dropbox nodes to this chat GPT nodes down here. I just left this here because this is exactly how we use it and how you get the highest quality results, which is what this is about. If you want to delete a part of this workflow, you can. If you want to change 11 labs to something that's free but lower quality, you can. If you want to change Dropbox to another file system that you might be using, you can. this is how we use it and this is the highest quality that we managed to achieve from it so again this takes apart the summary that comes directly from google's gemini google meet summarizer that you can see on the screen right now it always comes in this predefined format and this basically identifies the pattern and gives us the ability to work with this file in a bit more detail than just throwing a big paragraph at it and then chachapity having to figure out what's going on in there one pro tip would be you could totally prompt your llm or your summarization step before this to export it into exactly the file format of this Google Gemini summary that I will also put into the Google Drive folder. So you can see what that looks like. Now, look, I understand that your summaries might not be coming in this format, but this really works for us. And we found this to be the highest quality workflow. So what I'll also do, I'll give you a prompt inside of the Google Drive folder that you can use to summarize in a way that will produce this exact outcome every time. And those summaries will work extremely well. with this. But again, it's not mandatory. You could just give it a paragraph of text that's a summary. It's just an extra step to make this as high quality as possible, which is the goal of this video. I mean, Notebook LM is so good. That's why people love it. And we did what we could to get as close as possible here. As I mentioned, if you want to simplify things, you can always do that. Okay, so that is this row. And then in the next row, we will be going through the various ChatGPT steps. But for this, we'll have to set up a connection. I'll add a new one here. I'll just call this fine-tune model. And here I will paste the API key that I created here in my open AI platform by saying create new secret key. And then once you create it, you simply copy it over here to API key and say save. And then here what you want to customize is the model name, right? This is my own fine tune and you don't have my API key. So this won't work for you. You need to head on over to the playground and then take the model name up here. By the way, this is a different open AI account. So this won't exactly match up, but you want to. put in that model name into this field. Everything else is set up. The prompt is set up. We connected it via our API key to our own account, but you need to link your custom model that you trained on your own data for this to work. So yeah, I've done that here. I'll click okay. You don't have to do anything in this step. In the next OpenAI step, again, I just want to pick my fine-tuned model connection. Again, make sure the model is correctly filled in here. There's one more thing that you probably should customize in here, which is the prompt here. Here I gave it some context on me. I'm Igor Poganyi, the founder of the AI Advantage community. So you probably want to change this first sentence to fit your own context. So ChatGPT recognizes you from the meeting summaries, right? I run these meetings and that's why I want the summarizer to summarize this as me, Igor. It has my custom 11 labs voice. Now also ChatGPT knows what's up here. Cool. You can skip this tool step in the OpenAI step. Again, we want to pick the fine-tuned model. Make sure that the right model is in here again. And again, this is the same prompt. You might want to change this out to your very own context. Here's just a quick side note on why multiple steps. Well, these different steps process different parts of the meeting summary. And we just like this format of it first saying hello to the team and then stating what the date is. Taking exactly the date that we extracted with this little step. Producing something that's really custom as opposed to just a generic meeting summary. As you heard in the recording in the beginning, it greets the people and it states the date. And then it goes into the points. Just these little touches that go a long way. If you're more advanced, you can go into customizing this, but if you just want to copy what I'm doing here, no need to change anything else in there. We can skip the tool step, and then we're almost done here. On the last row, 11 Labs is quite simple. You just create a connection. I'll just call this My 11 Labs Connection, and then all you want to do here is head on over to the 11 Labs account, go to API keys, say create an API key, demo key one. I'll delete this one after this video, and here you can just copy this to the clipboard, paste it in here. and voila we connected our 11 labs account in which the custom voice that we trained will show up look at that professional igor the ai advantage this is the custom voice and how i named it inside of the 11 labs account when training and again everything else is set up you can see it pulls in the transcription from the last step here already and 11 turbo v2 from our testing is the best voice that you want to use here ha we're so close to being done and this actually working so last thing i need to do is connect these last three dropbox steps so i'll just pick my connection here and then here i just have to pick a folder I'll go to the meeting summarizer folder and I want to navigate to the completed summaries as we're at the end here now. We want to generate this new voice file from 11 Labs inside of completed summaries. That's where the results go. I click okay and then the last two steps will be the same deal. I just pick my connection, navigate to my custom meeting summarizer folder and completed summaries. Hit okay again. This saves the transcript. In case you don't need that, you can delete the step and then again, same thing. I need to pick my folder path, go to Igor's custom meeting summarizer. completed summaries and then this last step moves the initial file that we sent from in progress to complete it and that's it i'm not saying this is super simple but i believe that everybody can do this it's just bringing together a lot of these tools that we talk about here on this channel all right so now what i could do is one of two things i could set this up to run every 15 minutes ah there's a little error here it wants me to save this i apparently didn't click ok here at the bottom so i did that i think we should be okay so now all i have to do is click save here at the bottom Now this scenario, this automation is saved inside of my Make account, and I can set this up to run every 15 minutes, like so. And now every 15 minutes, it will check if there's a new file inside of the folder and run this automation. And as you can see now, all I need to do is drag and drop this meeting summary file that I automatically get from the AI inside of Google Meets into this Dropbox folder, like so. And now inside of the scenario, I just run this once, and we get the custom summary in my tone, style, and my real voice. Well, Eleven loves voice. all generated automatically. Here we go. Hello everyone, TopG here. Welcome to the recap of the AIA weekly team meeting for October 28th, 2024. Let's get started. Here's a quick summary of what happened at last week's event. Matthias shared his positive impressions of the presentation, noting the speaker's good vocabulary. Isn't that amazing? Now you could imagine that there's a lot of customizability here. You could change the voices, you could change the file system, you could change the... prompting. You could do something different than summarizing meetings with this. I mean, really, this is an automated way to turn text documents into audio files that sound just like you. And I think that's the coolest part about this automation. There's a lot of opportunities here. And on the Make platform, it's relatively simple and approachable to customize these things. I'm not saying it takes no effort at all. I'm just saying it's doable and as approachable as it gets. And that's why I like Make. That's why I like teaching with Make. So again, a big thank you to Make for partnering with us on this video. I know this was a bit more advanced than we usually cover here on the channel, but I'm sure a few people are going to get a lot of value out of this. And just to round things out, I would like to say if you have any questions, probably the best place to ask them is the public area of the community. This is completely free. You can ask the questions here. Nevertheless, I would encourage everybody to give this a shot and to try this out. With this video, you have everything you need to put this into practice yourself. All the links are in the description below. And with that being said, I hope you have a wonderful day and I'll see you soon.