we interrupt your browsing to bring your newsflash up till now lazy lip sinkers have been taught to move the mouse based on the volume of the voice but in their hearts they knew that this was not how the mouth moved to form work for they had seen the Google image search for lip sync amongst it this paid from Preston Blair's 1948 book animation introducing rhubarb blitzing by Daniel s wolf a command line program that will listen to your voice and output a series of lipstick timings it was used in the 2017 Games symbol read park by wrong Delbert thimble week the park and rhubarb lip sync relieved I had to find out how okay so first you want to download rhubarb lip sync pimple description and you want to unzip the file and remember where you put it you next want to download the blender add on rhubarb lip sync for blender google description and then you want to boot up blender and install this add-on by going to and use this to find the rhubarb folder you've created earlier and find the rhubarb XC or whatever the equivalent is for your operating system I have now imported a person using this method description and if we select the rig and go to post mode will notice a few things if we go to the make human runtime tab on the left we'll see that there's actually this vism stab right at the bottom which we can press and these look suspiciously like the mouth shapes we were looking at earlier some more than others also if we go to the armature buttons and scroll to the bottom we'll see that root route we see that rhubarb lip sync is basically requesting we put together a pose library before it can do anything ok I'm up for that let's create a pose library yeah so let's do these poses first of all I'm going to swap this for the uv/image editor and I'm going to open up this image which you can download in description and it's basically this is the shape that rhubarb uses so a that's basically a shut shape so if I go to book and now I want to select all the bones all of these things these bits here are the bits that control the face we can select one right click to select as ever and g2 grab around and it controls the movement of it so like these ones and you do also want to include that one that includes that controls the chin and that one that controls the tongue and of somehow missed that one right in the middle here enter and now I've selected those and that mouth is as it is I'm going to create a new pose in the pose library add new yep and call it a so that's a there we're now going to go to number B which is slightly open but you know what I think I might just do it like this maybe not that one yeah and then see select its the one thing you might have noticed about these ones is there a little bit extreme and then you create another one called B it's not really how amber people normally move their mouths quite as extremely as that so we do need to kind of tone them down a little bit as you see the first four are basically just opening the mouth don't worry about that large square being selected as well as matter of course that one's G is actually a sound and then H here is a sound and then X here is a rest position and now we can scroll down here and basically put each of these in its correct slot and then we can load up a sound file if you've ended up with like way too many files here and you can't make them out there this button here will isolate the sound files and if you have the dialogue in a text file it is recommended that you slot this in here as well according to Daniel s wolf the creator of rhubarb lip sync it's always a good idea to specify the dialogue text even if it's not word-for-word accurate the example he gives is the script says that's all gobbledygook to me but the voice actor ends up saying that's just gobbledygook to me but even so it's still worth putting that original script file in the rhubarb or look out for the rather unusual word gobbledygook and find that and enunciate to that now I'm going to drag that up there and I'm going to open a video sequence editor and what I've already done it but start will start on frame 100 and we're going to add a sound file which is obviously the same town father we were using earlier and if we set this to a vsync we will be blender will play with the audio and visual in time with each other we're starting at frame 100 because basically apart from the mouth we're still using the method shown in this tutorial pimples description so the end film of there is baum 188 so I'm gonna go to well I'm gonna go to 1 200 at the end so it's a little bit longer I'm gonna pop that up and do draw away form and gonna select that because this is actually a video editor that black box at the top was to put the video in so we've got the sound file there so we can set this starts on frame 100 so we can set this to frame 100 and we can do press rhubarb lip-sync and basically wait for a few minutes and it will have come up with keyframes okay so all these keyframes have popped up here which is how we know that rhubarb has done its stuff and you can see that the mouth is automatically moving which is very nice now one thing to remember with this is well rhubarb was used on a pixel art game and pixel art kind of works in the same way and sell in the same way as the face will either be one shape or it will be another it's not like a 3d model that walls made out of polygons that move seamlessly between one's face shape and the next and because of this and I'm going to go to the graph editor and press home and I still can't see anything I'm going to press a to unselect all B box select drag the bottom select and press keypad point and there we get this here so now I really are we really going to be able to see what I'm doing I'm gonna drag that there so that this so like right so I'll do it this way we go to interpolation mode constant it'll you see it jumps from one position to the next yeah because that that's that's how it was designed if we've been you know sometimes that actually works really nicely in CG sometimes it works to impersonate stop-motion in CG however not really this time so if we I mean if we go to Bezier like it's sort of now it's going to sort of start each mouth shape a little bit early which you know again not necessarily too bad but we can improve on this if so if I go key to bump up up with our easing type ease in yes or do I have to go oh and then I have to go easing by strength and I go with I don't know cubic and you sort of see you can see how it all neat shape itself starts with the shape and then it pops the next one so that now now that will that should time it quite well another thing we can do and I'm just gonna sort of scroll back to everything being on screen right there are certain mouth shapes that your mouth has to shut for the classics being mmm actually B and P that sound actually comes out the moment you open your mouth after holding it shut but never mind this is a limit to how accurate automated lip-sync is and the true secret is that people don't actually stare at somebody's mouth as they talk they generally do like eye contact or something or maybe like watch their hands as they're gesturing quite a lot that kind of thing so if we were to be box select and select all the frames in all the Shakey's in the middle if they're on 0-0 that's like when the mouth is shut generally and then I've compressed control I to inverse little action and then I'm going to do if I press space here and I go smooth smooth keys and it's alt o so if we smooth those me do that again will now get a slightly more smooth mouth movement so that's the rhubarb method of animating the mouth with a realistic 3d person animating the rest of the person making them blink making their face move and making their body move is just as important as it ever was so you can't ever just skip out on that just because you've got better lip sync and I'm not going to do an entire tutorial an entire 20 minute tutorial on that again so well here's another I'm going to be able to use my new jiggle once more google description for another tutorial on lip sync basically the the method for animating the mouth is different but the rest of it is all the same I'm sure you can kind of work out how to combine the two together [Music] [Music]