- 10 minutes ago
RBA2D3D Easy Blender 3.6.4 Pose The Character For Lip Sync
Lip Sync is tied to the character action
all Lip Sync and poses are stored locally
1: you need Blender 3 or 4 or 5
2: you need a Character
3: you need a sound for the Character mp3 or wav
4: we can do it now
Lip Sync is tied to the character action
all Lip Sync and poses are stored locally
1: you need Blender 3 or 4 or 5
2: you need a Character
3: you need a sound for the Character mp3 or wav
4: we can do it now
Category
🦄
CreativityTranscript
00:01Hello and welcome. Welcome to RBA 2D 3D. Welcome to Blender. Welcome to my character called Emma.
00:09What I'll be doing is showing you how to manually lip sync your character, just in case you're interested.
00:16This will be the first part. The second part will be how to get the whole animation out with the
00:22sound so your character can actually speak.
00:24That way, if you want to make yourself an animated cartoon, an animated movie, then yes, you can do that.
00:32Okay, we're going to keep it on plain and simple. What we're going to do, I'm going to basically, when
00:36you first open Blender, you get this bar.
00:39We're going to add the second bar. The second bar is so we can add the sound, right?
00:45And this first bar is going to allow us to animate the mouth to go with the sound.
00:51Nice and easy, plain and simple. Hopefully you get it.
00:54When I bring my character in, when I first bring her in, because she's a glyph folder, the bones are
01:00slightly big.
01:01So I'm going to fix that, and then we're going to get on with basically doing the voice.
01:05Ready? Here we go.
01:06Okay, you need Blender, any version of Blender.
01:10Okay, I recommend 364, because you just need to work properly.
01:15Go here. I'm going to reset it.
01:19So this is how you start off your Blender.
01:22Right, this is exactly how you start. Hold this, drag this off.
01:27Go over here. Wait till the little mouse changes to the little X in the corner.
01:35Hold it and drag it down. Change this to Video Sequencer.
01:41So, this is where you're going to put your sound. This is where you're going to put your animation.
01:47And the two of them are going to work together, and let your character be able to speak.
01:52To add sound, nice and easy. Press this one. You can add photos, and you can add sound.
01:59Let's add the sound first. Let's go here.
02:02Go pre-download. I don't like to work in downloads. I want to open my file.
02:06I can pick whatever sound I want. I'll go here.
02:11I want to go woo like that. Just a simple woo sound.
02:16That's what I want to do. A bit like a police car. A bit like that.
02:20So, okay. That's the sound.
02:22Now what I want to do is bring in the character. Go here.
02:26Import. And whichever character you've got. If it's a Mixamo character, it's FBX.
02:32I'm going to use these ones. Bring that one in. Makes no difference. Go here.
02:37My emeralds. My character. And bring her in.
02:44I'm going to tell you the first look you're going to get at Emma.
02:46Because if you're following the content, you know what Emma looks like.
02:49Go here. Delete that. See the textures. Go here. And turn them on.
02:54Turn the camera. Bring it down. Look at your character. Zoom in.
02:59Now, like I told you. When you bring your character in. That's it.
03:02It's all set up almost completely. Okay.
03:05It's all set up for the link that's syncing. Right.
03:09Now, to get the animation out. Yeah. That's going to be video number two.
03:12Because we need to change properties over here. Okay.
03:15We're not doing that anyway today. We're not doing that. Okay.
03:18So, first we want to do this file. Okay.
03:21Go here. And save your file. I want to recommend you call it.
03:25I want to call mine E. E30.
03:30Because it's Emma. And this is video number 13.
03:33So, okay. Great.
03:35First, let me just fix my skeleton.
03:37Because, not I told you. When I bring my skeleton in.
03:40Yeah. Blender wants to mess around with my bones.
03:43I don't know why you don't leave the bones where they are.
03:46As I said. Just go here. Go to edit mode. Press this.
03:50Into transparency. And what you want to do is select both my bones.
03:54I want to go to scale. I want to zoom out a fraction.
03:57And I want to zoom in. And I want to zoom in.
04:00And I want to zoom in. And I want to go here. Back over to the left side.
04:04And I want to move this out of the way. And put it up here somewhere.
04:08Just so it's not on the face. Right.
04:10So I want to take into bones. Because there are 2 bones here as well.
04:14So here. I want to scale them. Make sure.
04:18Then we just undo that.
04:20I'll do that.
04:22Make sure when you do this select the bone itself.
04:25And scale the bone.
04:28If you don't do it in edit mode, it's going to pull the character's face.
04:33So you have to reload the character.
04:35Put that there.
04:37Now this bloke here is the hoise.
04:41I don't avoid down there.
04:42I really don't.
04:43I can go here and scale it.
04:46I accidentally stop it.
04:49I want to go back to undo.
04:51I'm not going to undo it.
04:52I just want to select it.
04:56I'm going to move this up here somewhere.
04:58I don't want to put it over here somewhere.
05:00Just so it's actually out of my way.
05:03I can do the same with this bone.
05:04I can click on this bone if I want to.
05:06So click that.
05:08As I said, there's no reason for the bone to be that big.
05:12As I said, click that one and click this one if you want to.
05:15Just make sure everything is actually where it's supposed to be.
05:19Just scale it down and then you grab this and you just put it over here somewhere.
05:24Just to go and get everything nice, neat and tidy.
05:27Like these bones.
05:29You see the size of them?
05:29You don't need them like that.
05:31Just scale them down.
05:33And then just put them where you want them.
05:35It doesn't matter where you put them.
05:36Later on, when you save it out.
05:39Then don't put them back like that.
05:41Yeah.
05:44Yeah.
05:45It's honestly really setting the bones.
05:47Sometimes it's actually pointless.
05:48Okay.
05:49So you set your bones.
05:50Okay.
05:51The first thing to do is what I'm going to tell you to do.
05:53Leave your entire character where she is.
05:55Right?
05:57Now, I'm going to basically click the face.
06:00This is the face bones.
06:02Right?
06:02This is how you separate your skeleton from the body to the face.
06:06This is the face animation.
06:08Right?
06:09And I do mine slightly different.
06:12I really do.
06:12But for the video, I'm going to do it this way.
06:15Because everybody does it this way.
06:17Okay.
06:17Go here.
06:18Once you set the face.
06:19Select all the bones.
06:21Don't do it in any mode.
06:22Come out of any mode.
06:23Press the kilns.
06:25Click off it.
06:26Paste your skeleton.
06:28Select all the bones.
06:30Now, you can press on the automatic mode.
06:33If you want to.
06:34Now, as soon as I do something, it will do a keyframe.
06:37I want to turn that off.
06:39I don't use it.
06:40If anyone else uses it, I don't use it.
06:42I like to do it this way.
06:44I like to do it manual.
06:45I like to select the bones.
06:47Right click.
06:48Insert keyframe.
06:49And save.
06:51See the keyframe?
06:52That's it.
06:53Go here.
06:54Skip it.
06:56Okay.
06:56Your character, believe it or not, is now ready to set up full air lifting in.
07:02What?
07:02No way.
07:03It's that easy.
07:04It's almost that easy.
07:05Here we go.
07:07If we go back into object mode, we can turn the transparency off.
07:11Okay.
07:11You notice you're in transparency.
07:12I look for transparency.
07:14And that's how I want to do it.
07:16Okay.
07:16What you want to do is work out the sound for your character.
07:20Go to the sound.
07:21Right click on it.
07:22I only tell you to do it.
07:23You don't have to do this.
07:24I tell you to do this.
07:26Okay.
07:26Click on the sound folder.
07:28Right click.
07:29And go and shrink it to that.
07:32It will turn red.
07:33So you go in here.
07:35And all you're doing is pressing that.
07:37Okay.
07:37That's it.
07:38You don't want nothing else.
07:39Just press that.
07:40Shrink it.
07:41Okay.
07:41You can zoom into that if you want to.
07:42And pull it across.
07:44And you can zoom into it.
07:46And you can pull it across.
07:48Just so you can see what's going on.
07:49If you keep doing it.
07:50Keep doing it.
07:51You can zoom right into that.
07:52Yeah.
07:53This one here.
07:54I want to work on this one.
07:55So zoom into that one.
07:57Put it across.
07:59Bring it across.
08:01Yeah.
08:01I like to zoom in a bit more.
08:02To my own personal preference.
08:04You know.
08:05Of course.
08:05You don't have to do this.
08:06And of course you want to zoom that one.
08:07Then you'll zoom that one to basically.
08:09About the same size.
08:11As that one.
08:12If you.
08:12It makes no difference.
08:14Okay.
08:15So you can see.
08:17Let's play.
08:17Go.
08:18Go.
08:20Go.
08:21Go.
08:23Okay.
08:24Now.
08:24She only goes.
08:25Woo.
08:26That's all she does.
08:27So.
08:27It's only two letters.
08:29Well.
08:29It's three letters.
08:31It's not really three letters.
08:32It's W.
08:33O.
08:34That's what she does.
08:35Okay.
08:36So you go here.
08:37You need to look at where she goes.
08:39Go.
08:40Go.
08:41Go.
08:42Go.
08:42Go.
08:42Go.
08:42Go.
08:43Go.
08:47Go.
08:48Go to the associated with the your character to the side.
08:49Now.
08:49This is where I'll tell you about the bones.
08:51Okay.
08:52I'll let you press this.
08:54I'm going to select this part of the face.
08:56Don't select any on this phone.
08:57When you press this.
08:59Make sure you're in the skeleton mode.
09:01Presqueleton.
09:02Look here.
09:03Skeleton.
09:04Select this.
09:07And of course you want to set that W sound.
09:10What you select them?
09:12Go to move.
09:13Go.
09:15The.
09:17Right, and of course, however you pronounce the W sound, because everybody pronounces it
09:23differently.
09:23Okay, I need to combine a transparency, press this, press on this one, and what I want to
09:33do when I pronounce the W sound, I'm going to grab this one here, I'm going to grab this
09:38on the bone, make sure it's in Skeleton mode, press the bone, and I want to close my mouth
09:44a little bit, I want to close her mouth a little bit, and that's what she's doing, once I'm
09:52happy with the bones, I'll just go back into here, I select and close bones, I right click
09:57and go insert visual condition, now this gives me my W sound, like this, you see her mouth,
10:06you see I've got a little smile going on, watch, okay, as I said, it's up to you how you
10:13want to do it, as I said, if you look at Emma's face, she looks like she's kind of a
10:18little
10:18bit sad, she's not sad, it's just how I've actually animated her girl, at the moment, so
10:25of course I can go back to standard, if I want to tweak her face a little bit, I can
10:29press
10:29the bone, and I can make her smile a little bit, so I can insert that keyframe, I can press
10:35this one, and I can bring it up, so now Emma's actually smiling, so this is how she looks,
10:42if I turn the keyframe off, I don't need to go through the whole thing, because this is
10:47how you do it, right, so look, she goes happy to sad, of course, she's not doing that, she's
10:53going woo, that's what she's doing, right, of course, when she goes woo, like that, it's
11:00right there somewhere, of course, I'll go back to my character, and I don't want her face
11:05down there, so I'm going to pull this back up, this is how I'm doing, and of course, I'm
11:13going to turn it around to the side, except this, put it back down a little bit, I'm going
11:18to insert that, I'm going to turn it back around, just so I can kind of see the position of
11:24her
11:24mouth, of course, you want to sort the smile out, the smile's not actually there, there
11:32for you, so I want to get the smile, as I said, I don't want to look like she's sad,
11:40so I'm
11:40going to insert that, I'll click that button, I'll insert it like that, as I said, depending
11:45on which button that you click on, if you only want an animation on a certain button, you can
11:50click the button, right click on here, and you can delete the animation of that button, right,
11:57so let's go back a little bit, so it's still a little bit sad over this part, okay, so I'm
12:05going to pull this back a little bit, right click, insert that, I'll say, if your face is
12:11not basically in the right position to start with, when you try and pronounce the word, you're
12:17not going to look really too happy when she says it, so you're going to go, woo, like
12:21that, woo, okay, that's it, so now, of course, if I play that for the sound, it's okay, but
12:30a little bit slow, okay, kind of great, that's it, I can select the whole face bones, see where
12:35my animations are, I can select all the bones like that, and show me where the animations are,
12:39just this, and drag the animation back, not back, still a bit slow, just these two, drag it
12:50back a bit more, go back, still a bit slow, drag these two, move these closer, go back, and
13:04a little bit, a little bit on the slow side, a little bit more, that should be perfect,
13:10okay, yeah, that'll kind of work, as I say, it's all about just tweaking the face, that's
13:16it, so all you do basically, you play the sound, right, that's it, the ooh is actually here,
13:24that's the ooh sound, ooh, okay, so almost you'll add the other two letters here, so this would
13:30be the do you, and then you've got ooh, and then you've got ooh, right, so as I say, I
13:37don't
13:37need to do it, because you know how to pronounce your mouth, you know how to, what shape it is,
13:42so all you do basically is look on your character, and however you want the ooh sound, okay, then
13:50what you do is go to the side, you grab the parts of the lip, right, that makes the character
13:57move, so we can pull it forward, if you want to, let me hold it to that one, because that
14:03was actually wrong, er, when you click the model, make sure it's on skeleton mode, which
14:08it is, I want to go into wav, er, not wav, right, go into this mode, select this, and I'm
14:19going to pull it forward a little bit, look at my character's face, and here, okay, that's
14:25going to be my woo sound, and of course, when you do the woo sound, your mouth's not open
14:32like that, okay, so I'm going to select all that, I'm going to go here, I'm going to go
14:41there, yeah, okay, as I say, all you have to do is just tweak, tweak the face, that's
14:47it, it's easy, it's simple, it really is, that's it, you don't have to go on the internet,
14:53you don't have to paint some AI program, er, credit, for duty for you, and you can do it
14:58with your blender, and you can see her, look, you see her lips, she goes woo, like that, that's
15:03what she does, that's it, see, watch your mouth, okay, so that's her expression, when she's
15:15doing the word, of course, when she's going like woo, like that, you want to move the nose,
15:20maybe a little bit, maybe the ears, maybe the ois, I want to go a little bit, as I said,
15:28it's your own personal preference, and that's the end of the video, so in part number two,
15:32I want to show you, you might say, well, it can't be that easy, yeah, honestly, it's
15:37that easy, er, all you have to do, to change the sound, is go here, load your new audio,
15:45pick a different sound, and put a different sound in there, er, if you're going to do that,
15:50click on the audio, click the audio, like click, and just go here, and delete the sound,
15:56don't delete it, because obviously that's the sound, that's the sound your character's
16:02going to make, right, so of course, once you're happy with the actual render, the scene, and
16:08of course, in part two, I will show you how to get the actual animation out, for this part
16:13of the scene, and of course, if you've got a longer scene, let's say you've got loads of
16:18things going on, yeah, because later on you're going to do that, you're going to have birds,
16:23and trees, and cars, and tanks, and guns, and everything else going on, yeah, that's going
16:28to take you a long time to set that up, yeah, and I'll say, especially if you do it manually,
16:33but of course, this is how you do it for free, inside Blender, 364, see you in part two,
16:41for the retina part, and the sound, see you later, bye.