This tutorial explains how to grab MotionCaptures from your Webcam or any video file, using the free BlendARMocap addon for Blender by cgtinker with Google Mediapipe, and turn them into 3Danimated Controlnets, using the OpenPoseBone tool by toyxyz. No further equipment needed.

In the second part of the tutorial, we will go through the process of creating images and animations with these Controlnets, using the FaceID PlusV2 IPadapter for consistent faces, the Openpose Controlnet nodes, AnimateDiff and some some other nodes to enhance and stabilize the images and animations. You can download the ComfyUI workflows here:

ComfyUI Image workflow:
https://drive.google.com/file/d/1hMvW...

ComfyUI Video workflow:
https://drive.google.com/file/d/1_0ae...


00:00 Intro
00:50 OpenPose Tool
02:24 Install BlendAR Mocap addon
04:13 Creating Motion Captures with your Webcam or from a Video
06:44 Create a Rigify Rig and transfer the Motion Capture to the rig
08:57 Map the animated rig to the Controlnet meshes
10:26 Adjust the Camera settings and render the Controlnets
12:03 Loading the ComfyUI workflows, dealing with workflow issues
13:33 Image Workflow explained
14:31 Animation Workflow explained
15:55 Outro

ComfyUI Image workflow:
https://drive.google.com/file/d/1hMvW...
ComfyUI Video workflow:
https://drive.google.com/file/d/1_0ae...


Download the BlendARMocap addon for Blender here:
https://github.com/cgtinker/BlendArMocap

Download the OpenPoseBone tool here:
https://toyxyz.gumroad.com/l/ciojz?la...

Link to my previous tutorial on the OpenPoseBone tool:
   • Turn MoCaps into 3DControlnets into ...  

Get Blender here:
https://www.blender.org/download/
Get ComfyUI here:
https://github.com/comfyanonymous/Com...
Get ComfyUI Manager here:
https://github.com/ltdrdata/ComfyUIM...

ComfyUI Basics Tutorial:
   • ComfyUI Starter Guide: How and Why to...  

Type this for starting Blender as an Administrator on a Mac:
sudo open /Applications/Blender.app/Contents/MacOS/Blender


ComfyUI IPAdapter Plus Info (for FaceID):
https://github.com/cubiq/ComfyUI_IPAd...

Download models for ComfyUI here (just search in “Filter by name”:
https://huggingface.co/models
Or try it here:
https://civitai.com/

Further infos:
Link to Google MediaPipe:
https://developers.google.com/mediapipe
FreeMocap Tool (not covered in this video, but still very useful):
https://github.com/freemocap/freemocap

#comfyui #mocapanimations #mocap #mediapipe #stablediffusion #controlnet #animatediff #blender