Dev Preview - Mediapipe and new method of retarget
🕑 Added 2021-07-15 12:14:51 +0000 UTCThis is a preview video of the reviewed code for mediapipe.
In this post you can download a demo file with a model from Vroid and the script
You also have the option to load the py code in your own scene
We provided the mapping to be used with Rokoko Studio and AutoRig Pro
The youtube video explains how to use it.
The easiest way to install the python packages inside blender to be able to use this blend file and run your own pose estimation, is doing this:
go to your blender installation folder, and copy its path
In this example, the path to blender is:
D:\Blender\Blender_exe\blender-2.93.1-windows-x64\2.93
replace the path below with the one in your system:
-- Installing Mediapipe
D:\Blender\Blender_exe\blender-2.93.1-windows-x64\2.93\python\bin\python.exe D:\Blender\Blender_exe\blender-2.93.1-windows-x64\2.93\python\lib\site-packages\pip install mediapipe
-- Installing OpenCV
D:\Blender\Blender_exe\blender-2.93.1-windows-x64\2.93\python\bin\python.exe D:\Blender\Blender_exe\blender-2.93.1-windows-x64\2.93\python\lib\site-packages\pip install opencv-python
Comments
Yes it is possible, and it is the next part to work (as soon as the body is finished, and it almost is) The plan is to have the hands and the face using Mediapipe. After that, the plan is to go back on the deeplabcut method for facial MOCAP
Hi, is it possible to add the mediapipe Hands module to the code, to include hands tracking as well?