New TouchDesigner MediaPipe Plugin 0.3.1 Release 🎉
🕑 Added 2023-10-31 21:43:37 +0000 UTC
Link to the original video tutorial walking through the component
New features
- Smooth Pose Tracking with MediaPipe update to 0.10.7. no more jittery poses
- Camera flip toggle on MediaPipe component flips the camera + output
- Face mesh example using the source video as texture
- Easily track pinch gestures with the new hand_tracking pinch midpoint, position, rotation and distance
Updates
- Update to MediaPipe 0.10.7 - now with smoother pose tracking!
- Websocket and web server components combined to use a single network port
- Results-processing components (e.g. hand_tracking, face_detector, etc.) are now embedded in main toe file so changes will be saved with the main project - no external tox saves required any more
- MediaPipe tox file is still external as it's so big and will make save files huge if embedded.
Image examples below of the new features + some nightmare fuel for the face mesh example.
Also huge shoutout to Dom Scott for all their help on this project!



Comments
Tyche Tech
Hi Torin. I've been following your creations and posts for a while now and last week subscribed to your top level. I'm working on an exhibition that is pushing my skills to the limit. I think the TD-mediapipe asset is a great tool and may help me solve some of the interactivity I'm wanting to program in TD using several OAK-Ds. I have been looking at maybe integrating TD MediaPipe plugin with OAK-D by saving out some TOXs from the TD OakSample project and import them into MediaPipe might work. But unsure which components would be best to achieve this or if this is a sensible approach. Maybe there's an easier way....any clues...?
Augusta Wicht
I have no idea how to use this to update my plugin?