Patrefans
tblankensmith from patreon
tblankensmith patreon

Easily Train Pose, Image, & Audio Detection AI in TouchDesigner (No Code): Teachable Machine Plugin

🕑 Added 2024-06-17 20:20:13 +0000 UTC
Easily Train Pose, Image, & Audio Detection AI in TouchDesigner (No Code):  Teachable Machine Plugin

Comments

akcaysegul

Hello, can I use an image or a 3D model in stead of my webcam? I want to detect the classifications on an image or a 3D scanned model for example. So I want to create a parameter for image input or 3D model input. I am a beginner btw, thanks for your help.

Jones Corzlus

Hey Man , is it possible to run multiple Instances in one TD Project?

Trishla Yadav

Hey Torin, Wonderful Tutorial! has helped me so much! I was wondering while triggering visuals based on single object detection, is there a possibility for the camera/touchdesigner to detect multiple objects and then trigger visuals bleeding into each other? I am trying out this architectural project and wanna see if its even possible. Thanks much!

Torin Blankensmith

Hey I need to roll out a fix for that. For now, go inside the component, locate the webrender TOP, there's a parameter called Cache. I'd you click the + button select a folder path. Make sure you're online and try downloading your model again. This should allow it to work offline

Edward

Hello , if I try to run the project offline, I get an error saying 'Error loading modelTypeError: Cannot read properties of undefined (reading 'load')'. Can you help me out with this?

Jonathan Masterson

Hello Torin Thanks for this wonderful share, opens a lot of doors. It seems like the Webcam and Microphone dropdowns list your devices, and not mine... would you have a quick workaround? Would you please post a fix? Thank you in advance

Karol Kłaput

Hi Torin, I'm a big fan of your work! When I open a project with a .tox with locally downloaded model as you instructed in the tutorial I get this message: "Error loading modelTypeError: Cannot read properties of undefined (reading 'load')". When I connect to internet everything works fine but it is important to me that the project works without an internet connection. Any ideas how to fix it or the internet connection is a must? I have win 11 and latest touchdesigner version with noncommercial license.

Lior Baum

Hey torin, im trying to use the model but i get this message : teachable machine error loading modeltyperror: failed to excute 'getusermedia on mediadevices: at least one of audio and video must be request. it that or it loading for a lot of time and not loaded. thank for help

Torin Blankensmith

hmm strange. I'll look into the multiple-camera issue

Kiki

I tried the method from Dom by sending multiple OBS virtual cameras to TD and tested it with MediaPipe, and it works! However, when I tried it with the Teachable Machine plugin in TD couldn't read from the OBS virtual camera at all.

Kiki

Hi Torin, thank you for the tutorial. I'm using Windows, and I tried to add a video device in from TOP, however, it seems to cause an error due to having two camera inputs at the same time (one is from Teachable_Machine_0.2.tox). Do you know how this can be fixed? Thank you!

Phil Jungschlaeger

I would like to run multiple teachable machines at the same time. Is it possible? How should I sent image data to the differet machines?

Keli'i Centurion

I tried to drag and drop the switch to place a reference from the null just like you did in the YouTube video but I get a red X with an error reading; argument must be a string or a real number, not 'td.switchTop'

Torin Blankensmith

are you on a windows computer?

Bojan Ma

Hey, thanks for the reply. tried pretty much everything - OBS to SpoutCam etc. Also went into the code but could not find an answer. only my laptop cam works, no NDI, OBS cam, spout cam and even tried Manycam. Any other solution suggestions? Much love

Torin Blankensmith

This project has pre-defined models, but you can bring in external python libraries into TD. It does take some setup though

Torin Blankensmith

Hey you can connect a TOP to the Spout Syphon Out top. On mac if you run OBS there's an option to bring in a Syphon feed and start a virtual webcam which then gets picked up in the plugin. On PC you can use Spout Cam to accomplish the same thing

Samson Wong

Can we also applying a trained model to touchdesigner? for example, Chord Recognition from tensorflow. https://github.com/topics/chord-recognition

Bojan Ma

Hey! First of all thanks for this amazing integration! I´m exploring it´s capabilities to categorize art genres for a uni project. Is it possible to have a Top Input as a image reference instead of the webcam? Best

Soyun Park

Windows 11! Yes, it works with the built-in webcam but my webcam is unfortunately broken. Switching to a different device doesn't work, even with changing only the first device shows :) I used it on Mac with an external camera and it worked great.

Torin Blankensmith

this works on mac and pc

omar karout

Hello, Does this plugin work on mac only?

Torin Blankensmith

What OS, and TD version are you both on? Also have you tested using your computer's built in webcam?

Soyun Park

I have the same issue! :')

Алексей Топалов

Hi, I'm trying to connect a Nexico webcamera to Teachable Machine, but it's not showing up. Only the default laptop webcam is turning on. What needs to be adjusted to make it work? I have windows 10


More Creators