Furkan Gözükara patreon

Gender Classifier - Low Colors & Multiple Face Remover - Stable Diffusion Training Images Preprocessor

🕑 Added 2023-11-09 22:26:13 +0000 UTC

Comments

Furkan Gözükara

thank you so much

Art

you're great, man...

Furkan Gözükara

fixed the attachment linking issue.

Art

hi... tried to download, but it givrs back error: {"errors":[{"code":902,"code_name":"AttachmentNotFound","detail":"Attachment with id 16536026 was not found.","id":"adc2fd20-2528-5dc3-b3d4-c08ff1d10ebd","status":"404","title":"Attachment was not found."}]}

Furkan Gözükara

it is not breaking the purpose. 0 faces still getting eliminated. what issue are you having right?

Airpilot

How did you solve the initial problem?

Furkan Gözükara

do you get any error while installing? what was your GPU?

mike oxmaul

cublasLt64_12.dll seems to be missing. I'm using CUDA 11.8.

Furkan Gözükara

i think you can use face similarity calculator for that : https://www.patreon.com/posts/sort-ai-images-82478694 https://www.youtube.com/watch?v=343I11mhnXs

mike oxmaul

Have you got a method of finding a specific face inside 100,000 images?

Furkan Gözükara

yes this is what i tell all the time. use python 3.10.x.

mike oxmaul

If you can't install because of Torch issue - ensure your using Python 3.10.11 as specified in path. 3.12 didn't work.

Furkan Gözükara

please ignore warning it should work 100%

Kevin O'Malley

WARNING:tensorflow:From A:\SD\gender_classifier\venv\Lib\site-packages\keras\src\losses.py:2976: The name tf.losses.sparse_softmax_cross_entropy is deprecated. Please use tf.compat.v1.losses.sparse_softmax_cross_entropy instead.

Furkan Gözükara

great. if you find a better library let me know please.

John Webb

it's ok I figured it out. However, I noted that it was not separating the 'no faces' properly. After digging into the code, I think this line face_count = 0 if not faces else len(faces) is the problem. Looking through the code for RetinaFace, it looks like it still returns a tuple when there are no faces, which still has a length. So instead, changing the code to face_count = 0 if not faces or not isinstance(faces, dict) else len(faces) seems to do the trick. This checks if the variable is indeed a dictionary, if it is not, then there were no faces found. I left the check to see if faces exists, though when debugging, it always seemed to have a length. It's entirely possible that this is specific to my machine; I have modified the venv as I'm playing with comparing the image to a reference image to find matches using facenet, though I might switch to another library as facenet is not producing amazing matches.

Furkan Gözükara

this is so weird. you are having problem when using classify_and_process_GPU.bat right? can you dump your venv pip freeze and email me or send me from discord? monstermmorpg@gmail.com

John Webb

Running this using the GPU, it just dumps the majority of the images into the unknown images folder. When I run it using CPU, it sorts them properly, though of course significantly slower - any idea what might be causing this? It's not a major problem of course, I'll just go and make a coffee and sort the laundry while it sorts though the 1500 images at what seems to be 1 per second. On a 4080 with the latest drivers. The sort_sharp script doesn't seem to have the same issue.