ctrl_shift_face
patreon
Full Metal Jacket: Update
🕑 Added 2019-06-24 14:40:59 +0000 UTCBill Murray is not fully cooperating.
I have some issues with his eyes. I had issues with eyes for a long time now as some of you may have noticed. So im going to train a new model from scratch.
It runs on a different architecture, it will have higher resolution (192 vs 160) and complexity (1024 vs 512). It should retain better likeness too. Im hoping the eye issue will be fixed.
Will see. This is not a straight forward process. Everything is an unknown territory. Stay tuned. Over and out.
#2 UPDATE:
Ok, the new model did not work at all. Thats very disappointing ok. The second architecture is not so sophisticated enough and it has problems with details and light. after training it for 48h, Its just not going to work. i scraped it already.
So back to the old model.
Besides the problem with eye tracking from side profiles, which confuses the AI (target actor has a distinct specular highlight in his eyes that confuses the network), theres a very big difference in expressions between source actor (Bill Murray) and target actor (Drill instructor). For Bill Murray, i used data from 6 movies like ghostbusters, groundhog day etc. but bill has the same expressions in all of those hh. he barely opens his mouth, has these sleepy eyes so the AI has to estimate a lot of these extreme angry, shouting expressions. and thats where there are problems with sharpness, artifacts and overal likeness.
So unfortunately the scene i had in mind probably wont be possible. Next time I'll be releasing the coming soon poster after im 100% sure i can deliver. (with this project i was pretty confident it will work but not 100%. at the end i was wrong)
Ill be going to an animated movie festival so ill let the model work for 3 days non stop and ill see what ill have when i get back. but im not super confident something will change.
There fore my plan is to salvage what i can, Ill try a different scene (jelly donut) and see if i can get something usable from that one.
Ill share the main scene here even if it fails. so youll see what the hell im talking about here.
deepfakes are still a young technology so there is a certain degree of uncertainty. another level of uncertainty adds the copyright claims and youtube blocks. its not easy is what im sayin.
So if some of you patreons expect to everything working flawlessly and a ton of content every week, thats not how its going to work. If you want to stay and support me so i can overcome these obstacles and traps, thank you.
