1-Click Installers and Upgraded APP for LivePortrait - Blazing Fast Static Image or Video to Video to Talking and Moving Animation
🕑 Added 2022-10-27 16:00:00 +0000 UTCNew post is here use this one : https://www.patreon.com/posts/119254105
Use new post : https://www.patreon.com/posts/119254105
This post no longer maintained
Use new one : https://www.patreon.com/posts/119254105
Patreon exclusive posts index to find our scripts easily, Patreon scripts updates history to see which updates arrived to which scripts and amazing Patreon special generative scripts list that you can use in any of your task.
Join discord to get help, chat, discuss and also tell me your discord username to get your special rank : SECourses Discord
Please also Star, Watch and Fork our Stable Diffusion & Generative AI GitHub repository and join our Reddit subreddit and follow me on LinkedIn (my real profile)
=======
LivePortrait: Efficient Portrait Animation with Stitching and Retargeting Control
This is the newest open source project even better than the paid apps. Its speed is mind blowing. Like you can generate 20 seconds animation in lesser than 50 seconds with RTX 3090.
This is the official repository ( https://github.com/KwaiVGI/LivePortrait )
27 October 2024
Updated to V11 installer : LP_V12.zip
Upgraded to Torch 2.5 and xFormers 0.0.28.post2 and Triton 3.1 and ONNX GPU 1.19.0 both for Windows and Linux
New Windows requirements are CUDA 12.4, cuDNN 8.9.7, C++ Tools, Git, FFMPEG
Full tutorial for this : https://youtu.be/DrhUHnYfwC0
Tested on Windows, RunPod and Massed Compute
For RunPod new mandatory template is :
RunPod Pytorch 2.2.0
runpod/pytorch:2.2.0-py3.10-cuda12.1.1-devel-ubuntu22.04
If you get cuDNN related error, try different onnx-gpu version like
pip install onnxruntime-gpu==1.17.1 or pip install onnxruntime-gpu==1.19.2 and such
This error happens due to cuDNN version mismatch
You have to use a short installation path like C:\LP_V11
Otherwise you will get very long path error
8 August 2024
Animals Live animation added
22 July 2024
Updated to V4
Source maximum dimension option added
So let's say you can modify 1920x1080p video and get same output resolution
If you have installed V3 just run Windows_Update_Version.bat file. Zip file still same
21 July 2024
Please make a fresh install since we changed the GitHub repository
A lot of bugs fixed
Video to video option added
Working amazing just try it
For video to video, don't forget to pick video 🎞️ Source Video in the step 1 when uploading source
10 July 2024 Update
Full Windows tutorial with manually written captions / subtitles and video chapters published
Full Cloud (Mac users follow this) Tutorial for Massed Compute, RunPod & Kaggle with manually written captions / subtitles and video chapters published
If you also upvote this Reddit Post I appreciate that very much
8 July 2024 Update
Amazing 59 demo_portrait_images.zip added to the post that you can test and use
I have recorded myself as a text experimental driving video that you can use :
You can download 59 demo portrait fully rendered (animated) videos by clicking here (3.74 GB)
Our New Features
Fixed FPS issue
Audio is automatically saved in output videos
Output video naming improved and overwriting previous files issue fixed
Open folders tab added (works on Windows and desktop Linux systems)
New feature Target Eye Lip Open Ratio added
When this is enabled, you can change the opening rate of mouth and the eyelid. However when this is enabled, the movement of the head is currently lost and not maintained.
1-Click to install on Windows, RunPod, Massed Compute and Kaggle.
How to Use
Extract attached zip file and install and use on your desired platform.
The generated animations will be automatically saved inside animations folder.
Requirements for Windows
Works with as low as 4 GB VRAM GPUs
New Windows requirements are CUDA 12.4, cuDNN 8.9.7, C++ Tools, Git, FFMPEG
Full tutorial for this : https://youtu.be/DrhUHnYfwC0
Windows full tutorial : https://youtu.be/FPtpNrmuwXk
Cloud Requirements
Full Cloud (Mac users follow this) tutorial for Massed Compute, RunPod and Kaggle : https://youtu.be/wG7oPp01COg
Windows tutorial : https://youtu.be/FPtpNrmuwXk
For RunPod and Massed Compute follow instructions inside the zip file.
You will see Massed_Compute_Instructions_READ.txt and Runpod_Instructions_READ.txt files.
For Kaggle follow instructions on the Kaggle notebook.
To be able to use Kaggle notebook get a free account and verify your phone number.
Zip file also has demo material so you can quickly test.
Upload / download big files / models on cloud via Hugging Face tutorial : https://youtu.be/X5WVZ0NMaTg
How to use permanent storage system of RunPod (storage network volume) : https://youtu.be/8Qf4x3-DFf4
Massive RunPod tutorial (shows runpodctl) : https://youtu.be/QN1vdGhjcRc
Usage Tips
If you feel the animated video has some jitter, please adjust the driving_smooth_observation_variance parameter in src/config/argument_config.py. We recommend that you change it by a factor of 10. For example, if the current value is 3e-7 and you feel the animated result is a bit jittery, you can adjust it to 3e-6, and so on. If you are using app.py, the corresponding adjustment location is motion smooth strength (v2v).
What does cropping do : https://github.com/KwaiVGI/LivePortrait/issues/187#issuecomment-2242107784
In the driving video first frame must have mouth closed - not open, not smiling, not showing teeths etc
Comments
Furkan Gözükara
awesome thanks a lot for comment
reaper557
Very cool! I finally tried your app after following along with your 'install ai tools' video and it works like a charm.
Furkan Gözükara
wow nice
Arkadiusz D
I just replaced all files from capi folder from FaceFusion_6 capi folder and works now.
Furkan Gözükara
you have install error. very likely you are missing accurate c++ tools D:\Live_Portrait_V6\LivePortrait\venv\lib\site-packages\torch\utils\cpp_extension.py:380: UserWarning: Error checking compiler version for cl: [WinError 2] The system cannot find the file specified warnings.warn(f'Error checking compiler version for {compiler}: {error}') building 'MultiScaleDeformableAttention' extension creating D:\Live_Portrait_V6\LivePortrait\src\utils\dependencies\XPose\models\UniPose\ops\build\temp.win-amd64-cpython-310
Arkadiusz D
I deleted everything and, following the step-by-step instructions from your articles, I reinstalled from scratch. Still the same error persists. Everything is identical, and the paths in PATH are correct. I'm giving up; it doesn't make sense. I found another version of the same program, LivePortrait6, and it works without any issues, so I have no idea what's wrong with this one. Install log: https://justpaste.it/fj7il Startup log: https://justpaste.it/gjx3k ENV scr: https://i.ibb.co/KK0CYRc/Screenshot-2024-10-12-144512.png I give up!
Furkan Gözükara
it works - if you cant solve i connect pc of Gold members and help them here full install logs (compare this with yours) : https://justpaste.it/bu5z2 here animal portrait run logs : https://justpaste.it/h0ufk
Arkadiusz D
And?
Furkan Gözükara
i am making a fresh install now to verify
Arkadiusz D
I did full reinstall after cuda installed. https://i.ibb.co/3kfygcX/Screenshot-2024-10-11-145031.png https://i.ibb.co/5sD8w0Y/Screenshot-2024-10-11-145058.png https://i.ibb.co/NYkqDNS/Screenshot-2024-10-11-150031.png Please select an option: 1. Human Live Portrait 2. Animal Live Portrait Enter your choice (1 or 2): 1 Starting Human Live Portrait... [15:01:01] Load appearance_feature_extractor from live_portrait_wrapper.py:46 D:\AI\Live_Portrait_V6\LivePortrait\pretrained_weights\liveportrait\base_models\a ppearance_feature_extractor.pth done. [15:01:03] Load motion_extractor from live_portrait_wrapper.py:49 D:\AI\Live_Portrait_V6\LivePortrait\pretrained_weights\liveportrait\base_models\m otion_extractor.pth done. [15:01:04] Load warping_module from live_portrait_wrapper.py:52 D:\AI\Live_Portrait_V6\LivePortrait\pretrained_weights\liveportrait\base_models\w arping_module.pth done. [15:01:06] Load spade_generator from live_portrait_wrapper.py:55 D:\AI\Live_Portrait_V6\LivePortrait\pretrained_weights\liveportrait\base_models\s pade_generator.pth done. Load stitching_retargeting_module from live_portrait_wrapper.py:59 D:\AI\Live_Portrait_V6\LivePortrait\pretrained_weights\liveportrait\retargeting_m odels\stitching_retargeting_module.pth done. 2024-10-11 15:01:06.2238791 [E:onnxruntime:Default, provider_bridge_ort.cc:1744 onnxruntime::TryGetProviderInfo_CUDA] C:\a\_work\1\s\onnxruntime\core\session\provider_bridge_ort.cc:1426 onnxruntime::ProviderLibrary::Get [ONNXRuntimeError] : 1 : FAIL : LoadLibrary failed with error 126 "" when trying to load "D:\AI\Live_Portrait_V6\LivePortrait\venv\lib\site-packages\onnxruntime\capi\onnxruntime_providers_cuda.dll" *************** EP Error *************** EP Error C:\a\_work\1\s\onnxruntime\python\onnxruntime_pybind_state.cc:866 onnxruntime::python::CreateExecutionProviderInstance CUDA_PATH is set but CUDA wasnt able to be loaded. Please install the correct version of CUDA andcuDNN as mentioned in the GPU requirements page (https://onnxruntime.ai/docs/execution-providers/CUDA-ExecutionProvider.html#requirements), make sure they're in the PATH, and that your GPU is supported. when using ['CUDAExecutionProvider'] Falling back to ['CUDAExecutionProvider', 'CPUExecutionProvider'] and retrying. **************************************** 2024-10-11 15:01:06.2806308 [E:onnxruntime:Default, provider_bridge_ort.cc:1744 onnxruntime::TryGetProviderInfo_CUDA] C:\a\_work\1\s\onnxruntime\core\session\provider_bridge_ort.cc:1426 onnxruntime::ProviderLibrary::Get [ONNXRuntimeError] : 1 : FAIL : LoadLibrary failed with error 126 "" when trying to load "D:\AI\Live_Portrait_V6\LivePortrait\venv\lib\site-packages\onnxruntime\capi\onnxruntime_providers_cuda.dll" Traceback (most recent call last): File "D:\AI\Live_Portrait_V6\LivePortrait\venv\lib\site-packages\onnxruntime\capi\onnxruntime_inference_collection.py", line 419, in __init__ self._create_inference_session(providers, provider_options, disabled_optimizers) File "D:\AI\Live_Portrait_V6\LivePortrait\venv\lib\site-packages\onnxruntime\capi\onnxruntime_inference_collection.py", line 483, in _create_inference_session sess.initialize_session(providers, provider_options, disabled_optimizers) RuntimeError: C:\a\_work\1\s\onnxruntime\python\onnxruntime_pybind_state.cc:866 onnxruntime::python::CreateExecutionProviderInstance CUDA_PATH is set but CUDA wasnt able to be loaded. Please install the correct version of CUDA andcuDNN as mentioned in the GPU requirements page (https://onnxruntime.ai/docs/execution-providers/CUDA-ExecutionProvider.html#requirements), make sure they're in the PATH, and that your GPU is supported. The above exception was the direct cause of the following exception: Traceback (most recent call last): File "D:\AI\Live_Portrait_V6\LivePortrait\app.py", line 64, in gradio_pipeline = GradioPipeline( File "D:\AI\Live_Portrait_V6\LivePortrait\src\gradio_pipeline.py", line 42, in __init__ super().__init__(inference_cfg, crop_cfg) File "D:\AI\Live_Portrait_V6\LivePortrait\src\live_portrait_pipeline.py", line 53, in __init__ self.cropper: Cropper = Cropper(crop_cfg=crop_cfg) File "D:\AI\Live_Portrait_V6\LivePortrait\src\utils\cropper.py", line 63, in __init__ self.face_analysis_wrapper = FaceAnalysisDIY( File "D:\AI\Live_Portrait_V6\LivePortrait\src\utils\face_analysis_diy.py", line 37, in __init__ super().__init__(name=name, root=root, allowed_modules=allowed_modules, **kwargs) File "D:\AI\Live_Portrait_V6\LivePortrait\src\utils\dependencies\insightface\app\face_analysis.py", line 33, in __init__ model = model_zoo.get_model(onnx_file, **kwargs) File "D:\AI\Live_Portrait_V6\LivePortrait\src\utils\dependencies\insightface\model_zoo\model_zoo.py", line 96, in get_model model = router.get_model(providers=providers, provider_options=provider_options) File "D:\AI\Live_Portrait_V6\LivePortrait\src\utils\dependencies\insightface\model_zoo\model_zoo.py", line 40, in get_model session = PickableInferenceSession(self.onnx_file, **kwargs) File "D:\AI\Live_Portrait_V6\LivePortrait\src\utils\dependencies\insightface\model_zoo\model_zoo.py", line 25, in __init__ super().__init__(model_path, **kwargs) File "D:\AI\Live_Portrait_V6\LivePortrait\venv\lib\site-packages\onnxruntime\capi\onnxruntime_inference_collection.py", line 432, in __init__ raise fallback_error from e File "D:\AI\Live_Portrait_V6\LivePortrait\venv\lib\site-packages\onnxruntime\capi\onnxruntime_inference_collection.py", line 427, in __init__ self._create_inference_session(self._fallback_providers, None) File "D:\AI\Live_Portrait_V6\LivePortrait\venv\lib\site-packages\onnxruntime\capi\onnxruntime_inference_collection.py", line 483, in _create_inference_session sess.initialize_session(providers, provider_options, disabled_optimizers) RuntimeError: C:\a\_work\1\s\onnxruntime\python\onnxruntime_pybind_state.cc:866 onnxruntime::python::CreateExecutionProviderInstance CUDA_PATH is set but CUDA wasnt able to be loaded. Please install the correct version of CUDA andcuDNN as mentioned in the GPU requirements page (https://onnxruntime.ai/docs/execution-providers/CUDA-ExecutionProvider.html#requirements), make sure they're in the PATH, and that your GPU is supported. Press any key to continue . . .
Furkan Gözükara
txt file deleted cant see. also did you make cuda 12.4 default in all fields? and did you reinstall after cuda 12.4 update?
Arkadiusz D
Still same :-( screenshot https://i.ibb.co/h2XXgFd/Screenshot-2024-10-11-093439.png error TXT file: https://file.io/nlW4wZFbavUE
Furkan Gözükara
your cuda is 12.6 not 12.4
Arkadiusz D
Thank you very much for your response. Unfortunately, the same error still occurs. I would like to add that FaceFusion_6 works without any issues, as do Rope_Live_Stream_V11, Kohya, and SwarmUI. Only this Live Portrait won't start due to this CUDA issue. https://i.ibb.co/W3PMPJc/Screenshot-2024-10-11-090108.png https://i.ibb.co/myDwsWN/Screenshot-2024-10-11-090143.png https://i.ibb.co/wdhqpTF/Screenshot-2024-10-11-090314.png
Furkan Gözükara
yes click edit path and make cudnn 8.9.7 top, also make cuda 12.4 top as shown in video
Arkadiusz D
Receiving this error. I know its Cuda problem, so i downloaded 8.9.7, but i have problem adding to environment as you did on video. My envir look different. https://i.ibb.co/JQ3NBcb/1.jpg Please select an option: 1. Human Live Portrait 2. Animal Live Portrait Enter your choice (1 or 2): 1 Starting Human Live Portrait... [18:15:17] Load appearance_feature_extractor from live_portrait_wrapper.py:46 D:\AI\Live_Portrait_V6\LivePortrait\pretrained_weights\liveportrait\base_models\a ppearance_feature_extractor.pth done. [18:15:18] Load motion_extractor from live_portrait_wrapper.py:49 D:\AI\Live_Portrait_V6\LivePortrait\pretrained_weights\liveportrait\base_models\m otion_extractor.pth done. [18:15:20] Load warping_module from live_portrait_wrapper.py:52 D:\AI\Live_Portrait_V6\LivePortrait\pretrained_weights\liveportrait\base_models\w arping_module.pth done. [18:15:22] Load spade_generator from live_portrait_wrapper.py:55 D:\AI\Live_Portrait_V6\LivePortrait\pretrained_weights\liveportrait\base_models\s pade_generator.pth done. Load stitching_retargeting_module from live_portrait_wrapper.py:59 D:\AI\Live_Portrait_V6\LivePortrait\pretrained_weights\liveportrait\retargeting_m odels\stitching_retargeting_module.pth done. 2024-10-10 18:15:22.2649472 [E:onnxruntime:Default, provider_bridge_ort.cc:1744 onnxruntime::TryGetProviderInfo_CUDA] C:\a\_work\1\s\onnxruntime\core\session\provider_bridge_ort.cc:1426 onnxruntime::ProviderLibrary::Get [ONNXRuntimeError] : 1 : FAIL : LoadLibrary failed with error 126 "" when trying to load "D:\AI\Live_Portrait_V6\LivePortrait\venv\lib\site-packages\onnxruntime\capi\onnxruntime_providers_cuda.dll" *************** EP Error *************** EP Error C:\a\_work\1\s\onnxruntime\python\onnxruntime_pybind_state.cc:866 onnxruntime::python::CreateExecutionProviderInstance CUDA_PATH is set but CUDA wasnt able to be loaded. Please install the correct version of CUDA andcuDNN as mentioned in the GPU requirements page (https://onnxruntime.ai/docs/execution-providers/CUDA-ExecutionProvider.html#requirements), make sure they're in the PATH, and that your GPU is supported. when using ['CUDAExecutionProvider'] Falling back to ['CUDAExecutionProvider', 'CPUExecutionProvider'] and retrying. **************************************** 2024-10-10 18:15:22.3103646 [E:onnxruntime:Default, provider_bridge_ort.cc:1744 onnxruntime::TryGetProviderInfo_CUDA] C:\a\_work\1\s\onnxruntime\core\session\provider_bridge_ort.cc:1426 onnxruntime::ProviderLibrary::Get [ONNXRuntimeError] : 1 : FAIL : LoadLibrary failed with error 126 "" when trying to load "D:\AI\Live_Portrait_V6\LivePortrait\venv\lib\site-packages\onnxruntime\capi\onnxruntime_providers_cuda.dll" Traceback (most recent call last): File "D:\AI\Live_Portrait_V6\LivePortrait\venv\lib\site-packages\onnxruntime\capi\onnxruntime_inference_collection.py", line 419, in __init__ self._create_inference_session(providers, provider_options, disabled_optimizers) File "D:\AI\Live_Portrait_V6\LivePortrait\venv\lib\site-packages\onnxruntime\capi\onnxruntime_inference_collection.py", line 483, in _create_inference_session sess.initialize_session(providers, provider_options, disabled_optimizers) RuntimeError: C:\a\_work\1\s\onnxruntime\python\onnxruntime_pybind_state.cc:866 onnxruntime::python::CreateExecutionProviderInstance CUDA_PATH is set but CUDA wasnt able to be loaded. Please install the correct version of CUDA andcuDNN as mentioned in the GPU requirements page (https://onnxruntime.ai/docs/execution-providers/CUDA-ExecutionProvider.html#requirements), make sure they're in the PATH, and that your GPU is supported. The above exception was the direct cause of the following exception: Traceback (most recent call last): File "D:\AI\Live_Portrait_V6\LivePortrait\app.py", line 64, in gradio_pipeline = GradioPipeline( File "D:\AI\Live_Portrait_V6\LivePortrait\src\gradio_pipeline.py", line 42, in __init__ super().__init__(inference_cfg, crop_cfg) File "D:\AI\Live_Portrait_V6\LivePortrait\src\live_portrait_pipeline.py", line 53, in __init__ self.cropper: Cropper = Cropper(crop_cfg=crop_cfg) File "D:\AI\Live_Portrait_V6\LivePortrait\src\utils\cropper.py", line 63, in __init__ self.face_analysis_wrapper = FaceAnalysisDIY( File "D:\AI\Live_Portrait_V6\LivePortrait\src\utils\face_analysis_diy.py", line 37, in __init__ super().__init__(name=name, root=root, allowed_modules=allowed_modules, **kwargs) File "D:\AI\Live_Portrait_V6\LivePortrait\src\utils\dependencies\insightface\app\face_analysis.py", line 33, in __init__ model = model_zoo.get_model(onnx_file, **kwargs) File "D:\AI\Live_Portrait_V6\LivePortrait\src\utils\dependencies\insightface\model_zoo\model_zoo.py", line 96, in get_model model = router.get_model(providers=providers, provider_options=provider_options) File "D:\AI\Live_Portrait_V6\LivePortrait\src\utils\dependencies\insightface\model_zoo\model_zoo.py", line 40, in get_model session = PickableInferenceSession(self.onnx_file, **kwargs) File "D:\AI\Live_Portrait_V6\LivePortrait\src\utils\dependencies\insightface\model_zoo\model_zoo.py", line 25, in __init__ super().__init__(model_path, **kwargs) File "D:\AI\Live_Portrait_V6\LivePortrait\venv\lib\site-packages\onnxruntime\capi\onnxruntime_inference_collection.py", line 432, in __init__ raise fallback_error from e File "D:\AI\Live_Portrait_V6\LivePortrait\venv\lib\site-packages\onnxruntime\capi\onnxruntime_inference_collection.py", line 427, in __init__ self._create_inference_session(self._fallback_providers, None) File "D:\AI\Live_Portrait_V6\LivePortrait\venv\lib\site-packages\onnxruntime\capi\onnxruntime_inference_collection.py", line 483, in _create_inference_session sess.initialize_session(providers, provider_options, disabled_optimizers) RuntimeError: C:\a\_work\1\s\onnxruntime\python\onnxruntime_pybind_state.cc:866 onnxruntime::python::CreateExecutionProviderInstance CUDA_PATH is set but CUDA wasnt able to be loaded. Please install the correct version of CUDA andcuDNN as mentioned in the GPU requirements page (https://onnxruntime.ai/docs/execution-providers/CUDA-ExecutionProvider.html#requirements), make sure they're in the PATH, and that your GPU is supported. Press any key to continue . . .
Furkan Gözükara
for video it is weak. you can extract frames and upscale as batch but it is not made for video frame system
Steve
Does this only work with video? Or can it take audio and animate an image realistically to fit the words?
Chris
Thanks! :)
Furkan Gözükara
fixed the link. if such thing happens always check very bottom attachments links
Chris
Hi, download link points to: "Expired URL"
Furkan Gözükara
great
Mike
It works, thanks
Furkan Gözükara
it is because fastapi broken globally all gradio apps. either reinstall or activate venv and pip install fastapi==0.111.0 - i just fixed requirements on the repo
Mike
Live Portrait V5_v2 broke, I get a connection error. "Exception in ASGI application" (I'm using the Massed Compute script)
Furkan Gözükara
please install this c++ tools and cuda 11.8 and reinstall : https://download.visualstudio.microsoft.com/download/pr/107aa087-4efd-4262-87ee-dc15a68f8e76/e903fad0236c076d13caa7c58440cc69451e008f8756ab255491d64670770d5a/vs_BuildTools.exe
Juuso A
i have the same problem..
Furkan Gözükara
you need accurate c++ tools and cuda. i replied you from discord
Mark Hernandez
I deleted everything and downloaded and installed the new v5 version. After running, I can select the 'Human Live Portrait' option and it works. The 'Animal Live Portrait' option doesn't load and gives errors: Please select an option: 1. Human Live Portrait 2. Animal Live Portrait Enter your choice (1 or 2): 2 Starting Animal Live Portrait... [10:58:06] Load appearance_feature_extractor from live_portrait_wrapper.py:361 D:\Live_Portrait_V5\LivePortrait\pretrained_weights\liveportrait_animals\base_mo dels\appearance_feature_extractor.pth done. Load motion_extractor from live_portrait_wrapper.py:364 D:\Live_Portrait_V5\LivePortrait\pretrained_weights\liveportrait_animals\base_mo dels\motion_extractor.pth done. Load warping_module from live_portrait_wrapper.py:367 D:\Live_Portrait_V5\LivePortrait\pretrained_weights\liveportrait_animals\base_mo dels\warping_module.pth done. [10:58:07] Load spade_generator from live_portrait_wrapper.py:370 D:\Live_Portrait_V5\LivePortrait\pretrained_weights\liveportrait_animals\base_mo dels\spade_generator.pth done. Load stitching_retargeting_module from live_portrait_wrapper.py:374 D:\Live_Portrait_V5\LivePortrait\pretrained_weights\liveportrait\retargeting_mod els\stitching_retargeting_module.pth done. [10:58:08] FaceAnalysisDIY warmup time: 1.076s face_analysis_diy.py:79 [10:58:09] LandmarkRunner warmup time: 0.788s human_landmark_runner.py:95 Traceback (most recent call last): File "D:\Live_Portrait_V5\LivePortrait\app_animals.py", line 62, in gradio_pipeline_animal: GradioPipelineAnimal = GradioPipelineAnimal( File "D:\Live_Portrait_V5\LivePortrait\src\gradio_pipeline.py", line 516, in __init__ super().__init__(inference_cfg, crop_cfg) File "D:\Live_Portrait_V5\LivePortrait\src\live_portrait_pipeline_animal.py", line 55, in __init__ self.cropper: Cropper = Cropper(crop_cfg=crop_cfg, image_type='animal_face', flag_use_half_precision=inference_cfg.flag_use_half_precision) File "D:\Live_Portrait_V5\LivePortrait\src\utils\cropper.py", line 79, in __init__ from .animal_landmark_runner import XPoseRunner as AnimalLandmarkRunner File "D:\Live_Portrait_V5\LivePortrait\src\utils\animal_landmark_runner.py", line 19, in from .dependencies.XPose.models import build_model File "D:\Live_Portrait_V5\LivePortrait\src\utils\dependencies\XPose\models\__init__.py", line 7, in from .UniPose.unipose import build_unipose File "D:\Live_Portrait_V5\LivePortrait\src\utils\dependencies\XPose\models\UniPose\__init__.py", line 10, in from .unipose import build_unipose File "D:\Live_Portrait_V5\LivePortrait\src\utils\dependencies\XPose\models\UniPose\unipose.py", line 23, in from .deformable_transformer import build_deformable_transformer File "D:\Live_Portrait_V5\LivePortrait\src\utils\dependencies\XPose\models\UniPose\deformable_transformer.py", line 30, in from .ops.modules import MSDeformAttn File "D:\Live_Portrait_V5\LivePortrait\src\utils\dependencies\XPose\models\UniPose\ops\modules\__init__.py", line 9, in from .ms_deform_attn import MSDeformAttn File "D:\Live_Portrait_V5\LivePortrait\src\utils\dependencies\XPose\models\UniPose\ops\modules\ms_deform_attn.py", line 23, in from src.utils.dependencies.XPose.models.UniPose.ops.functions.ms_deform_attn_func import MSDeformAttnFunction File "D:\Live_Portrait_V5\LivePortrait\src\utils\dependencies\XPose\models\UniPose\ops\functions\__init__.py", line 9, in from .ms_deform_attn_func import MSDeformAttnFunction File "D:\Live_Portrait_V5\LivePortrait\src\utils\dependencies\XPose\models\UniPose\ops\functions\ms_deform_attn_func.py", line 18, in import MultiScaleDeformableAttention as MSDA ModuleNotFoundError: No module named 'MultiScaleDeformableAttention' Press any key to continue . . .
Mark Hernandez
I had Live Portrait v3 installed. I extracted and replaced the files from v5 into the existing v3 folder. Then I ran the two .bat files: Run Windows_Update_Version.bat file Run Windows_Install.bat - will only download new models and new requirements When trying to load, I get file not found errors.
Furkan Gözükara
sure i plan to release ty
Furkan Gözükara
you are welcome
J D
EchoMimic looks very promising - would love to see this as a 1-click install or something like it that animates the head based on the audio
J D
Thank you so much!!!
Furkan Gözükara
you are welcome
Sugar Coat VFX Design
Thanks !
Furkan Gözükara
you are welcome
JamZam WamBam
Thanks!
Furkan Gözükara
just fixed please refresh the page.
JamZam WamBam
I can't find the LivePortrait link for V3
Mark Sutherland
Brilliant thank you very much for your hard work on this, awesome, thanks again and have a great day
Furkan Gözükara
published and it is even better version : https://www.patreon.com/posts/108403107?pr=true
Mark Sutherland
Brilliant, thanks again
Furkan Gözükara
thanks a lot i just returned today. i should publish tomorrow adding to list
Mark Sutherland
Reminder as promised, I think it's called PaintsUndo, cheers
Furkan Gözükara
Thank you so much. Also thank you so much to the patreon upgrade. The issue there are so many depended libraries that we can't fix so best to avoid such path :/
Guile Lindroth
Thank you! I’m really impressed with your work, professionalism and dedication with your tutorials and the way you treat your students! Congrats! Regarding my issue, I believe we could write a Python code to sanitize those paths. I think this will help people who have their native computer OS language with those especial characters. Keep the great work!
Furkan Gözükara
i was gonna tell this Usuário. your username is a big red flag. i am glad you solved :)
Guile Lindroth
Great work! When running the file "Windows_Start_app.bat" the gradio UI opens and I can select image and video, but when clicking on Run, I'm getting the error: global loadsave.cpp:241 cv::findDecoder imread_('C:\Users\Usu├írio\AppData\Local\Temp\gradio\bef81c8bfee48fec27ef2aef06cf22f20ce3848b\s7.jpeg'): can't open/read file: check file path/integrity I believe this is due to my Windows language being in Portuguese, and the system path to the images is: C:\Users\Usuário\AppData\Local\Temp\gradio Note that I have an accent in the "a" from the path "Usuário" word. Is there a workaround to fix that? ***Solved**** The fix is very simple. Open your Windows Environment Variables and change the "Temp" path to any folder without accented Unicode characters
Furkan Gözükara
Yes I am following to update our script. Also onnx huge speed up coming too
JamZam WamBam
I heard they are adding video to this very soon. That would make it an even more outstanding tool. Great for music videos.
Furkan Gözükara
ye i know supir error still exists. i replied there. thank you
hacbachvotinh
Thank you it works fine. I also encountered this same error in supir and I posted the error in the comment section of the supir post.
Furkan Gözükara
thanks. not yet but hopefully i will. i am out of city until 18th july
Tobe2d
Amazing work as always! I am wondaring if you have you seen EchoMimic? it was released today https://github.com/BadToBest/EchoMimic
Furkan Gözükara
Do you have ffmpeg installed please verify and let me know. Also send me entire cmd output
daniel mendoza
[WinError 2] The system cannot find the specified file. This dont save the video
Furkan Gözükara
great ty
Mark Sutherland
Enjoy the wedding, I will add a reply in a weeks time, thank you
Furkan Gözükara
Hello. Sure hopefully I can make but I am out of city for my cousins wedding. So it has to wait. Can you remind me again in 1 week please?
Mark Sutherland
Brilliant work as always, any chance of a one click installer for PaintsUndo
Furkan Gözükara
just updated and fixed this issue. please run windows update and restart app and it should be fixed now. let me know please
Furkan Gözükara
just updated and fixed this issue. please run windows update and restart app and it should be fixed now. let me know please
Furkan Gözükara
yep this is number 1 right now
Mike
The timing of this post is amazing for me - I was looking for a way to animate my character and nothing I found looked as good as this
hacbachvotinh
yes it is! i wait for you!
Furkan Gözükara
Yes this happens due to that your video doesn't have any audio. Add some fake audio to it or wait for me to fix which I can't do right now. I am out of home right now
Furkan Gözükara
Your video don't have any sound? Did you test demo material? Demo material works?
hacbachvotinh
Input #1, mov,mp4,m4a,3gp,3g2,mj2, from 'D:\temp\gradio\3d58cc0bedbf8fd0dec70a1178f4312bf9682855\d0.mp4': Metadata: major_brand : isom minor_version : 512 compatible_brands: isomiso2avc1mp41 encoder : Lavf58.29.100 Duration: 00:00:03.12, start: 0.000000, bitrate: 7585 kb/s Stream #1:0[0x1](und): Video: h264 (High) (avc1 / 0x31637661), yuv420p(progressive), 512x512, 7581 kb/s, 25 fps, 25 tbr, 12800 tbn (default) Metadata: handler_name : VideoHandler vendor_id : [0][0][0][0] Stream map '1:a' matches no streams. To ignore this, add a trailing '?' to the map. Failed to set value '1:a' for option 'map': Invalid argument Error parsing options for output file animations/s6_sound_0001.mp4. Error opening output files: Invalid argument Error occurred: Command '['ffmpeg', '-y', '-i', 'animations/s6_0001.mp4', '-i', 'D:\\temp\\gradio\\3d58cc0bedbf8fd0dec70a1178f4312bf9682855\\d0.mp4', '-map', '0:v', '-map', '1:a', '-c:v', 'copy', '-shortest', 'animations/s6_sound_0001.mp4']' returned non-zero exit status 4294967274. i got this error.
Furkan Gözükara
thanks for the tips
Furkan Gözükara
Gradio still says V1 true. just run windows updater that is it :D
Douglas Aaron
make sure you click on red rec button again. That happened to me it was still recording while I thought I clicked on it , so you must confirm to stop recording then it is prepared to animate
Douglas Aaron
Another great job! I installed v1 and then I just saw v2 link and installed, but could you please confirm if in the gradio when running it is suppose to say also V2. Both of my installs say v1 in the gradio title where it reads " This is the official gradio demo for LIvePortrait improved version by SECourses V1"
Furkan Gözükara
that means upload of the video is not completed yet. wait for video upload to be completed to gradio and it shall work
Alexandru Naftanaila
Hey. i have this error when i try to use camera : "The input source portrait or driving video hasn't been prepared yet 💥!"
Furkan Gözükara
it generates same resolution of input image for me with paste back feature. you can try without do-crop and paste-back to see
Furkan Gözükara
:D
Sergiy Dovgal
Why is the resolution adapted to square? Is it possible to add a resolution change? In Comfyui even when the resolution of files does not match it generates normally.
jonathan sanchez
fantastic tools, thans you. now that the turkish national team has been eliminated from the european championship you will have more time to bring us more and cooler tools hahahaha ;)
Furkan Gözükara
you are welcome ty for comment
Nobodys Hero
fantstic very fast with this Doc, amazing work bringing it to runpod etc so more can enjoy