1-Click INSTALL LOCAL TEXT GEN WebUI!
🕑 Added 2025-11-08 18:41:40 +0000 UTCHey everyone! I've created a 1-click installer for the Oobabooga TextGen WebUI 2025 Update, the easiest way to run your favorite UNRESTRICTED open-source LLMs locally for FREE! This version is a massive improvement over the old one, with faster installs, full model compatibility, and a cleaner interface that makes it easier than ever to use.
You can check out the video right here: https://youtu.be/QSJS9YDqf9w
The installer of course automates the entire install process for the webui!
Links for the models:
CYDONIA 24B: bartowski/TheDrummer_Cydonia-24B-v4.1-GGUF · Hugging Face
GPT-OSS-120B: unsloth/gpt-oss-120b-GGUF · Hugging Face
GLM-4.5-355B: unsloth/GLM-4.5-GGUF · Hugging Face
GLM-4.5-Air-106B: unsloth/GLM-4.5-Air-GGUF · Hugging Face
LOCAL INSTALL
Download the TEXT-GEN_WEBUI_INSTALLER.bat
Run the bat file
It will then asks which GPU you got, most of you will choose A for Nvidia, since other GPUs are only really compatible on Linux (like AMD) press enter
Wait for the install to finish
The webui will launch, or hold ctrl then left click on the local url and there you go😎
IF YOU ARE USING RUNPOD :
Create an account if you haven't already: Runpod
Click on Pod (on the left side) then click deploy
Choose a GPU OR GPUs, depending on what you are looking for, chose the pytorch 2.8.0, then edit the template and choose min 300gb for both the container and volume disk, add the 7860 port and then deploy on demand
Go to my pods, wait for everything to finish and then click "connect", then "Connect to HTTP SERVICE port 8888" and drag and drop the TEXT-GEN_WEBUI_INSTALL-RUNPOD.sh file on the left side of the UI then click on the "Terminal" icon on the right side on the UI
Copy and paste these two lines then press enter:
chmod +x TEXT-GEN_WEBUI_INSTALL-RUNPOD.sh
./TEXT-GEN_WEBUI_INSTALL-RUNPOD.sh start
Choose if you want to put a username and password
Wait for everything to be installed
Go to the port 7860 and there you go 😎
IF YOU PAUSE THE POD THEN RESTART IT AND YOU WANT TO RESTART THE WEBUI:
click on the terminal icon and there type:
./start_linux.sh --listen --listen-host 0.0.0.0 --listen-port 7860 --gradio-auth user:pass
where user:pass is your username and password
IF YOU NEED TO DOWNLOAD A BIG MODEL
Go inside the text generation webui folder, drag and drop the MODEL_DOWNLOADER-RUNPOD.sh file on the left side of the UI then click on the "Terminal" icon on the right side on the UI
Copy and paste these two lines then press enter:
chmod +x MODEL_DOWNLOADER-RUNPOD.sh
./MODEL_DOWNLOADER-RUNPOD.sh
It will then ask you to paste the url of the model from huggingface and once you do, press enter and it will dl quickly all the model files.
As always, supporting me on Patreon allows me to keep creating helpful resources like this for the community. Thank you for your support - now go have some fun😉!
PS: Sorry again for the lack of communication, those who know, knows ❤️
Comments
William
Got this error at the end: ******************************************************************* * You haven't downloaded any model yet. * Once the web UI launches, head over to the "Model" tab and download one. ******************************************************************* bash: -c: line 1: syntax error near unexpected token `)' bash: -c: line 1: `. "/workspace/text-generation-webui/installer_files/conda/etc/profile.d/conda.sh" && conda activate "/workspace/
Colliebii
The same thing happens to me. Did you find out how to fix it?
neil
when i click the bat it opens then closes straight away
Lance Fanger
When using one click installer I am getting this error: line 9, in import yaml ModuleNotFoundError: No module named 'yaml'
Aitrepreneur
what updates are you talking about?
Aitrepreneur
I had that too, you can create a new conda env and then activate it sowhere in some folder. you can use these commands for example: conda create -n myenv conda activate myenv it should then give you the possibility to accept the tos, then you can relaunch the installer
Teresa Greasley
Will there be updates to this? If so will they be posted here or on Hugging Face?
Kodaijin Starfall
How does one accept the conta tos and eula when using the 1-click bat file?
Hrothgar's Hoard
Anyone have suggestions on models to use? I'm trying the TheDrummer_Cydonia-24B-v4.1-Q6_K_L.gguf and it works well enough, but it seems *really* chatty. I'll ask a 3 word question and I get multiple paragraphs in response.
J
Thank you for the video.