Aitrepreneur patreon

1-Click INSTALL SillyTavern FOR PHONES - BEST MOBILE ROLEPLAY EXPERIENCE!

🕑 Added 2024-01-19 19:00:50 +0000 UTC

Comments

Kennedy Vieira Lopes

For me, the following error appears on Google collab. RuntimeError: Failed to import transformers.models.auto.processing_auto because of the following error (look up to see its traceback): module 'torch.library' has no attribute 'register_fake'

James IV

The commands aren't working in Terms. Getting 5108 aborted on the storage setup. And no such time of directory on the second line

Ghostface428

Same

Jorge E Ibarra

I found the issue, if you have multiple devices on the same network and have the server address the same across the devices then you get the error. Could be wrong though...

Jorge E Ibarra

I keep getting the error "Uncaught exception: Error: listen EADDRINUSE: address already in use 127.0.0.1:8000" Then it stops the process

Senjka Danhieux

In the google colab, I get this: ImportError: /usr/local/lib/python3.10/dist-packages/flash_attn_2_cuda.cpython-310-x86_64-linux-gnu.so: undefined symbol: _ZN3c104cuda9SetDeviceEi

philip holman

I am also getting this. after some googling it has something to do with nodeJS version apparently??? but i am not finding a quick solution myself

AngwySquid

I know nothing about coding but I finally got it to connect with the help of gpt 4

AngwySquid

I've been trying to get the open ai url but this keep showing up In collab what should I do? "ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. google-colab 1.0.0 requires pandas==2.0.3, but you have pandas 2.2.2 which is incompatible. imageio 2.31.6 requires pillow<10.1.0,>=8.3.2, but you have pillow 10.3.0 which is incompatible. tensorflow 2.15.0 requires tensorboard<2.16,>=2.15, but you have tensorboard 2.16.2 which is incompatible. Successfully installed DataProperty-1.0.1 GitPython-3.1.43 Pillow-10.3.0 accelerate-0.27.2 aiofiles-23.2.1 aqlm-1.1.3 auto-gptq-0.6.0+cu121 autoawq-0.2.3 autoawq-kernels-0.0.6 bitsandbytes-0.43.1 colorama-0.4.6 coloredlogs-15.0.1 cramjam-2.8.3 datasets-2.19.0 dill-0.3.8 diskcache-5.6.3 docker-pycreds-0.4.0 einops-0.8.0 exllamav2-0.0.19+cu121 fastapi-0.110.3 fastparquet-2024.2.0 ffmpy-0.3.2 flash-attn-2.5.6 gekko-1.1.1 gitdb-4.0.11 gptq-for-llama-0.1.1+cu121 gradio-4.26.0 gradio-client-0.15.1 h11-0.14.0 hqq-0.1.5 httpcore-1.0.5 httpx-0.27.0 huggingface-hub-0.22.2 humanfriendly-10.0 jinja2-3.1.2 jsonlines-4.0.0 llama-cpp-python-0.2.64 llvmlite-0.42.0 lm_eval-0.3.0 mbstrdecoder-1.1.3 multiprocess-0.70.16 ninja-1.11.1.1 numba-0.59.1 numpy-1.26.4 nvidia-cublas-cu12-12.1.3.1 nvidia-cuda-cupti-cu12-12.1.105 nvidia-cuda-nvrtc-cu12-12.1.105 nvidia-cuda-runtime-cu12-12.1.105 nvidia-cudnn-cu12-8.9.2.26 nvidia-cufft-cu12-11.0.2.54 nvidia-curand-cu12-10.3.2.106 nvidia-cusolver-cu12-11.4.5.107 nvidia-cusparse-cu12-12.1.0.106 nvidia-nccl-cu12-2.19.3 nvidia-nvjitlink-cu12-12.4.127 nvidia-nvtx-cu12-12.1.105 openai-1.24.0 optimum-1.17.1 orjson-3.10.1 pandas-2.2.2 pathvalidate-3.2.0 peft-0.8.2 portalocker-2.8.2 psutil-5.9.8 pybind11-2.12.0 pycountry-23.12.11 pydub-0.25.1 pytablewriter-1.2.0 python-multipart-0.0.9 rouge-1.0.1 rouge-score-0.1.2 ruff-0.4.2 sacrebleu-1.5.0 scipy-1.13.0 semantic-version-2.10.0 sentencepiece-0.2.0 sentry-sdk-2.0.1 setproctitle-1.3.3 shellingham-1.5.4 smmap-5.0.1 sqlitedict-2.1.0 tabledata-1.3.3 tcolorpy-0.1.6 tensorboard-2.16.2 timm-0.9.16 tomlkit-0.12.0 tqdm-multiprocess-0.0.11 transformers-4.40.1 typepy-1.3.2 uvicorn-0.29.0 wandb-0.16.6 websockets-11.0.3 xxhash-3.4.1 zstandard-0.22.0 WARNING: The following packages were previously imported in this runtime: [PIL,psutil] You must restart the runtime in order to use newly installed versions."

P

Could not get to work. Over and over, "could not extract reply in 5 attempts " on silly tavern

Jon

Hey Aitrepreneur, can you check the Google doc to see if it's still working? Wondering if they did another update, thanks as always!

Akshay

How do I run the XTTS.bat file when I don't have a GPU? I have colab pro with me, is there a way to create and API link, can you guide??

Aitrepreneur

a100 but it won't matter unless you are using a super big model though

Jon

If you pay for Google colab what's the best gpu for bigger models, T4, A100, or V100? Or should I just stick with the t4 suggestion from the video, also will enabling high ram help? thanks

Aitrepreneur

yes, just go to the session tab, and enable openai and public url checkbox, apply the changes and it will then give you a long public url to connect it to sillytavern

Ryan Clancy

Instead of using a Google Colab, can I just set my home desktop's OOBABOOGA up to be accessible anywhere from my phone with an API? Do you have a tutorial on that?

Jon

Anyone get the "could not extract reply in 5 attempts" error in ST? From what im seeing its a nodejs update issue, but that can't be updated within Termux until they rollout a package update.. thoughts? If it's currently running for anyone else then I'm doing something wrong

Aitrepreneur

that's...a weird behaviour O_o but thanks for the info

For those who also have problems running the termux-setup-storage command: I have run the CMD "apt update" as recommended. However, I got an error message that the source is not signed. Solution for me: When I try to access the website (specified in the code) where the updates should be pulled, I am redirected to a, for whatever reason, ring advertising page. Therefore no update can be pulled from the source. The solution is to select a mirror as recommended. For this: termux-change-repo //select any Mirror in the menu Then execute the commands again. Now it should be able to pull the updates and work. apt update apt upgrade pkg update pkg upgrade (Write Y for each request) You should not get any error messages now. After that: termux-setup-storage (No output = no error) cd ~/storage/shared/AI Now everything should work... at least for me now. Hope I could help you.

Aitrepreneur

Yes can just activate the public url in the session tab in the text gen webui and use that url inside sillytavern on your phone

Kubilay göze

is it somehow possible to use my pc as the server and use the sillytavern UI on my phone connected to the same network ?

Peter Bernaiche

I'm getting the following error when trying g to enter the first command after installing termux.: Report issues at https://termux.com/issues ~ $ termux-setup-storage /data/data/com.termux/files/usr/bin/termux-setup-storage: line 29: 29934 Aborted am broadcast --user 0 --es com.termux.app.reload_style storage -a com.termux.app.reload_style com.termux > /dev/null

fixed it by downloading the files on my pc, sending it to my phone

same issues. do not load, just errors on both

Aitrepreneur

you can, all your chats should be saved in the backups folder

Nabil Boulezaz

Can i transfer my progress when i finally get gpu ?

BP

Both silly.sh and launchsilly.sh link to their filenames not their URLs.

Errors are: failed to fetch and the repository is not signed

I figured it already out with the permission in Android 14 but still getting failures when trying following the steps. Got any ideas? It says the same for installing termux-am as for the silly tavern package... verification errors and because of it no installation is possible. I granted termux any rights and allowed unsafe installations. Nothing helped.

Both chrome and edge on a Samsung fold say "This site can’t be reachedCheck if there is a typo in launchsilly.sh. DNS_PROBE_FINISHED_NXDOMAIN" and fail.

Aitrepreneur

Then try using chrome or edge

BP

I just tried downloading on my phone via Firefox browser and it said download failed. Tapped and long pressed, both failed

Aitrepreneur

not really, except either using a Google colab doc or running SD on a pc then connecting to the url with your phone.

Nabil Boulezaz

Can we use stable diffusion on Android?

Ma No

That's fair just thought it might make an interesting video. Or maybe not just RDP into the desktop. Wasn't sure if there was a good solution. Do you know if the characters/roleplays you have can be carried over/ported to your mobile device or would you have to start over or export/import your current roleplay?

Aitrepreneur

you can do that but it's not as interesting since first, you need a computer always running while this allows you to be anywhere you want and as long as you have internet connection, it will work as is

Ma No

Interesting Youtube comment advised setting the AI up on your computer and Remoting in to the desktop. Might be something worth of exploring for a video.

Aitrepreneur

What is the issue?

Aitrepreneur

These files should be downloaded without any issues, just tried it

Zolon Farsane

If you are on Android 14, you also need to go into the app permissions for Termux and give it full file access. After I did that, the pkg install line worked, which then allowed the storage command to run.