StoryToolkitAI
patreon
Release of version 0.19.5 and future plans
🕑 Added 2023-08-22 06:54:56 +0000 UTCYesterday, we uploaded on GitHub the latest release of the tool which improves some of the features we've been coding in the past couple of months.
Here are the direct download links:
For macOS arm64 (M1, M2 etc.) use this link.
For Windows (CUDA only) use this link.
Although not perfect, it somehow feels that we're getting there...
Thanks again to all the patrons that have been supporting this!
What's next?
We're going to focus our attention on creating a system that allows us to select content into a separate window which can be later exported as a timeline for Resolve, Premiere, AVID MC and any other software that support EDL.
Basically, after the transcription and indexing is done, not only that we will be able to search for stuff, but also add transcription segments or video footage into a selection that we can later use for the main edit.
This will be particularly useful especially for those of us who prefer to work with select reels in the first steps of the editing process.
The first version of this means that we will be making the selections manually, but our goal is to give AI all the tools it needs to prepare these selections for us, and possibly also auto-complete our own selections with things that it "thinks" are suitable for whatever we're working on using the content that we have in the project - like an AI assistant editor or an editing copilot.
We're not sure how much of the last part will be possible strictly on the local machine since we're currently still dependent on OpenAI for the really smart AI stuff, but we're going to find some sort of solution one way or another...
What do you think?
Would this feature be useful in your workflow? What can we do to make it better?
Comments
Joseph Ferreira Campos
Did you ever figure this out? Also wanting to use it on Brazilian Portuguese
dustin
What LLM would be best at translating/transcribing Brazilian Portuguese to English? Would it be Large_V3 or Large_V2 or Large? Or would a completely different custom LLM be better at this. Thanks! Appreciate you’re work
immense_poets
This would be an amazing feature!
Ted Hayash
This would be great especially for those of us who edit material in languages we don’t speak - currently I transcribe and then translate and then export the translated subtitles into Resolve.
