Aitrepreneur
patreon
OVI THE FIRST OPEN-SOURCE SORA 2 WebUI!
🕑 Added 2025-10-04 17:49:12 +0000 UTCHey everyone! I've just uploaded a video about “The FIRST Open-Source Sora 2 Model" Webui, featuring the brand-new OVI model. This one is a absolute first in the history of open-source AI models because we finally have a model that is able to generate a video with AUDIO either from scratch with a simple text prompt or with an Image to convert it into a video with audio, total game-changer!
You can check out the video right here: https://youtu.be/2SvPfkXs3Nk
I have also made a 1-click installer for both local and runpod: https://www.patreon.com/posts/140447198
Manual install: https://pastebin.com/vEdz0iGC
As always, supporting me on Patreon allows me to keep creating helpful resources like this for the community. Thank you for your support - now go have some fun😉!
ChatGPT prompt:
I'm using a brand new text to video and audio tool that can generate a video with audio from either a full text prompt or an image WITH text prompt called "OVI" but I need to write my prompt correctly.
Here are a few example to how to write those prompts:
"A young woman with long, wavy blonde hair and light-colored eyes is shown in a medium shot against a blurred backdrop of lush green foliage. She wears a denim jacket over a striped top. Initially, her eyes are closed and her mouth is slightly open as she speaks, <S>Enjoy this moment<E>. Her eyes then slowly open, looking slightly upwards and to the right, as her expression shifts to one of thoughtful contemplation. She continues to speak, <S>No matter where it's taking<E>, her gaze then settling with a serious and focused look towards someone off-screen to her right.. <AUDCAP>Clear female voice, faint ambient outdoor sounds<ENDAUDCAP>"
"The video opens with a close-up of a woman with vibrant reddish-orange, shoulder-length hair and heavy dark eye makeup. She is wearing a dark brown leather jacket over a grey hooded top. She looks intently to her right, her mouth slightly agape, and her expression is serious and focused. The background shows a room with light green walls and dark wooden cabinets on the left, and a green plant on the right. She speaks, her voice clear and direct, saying, <S>doing<E>. She then pauses briefly, her gaze unwavering, and continues, <S>And I need you to trust them.<E>. Her mouth remains slightly open, indicating she is either about to speak more or has just finished a sentence, with a look of intense sincerity.. <AUDCAP>Tense, dramatic background music, clear female voice.<ENDAUDCAP>"
"A bearded man wearing large dark sunglasses and a blue patterned cardigan sits in a studio, actively speaking into a large, suspended microphone. He has headphones on and gestures with his hands, displaying rings on his fingers. Behind him, a wall is covered with red, textured sound-dampening foam on the left, and a white banner on the right features the ""CHOICE FM"" logo and various social media handles like ""@ilovechoicefm"" with ""RALEIGH"" below it. The man intently addresses the microphone, articulating, <S>is talent. It's all about authenticity. You gotta be who you really are, especially if you're working<E>. He leans forward slightly as he speaks, maintaining a serious expression behind his sunglasses.. <AUDCAP>Clear male voice speaking into a microphone, a low background hum.<ENDAUDCAP>"
A young Black woman with dark, curly hair sits with her head bowed and bare shoulders, positioned to the right of the frame in what appears to be a dimly lit, hazy room. She looks downcast, appearing distressed or submissive. In the blurred background, a stern-faced woman with light hair in a dark uniform stands, looking directly towards the young woman. Another uniformed figure is faintly visible further back in the room. The uniformed woman in the foreground takes a deliberate step forward, her gaze remaining fixed on the young woman. She then speaks, her voice firm, <S>Come here.<E> The young woman remains still, her head still bowed, not immediately responding to the command.. <AUDCAP>Muffled clattering/rattling sounds, soft footsteps, indistinct background murmuring, a stern female voice.<ENDAUDCAP>
A man with a beard, wearing a patterned shirt, stands on the left, partially visible, looking towards a woman positioned slightly to the right of the frame. The woman, with dark hair fading to lighter ends and wearing a green and brown patterned top, initially looks down with a somber expression. She begins to speak, <S>Hope beats circuits every time.<E>. Her eyes appear to well up with tears as she slowly lifts her gaze slightly, maintaining a distressed look. She continues her statement, her voice tinged with sadness, <S>Humanity endures beyond your code.<E>. The man remains attentive, his focus entirely on the woman, as the scene holds on their interaction against a textured, light-colored wall background.. <AUDCAP>Female voice speaking with a distressed tone.<ENDAUDCAP>
A close-up shot shows a woman with her eyes closed, wearing makeup including red lipstick, as she begins to speak, <S>The truth<E>. Her right hand is slightly raised. She then opens her eyes, looking down and to the left, a slight smile playing on her lips, and continues, <S>is that<E>. A microphone becomes visible in the lower part of the frame. She continues to speak, her expression shifting slightly as she adds, <S>it's actually a really sad tale<E>. She looks down intently, her mouth slightly open, as if pausing or reflecting on her words. The background features a vibrant pink wall and a dark, reflective surface to her left.. <AUDCAP>Clear female speech, slight room reverberation.<ENDAUDCAP>
A zoomed in close-up shot of a man in a dark apron standing behind a cafe counter, leaning slightly on the polished surface. Across from him in the same frame, a woman in a beige coat holds a paper cup with both hands, her expression playful. The woman says <S>You always give me extra foam.<E> The man smirks, tilting his head toward the cup. The man says <S>That’s how I bribe loyal customers.<E> Warm cafe lights reflect softly on the counter between them as the background remains blurred.. <AUDCAP>Female and male voices speaking English casually, faint hiss of a milk steamer, cups clinking, low background chatter.<ENDAUDCAP>>
A Black man with a short beard and dark hair stands center stage, illuminated by stage lights against a rippled royal blue curtain backdrop. He wears a white denim jacket over a mustard yellow t-shirt and holds a silver microphone in his right hand. He begins speaking, looking towards his left with a slight frown, <S>to<E> <S>cold like a month ago<E>. He then turns his gaze slightly right, his expression becoming more animated, his mouth open as if exclaiming. He shifts his weight, gesturing subtly with his microphone hand while continuing to speak, his head nodding slightly. He turns back to the left, his eyes wide and mouth open again, before stating with a direct look, <S>It's cold now, okay?<E> He then looks to his right, and his mouth briefly opens as if to say more, <S>I could<E>.. <AUDCAP>Male speaking voice, sound of audience laughter.<ENDAUDCAP>
The video opens with a medium shot of an older man with light brown, slightly disheveled hair, wearing a dark blazer over a grey t-shirt. He sits in front of a theatrical backdrop depicting a large, classic black and white passenger ship named "GLORIA" docked in a harbor, framed by red stage curtains on either side. The lighting is soft and even. As he speaks, he gestures expressively with both hands, often raising them and then bringing them down, or making a fist. His facial expression is animated and engaged, with a slight furrow in his brow as he explains. He begins by saying, <S>to help them through the grimness of daily life.<E> He then raises his hands again, gesturing outward, and continues speaking in a different language, <S>Da brauchst du natürlich Fantasiebilder.<E> His gaze is directed slightly off-camera as he conveys his thoughts.. <AUDCAP>Male voice speaking clearly and conversationally.<ENDAUDCAP>
A close-up shot focuses on a woman's face, positioned to the right of the frame, bathed in dim, almost dark lighting, with a faint blue/purple glow emanating from the left side. Her dark hair is visible, and her face expresses deep sadness, her eyes appearing moist and her brow furrowed as if struggling with emotion. She begins to speak, her voice trembling slightly, <S>No puedo olvidar aquella noche.<E> Her expression intensifies, tears welling in her eyes as she continues, her voice breaking slightly, <S>La recuerdo todo<E>, before the scene cuts off. The somber atmosphere is conveyed through her distressed demeanor and the low lighting.. <AUDCAP>Soft, melancholic background music, a female voice speaking emotionally, close to tears.<ENDAUDCAP>
A man with dark hair, wearing a dark top, is shown in a close-up, illuminated by an intense, deep red and pink light that casts a strong hue over the entire scene. His head is slightly tilted down, and his eyes are initially looking downwards. In the blurred background, another figure, possibly a child, is faintly visible to the left. The man's eyes briefly close, then open, and he looks slightly to his right, his expression appearing contemplative. He then articulates, <S>Who the hell is Mark?<E> His gaze remains fixed as he asks the question, his brow slightly furrowed.. <AUDCAP>A continuous low-frequency hum, a very faint, almost inaudible high-pitched tone just before the dialogue, a man's voice.<ENDAUDCAP>
A close-up shot features an East Asian man with dark, dishevelled hair and a short beard or stubble, his brow furrowed in intense concentration. He wears a light grey or blue bomber jacket over a white collared shirt. His eyes are wide open, fixed on something below or in front of him, and his mouth is slightly agape. <S>제가<E> he states, his voice low and strained. He blinks slowly, his eyes closing for a moment before reopening with an even more intense, pained expression. The arm of another person, clad in a dark sleeve, is visible behind his left shoulder, seeming to apply pressure. He continues, <S>과거에 과장님께 뭔가<E> as a loud, high-pitched ringing sound begins and persists, coinciding with his strained utterance.. <AUDCAP>Faint ambient hum, high-pitched continuous ringing sound.<ENDAUDCAP>
So take those examples, try to undestand how they work and how to create new ones
Comments
Yukon Cornelius
That is what he himself uses I am pretty sure so. Should work fine.
NewBe2
Works great thanks. if you are working on a comfyui. would be great if you did the same thing as the "WAN 2.2 Longer Videos" I am sure the voices will change between each section but will work for some creations and is a step towards when you can use pretrained voices.
Patrice B.
Does it work with an rtx 3090 24gb?
Lance Fanger
for some reason when i try the FP8 version with the one click installer it fails.
John Holden
I've just successfully installed and all opened ok. I shut OVI down but i cannot find how to run it again.
Oli Norwell
FP8 version out I see - so according to them is now usable on a 3090/4090 with 24GB VRAM
