Azgaar
patreon
Visualization using DALL-E 2 image generator
🕑 Added 2022-07-29 22:02:45 +0000 UTCHad some time to play with the famous DALL-E 2 image generator by Open AI (currently in closed beta) and think how it can be potentially used in FMG. DALL-E generates images from a short text prompt and is especially good in visualization of abstract ideas or mimicking a known style. Found pretty a lot of possible use cases, AI-based image generation has great potential for worldbuilding.
I started with an idea of a Deity generation, using the current FMG deity generator as a source. For each request DALL-E generates 4 images. Each image is editable, also the system can generate variations of a selected image, but I did not play with it a lot. Text prompt is below the generated images, so you can see what was requested.
God of nature named Bonyfarius, The Blue Panther, digital art
Variants of the first image above
Pretty lame: it's a cool panther, it's blue, but it doesn't look like a god. Need to be more specific.
Church painting of the God of Nature, The Blue Panther, with golden nimbus, digital art
Wow, that's almost exactly what I wanted. I can see how images 1,2 and 4 can be used in the generator without any change. Let's try some stylisation.
Church painting of the God of Nature, The Blue Panther, with golden nimbus, medieval art style
The result is good, the medieval style is followed very closely. But it doesn't look like a god. Try to be even more specific.
God of Nature in a form of The Blue Panther is sitting on the cloud, the panther has a golden nimbus, orthodox church art style
Interesting, but it looks 'orthodox church art style' is beyond its possibilities. 'Digital art' prompt worked better.
God of Nature with golden nimbus in a form of The Blue Panther is sitting on the cloud, church art style, digital art
God of Nature with golden nimbus in a form of The Blue Panther is sitting on the cloud, church art style, photorealistic
Both a pretty good, but let's try something different.
Church painting Belhil, The Goddess of Frost, digital art
Hm, interesting, kinda usable. A bit different approach, let's try to add more irrelevant details.
Church painting of Belhil, The Goddess of Frost of Dail (Human) folk culture. Digital art
The tool not production ready as for now and expected to be pretty expensive for a free tool like FMG, but still is interesting to experiment with. I believe it won't take too much time for new tools to be built and maybe these new tools can be more affordable or even free.
Thanks a community member for providing an access to the tool.
For more examples see:
- Visualization using DALL-E 2 image generator: part 2
- Visualization using DALL-E 2 image generator: part 3
- Visualization using DALL-E 2 image generator: part 4
Comments
Azgaar
Yes, but it's tricky. The quality is not guaranteed, also need to create a server to manage payments. In any case image generator is not yet allowed for production usage.
Paul Ingram
I would probably pay per art piece downloaded if the cost was like .50c.
Jon
Very cool exploration! The expense will probably be prohibitive to be included in a free map gen tool though :(
Azgaar
All the styles are already there, it's an open model - you can put any prompt and it will generate an image. But it's not production-ready, it's in beta and very expensive as for now
Adam Butler
This would make a really interesting addition. I wonder if they will add more styles? It would be interesting to see a few more historical styles added, e.g. Greco-roman.
