Generative AI
RealmWeaver-AI: procedural game asset generator
Stable Diffusion, CVAE-GAN and Wave Function Collapse for Unity
- Timeline
- Mar 2025 to Apr 2025
- Affiliation
- Worcester Polytechnic Institute
- FID
- 32.4
- Time per asset
- 2.7 s
- Manual effort
- -73%
What it is
A procedural 2D asset framework that generates terrain tiles and props with Stable Diffusion and LoRA, learns tile structure with a CVAE-GAN, lays out biomes with Wave Function Collapse and places prefabs automatically in Unity.
Problem
Indie developers spend most of their time building game worlds by hand.
Approach
VAE-based terrain synthesis, entropy-minimized Wave Function Collapse for biome layouts, LoRA-enhanced latent diffusion for assets, and a classifier-discriminator extension of the CVAE-GAN tuned by ablation for stability and style coherence.
Highlights
FID 32.4 at 2.7 seconds per asset, surpassing baseline procedural methods in realism and diversity.
Biome-aware prefab mapping in Unity reduced manual integration effort 73%.
