DIY: Games with AI
New level of creating games, right out of your pocket: Playable 3D worlds from your own 360° panorama images with AI.
Hugo
/
July 6, 2023
Intro

In today's digital era, artificial intelligence (AI) has made a remarkable impact on the world of 3D modeling and game development. With powerful tools like Skybox.ai, InstaVerse, Polycam, and the Leiapix Converter, it is now possible to create individual, playable 3D worlds from our own 360° panorama images and play within them! This blog post will guide you through the steps of crafting stunning 3D worlds based on your own images using these innovative tools.

How it works

The journey begins with Skybox.ai, an AI-powered tool that generates 360° skyboxes from text prompts. After creating an account, simply enter a text prompt that describes your desired scene, such as "a tropical beach" or "a snow-covered mountain range". Skybox.ai then creates a photorealistic 360° skybox based on your description. With features like Sketch mode and Remix mode, Skybox.ai gives you complete control and flexibility to create the skybox you envision.


The Skybox assets can be uploaded into InstaVerse and rendered as 3D worlds. With InstaVerse, it's easy to explore and play within the 3D environments created.


However, your creativity can go even further! You do not need to rely solely on Skybox.ai. With the Polycam app, you can create your own 360° panorama images! Simply hold your iPhone steady and rotate it in a full circle. Polycam then creates a 360° photo from the captured images.


For a more detailed and realistic depiction of your 3D world, you can use the LeiaPix Converter. This online tool enables you to generate a depth map from your own 360° panorama image. Simply upload the image and click on "Convert" to receive a depth map.

Tip: It might be useful to edit your panorama image in Photoshop or a similar software. Increasing the contrast, adding more saturation, and experimenting a bit could help you generate a better depth map image in the subsequent steps.


The generated depth maps can now be uploaded to InstaVerse to transform your own 360° panorama images into a playable 3D world. To do this, simply upload the image and its corresponding depth map, and InstaVerse will generate an impressive 3D world for you to explore and play in.


Conclusion

The possibilities that arise from combining these tools are incredible! With Skybox.ai, you can create your own skyboxes, upload and play them in InstaVerse. You can also generate your own 360° panorama images and depth maps with Polycam and Leiapix Converter. The power of AI delivers results at a speed that game developers could only dream of a few years ago. This democratizes game world creation immensely. We will need to wait a while to discover more concrete use cases, but for now, we can at least talk about another opportunity for content creation and pretotyping of immersive worlds you want to interact with.

Please note that the current output of the aforementioned generation of playable 3D worlds does not constitute a full game. Apart from minor physics, there is no gaming logic that can be influenced yet. But that is the next step we are all waiting for. 😎

Hugo
Creative Technologist
About 2 years of experience in UX, gained through UX Design studies on SWPS and working on commercial projects. Passionate about intuitive, user-centered design and enthusiast of board games that stimulate imagination and creativity.
All articles by Patrycja
Blog
Digital Flux Episode #3
pace goes Podcast
pace x BRZ Studio
Webflow’s new features: almost perfect codeless website-building
icon for the category follow fun
Follow pace
We don't post often, but when we do...
LinkedIn logo, yellow