In mid-April 2021, NVIDIA introduced GANcraft, a neural network that turns video with voxel (block) graphics from Minecraft into photorealistic videos. The company has now made its source code open to everyone by publishing it on GitHub.
At the input, GANсraft accepts a world of blocks depicting different objects (trees, water, sand, grass, and the like), the camera trajectory and stylization parameters, and at the output it outputs a video recording with the same shooting trajectory, but with photorealistic graphics.
“Imagine a world in which every minecrafter is a 3D artist!” – NVIDIA.
In the future, this neural network (or developments based on it) will allow you to quickly and easily create realistic virtual worlds, for example, for games or something like video screensavers, and will also be useful for Minecraft fans to add realism to in-game creations.