However, they need to be trained on image-depth pairs which are hard to collect.

There are several works on depth estimation from single 2D image with DNNs. For automatic conversion, we would like to learn a model for it. The difficult step is estimating the depth map.

To convert an 2D image to 3D, you need to first estimate the distance from camera for each pixel (a.k.a depth map) and then wrap the image based on its depth map to create two views. Normally you need 3D glasses or VR display to watch 3D images, but since most readers won't have these we show the 3D images as GIFs.ģD imagery has two views, one for the left eye and the other for the right. In case you are already getting sleepy, here are some cool 3D images converted from 2D ones by Deep3D. Wouldn't it be cool if 2D-to-3D conversion can be done automatically, if you can take a 3D selfie with an ordinary phone? Teaser Shooting with a special 3D camera or shooting in 2D and manually convert to 3D.īut 3D cameras are expensive and unwieldy while manual conversion involves an army of 'depth artists' who sit there and draw depth maps for each frame. There are two ways of doing this and in practice they are about equally popular: Producing 3D movies, however, is still hard. Roughly 10 to 20 3D movies are produced each year and the launch of Oculus Rift and other VR head set is only going to drive up the demand. Since the debut of Avatar in 2008, 3D movies has rapidly developed into mainstream technology. Then, append EXTRA_OPERATORS=path/to/deep3d/operators to path/to/mxnet/config.mk and recompile MXNet. Please open mxnet/config.mk and set USE_CUDA and USE_CUDNN to 1. Please install MXNet following the official document.ĭeep3D requires MXNet to be built with Cuda 7.0 and Cudnn 4 or above. Deep3D: Automatic 2D-to-3D Video Conversion with CNNs How To Run

Download 2d to 3d video converter