Reconstructing and registering 3d surface from single intensity image

Аннотация

Reconstructing 3D surface from of an intensity image is a fundamental problem in the computer-vision community. Humans have a remarkable ability to perceive shape of an object when looking at a 2D intensity image, but enabling computers to do so is still a very challenging task. Advances in this area can help us solve problem of building panoramic 3D view by registering multiple surfaces. It has many useful applications such as medical surgery using CT/MRI scans, restoring ancient artifacts using single image, path/arm guiding algorithms for robots, etc. Most existing methods in this area belong to the category of Shape from Shading. Such methods have shown limited success recovering simple shapes, such as a vase. However, due to inherent ambiguity associated with relating intensity to depth, existing methods have not been able to demonstrate similar success for complex surfaces. Improved methods use additional information, such as stereo images like Structure from Motion, or multiple light sources like Photometric Stereo. Such methods have two broad issues. Firstly, inherent problem from Lambertian reflectance model is not solved and therefore, secondly, they could not provide insights regarding the human ability to perceive depth from 2D images.