Wednesday, January 9, 2019 - 1:00pm
Location:6002 Gates Hillman Centers
Speaker:SAI PRAVEEN BANGARU, Masters Student https://www.linkedin.com/in/saipraveen-bangaru-2ba085a0
Radiometric methods for the extraction of shape from images, such as photometric stereo, make simplifying assumptions about the light transport effects underlying those image. Among the most common assumptions are absence of interreflections and Lambertian reflectance. This makes radiometric shape reconstruction techniques unsuitable for many classes of common objects, including those with glossy surfaces or concave shapes. Our goal is to construct an inverse rendering framework that can be used to reconstruct shape and reflectance properties without these assumptions. Towards this goal, we develop a versatile, shape-differentiable, Monte Carlo renderer, which can efficiently estimate the differentials of image intensity values with respect to BSDF and local shape parameters. We combine this differentiable renderer with stochastic optimization and surface reconstruction algorithms, to develop a pipeline that estimates a 3D mesh that best explains captured image measurements. We evaluate this pipeline in experiments using both simulated and captured image datasets, and show that it can accurately reconstruct complex reflectance and shape even in the presence of strong global illumination. Finally, we discuss future extensions towards enabling the application of our inverse rendering framework to measurements from a large variety of 3D sensing systems.
Ioannis Gkioulekas (Chair)