Shapecollage: occlusion-aware, example-based shape interpretation

Forrester Cole, Phillip Isola, William T. Freeman, Frédo Durand, and Edward H. Adelson

Abstract

This paper presents an example-based method to interpret a 3D shape from a single image depicting that shape. A major difficulty in applying an example-based approach to shape interpretation is the combinatorial explosion of shape possibilities that occur at occluding contours. Our key technical contribution is a new shape patch repre- sentation and corresponding pairwise compatibility terms that allow for flexible matching of overlapping patches, avoiding the combinatorial ex- plosion by allowing patches to explain only the parts of the image they best fit. We infer the best set of localized shape patches over a graph of keypoints at multiple scales to produce a discontinuous shape represen- tation we term a shape collage. To reconstruct a smooth result, we fit a surface to the collage using the predicted confidence of each shape patch. We demonstrate the method on shapes depicted in line drawing, diffuse and glossy shading, and textured styles.

Information

title:
Shapecollage: occlusion-aware, example-based shape interpretation
author:
Forrester Cole,
Phillip Isola,
William T. Freeman,
Frédo Durand,
and Edward H. Adelson
citation:
ECCV
year:
2012
created:
2012-09-10
keyword:
adelson,
cole,
isola,
freeman,
durand
summary:
shapecollage
pdf:
http://persci.mit.edu/pub_pdfs/shapecollage.pdf
pageid:
shapecollage
type:
publication
 
publications/shapecollage.txt · Last modified: 2013/02/14 10:40 by elmer