Band-Sifting Decomposition for Image-Based Material Editing.

I Boyadzhiev, K Bala, S Paris, E Adelson


Abstract

Photographers often “prep” their subjects to achieve various effects; for example, toning down overly shiny skin, covering blotches, etc. Making such adjustments digitally, after a shoot, is possible but difficult without good tools and good skills. Making such adjustments to video footage is harder still. We describe and study a set of 2D image operations, based on multi-scale image analysis, that are easy and straightforward, and that can consistently modify perceived material properties. These operators first build a subband decomposition of the image and then selectively modify the coefficients within the subbands. We call this selection process band sifting.

We show that different siftings of the coefficients can be used to modify the appearance of properties such as gloss, smoothness, pigmentation, or weathering. The band-sifting operators have particularly striking effects when applied to faces; they can provide “knobs” to make a face look wetter or drier, younger or older, and with heavy or light variation in pigmentation. Through user studies, we identify a set of operators that yield consistent subjective effects for a variety of materials and scenes. We demonstrate that these operators are also useful for processing video sequences.

Information

title:
Band-Sifting Decomposition for Image-Based Material Editing.
author:
I Boyadzhiev,
K Bala,
S Paris,
E Adelson
citation:
ACM Transactions on Graphics (TOG) 34 (5), 163
shortcite:
ACM Transactions on Graphics (TOG) 34 (5), 163
year:
2015
created:
2015-01-01
keyword:
adelson
www:
http://persci.mit.edu/pub_abstracts/band-sifting-decomposition.html
pdf:
http://persci.mit.edu/pub_pdfs/band-sifting-decomposition.pdf
pageid:
band-sifting-decomposition
type:
publication