Visual wetness perception based on image color statistics

Masataka Sawayama, Edward H Adelson, Shin'ya Nishida


Abstract

Color vision provides humans and animals with the abilities to discriminate colors based on the wavelength composition of light and to determine the location and identity of objects of interest in cluttered scenes (e.g., ripe fruit among foliage). However, we argue that color vision can inform us about much more than color alone. Since a trichromatic image carries more information about the optical properties of a scene than a monochromatic image does, color can help us recognize complex material qualities. Here we show that human vision uses color statistics of an image for the perception of an ecologically important surface condition (i.e., wetness). Psychophysical experiments showed that overall enhancement of chromatic saturation, combined with a luminance tone change that increases the darkness and glossiness of the image, tended to make dry scenes look wetter. Theoretical analysis along with image analysis of real objects indicated that our image transformation, which we call the wetness enhancing transformation, is consistent with actual optical changes produced by surface wetting. Furthermore, we found that the wetness enhancing transformation operator was more effective for the images with many colors (large hue entropy) than for those with few colors (small hue entropy). The hue entropy may be used to separate surface wetness from other surface states having similar optical properties. While surface wetness and surface color might seem to be independent, there are higher order color statistics that can influence wetness judgments, in accord with the ecological statistics. The present findings indicate that the visual system uses color image statistics in an elegant way to help estimate the complex physical status of a scene.

Information

title:
Visual wetness perception based on image color statistics
author:
Masataka Sawayama,
Edward H Adelson,
Shin'ya Nishida
citation:
Journal of Vision June 2017, Vol.17, 7. doi:10.1167/17.5.7
shortcite:
JOV 2017
year:
2017
created:
2017-06-01
keyword:
adelson
www:
http://persci.mit.edu/pub_abstracts/visual-wetness-perception-based-on-image-color-statistics.html
pdf:
http://jov.arvojournals.org/article.aspx?articleid=2627514
pageid:
visual-wetness-perception-based-on-image-color-statistics
type:
publication