People / Faculty
Ruth Rosenholtz, Ph.D.
Principle Research Scientist of Visual Cognition
Human vision and its applications
We study human vision, including such topics as visual search, peripheral vision, perceptual organization, set perception, and the impact of visual clutter on task performance. We take a three-pronged approach: 1) Computational modeling (computer vision-based, ideal observers, Monte Carlo simulations, and neurobiologically-inspired); 2) Behavioral experiments; and 3) Applying our models and understanding of human vision to applications such as image compression, design of user interfaces, and design of information visualizations.
How do we decide where to look next in an image? How do we interpret the visual input as composed of meaningful parts and objects? A repeated theme in the work of the lab is that of the visual system as statistician: The visual system represents the visual input via noisy and uncertain feature estimates, and in many cases computes summary statistics such as the mean and variance of those features. Based upon these "descriptive statistics," the visual system makes intelligent inferences about the world, and participates in intelligently planning what actions to take.
Models of this form have proven quite powerful in predicting behavior at visual tasks, such as visual search and image segmentation. Our more recent work suggests that the visual system may represent peripheral stimuli not through the exact configuration of their parts, but rather through the joint statistics of responses of V1-like receptive fields. This model of the information available in peripheral vision shows promise at being able to predict a wide variety of visual phenomena, from time to find a target in a complex display through the perception of optical illusions.
Balas B, Nakano L, Rosenholtz R. A summary-statistic representation in
peripheral vision explains visual crowding. J Vis. 2009 Nov 19;9(12):13.1-18.
Rosenholtz R, Li Y, Nakano L. Measuring visual clutter. J Vis. 2007 Aug
Hindi Attar C, Hamburger K, Rosenholtz R, G ötzl H, Spillmann L. Uniform versus
random orientation in fading and filling-in. Vision Res. 2007 Nov;47(24):3041-51.
Rosenholtz R, Nagy AL, Bell NR. The effect of background color on asymmetries in color search. J Vis. 2004 Mar 31;4(3):224-40.