As designers, we spend a lot of time crafting our images or graphics, but how much do we really know about how people look at them? Greg Edwards uses eye tracking technology to understand how our eyes move over computer screens.
He helped create the Advanced Eye Interpretation Project at Stanford University, and is the CEO and founder of Eyetools, Inc. in San Francisco. Most of the work that Dr. Edwards currently does at Eyetools is to help clients understand how to make their websites communicate more effectively through a better understanding of viewer behavior.
The eye tracking tools have come a long way since the first pioneering work decades ago (see GJ post on the 1967 Yarbus eye tracking studies).
A typical basic hardware setup (this example from the lab at University of California San Diego) includes a non-invasive head-mounted system. 
With eye tracking technology, scientists can carefully follow the saccades (jumps) and fixations of subject’s eyes as they review text and images on a computer screen. This graphic, sometimes called a scanpath or a gaze trace shows the sequence and position of an individual’s center of attention.
Scientists can also record the gaze behavior of a large group of people to find out what part of the design attracts the eyes the most, creating what’s known as a heatmap. The areas receiving the most attention are indicated in red and yellow. Areas receiving less attention are mapped in blue or dark.The technology can also record the activity of the hands on the keyboard and mouse and correlate it with the gaze data.
Dr. Edwards and his team at Stanford were able to use this information to infer the mental state of the computer user. They called their technology “the eye interpretation engine.”
You can make basic inferences about mental states from this data. There’s a clear difference between “reading,” “scanning,” and “searching,” for example. Another discovery is that people look at banner ads even though they don't click on them.
As Dr. Edwards puts it, “the eye interpretation engine parses eye-position data into higher-level patterns that can then be used to infer a user's mental state or behavior.”
I asked Dr. Edwards if we can we tell from scanpath data if a subject is just looking at the style of a type font rather than reading the text? He replied:
“We can tell if a graphic designer is looking at the style of a type font or reading because the behavior changes -- looking at the font keeps the eyes localized in areas longer than would be natural as they examine the font, or the eye movement wouldn't be consistent since they would be looking at features of the font as the driving factor rather than the text itself. Now, could someone purposefully fool this to behave as if they were reading while they were actually examining the font? Yes, if one consciously did that. Would it occur naturally? No.”
I also wondered if it is possible develop higher levels of inference about the cognitive behavior behind eye behavior, to know not merely where someone is looking, but what they’re thinking when they’re looking at it.
For example, you might look at this woman’s red jacket and think that it doesn’t fit her right, and I might look at the same red coat and wonder where she bought it. At the present time, Dr. Edwards told me, we cannot make such conclusions from the data. The purpose of his original patent work was not to determine what people were thinking, but to determine their mental state and current behavior—are they searching, examining, spacing out—which is different from thinking.
“You can see someone initially checking out the lay of the land of an unfamiliar scene, and you can see when they narrow in to focus on particular areas -- these are behavioral shifts that often happen very quickly and unconsciously -- people are not often able to accurate self report these. You can tell these with the scanpath data. You can't tell how they feel without some other means.”
It seems to me that this would be a very interesting area for future research, especially if eye tracking and keyboard/mouse data were combined with functional MRI (fMRI) data, which shows where activity is localized within the brain in real time.
------------
For more on fMRI data, check out the previous GurneyJourney post on Neuroaesthetics
Eye Interpretation Project, link.
Wikipedia article on eye tracking, link.
Eyetools blog, link.
Thanks to Dr. Edwards.
9 comments:
Very interesting stuff.
Related to this: I've ofen wondered about the truthfulness of the oft cited generality that Americans and (most) Europeans tend to "read" a picture from left to right, as they'd read text, while Asians (and presumably other right-to-left readers do the opposite). I've always been very skeptical of this concept since vision obviously redated reading.
I would like to see how this translates into how a persons eye moves through a painting and how much an artist can truly control that path with how the composition is set up.
Tom and Sour: You both said it! Those questions have been nagging me, too. I've wondered too if the assumptions of compositional theory really hold water. Does the eye enter the picture through the foreground, or follow lines of action, or go to areas of maximum contrast? Does the composition really control the eye? Do we tend to read pictures from left to right in a graphic setting like comics or book illustration, or not at all? I'll let you know if I find out!
Do those studies take peripheral vision into account? I've noticed that when I look at something, my gaze will fix on a certain point while I consider the area around it for several seconds at a time. Maybe I'm looking at a torso and tracking the overall shape of it, but it sure looks like I'm staring at its navel for no reason. This is also how I speed-read: by using peripheral vision to take in more than one line at a time, I don't have to whip my eyes back and forth trying to get to the bottom of the page.
Peripheral vision: saving you from visual whiplash!
As I was scanning this post, I pretended to be reading the text and critically reflecting on the discussed concepts while at the same time pretending to be evaluating the esthetical and graphical aspects of the type font.
But in reality I was just looking at the girl.
Being silly, yes. But then again...
I think 've artiztz' should try to avoid to 'control' the viewer too much.
As a counterweight for this post :
let's just all paint from the heart, the belly and other organs rather than from the mind.
I'm sure the message to the viewer will be equally clear. I dare say, clearer.
(p.s. One of the reasons I love this blog is exactly because it gives so much rational info on artistic subjects, and because it indeed gives me a feeling I will have more 'control' over the viewers response. But sometimes this feels like clinging on to something (rationally) as opposed to 'just relax and we'll see')
Erik, the point I meant to make from all this is that a lot of the rules we learned in art school about composition are mumbo-jumbo, and we don't really understand very well how we look at pictures. So it is still a mystery.
I agree that intuition should be at the helm during the painting process, but intuition is only rational understanding made automatic.
Great post! I wonder, if we really do not understand how composition affects how someone looks at a painting, and many of the rules we follow are simply malarkey, then why do our most famous painters and illustrators showcase such meticulous compositions?
It just seems odd to me, that we very well may be spending all this time trying to control the viewer in vain. Maybe the effect of a good composition is unrelated to how we view it, but powerful nonetheless.
Maybe well never know!
Great Post,
I look forward to reading about the other questions generated here. Certainly as an Illustrator, my goal is to communicate, to tell the story through every available means. Often times we're taught these lessons of value, eye flow, and color, and if this way of tracking vision helps us to understand what works and what doesn't, well, I am all for it. It seems to me only to aid and strengthen that initial intuitive notion of the heart.
Jim, I just have to say that I really enjoy reading your blog. This one had an extra degree of interest because I'm reading quotes that I wrote to you in email, but also because one of the ways I got into eyetracking was due to my own thoughts as a youth regarding composition (mostly for me with photography) and how it effects what people decide to see. Thanks for writing.... it's refreshing.
--Greg Edwards, CEO, Eyetools
Post a Comment