How Our Brain Understands Pictures

How is it possible that we perceive our world in 3D when our eyes only register 2D images? And how do we decide in a millisecond if something in front of us is a bouquet of flowers or a painting? Researchers from Johns Hopkins University think they know how our brain is analyzing pictures. They say that their research "answers the century-old question of the basis of subconscious processes in visual perception." According to the researchers, we're capable to "process visual information automatically and independently of what we know, think or expect." This research might lead to future treatments of human brain disorders. Read more.

Here is the introduction of the Johns Hopkins University news release.

The figure is famous: a deceptively simple line drawing that at first glance resembles a vase and, at the next, a pair of human faces in profile. When you look at this figure, your brain must rapidly decide what the various lines denote. Are they the outlines of the vase or the borders of two faces? How does your brain decide?

Below is an illustration describing the problem of interpreting 2D images in terms of objects in a 3D world (Credit: Johns Hopkins University).

Images are composed of regions that correspond to objects in space (A). The boundaries of these regions are generally the contours of objects that occlude more distant parts of the scene (occluding contours). To interpret images successfully, the visual system has to detect these contours and link them to the occluding regions. (B) The light textured region is generally perceived as a tilted square on a dark background, and the light-dark border as the contour of the square. But the display is ambiguous: the square could be a window. (C) The concept of border ownership. The interpretation of a 2D display depends on how the contrast borders are assigned (top). Consider the border marked by a black dot: if the border is assigned left, the square is an object in front of a dark background; if the border is assigned right, the square becomes a piece of background that is seen through a window. Given flat displays without depth cues, the visual system assumes the object interpretation.

The above image and legend come from a paper recently published by Neuron, "Figure and Ground in the Visual Cortex: V2 Combines Stereoscopic Cues with Gestalt Rules." Here is a link to the full paper (PDF format, 12 pages, 323 KB).

There is but one Paris and however hard living may be here, and if it became worse and harder even—the French air clears up the brain and does good—a world of good.
—Vincent Van Gogh (1853–1890)

Now, let's return to the original news release for more explanations.

"Our paper answers the century-old question of the basis of subconscious processes in visual perception, specifically, the phenomenon of figure-ground organization," said Rudiger von der Heydt, a professor in the Zanvyl Krieger Mind/Brain Institute.

The report, based on recordings of nerve cells in the visual cortex of macaque monkeys, suggests that this automatic processing of images is repeated each time an individual looks at something new, usually three to four times per second. What's more, the brain provides what von der Heydt calls "a sophisticated program" to select and process the information that is relevant at any given moment.

But the researchers recognize that there are still lots of work to do before treating human brain disorders. Their current research needs to be "complemented by new brain imaging techniques, traditional psychophysics, psychology and computational and theoretical neuroscience."

Sources: Johns Hopkins University news release, August 9, 2005; and various web sites

Related stories can be found in the following categories.

I am willing, for a money consideration, to test this physical strength, this nervous force, and muscular power with which I’ve been gifted, to show that they will bear a certain strain. If I break down, if my brain gives way under want of sleep, my heart ceases to respond to the calls made on my circulatory system, or the surcharged veins of my extremities burst—if, in short, I fall helpless, or it may be, dead on the track, then I lose my money.
—Ada Anderson (1860–?)

Medicine

Psychology

Science

Vision and Visualization Apps

And remember that comments are no longer accepted here because of a vandal. If you want to tell me something about this post, please go to the bottom right of this page and send me an e-mail.



Brain Info ...

Brain Power: What Alzheimer's Disease Does To The Brain ... During this time, proteins build up and create the telltale tangles and plaques within the entorhinal cortex of the brain... This is the part, which is essential to the memory; retrieving past memories and thoughts, as well as processing new information and memories within the brain...

The Best Toys To Stimulate The Brain ... They appear to be strictly about fun when in fact they stimulate the brain and help it develop and grow...

Developing Your Baby's Brain ... Have you ever wondered why toys for babies tend to have so many bells, whistles and lights? Or why they have so many different textures, and materials and colors? It's almost as if we want to provide young babies with a whole world of stimulation and we can't quite get it to them fast enough.. ...

Brain Food For Baby ... This article shows you the brain food that can make your child smarter Brain development is affected greatly by a baby's nutrition intake... Children who are malnourished will resulted an inadequate brain growth that showing lower IQ, slower language and fine moter development...

Computers Mimicking The Brain ... This computer model has been built in Tomaso Poggio's laboratory at the McGovern Institute. Poggio also is co-director of the Center for Biological & Computational Learning (CBCL) at MIT where he worked with Thomas Serre...

Need A Great Idea? Feed Your Brain ... A lot of great ideas happen when two or more other ideas collide to form something completely new. Think of this like those old chemistry movies we used to watch in school...

Our Brains Cheat During Learning ... For example, when learning skills such as arithmetic, the brain doesn't necessarily reach back into its basic calculating skills for each problem, suggested the researchers who made the finding... Rather, the brain builds a repertoire of rote responses to frequently encountered problems that it can use to save time and effort, they said... Put anatomically, the new experiments suggest the human brain might rapidly circumvent deliberative processing in higher brain regions, called the cortex, as it learns to respond appropriately and automatically to stimuli such as repeated tasks....


Visual Info ...

Dancing Online: How To Use Visual Chats For More Effective Online Dating ... He had met her in a grocery store checkout line, and they'd immediately hit it off. so well, in fact that he'd suggested a "get acquainted" date at Starbucks...

Document Cameras - An Effective Pedagogical Resource For Educating Younger Generations ... Also referred as Visual Presenters, they can be easily connected to computer, projector or an interactive screen...

Wearable Eyetracking And Visual Perception Research ... First, here is the introduction of the RIT news release. How do we use our eyes to perceive the world? Could eye movements be windows into human cognition?...

Add Value To Your House By Creating Visual Space ... Visual space makes your home appear larger by allowing the buyer's eye to move from one side of the room to the other without interruption, giving the illusion of more space and openness...

Artists Biographies On Film Top Movies About Visual Artists ... Here you can read about some of the most interesting movies about visual artists biographies. Lust for Life directed by Vincente Minnelli in 1952...

The Secret Of Our Stable Vision ... Before going further, below is an illustration showing how we maintain our visual stability across saccades... "When we scan a visual scene with quick eye movements known as saccades (top), the retinas send a series of 'snapshot' images to the brain that must be integrated properly." (Credit: Marc Sommer/Robert Wurtz)...

Virtual Robots Fooled By Visual Illusions ... You can see above one of the visual illusions featured on the Web site of the lead researcher for this project...

Visual Art Sells: How To Select Fine Art Media For Reproductions ... The artist creates the most visually appealing rendition of their art possible so consumers will be drawn to it, the publisher prints the best possible catalogue to increase exposure and prestige; framer matches the art with a frame that becomes an visual extension of the painting, and the printmaker produces the most vibrant, accurate, and sellable print possible through equipment selection, experience, and talent... While each of these players is involved in the overall sell-ability of art, the purpose of this article is to focus on the printmaker and his/her influence on the visual appeal of a fine art reproduction... Uncontrollable variables are also a key contributing factor in creating the visual appeal and sale-ability of an art reproduction...

Helping Many People Become Wireless With Audio Visual ... Sometimes when you're trying to find better information on audio visual, you'll find it's complex separating quality information from inexpert audio visual submissions and support so it's prudent to know ways of moderating the information presented to you....


Square Info ...

A Real Dog Fight: Renters & Landlords Square Off On Pet Policies ... Several residents of Emerald Terrace have been served with papers ordering them to get rid of their pets, or face eviction. The deadline for these tenants has passed and eviction notices have been sent, but residents are fighting back by taking the management company to court...

Bicycle Riding On Square Wheels ... Stan Wagon, a mathematician at Macalester College in St. Paul, Minn., has a bicycle with square wheels...

The Cyber Public Square ... If you're not my client, please continue on as you always have, there is no joy like the joy of incriminating a party opponent with pictures and posts they themselves put out there in the public domain; nothing. If you're not the soul of discretion twenty four seven, (and c'mon people, who is?), there is potentially damaging evidence out there on the internet about you that you created and you posted....

The Hotel At Times Square Photos ... The Hotel At Times Square Photos Norwich, the county town and Norfolk's only city, is a fantastic shopping destination, featuring large pedestrianised areas, modern shopping precincts, quirky indie shops as well as a 190-stall Monday-to-Saturday open market, which can trace its roots back to Saxon times and is the largest six-day-a-week open air market in England....