Feedforward, lateral, feedback interactions in visual information processing

Psy8036
or
Psy 8993 -024 (course number: 56125)

University of Minnesota, Spring Semester, 2007
http://courses.kersten.org

Instructors:
Dan Kersten (kersten@umn.edu)
Sheng He (sheng@umn.edu)

Meeting time : 3:45 to 5:15 pm Tuesdays
Place: Elliott 204

There is no dispute that visual information processing involves both feedforward and feedback processes. A full understanding of the neural basis of perception has to include the elucidation of structure and functional properties of both the feedforward and feedback pathways. However, the roles played by feedforward and feedback processing remain largely unclear.  In this seminar, we will review papers and discuss studies that more explicitly address the separate functions of the feedforward and feedback pathways as well as their interactions.

Format: Discussion of journal articles led by seminar members, term paper or term project on a related topic.

Reading List

(updated each week)

Overview:

Anatomy and Physiology:

(Angelucci & Sainsbury, 2006)
(Smith, Bair, & Movshon, 2006)
(Dong, Wang, Valkova, Gonchar, & Burkhalter, 2004)
(Lamme, Zipser, & Spekreijse, 2002)
(Bruno & Simons, 2002)
(Alonso, 2002)
(Super, Spekreijse, & Lamme, 2001)
(Gilbert, Ito, Kapadia, & Westheimer, 2000)
(Spillmann, 1999)
(Hupe et al., 1998)
(Zipser, Lamme, & Schiller, 1996)  

Psychophysics:

Neuroimaging:

Models/Computation:

Neuropsychology:

(Rolls & Stringer, 2006)
(Kemner, Lamme, Kovacs, & van Engeland, 2006)
(Schenk, Schindler, McIntosh, & Milner, 2005)
(Deco & Rolls, 2005)
(Deco & Rolls, 2004)
(Ptak, Valenza, & Schnider, 2002)
(Lamme, 2001)
(Panzeri, Rolls, Battaglia, & Lavis, 2001)

  Master Reading list (tentative)

  Ahissar, M., & Hochstein, S. (2004). The reverse hierarchy theory of visual perceptual learning. Trends Cogn Sci, 8(10), 457-464.

Alonso, J. M. (2002). Neural connections and receptive field properties in the primary visual cortex. Neuroscientist, 8(5), 443-456.

Angelucci, A., Levitt, J.B., Walton, E.J., Hupe, J.M., Bullier, J., & Lund, J.S. (2002). Circuits for local and global signal integration in primary visual cortex. J Neurosci, 22 (19), 8633-8646.

Angelucci, A., & Sainsbury, K. (2006). Contribution of feedforward thalamic afferents and corticogeniculate feedback to the spatial summation area of macaque V1 and LGN. J Comp Neurol, 498(3), 330-351.

Bar, M. (2004). Visual objects in context. Nat Rev Neurosci, 5(8), 617-629.

Bar, M., & Aminoff, E. (2003). Cortical analysis of visual context. Neuron, 38(2), 347-358.

Bar, M., Kassam, K. S., Ghuman, A. S., Boshyan, J., Schmid, A. M., Dale, A. M., et al. (2006). Top-down facilitation of visual recognition. Proc Natl Acad Sci U S A, 103(2), 449-454.

Brandt, T., Deutschlander, A., Glasauer, S., Nolte, A., Bruckmann, H., Dieterich, M., et al. (2005). Expectation of sensory stimulation modulates brain activation during visual motion stimulation. Ann N Y Acad Sci, 1039, 325-336.

Bruno, R. M., & Simons, D. J. (2002). Feedforward mechanisms of excitatory and inhibitory cortical receptive fields. J Neurosci, 22(24), 10966-10975.

Bullier, J. (2001). Integrated model of visual processing. Brain Res Brain Res Rev, 36 (2-3), 96-107.

Carpenter, G., & Grossberg, S. (1995). Adaptive resonance theory (ART). In M. Arbib (Ed.), Handbook of Brain Theory and Neural Networks (pp. 79--82): MIT Press.

Cass, J. R., & Spehar, B. (2005). Dynamics of cross- and iso-surround facilitation suggest distinct mechanisms. Vision Res, 45(24), 3060-3073.

Compte, A., & Wang, X. J. (2006). Tuning curve shift by attention modulation in cortical neurons: a computational study of its mechanisms. Cereb Cortex, 16(6), 761-778.

Deco, G., & Rolls, E. T. (2004). A neurodynamical cortical model of visual attention and invariant object recognition. Vision Res, 44(6), 621-642.

Deco, G., & Rolls, E. T. (2005). Neurodynamics of biased competition and cooperation for attention: a model with spiking neurons. J Neurophysiol, 94(1), 295-313.

Dohle, C., Kleiser, R., Seitz, R. J., & Freund, H. J. (2004). Body scheme gates visual processing. J Neurophysiol, 91(5), 2376-2379.

Dong, H., Wang, Q., Valkova, K., Gonchar, Y., & Burkhalter, A. (2004). Experience-dependent development of feedforward and feedback circuits between lower and higher areas of mouse visual cortex. Vision Res, 44(28), 3389-3400.

Fahle, M. (2004). Perceptual learning: a case for early selection. J Vis, 4(10), 879-890.

Fang, F., & He, S. (2005). Cortical responses to invisible objects in the human dorsal and ventral pathways. Nat Neurosci, 8(10), 1380-1385.

Friston, K. (2003). Learning and inference in the brain. Neural Netw, 16(9), 1325-1352.

Friston, K. (2005). A theory of cortical responses. Philos Trans R Soc Lond B Biol Sci, 360(1456), 815-836.

Frith, C., & Dolan, R. J. (1997). Brain mechanisms associated with top-down processes in perception. Philosophical Transactions of the Royal Society B, 352(1358), 1221-1230.

Gilbert, C., Ito, M., Kapadia, M., & Westheimer, G. (2000). Interactions between attention, context and learning in primary visual cortex. Vision Res, 40(10-12), 1217-1226.

Handy, T. C., Grafton, S. T., Shroff, N. M., Ketay, S., & Gazzaniga, M. S. (2003). Graspable objects grab attention when the potential for action is recognized. Nat Neurosci, 6(4), 421-427.

Hochstein, S., & Ahissar, M. (2002). View from the top: hierarchies and reverse hierarchies in the visual system. Neuron, 36 (5), 791-804.

Hupe, J. M., James, A. C., Payne, B. R., Lomber, S. G., Girard, P., & Bullier, J. (1998). Cortical feedback improves discrimination between figure and background by V1, V2 and V3 neurons. Nature, 394(6695), 784-787.

Jehee, J.F., Rothkopf, C., Beck, J.M., & Ballard, D.H. (2006). Learning receptive fields using predictive feedback. J Physiol Paris, 100 (1-3), 125-132.

Jiang, Y., & He, S. (2006). Cortical responses to invisible faces: dissociating subsystems for facial-information processing. Curr Biol, 16(20), 2023-2029.

Juan, C. H., Campana, G., & Walsh, V. (2004). Cortical interactions in vision and awareness: hierarchies in reverse. Prog Brain Res, 144, 117-130.

Kemner, C., Lamme, V. A., Kovacs, I., & van Engeland, H. (2006). Integrity of lateral and feedbackward connections in visual processing in children with pervasive developmental disorder. Neuropsychologia.

Lamme, V. A. (2001). Blindsight: the role of feedforward and feedback corticocortical connections. Acta Psychol (Amst), 107(1-3), 209-228.

Lamme, V. A., & Roelfsema, P. R. (2000). The distinct modes of vision offered by feedforward and recurrent processing. Trends Neurosci, 23(11), 571-579.

Lamme, V. A., Super, H., & Spekreijse, H. (1998). Feedforward, horizontal, and feedback processing in the visual cortex. Curr Opin Neurobiol, 8(4), 529-535.

Lamme, V. A., Zipser, K., & Spekreijse, H. (2002). Masking interrupts figure-ground signals in V1. J Cogn Neurosci, 14(7), 1044-1053.

Lee, T. S., & Mumford, D. (2003). Hierarchical Bayesian inference in the visual cortex. J Opt Soc Am A Opt Image Sci Vis, 20(7), 1434-1448.

Lee, T.S., & Yuille, A.L. (2007). Efficient coding of visual scenes by grouping and segmentation: Theoretical predictions and biological evidence. In: K. Doya, S. Ishii, A. Pouget, & R.P.N. Rao (Eds.), Bayesian Brain: Probabilistic Approaches to Neural Coding.

Macaluso, E., Frith, C. D., & Driver, J. (2000). Modulation of human visual cortex by crossmodal spatial attention. Science, 289(5482), 1206-1208.

MacKay, D. M. (1956). Towards an information-flow model of human behavior. British Journal of Psychology, 47, 30-43.

Muckli, L., Kohler, A., Kriegeskorte, N., & Singer, W. (2005). Primary visual cortex activity along the apparent-motion trace reflects illusory perception. PLoS Biol, 3(8), e265.

Murray, S. O., Kersten, D., Olshausen, B. A., Schrater, P., & Woods, D. L. (2002). Shape perception reduces activity in human primary visual cortex. Proc Natl Acad Sci U S A, 99(23), 15164-15169.

Murray, S.O., Boyaci, H., & Kersten, D. (2006). The representation of perceived angular size in human primary visual cortex. Nat Neurosci, 9 (3), 429-434.

Noesselt, T., Hillyard, S. A., Woldorff, M. G., Schoenfeld, A., Hagner, T., Jancke, L., et al. (2002). Delayed striate cortical activation during spatial attention. Neuron, 35(3), 575-587.

Panzeri, S., Rolls, E. T., Battaglia, F., & Lavis, R. (2001). Speed of feedforward and recurrent processing in multilayer networks of integrate-and-fire neurons. Network, 12(4), 423-440.

Pascual-Leone, A., & Walsh, V. (2001). Fast backprojections from the motion to the primary visual area necessary for visual awareness. Science, 292(5516), 510-512.

Ptak, R., Valenza, N., & Schnider, A. (2002). Expectation-based attentional modulation of visual extinction in spatial neglect. Neuropsychologia, 40(13), 2199-2205.

Rajimehr, R. (2004). Unconscious orientation processing. Neuron, 41(4), 663-673.

Ramsden, B. M., Hung, C. P., & Roe, A. W. (2001). Real and illusory contour processing in area V1 of the primate: a cortical balancing act. Cereb Cortex, 11(7), 648-665.

Ro, T., Breitmeyer, B., Burton, P., Singhal, N. S., & Lane, D. (2003). Feedback contributions to visual awareness in human occipital cortex. Curr Biol, 13(12), 1038-1041.

Roelfsema, P. R. (2006). Cortical algorithms for perceptual grouping. Annu Rev Neurosci, 29, 203-227.

Roelfsema, P. R., Lamme, V. A., & Spekreijse, H. (2000). The implementation of visual routines. Vision Res, 40(10-12), 1385-1411.

Roelfsema, P. R., Lamme, V. A., Spekreijse, H., & Bosch, H. (2002). Figure-ground segregation in a recurrent network architecture. J Cogn Neurosci, 14(4), 525-537.

Rolls, E. T., & Stringer, S. M. (2006). Invariant visual object recognition: A model, with lighting invariance. J Physiol Paris, 100(1-3), 43-62.

Rose, D., Bradshaw, M. F., & Hibbard, P. B. (2003). Attention affects the stereoscopic depth aftereffect. Perception, 32(5), 635-640.

Sasaki, Y., & Watanabe, T. (2004). The primary visual cortex fills in color. Proc Natl Acad Sci U S A, 101(52), 18251-18256.

Schenk, T., Schindler, I., McIntosh, R. D., & Milner, A. D. (2005). The use of visual feedback is independent of visual awareness: evidence from visual extinction. Exp Brain Res, 167(1), 95-102.

Smith, M. A., Bair, W., & Movshon, J. A. (2006). Dynamics of suppression in macaque primary visual cortex. J Neurosci, 26(18), 4826-4834.

Spillmann, L. (1999). From elements to perception: local and global processing in visual neurons. Perception, 28(12), 1461-1492.

Spratling, M. W., & Johnson, M. H. (2004). A feedback model of visual attention. J Cogn Neurosci, 16(2), 219-237.

Sterzer, P., Haynes, J. D., & Rees, G. (2006). Primary visual cortex activation on the path of apparent motion is mediated by feedback from hMT+/V5. Neuroimage, 32(3), 1308-1316.

Summerfield, C., Egner, T., Greene, M., Koechlin, E., Mangels, J., & Hirsch, J. (2006). Predictive codes for forthcoming perception in the frontal cortex. Science, 314(5803), 1311-1314.

Super, H., Spekreijse, H., & Lamme, V. A. (2001). Two distinct modes of sensory processing observed in monkey primary visual cortex (V1). Nat Neurosci, 4(3), 304-310.

Taylor-Clarke, M., Kennett, S., & Haggard, P. (2002). Vision modulates somatosensory cortical processing. Curr Biol, 12(3), 233-236.

Torralba, A., Oliva, A., Castelhano, M.S., & Henderson, J.M. (2006). Contextual guidance of eye movements and attention in real-world scenes: the role of global features in object search. Psychol Rev, 113 (4), 766-786.

Watanabe, T., Nanez, J. E., & Sasaki, Y. (2001). Perceptual learning without perception. Nature, 413(6858), 844-848.

Wilson, H. R. (2003). Computational evidence for a rivalry hierarchy in vision. Proc Natl Acad Sci U S A, 100(24), 14499-14503.

Zipser, K., Lamme, V. A., & Schiller, P. H. (1996). Contextual modulation in primary visual cortex. J Neurosci, 16(22), 7376-7389.

Yuille, A., & Kersten, D. (2006). Vision as Bayesian inference: analysis by synthesis? Trends Cogn Sci, 10(7), 301-308.