Summary:
The processing of (object) information in working memory has been intensively investigated in the visual modality (i.e. D’Esposito, 2007; Ranganath, 2006). In comparison, research on kinesthetic/haptic or crossmodal processing in working memory is still sparse. During recognition and comparison of object information across modalities, representations built from one sensory modality have to be matched with representations obtained from other senses. In the present thesis, the questions how object information is represented in unimodal and crossmodal working memory, which processes enable unimodal and crossmodal comparisons, and which neuronal correlates are associated with these processes were addressed. In particular, unimodal and crossmodal processing of visually and kinesthetically perceived object features were systematically investigated in distinct working memory phases of encoding, maintenance, and recognition. At this, the kinesthetic modality refers to the sensory perception of movement direction and spatial position, e.g. of one’s own hand, and is part of the haptic sense. Overall, the results of the present thesis suggest that modality-specific representations and modality-specific processes play a role during unimodal and crossmodal processing of object features in working memory.
Bibliographie / References
- Fiehler, K., & Seemüller, A. (2008). Multisensorische Integration. In P. Khader et al. (Eds.), Beiträge zur 50. Tagung experimentell arbeitender Psychologen, Lengerich: Pabst, p.67. (Symposium)
- Hummel, F., Gerloff, C., 2005. Larger interregional synchrony is associated with greater behavioral success in a complex sensory integration task in humans. Cereb Cortex 15, 670–678.
- McClelland, J.L., McNaughton, B.L., O'Reilly, R.C., 1995. Why there are complementary learning systems in the hippocampus and neocortex: Insights from the successes and failures of connectionist models of learning and memory. Psychol Rev 102, 419-457.
- Singer, W., Gray, C.M., 1995. Visual feature integration and the temporal correlation hypothesis. Annu Rev Neurosci 18, 555–586.
- Hadjikhani, N., Roland, P.E., 1998. Cross-modal transfer of information between the tactile and the visual representations in the human brain: a positron emission tomographic study. J Neurosci 18, 1072–1084.
- Seemüller, A., Fiehler, F., Rösler, F., 2010. Unimodal and crossmodal working memory representations of visual and kinesthetic movement trajectories. Acta Psychologica doi:10.1016/j.actpsy.2010.09.014
- Gallace, A., Spence, C., 2009. The cognitive and neural correlates of tactile memory. Psychol Bull 135, 380–406.
- Mima, T., Sadato, N., Yazawa, S., Hanakawa, T., Fukuyama, H., Yonekura, Y., Shibasaki, H., 1999. Brain structures related to active and passive finger movements in man. Brain 122, 1989–1997.
- Calvert, G.A., 2001. Crossmodal processing in the human brain: insights from functional neuroimaging studies. Cereb Cortex 11, 1110–1123.
- Gevins, A., Smith, M.E., McEvoy, L., Yu, D., 1997. High-resolution EEG mapping of cortical activation related to working memory: effects of task difficulty, type of processing, and practice. Cereb Cortex 7, 374–385.
- von Stein, A., Rappelsberger, P., Sarnthein, J., Petsche, H., 1999. Synchronization between temporal and parietal cortex during multimodal object processing in man. Cereb Cortex 9, 137–150.
- Siegel, M., Donner, T.H., Oostenveld, R., Fries, P., Engel, A.K., 2008. Neuronal synchronization along the dorsal visual pathway reflects the focus of spatial attention. Neuron 60, 709–719.
- Grefkes, C., Weiss, P.H., Zilles, K., Fink, G.R., 2002. Crossmodal processing of object features in human anterior intraparietal cortex: an fMRI study implies equivalencies between humans and monkeys. Neuron 35, 173–184.
- Rizzolatti, G., Matelli, M., 2003. Two different streams form the dorsal visual system: anatomy and functions. Exp Brain Res 153, 146–157.
- Hennighausen, E., Heil, M., Rösler, F., 1993. A correction method for DC drift artifacts. Electroencephalogr Clin Neurophysiol 86, 199–204.
- Worden, M.S., Foxe, J.J., Wang, N., Simpson, G.V., 2000. Anticipatory biasing of visuospatial attention indexed by retinotopically specific α-band electroencephalography increases over occipital cortex. J Neurosci 20, 1–6.
- Vertretungen des Seminars " Ausgewählte Themen der Biologischen Psychologie " von Prof. Dr. Rösler: " Sehen II " und " Großhirnrinde I " SS 2008, SS 2009 Betreuung der praktischen Übung " Einführung in die Methoden der SS 2010 kognitiven Neurowissenschaften " : EEG-Aufzeichnung mit Katja Fiehler Curriculum Vitae __________________________________________________________________________________________________________________ 2
- SS 2008, SS 2009, Betreuung der praktischen Übung " Einführung in die Methoden der SS 2010 kognitiven Neurowissenschaften " : EEG-Auswertung mit Katja Fiehler März 2009 Mitorganisation des EEG-Praktikums der AG Kognitive Psychophysiologie für das Graduiertenkolleg " NeuroAct " WS 2009/2010
- Weiller, C., Jüptner, M., Fellows, S., Rijntjes, M., Leonhardt, G., Kiebel, S., Müller, S., Diener, H.C., Thilmann, A.F., 1996. Brain representation of active and passive movements. Neuroimage 4, 105–110.
- Homan, R.W., Herman, J., Purdy, P., 1987. Cerebral location of international 10-20 system electrode placement. Electroencephalogr Clin Neurophysiol 66, 376–382.
- Singer, W., 1994. Coherence as an organizing principle of cortical functions. Int Rev Neurobiol 37, 153–183.
- Andres, F.G., Gerloff, C., 1999. Coherence of sequential movements and motor learning. J Clin Neurophysiol 16, 520–527.
- Fein, G., Raz, J., Brown, F.F., Merrin, E.L., 1988. Common reference coherence data are confounded by power and phase effects. Electroencephalogr Clin Neurophysiol 69, 581–584.
- Senkowski, D., Schneider, T.R., Foxe, J.J., Engel, A.K., 2008. Crossmodal binding through neural coherence: implications for multisensory processing. Trends Neurosci 31, 401– 409.
- Seemüller, A., Fiehler, K., & Rösler, F. (2008). Crossmodal discrimination of object shape.
- International Multisensory Research Forum, Hamburg, Germany. (Poster) Seemüller, A., Fiehler, K., Rösler, F. (2009). Crossmodal short-term memory representation of visual and kinesthetic information. 10 th International Multisensory Research Forum (IMRF), New York, USA. (Poster)
- Andrew, C., Pfurtscheller, G., 1996. Dependence of coherence measurements on EEG derivation type. Med Biol Eng Comput 34, 232–238.
- Kuś, R., Kamiński, M., Blinowska, K.J., 2004. Determination of EEG activity propagation: pair-wise versus multichannel estimate. IEEE Trans Biomed Eng 51, 1501–1510.
- von Stein, A., Sarnthein, J., 2000. Different frequencies for different scales of cortical integration: from local gamma to long range alpha theta synchronization. Int J Psychophysiol 38, 301–313.
- Vertretung des Seminars " Lernen und Exekutivfunktionen " von Prof. Dr. Rösler: " Dopamin beim Menschen I: Temporal difference model " Publikationen Khader, P., Ranganath, C., Seemüller, A., & Rösler, F. (2007). Working-Memory Maintenance Contributes to Long-Term Memory Formation: Evidence from Slow Event- Related Brain Potentials. Cognitive, Affective, and Behavioral Neuroscience, 7(3), 212–224.
- Engel, A.K., Fries, P., Singer, W., 2001. Dynamic predictions: oscillations and synchrony in top-down processing. Nat Rev Neurosci 2, 704–716.
- Klimesch, W., Sauseng, P., Hanslmayr, S., 2007. EEG alpha oscillations: the inhibition- timing hypothesis. Brain Res Rev 53, 63–88.
- Essl, M., Rappelsberger, P., 1998. EEG coherence and reference signals: experimental results and mathematical explanations. Med Biol Eng Comput 36, 399–406.
- Nunez, P.L., Srinivasan, R., Westdorp, A.F., Wijesinghe, R.S., Tucker, D.M., Silberstein, R.B., Cadusch, P.J., 1997. EEG coherency I: statistics, reference electrode, volume conduction, Laplacians, cortical imaging, and interpretation at multiple scales. Electroencephalogr and Clin Neurophysiol 103, 499–515.
- Seemüller, A., & Rösler, F. (submitted). EEG-power and -coherence changes in a crossmodal working memory task with visual and kinesthetic stimuli. International Journal of Psychophysiology Peer-reviewed Abstracts/Vorträge Seemüller, A., Khader, P., Ranganath, C., & Rösler, F. (2006). Aufrechterhaltung im Arbeitsgedächtnis trägt zur Speicherung im Langzeitgedächtnis bei: Eine EEG-Studie. In H.
- Nunez, P.L., Srinivasan, R., 2006. Electric fields of the brain. The neurophysics of EEG. New York: Oxford UP.
- Plewnia, C., Rilk, A.J., Soekadar, S.R., Arfeller, C., Huber, H.S., Sauseng, P., Hummel, F., Gerloff, C., 2008. Enhancement of lang-range EEG coherence by synchronous bifocal transcranial magnetic stimulation. Eur J Neurosci 27, 1577–1583.
- Pfurtscheller, G., Klimesch, W., 1991. Event-related desynchronization during motor behavior and visual information processing. In: Brunia, C.H.M., Mulder, G., Verbaten, M.N. (Eds.), Event-Related Brain Research, Amsterdam, Elsevier, p. 58–65.
- Experimental studies __________________________________________________________________________________________________________________ 26
- Experimental studies __________________________________________________________________________________________________________________ 27
- Experimental studies __________________________________________________________________________________________________________________ 28
- Hecht et al. (Eds.), Experimentelle Psychologie. Beiträge zur 48. Tagung experimentell arbeitender Psychologen, Lengerich: Pabst, p.167. (Vortrag)
- D'Esposito, M., 2007. From cognitive to neural models of working memory. Philos Trans R Soc Lond B Biol Sci 362, 761–772.
- Sauseng, P., Klimesch, W., Schabus, M., Doppelmayr, M., 2005. Fronto-parietal EEG coherence in theta and upper alpha reflect central executive functions of working memory. Int J Psychophysiol 57, 97–103.
- Amedi, A., von Kriegstein, K., van Atteveldt, N.M., Beauchamp, M.S., Naumer, M.J., 2005. Functional imaging of human crossmodal identification and object recognition. Exp Brain Res 166, 559–571.
- Hz) increase with memory load during retention in a short-term memory task. Cereb Cortex 12, 877–882.
- Classen, J., Gerloff, C., Honda, M., Hallett, M., 1998. Integrative visuomotor behavior is associated with interregionally coherent oscillations in the human brain. J Neurophysiol 79, 1567–1573.
- McCloseky, D.I., 1978. Kinesthetic sensibility. Physiol Rev 58, 763–820.
- Seemüller, A., Fiehler, K., & Rösler, F. (2008). Kreuzmodale Diskriminierung bei der Formerkennung. In P. Khader et al. (Eds.), Beiträge zur 50. Tagung experimentell arbeitender Psychologen, Lengerich: Pabst, p.68. (Vortrag) Curriculum Vitae __________________________________________________________________________________________________________________ 3
- Kollegiatin, Graduiertenkolleg DFG 885/1 " NeuroAct – Neuronale Repräsentation und Handlungssteuerung " , Philipps-Universität Marburg, Justus-Liebig-Universität Gießen SS 2008
- Rappelsberger, P., 1998. Probability mapping of power and coherence: technical aspects. In: Petsche, H., Etlinger, S.C. (Eds.), EEG and thinking, Wien, Österr. Akad. der Wiss.
- Druschky, K., Kaltenhäuser, M., Hummel, C., Druschky, A., Huk, W.J., Neundörfer, B., Stefan, H., 2003. Somatosensory evoked magnetic fields following passive movement compared with tactile stimulation of the index finger. Exp Brain Res 148, 186–195.
- Schiffman, H.R., 1990. Somesthesis I: Kinesthesis and cutaneous sense. In: Schiffman, H.R. (ed.), Sensation and perception: An integrated approach, John Wiley & Sons, NY, p. 119–138.
- Salmelin, R., Hari, R., 1994. Spatiotemporal characteristics of sensorimotor neuromagnetic rhythms related to thumb movement. Neurosci 60, 537–550.
- Oldfield, R.C., 1971. The assessment and analysis of handedness: The Edinburgh inventory. Neuropsychologia 9, 97–113.
- Woods, A.T., O'Modhrain, S., Newell, F.N., 2004. The effect of temporal delay and spatial differences on cross-modal object recognition. Cogn Affect Behav Neurosci 4, 260– 269.
- Gibson, J.J., 1966. The senses considered as perceptual systems. Boston: Houghton Mifflin.
- Droll, J.A., Hayhoe, M.M., 2007. Trade-offs between gaze and working memory use. J Exp Psychol: Hum Percept Perf 33, 1352–1365.
- Mima, T., Oluwatimilehin, T., Hiraoka, T., Hallett, M., 2001. Transient interhemispheric neuronal synchrony correlates with object recognition. J Neurosci 21, 3942–3948.
- Anleitung von drei Semesterarbeiten zu " Uni-und kreuzmodale Verarbeitung und Speicherung visueller und kinästhetischer Bewegungsinformationen " mit Katja Fiehler SS 2008
- Studentische Hilfskraft, Experimentelle und Biologische Psychologie, AG Kognitive Psychophysiologie (Prof. Dr. Rösler) 07/2005–09/2005 Wissenschaftliches Praktikum, Institute of Cognitive Neuroscience (ICN), University College London 07/2006–09/2006 Wissenschaftliches Praktikum, Institut für Neuropsychologie und Klinische Psychologie, Zentralinstitut für Seelische Gesundheit (ZI)/ Ruprecht-Karls-Universität Heidelberg 2007–2010 Wissenschaftliche Mitarbeiterin, Experimentelle und Biologische Psychologie, AG Kognitive Psychophysiologie (Prof. Dr. Rösler) 04/2007–12/2009
- Ungerleider, L.G., Haxby, J.V., 1994. 'What' and 'where' in the human brain. Curr Opin Neurobiol 4, 157–165.
- Triesch, J., Ballard, D.H., Hayhoe, M.M., Sullivan, B.T., 2003. What you se eis what you need. J Vis 3, 86–94.
- Banati, R.B., Goerres, G.W., Tjoa, C., Aggleton, J.P., Grasby, P., 2000. The functional anatomy of visual–tactile integration in man: a study using positron emission tomography. Neuropsychologia 38, 115–124.
- Pfurtscheller, G., Neuper, C., Mohl, W., 1994. Event-related desynchronization (ERD) during visual processing. Int J Psychophysiol 16, 147–153.
- Postle, B.R., 2006. Working memory as an emergent property of the mind and brain. Neurosci 139, 23–38.
- Sarnthein, J., Petsche, H., Rappelsberger, P., Shaw, G.L., von Stein, A., 1998. Synchronization between prefrontal and posterior association cortex during human working memory. Proc Natl Acad Sci USA 95, 7092–7096.