Publikationsserver der Universitätsbibliothek Marburg

Titel:The neurocognitive processing of plausibility and real-world knowledge:A cross-linguistic investigation
Autor:Tune, Sarah
Weitere Beteiligte: Bornkessel-Schlesewsky, Ina (Prof. Dr.)
Veröffentlicht:2014
URI:https://archiv.ub.uni-marburg.de/diss/z2014/0150
URN: urn:nbn:de:hebis:04-z2014-01507
DOI: https://doi.org/10.17192/z2014.0150
DDC: Sprachwissenschaft, Linguistik
Titel (trans.):Die neurokognitive Verarbeitung von Plausibilität und Weltwissen: eine sprachübergreifende Untersuchung
Publikationsdatum:2014-02-04
Lizenz:https://rightsstatements.org/vocab/InC-NC/1.0/

Dokument

Schlagwörter:
Sprachverarbeitung, Language Processing

Summary:
Our knowledge about concepts and meanings is at the very heart of human cognition. In everyday life, we have to interact with our environment in a variety of different ways. Our actions are guided by what we know and believe about the world and this knowledge derives primarily from previous sensory and perceptual experiences. The fact that we are capable of engaging with our environment in an appropriate and efficient way means that we have learnt (how) to make sense of the events and entities we are faced with in day-to-day life. We are thus able to recognise and name both physical objects and abstract concepts, to categorise and associate them based on their specific properties, to interpret other people’s intentions, and to judge cause and effect of their actions as well as our own. Moreover, the ability to represent this wealth of knowledge about the real world in the conceptualised and symbolic form of language is believed to be exclusive to humans. Our language capacity allows us to communicate with others about past and future events or to describe fictitious scenarios by combining previously acquired concepts in a novel way without the need for external stimulation. Thus language forms a primary means of interacting with those around us by allowing us to express our own thoughts and comprehend those of others. As long as language processing proceeds in an undisturbed manner, we are largely unaware of the underlying mechanisms that support the seemingly effortless interpretation of linguistic input. The importance of these processes for successful communication, however, becomes all the more apparent when language processing is disrupted, for example, by brain lesions that render semantic analysis difficult or impossible. Scientific research that aims to uncover and define cognitive or neural mechanisms underlying semantic processing is inevitably faced with the complexity and wealth of semantic relationships that need to be taken into account. In absence of noninvasive neurocognitive methods and insights gleaned from modern neurobiology, early research had a limited impact on our understanding of how semantic processing is implemented in the human brain. Traditional neurological models of language have been based primarily on lesion-deficit data, and thus supported the view that certain areas of the brain were exclusively dedicated to the processing of language-specific functions (Geschwind, 1970; Lichtheim, 1885; Wernicke, 1874). Furthermore, classical theories of sensory processing viewed the brain as a purely stimulus-driven system that retrieves and combines individual low-level aspects or features in an automated, passive and context-independent manner (Biederman, 1987; Burton & Sinclair, 1996; Hubel & Wiesel, 1965; Massaro, 1998). After a recent paradigm shift in the cognitive neurosciences, current theories of sensory processing are now based on the concept of the brain as a highly active, adaptive and dynamic device. In this sense, language comprehension, like many other higher-cognitive functions, is shaped by a flexible interaction of a number of different processes and information sources that include so-called bottom-up signals, i.e., the actual sensory input and processes related to their forward propagation, and top-down processes that generate predictions and expectations based on prior experience and perceived probabilities. Therefore, accounts that view semantic processing as a dynamic and active construction of meaning that is highly sensitive to contextual influences seem most probable from a neurobiological perspective. Results from electrophysiological and neuroimaging research on semantic analysis in sentence and discourse context have provided evidence for top-down influences from the very beginning. In addition, recent ERP results have suggested that the interaction between topdown and bottom-up information is more flexible and dynamic than previously assumed. Yet, the importance of predictions and expectations has long been neglected in models of semantic processing and language comprehension in general. Neuroimaging data have provided us with a long list of brain regions that have been implicated in different aspects of semantic analysis. We are only beginning to understand the role(s) that these regions play and how they interact to support the flexible and efficient construction of meaning. The aim of the present thesis is to gain a more comprehensive view on the computational mechanisms underlying language processing by investigating how bottom- up and top-down information and processes interactively contribute to the semantic analysis in sentences and discourse. To this end, we conducted a total of five studies that used either event-related potentials or functional neuroimaging to shed light on this matter from different perspectives. The thesis is divided into two main parts: Part I (chapters 1-5) provides an overview on previous results from electrophysiology and neuroimaging on semantic processing as well as a description and discussion of the studies conducted in the present thesis. Part II (chapters 6-9) consists of three research articles that describe and discuss the results of five experimental studies. In Part I, Chapter 2 gives a brief introduction to the event-related potential and functional neuroimaging techniques and reviews the most relevant results and theories that have emerged from studies on sentence and discourse processing. Chapter 3 highlights the research questions targeted in each of the experimental studies and describes and discusses the most relevant findings against the background established by Chapter 2. Chapters 4 and 5 conclude Part I by placing the presented results in a broader context and by briefly outlining future directions. Part II begins with a survey of the three studies reported in the subsequent chapters. Chapter 7 highlights the results of the first study, a German ERP experiment that investigated the impact of capitalisation, i.e., a purely form-based and contextually independent bottom-up manipulation, on the processing of semantic anomalies in single sentences. Chapter 8 comprises three ERP experiments that used both easy and hard to detect semantic anomalies in German and English to corroborate the assumption that the weighting of top-down and bottom-up information cues might be determined in a language-specific way. Chapter 9, the final chapter of the thesis, describes and discusses the results of the third study, in which the impact of embedding context on the required depth of semantic processing was examined using functional neuroimaging.

Bibliographie / References

  1. Tian B, Reser D, Durham A, Kustov A, and Rauschecker JP. Functional specializa- tion in rhesus monkey auditory cortex. Science, 292 (5515): 290–293, 2001.
  2. Tettamanti M, Buccino G, Saccuman MC, Gallese V, Danna M, Scifo P, Fazio F, Rizzolatti G, Cappa SF, and Perani D. Listening to Action-related Sentences Activates Fronto-parietal Motor Circuits. Journal of Cognitive Neuroscience, 17 (2): 273–281, 2005.
  3. Inan S, Mitchell T, Song A, Bizzell J, and Belger A. Hemodynamic correlates of stimulus repetition in the visual and auditory cortices: an fMRI study. NeuroI- mage, 21 (3): 886–893, 2004.
  4. Ni W, Constable RT, Mencl WE, Pugh KR, Fulbright RK, Shaywitz SE, Shaywitz BA, Gore JC, and Shankweiler D. An Event-related Neuroimaging Study Dis- tinguishing Form and Content in Sentence Processing. Journal of Cognitive Neuroscience, 12 (1): 120–133, 2000.
  5. Mar RA. The neuropsychology of narrative: story comprehension, story production and their interrelation. Neuropsychologia, 42 (10): 1414–1434, 2004.
  6. Price CJ, Moore CJ, Humphreys GW, and Wise RJS. Segregating Semantic from Phonological Processes during Reading. Journal of Cognitive Neuroscience, 9 (6): 727–733, 1997.
  7. Vandenberghe R, Nobre AC, and Price CJ. The response of left temporal cortex to sentences. Journal of Cognitive Neuroscience, 14 (4): 550–560, 2002.
  8. Mummery CJ, Patterson K, Hodges JR, and Price CJ. Functional Neuroanatomy of the Semantic System: Divisible by What? Journal of Cognitive Neuroscience, 10 (6): 766–777, 1998.
  9. Sharp DJ, Scott SK, and Wise RJ. Retrieving meaning after temporal lobe infarction: the role of the basal language area. Annals of Neurology, 56 (6): 836–846, 2004. PART II STUDY 3
  10. Bornkessel-Schlesewsky, I., Kretzschmar, F., Tune, S., Wang, L., Genç, S., Philipp, M., et al. (2011). Think globally: Cross-linguistic variation in electrophysiologi- cal activity during sentence comprehension. Brain and Language, 117(3), 133– 152. doi:10.1016/j.bandl.2010.09.010
  11. Rauschecker JP and Scott SK. Maps and streams in the auditory cortex: nonhuman primates illuminate human speech processing. Nature Neuroscience, 12 (6): 718–724, 2009.
  12. Lau EF, Phillips C, and Poeppel D. A cortical network for semantics: (de)constructing the N400. Nature Reviews Neuroscience, 9 (12): 920–933, 2008.
  13. Schacter DL, Buckner RL, Koutstaal W, Dale AM, and Rosen BR. Late onset of an- terior prefrontal activity during true and false recognition: an event-related fMRI study. NeuroImage, 6 (4): 259–269, 1997.
  14. Van Oostendorp H and De Mul S. Moses beats Adam: A semantic relatedness effect on a semantic illusion. ACTPSY, 74 (1): 35–46, 1990.
  15. Reder LM and Kusbit GW. Locus of the Moses illusion: Imperfect encoding, re- trieval, or match? Journal of Memory and Language, 30 (4): 385–406, 1991.
  16. Thompson-Schill SL, Bedny M, and Goldberg RF. The frontal lobes and the regula- tion of mental activity. Current Opinion in Neurobiology, 15 (2): 219–224, 2005.
  17. Raposo A and Marques JF. The contribution of fronto-parietal regions to sentence comprehension: Insights from the Moses illusion. NeuroImage, 83: 431–437, 2013.
  18. Erickson, T. D., & Mattson, M. E. (1981). From words to meaning: A semantic illu- sion. Journal of Verbal Learning and Verbal Behavior, 20(5), 540–551.
  19. Rauschecker JP. Cortical processing of complex sounds. Current Opinion in Neuro- biology, 8 (4): 516–521, 1998a.
  20. Pulvermüller F. Opinion: Brain mechanisms linking language and action. Nature Re- views Neuroscience, 6 (7): 576–582, 2005.
  21. Van Oostendorp H and Kok I. Failing to notice errors in sentences. Language and Cognitive Processes, 5 (2): 105–113, 1990.
  22. Mitchell RLC and Crow TJ. Right hemisphere language functions and schizophrenia: the forgotten hemisphere. Brain, 128 (5): 963–978, 2005.
  23. Noppeney U, PATTERSON K, Tyler LK, Moss H, Stamatakis EA, Bright P, Mum- mery C, and Price CJ. Temporal lobe lesions and semantic impairment: a com- parison of herpes simplex virus encephalitis and semantic dementia. Brain, 130 (4): 1138–1147, 2006.
  24. Shulman GL. Two Attentional Processes in the Parietal Lobe. Cerebral Cortex, 12 (11): 1124–1131, 2002.
  25. Tomasi D and Volkow ND. Association between Functional Connectivity Hubs and Brain Networks. Cerebral Cortex, 21 (9): 2003–2013, 2011.
  26. Kristensen LB, Wang L, Petersson KM, and Hagoort P. The Interface Between Lan- guage and Attention: Prosodic Focus Marking Recruits a General Attention Network in Spoken Language Comprehension. Cerebral Cortex, 23 (8): 1836– 1848, 2013.
  27. Shulman GL, McAvoy MP, Cowan MC, Astafiev SV, Tansy AP, d'Avossa G, and Corbetta M. Quantitative analysis of attention and detection signals during visual search. Journal of Neurophysiology, 90 (5): 3384–3397, 2003.
  28. Shulman GL, Fiez JA, Corbetta M, Buckner RL, Miezin FM, Raichle ME, and Peter- sen SE. Common Blood Flow Changes across Visual Tasks: II. Decreases in Cerebral Cortex. Journal of Cognitive Neuroscience, 9 (5): 648–663, 1997.
  29. Rizzolatti G and Craighero L. The mirror-neuron system. Annual Review of Neuro- science, 27 (1): 169–192, 2004.
  30. Stowe LA, Haverkort M, and Zwarts F. Rethinking the neurological basis of lan- guage. Lingua, 115 (7): 997–1042, 2005.
  31. Viceic D, Fornari E, Thiran J-P, Maeder PP, Meuli R, Adriani M, and Clarke S. Hu- man auditory belt areas specialized in sound recognition: a functional magnetic resonance imaging study. NeuroReport, 17 (16): 1659–1662, 2006.
  32. Stowe LA, Broere CA, Paans AM, Wijers AA, Mulder G, Vaalburg W, and Zwarts F. Localizing components of a complex task: sentence processing and working memory. NeuroReport, 9 (13): 2995–2999, 1998.
  33. Rizzolatti G and Matelli M. Two different streams form the dorsal visual system: an- atomy and functions. Experimental Brain Research, 153 (2): 146–157, 2003.
  34. Newman AJ, Pancheva R, Ozawa K, Neville HJ, and Ullman MT. An Event-Related fMRI Study of Syntactic and Semantic Violations. Journal of Psycholinguistic PART II STUDY 3
  35. Miller EK and Cohen JD. An Integrative Theory of Prefrontal Function. Annual Re- view of Neuroscience, 24 (1): 167–202, 2001.
  36. Vigneau M, Beaucousin V, Herve P-Y, Duffau H, Crivello F, Houde O, Mazoyer B, L. Middle frontal gyrus L. Pars triangularis of the IFG L. Pars triangularis of the IFG L. Pars triangularis of the IFG L. Precentral sulcus L. Superior frontal gryus L. Superior frontal gyrus R. Anterior insula R. Inferior frontal sulcus R. Middle frontal gyrus R. Orbital gyrus R. Pars opercularis of the IFG R. Pars orbitalis of the IFG R. Pars triangularis of the IFG R. Pars triangularis of the IFG R. Precentral sulcus R. Superior frontal gyrus R. Superior frontal gyrus L. Paracentral lobule L. Parieto-occipital sulcus L. Parieto-occipital sulcus L. Postcentral gyrus L. Postcentral gyrus L. Postcentral sulcus L. Posterior cingulate gyrus L. Posterior cingulate gyrus, ventral L. Posterior pericallosal sulcus L. Precuneus (inferior) L. Precuneus (posterior) L. Precuneus (superior) L. Subcentral sulcus L. Superior parietal lobule (anterior) L. Superior parietal lobule (lateral) L. Supramarginal gyrus (inferior) R. Marginal branch of the cingulate sulcus R. Paracentral lobule (anterior) R. Paracentral lobule (posterior) R. Postcentral gyrus R. Postcentral sulcus R. Postcentral sulcus R. Posterior cingulate gyrus (dorsal) R. Posterior cingulate gyrus (ventral) R. Posterior pericallosal sulcus L. Anterior/middle cingulate sulcus L. Central sulcus (superior) L. Inferior frontal sulcus L. Middle frontal gyrus L. Pars triangularis of the IFG L. Precentral sulcus (inferior) L. Precentral sulcus (superior) L. Precentral sulcus L. Superior frontal gyrus L. Superior frontal gyrus R. Anterior insula R. Lateral orbital sulcus R. Middle frontal gyrus R. Pars opercularis of the IFG R. Pars orbitalis of the IFG R. Precentral sulcus R. Superior frontal gyrus L. Precuneus (posterior) L. Precuneus (superior) L. Precuneus (inferior) L. Subcentral sulcus L. Superior parietal lobule (anterior) L. Superior parietal lobule (lateral) L. Supramarginal gyrus (inferior) R. Marginal branch of the cingulate sulcus R. Paracentral lobule (anterior) R. Paracentral lobule (posterior) R. Postcentral gyrus R. Postcentral sulcus R. Postcentral sulcus R. Posterior cingulate gyrus (dorsal) R. Posterior cingulate gyrus (ventral) R. Posterior pericallosal sulcus R. Precuneus R. Precuneus (superior) R. Precuneus (inferior) R. Subcentral gyrus R. Subcentral sulcus R. Superior parietal lobule (medial) R. Superior parietal lobule (lateral) R. Supramarginal gyrus
  37. Moss HE, Abdallah S, Fletcher P, Bright P, Pilgrim L, Acres K, and Tyler LK. Select- ing among competing alternatives: selection and retrieval in the left inferior frontal gyrus. Cerebral Cortex, 15 (11): 1723–1735, 2005.
  38. Seghier ML. The Angular Gyrus Multiple Functions and Multiple Subdivisions. The Neuroscientist, 19 (1): 43–61, 2013.
  39. Oldfield RC. The assessment and analysis of handedness: The Edinburgh inventory. Neuropsychologia, 9 (1): 97–113, 1971.
  40. Joseph R. The neuropsychology of development: Hemispheric laterality, limbic lan- guage, and the origin of thought. Journal of Clinical Psychology, 38 (1): 4–33, 1982.
  41. Straube B, Green A, Weis S, Chatterjee A, and Kircher T. Memory Effects of Speech and Gesture Binding: Cortical and Hippocampal Activation in Relation to Sub- sequent Memory Performance. Journal of Cognitive Neuroscience, 21 (4): 821– 836, 2009.
  42. Indefrey P and Cutler A. Prelexical and lexical processing in listening. The cognitive neurosciences, 3: 759–774, 2004.
  43. Sanford AJ, Leuthold H, Bohan J, and Sanford AJ. Anomalies at the borderline of awareness: An ERP study. Journal of Cognitive Neuroscience, 23 (3): 514–523, 2011.
  44. Newman, SD, Just, MA, Keller, TA, Roth, J, and Carpenter, PA. Differential effects of syntactic and semantic processing on the subregions of Broca's area. Cogni- tive Brain Research, 16, 297–307, 2003.
  45. Mazoyer BM, Tzourio N, Frak V, Syrota A, Murayama N, Levrier O, Salamon G, Dehaene S, Cohen L, and Mehler J. The cortical representation of speech. Jour- nal of Cognitive Neuroscience, 5 (4): 467–479, 1993.
  46. Kutas, M., & Hillyard, S. A. (1980). Reading senseless sentences: Brain potentials reflect semantic incongruity. Science, 207(4427), 203–205.
  47. Rauschecker JP. Parallel processing in the auditory cortex of primates. Audiology and Neurotology, 3 (2-3): 86–103, 1998b.
  48. Tune S, Schlesewsky M, Small SL, Sanford AJ, Bohan J, Sassenhagen J, and Bornkessel-Schlesewsky I. Cross-linguistic variation in the neurophysiological response to semantic processing: Evidence from anomalies at the borderline of awareness. Neuropsychologia, under revision.
  49. Thompson-Schill SL, D'Esposito M, Aguirre GK, and Farah MJ. Role of left inferior prefrontal cortex in retrieval of semantic knowledge: A reevaluation. Proceed- ings of the National Academy of Sciences, 94 (26): 14792–14797, 1997.
  50. Stoeckel C, Gough PM, Watkins KE, and Devlin JT. Supramarginal gyrus involve- ment in visual word recognition. CORTEX, 45 (9): 1091–1096, 2009.
  51. Kuperberg GR, Sitnikova T, and Lakshmanan BM. Neuroanatomical distinctions within the semantic system during sentence comprehension: Evidence from functional magnetic resonance imaging. NeuroImage, 40 (1): 367–388, 2008.
  52. McDermott KB, Petersen SE, Watson JM, and Ojemann JG. A procedure for identify- ing regions preferentially activated by attention to semantic and phonological relations using functional magnetic resonance imaging. Neuropsychologia, 41 (3): 293–303, 2003.
  53. Mashal N, Faust M, Hendler T, and Jung-Beeman M. An fMRI investigation of the neural correlates underlying the processing of novel metaphoric expressions. Brain and Language, 100 (2): 115–126, 2007.
  54. Kemmerer D and Gonzalez-Castillo J. The Two-Level Theory of verb meaning: An approach to integrating the semantics of action with the mirror neuron system. Brain and Language, 112 (1): 54–76, 2010.
  55. Jung-Beeman M. Bilateral brain processes for comprehending natural language. Trends in Cognitive Sciences, 9 (11): 512–518, 2005.
  56. Sliwinska MW, Khadilkar M, Campbell-Ratcliffe J, Quevenco F, and Devlin JT. Early and sustained supramarginal gyrus contributions to phonological process- ing. Frontiers in Psychology, 3, 2012.
  57. Park H and Reder LM. Moses illusion: Implication for human cognition. In Pohl RF (Ed.),Hove, UK: Psychology Press: Cognitive illusions: A handbook on falla- cies and biases in thinking, judgment, and memory, 2004: 275–291.


* Das Dokument ist im Internet frei zugänglich - Hinweise zu den Nutzungsrechten