Semantic integration of multidimensional perceptual information in L1 sentence comprehension

Many studies have substantiated the perceptual symbol system, which assumes a routine generation of perceptual information during language comprehension, but little is known about the processing format in which the perceptual information of different dimensions is conveyed simultaneously during sentence comprehension. The current study provides the first experimental evidence of how multidimensional perceptual information (color and shape) was processed during online sentence comprehension in Mandarin. We designed three consecutive sentence–picture verification tasks that only differed in the delay of the display of pictures preceded by declarative sentences. The processing was analyzed in three stages based on time intervals (i.e., 0ms, +750ms, +1500ms). The response accuracy and response time data were reported. The initial stage (i.e., ISI=0ms) attested the match effect of color and shape, but the simulated representation of color and shape did not interact. In the intermediate stage (i.e., ISI=750ms), the routinely simulated color and shape interacted, but the match facilitation was found only in cases where one perceptual information was in mismatch while the other was not. In the final stage (i.e., ISI=1500ms), the match facilitation of one particular perceptual property was influenced by a mismatch with the other perceptual property. These results suggested that multiple perceptual information presented simultaneously was processed in an additive manner to a large extent before entering into the final stage, where the simulated perceptual information was integrated in a multiplicative manner. The results also suggested that color and shape were comparable to object recognition when conjointly conveyed. In relation to other evidence from behavioral and event-related potential studies on sentence reading in the discussion, we subscribed to the idea that the full semantic integration became available over time.

Investigating Heritage Language Processing: Meaning Composition in Chinese Classifier-Noun Phrasal Contexts

The aim of the present study was to investigate how Chinese-Malay bilingual speakers with Chinese as heritage language process semantic congruency effects in Chinese and how their brain activities compare to those of monolingual Chinese speakers using electroencephalography (EEG) recordings. To this end, semantic congruencies were manipulated in Chinese classifier-noun phrases, resulting in four conditions: (i) a strongly constraining/high-cloze, plausible (SP) condition, (ii) a weakly constraining/low-cloze, plausible (WP) condition, (iii) a strongly constraining/implausible (SI) condition, and (iv) a weakly constraining/implausible (WI) condition. The analysis of EEG data focused on two event-related potential components, i.e., the N400, which is known for its sensitivity to semantic fit of a target word to its context, and a post-N400 late positive complex (LPC), which is linked to semantic integration after prediction violations and retrospective, evaluative processes. We found similar N400/LPC effects in response to the manipulations of semantic congruency in the mono- and bilingual groups, with a gradient N400 pattern (WI/SI > WP > SP), a larger frontal LPC in response to WP compared to SP, SI, and WI, as well as larger centro-parietal LPCs in response to WP compared to SI and WI, and a larger centro-parietal LPC for SP compared to SI. These results suggest that, in terms of event-related potential (ERP) data, Chinese-Malay early bilingual speakers predict and integrate upcoming semantic information in Chinese classifier-noun phrase to the same extent as monolingual Chinese speakers. However, the global field power (GFP) data showed significant differences between SP and WP in the N400 and LPC time windows in bilinguals, whereas no such effects were observed in monolinguals. This finding was interpreted as showing that bilinguals differ from their monolingual peers in terms of global field power intensity of the brain by processing plausible classifier-noun pairs with different congruency effects.

Aesthetic appraisals of literary style and emotional intensity in narrative engagement are neurally dissociable

Humans are deeply affected by stories, yet it is unclear how. In this study, we explored two aspects of aesthetic experiences during narrative engagement - literariness and narrative fluctuations in appraised emotional intensity. Independent ratings of literariness and emotional intensity of two literary stories were used to predict blood-oxygen-level-dependent signal changes in 52 listeners from an existing fMRI dataset. Literariness was associated with increased activation in brain areas linked to semantic integration (left angular gyrus, supramarginal gyrus, and precuneus), and decreased activation in bilateral middle temporal cortices, associated with semantic representations and word memory. Emotional intensity correlated with decreased activation in a bilateral frontoparietal network that is often associated with controlled attention. Our results confirm a neural dissociation in processing literary form and emotional content in stories and generate new questions about the function of and interaction between attention, social cognition, and semantic systems during literary engagement and aesthetic experiences.

DESIGN AND EVALUATION OF A BIM-GIS INTEGRATED INFORMATION MODEL USING RDF GRAPH DATABASE

The semantic integration modeling of BIM industry foundations classes and GIS City-geographic markup language are a milestone for many applications that involve both domains of knowledge. In this paper, we propose a system design architecture, and implementation of Extraction, Transformation and Loading (ETL) workflows of BIM and GIS model into RDF graph database model, these workflows were created from functional components and ontological frameworks supporting RDF SPARQL and graph databases Cypher query languages. This paper is about full understanding of whether RDF graph database is suitable for a BIM-GIS integrated information model, and it looks deeper into the assessment of translation workflows and evaluating performance metrics of a BIM-GIS integrated data model managed in an RDF graph database, the process requires designing and developing various pipelines of workflows with semantic tools in order to get the data and its structure into an appropriate format and demonstrate the potential of using RDF graph databases to integrate, manage and analyze information and relationships from both GIS and BIM models, the study also has introduced the concepts of Graph-Model occupancy indexes of nodes, attributes and relationships to measure queries outputs and giving insights on data richness and performance of the resulting BIM-GIS semantically integrated model.

COVID-19 knowledge graph from semantic integration of biomedical literature and databases

Summary The global response to the COVID-19 pandemic has led to a rapid increase of scientific literature on this deadly disease. Extracting knowledge from biomedical literature and integrating it with relevant information from curated biological databases is essential to gain insight into COVID-19 etiology, diagnosis, and treatment. We used Semantic Web technology RDF to integrate COVID-19 knowledge mined from literature by iTextMine, PubTator, and SemRep with relevant biological databases and formalized the knowledge in a standardized and computable COVID-19 Knowledge Graph (KG). We published the COVID-19 KG via a SPARQL endpoint to support federated queries on the Semantic Web and developed a knowledge portal with browsing and searching interfaces. We also developed a RESTful API to support programmatic access and provided RDF dumps for download. Availability and implementation The COVID-19 Knowledge Graph is publicly available under CC-BY 4.0 license at https://research.bioinformatics.udel.edu/covid19kg/.

Semantic feedback processing mechanism of the enactment effect: Evidence from event-related potentials

The enactment effect refers to a phenomenon in which the memory performance for action phrases is enhanced by performing the described action (e.g., sharpen a pencil) compared with simply reading the action phrase. This produced effect can result in improved motor processing. This study investigated the contribution of semantic integration to the enactment effect by contrasting well-integrated phrases, such as “blow up the balloon,” with poorly integrated phrases, such as “sew the toothpick,” and analysing the N400 component of event-related potentials (ERPs). The subjects encoded action phrases with different degrees of semantic integration by either pretending to perform or reading action phrases. They then completed a phrase recognition test, while electroencephalographic signals were simultaneously recorded. The behavioural results showed that semantic integration improved memory performance under the motor encoding condition but not under the verbal encoding condition. The ERP results revealed that, regardless of whether it was an old (memorised) or new (distractor) phrase, a larger N400 component was elicited under the motor encoding condition than under the verbal encoding condition. In the motor encoding condition, poorly integrated phrases elicited a larger N400 component than well-integrated phrases; in the verbal encoding condition, this effect was not observed. The N400 effect associated with semantic processing was enhanced by semantic integration under the motor encoding condition rather than the verbal encoding condition. These results supported a deep semantic processing mechanism under the motor encoding condition, and a semantic feedback processing mechanism for the enactment effect was partially supported.

Does narrator variability facilitate incidental word learning in the classroom?

Recent studies have revealed that presenting novel words across various contexts (i.e., contextual diversity) helps to consolidate the meaning of these words both in adults and children. This effect has been typically explained in terms of semantic distinctiveness (e.g., Semantic Distinctiveness Model, Jones et al., Canadian Journal of Experimental Psychology, 66(2), 115, 2012). However, the relative influence of other, non-semantic, elements of the context is still unclear. In this study, we examined whether incidental learning of new words in children was facilitated when the words were uttered by several individuals rather than when they were uttered by the same individual. In the learning phase, the to-be-learned words were presented through audible fables recorded either by the same voice (low diversity) or by different voices (high diversity). Subsequently, word learning was assessed through two orthographic and semantic integration tasks. Results showed that words uttered by different voices were learned better than those uttered by the same voice. Thus, the benefits of contextual diversity in word learning extend beyond semantic differences among contexts; they also benefit from perceptual differences among contexts.

Transcranial Direct Current Stimulation Over the Right Anterior Temporal Lobe Does Not Modulate False Recognition

Non-invasive transcranial direct current stimulation (tDCS) over the left anterior temporal lobe (ATL) has been shown to cause a reduction in the rate of false memories with semantically related words. Such a reduction seems to be specific to false memories induced by the study of associative lists, but is not observed when the studied lists are categorical in nature. These findings are interpreted as evidence that the left ATL functions as an integration hub that is crucial for the binding of semantic information into coherent representations of concepts. In order to investigate whether the right ATL might also contribute to semantic integration in the processing of verbal associative material, a follow-up tDCS study was conducted with the stimulation at study lateralized on the right ATL. A sample of 75 undergraduate students participated in an experiment in which they studied 8 associative lists and 8 categorical lists. One third of the participants studied all their word lists under anodal stimulation, another third studied under cathodal stimulation and the other third under sham stimulation. Results showed that stimulation of the right ATL by tDCS does not modulate false recognition for either association-related critical words or category-related critical words. These results provide preliminary support to views positing asymmetric connectivity between the anterior temporal lobes and the semantic representational network, and provide evidence for understanding bilateral brain dynamics and the nature of semantically induced memory distortions.